Benchmarking Public Services in North-East India (CRC1)

The CRC 1 was led by PAC, who provided the technical expertise in terms of designing the CRCs, training of supervisors and enumerators, data analysis and report writing. Initially, a three-day training programme on CRCs was provided to supervisors (NEICORD staff).

 Download CRC Report – 2015 (7 MB)

Methodology

The research strategy for the CRC comprised of the following modular steps:

1. Preparatory activities

An information-sharing exercise presentation was carried out PAC with ACTED and its other project partners to convey the relevance of this exercise which would be carried out at three different points of the project. During this exercise the 10 programmes to be assessed were finalised along with the seven districts (Churachandapur, Ribhoi, Cachar, Wokha, Goalpara, Chandel and Lawngtlai) that would be covered in the 4-year project.

The programmes included:. JSSK – Janani Shishu Suraksha Yojana (mother and child) , IAY – Indira Awas Yojana (housing); ICDS – Integrated Child Development Scheme; MGNREGS – Mahatma Gandhi National Rural Employment Guarantee Scheme; MDM – Mid Day Meal Scheme; NBA – Nirmal Bharat Abhiyan (sanitation) ; NSAP – National Social Pension ; PDS – Public Distribution System ; RGGVY –Rajiv Gandhi Grameen Vidyutikana Yojana (rural electrification) ; RKVY – Rashtriya Krishi Vikas Yojana (agricultural development).

2. Questionnaire Design

• On the basis of the information collected through secondary data, draft questionnaires were prepared and then piloted in the field to check on content, flow and language. Changes were then made to the questionnaires accordingly.
• To address each programme, 10 questionnaires were prepared to collect data from beneficiaries. In the absence of lists of beneficiaries, listing questionnaires were also prepared to identify beneficiaries.
• The scope of the data collection instruments covered the following:
  • Availability of the service
  • Access and usage of the service
  • Service quality and reliability
  • Problem incidence, responsiveness and problem resolution
  • Costs, including Corruption
  • Satisfaction
  • Suggestions for improvement

3. Sampling design

The sampling design followed comprised of the following steps:

• A total of 200 villages instead of GP were covered in the 7 project districts
• Equal distribution of villages across districts i.e. 28 villages each from each districts were taken (30 each from Goalpara and Cachar to reach target of 200 villages)
• Again, from each district two blocks were considered (i.e. 14 villages per block)
• Of these one block comprised of the HQ block or most near to HQ block, and another one a farther block (also having good population to get required number of beneficiaries)
• Therefore, total of 14 blocks were covered with a target of 175 beneficiaries per block (i.e. per 14 villages) i.e. 350 per district
• 50 to 100 households were covered per village in HH survey (Total Household or 100 household per village, whichever is lower)
• Approximately 13 beneficiaries per village were interviewed

The final sample size was as follows

Programme	Wokha	CCpur	Cachar	Ribhoi	Lawngtlai	Chandel	Goalpara	Total
HHs Listed	1385	1443	1516	1410	1406	1477	1105	9742
JSSK	26	28	30	32	15	22	21	174
IAY	28	29	30	27	21	27	21	183
ICDS	56	61	60	56	56	57	41	387
MGNREGS	56	66	61	56	56	58	45	398
MDM	53	60	57	56	56	61	46	379
NBA	23	29	29	22	25	22	15	165
NSAP	27	33	31	27	29	29	19	195
PDS	54	66	63	55	56	58	46	398
RGGVY	9	10	28	15	17	21	23	123
RKVY	26	14	26	18	19	19	17	140
TOTAL (Programmes)	358	396	415	364	350	374	294	2542

FIELD WORK AND QUALITY ASSURANCE

ACTED’s primary grantee partner NEICORD carried out the CRC survey in the selected villages. A two-level training programme was carried out (at Guwahati and in each of the selected districts) to ensure that the interviewers could collect the data correctly. During the course of field work, PAC research team along with ACTED, consistently monitored the field work through field visits and carried out spot checks and back checks and onsite scrutiny of filled in questionnaires. The NEICORD District Coordinators also kept in contact with the PAC team for updates on a daily basis. Another round of random scrutiny was carried out once the questionnaires were received at PAC before data entry.

DATA ENTRY AND ANALYSIS

Data entry for all the listing questionnaires and the beneficiary questionnaires was carried out in Bangalore under the direct supervision of the PAC study team. The reliability of estimate presented in this report is significant at 95% confidence level. The margin of error is +/-2.7%.

PRESENTATION OF FINDINGS

The findings from the study were presented at a CSC training programme which was followed by discussions of the same along with training on the indicators that were identified from the findings.