Conducting the eCRC Survey A Practical Guide The Asia Foundation, Dambulla, September 1-4, 2013

DREAMERS LEARNERS DOERS DOUBTERS Meeting Expectations

SESSION 1 The Asia Foundation, Dambulla, September 1-4, 2013 Methodology of eCRC

The Key Steps… 1.Identifying services & issues– Which services and what to study? 2.Determining the sample – Whom to ask? 3.Designing the questionnaire – What to ask? 4.Conducting the survey – How to collect information? 5.Analyzing the information – What to report? 6.Using the information – How to use the findings to improve services? The Asia Foundation, Dambulla, September 1-4, 2013

What services are we looking at LG Regulatory Services (10) LG Common Services (10) Local Infrastructure (9) The Asia Foundation, Dambulla, September 1-4, 2013

1. Local Infrastructure What do we want to know? - meeting community priority - quality of construction - time taken to complete the work - availability of information - performance of the contractor - awareness & performance of SACs - community participation Whom do we ask? - Immediate beneficiaries The Asia Foundation, Dambulla, September 1-4, 2013

1. Local Infrastructure (Contd.) What type of information / analysis are we interested in? - variations of experiences across a. LAs b. GN Divisions (within a LA) c. Type of infrastructure d. Value of contract e. Contractors The Asia Foundation, Dambulla, September 1-4, 2013

2. LG Common Services What do we want to know? - Availability of service - Usage of service - Quality of service - Reliability of service - Satisfaction with service ` Whom do we ask? - Users (in a household) The Asia Foundation, Dambulla, September 1-4, 2013

2. LG Common Services (Contd.) What type of information / analysis are we interested in? - variations of experiences across a. LAs b. GN Divisions (within a LA) c. Gender d. Age e. Ethnicity f. Economic status g. Distance of residence from centre The Asia Foundation, Dambulla, September 1-4, 2013

3. LG Regulatory Services What do we want to know? - Availability of information - Ease of applying - Process time - Satisfaction with service ` Whom do we ask? - Users The Asia Foundation, Dambulla, September 1-4, 2013

3. LG Regulatory Services (Contd.) What type of information / analysis are we interested in? - variations of experiences across a. LAs b. GN Divisions (within a LA) c. Gender d. Ethnicity e. Economic status f. Distance of residence from centre The Asia Foundation, Dambulla, September 1-4, 2013

Understanding the Questionnaire Components of questionnaire Enumerator information Introduction Filter / qualifiers questions Demographics The body of the schedule - sections if needed - sub- schedules if required 12 The Asia Foundation, Dambulla, September 1-4, 2013

Ayubowan! I am ……… from the ……LA. This is my identity card. We are currently conducting a survey on the services provided by the LA. We are conducting interviews at over 1500 households and your house is one of them that was chosen by chance from this area. We would like to discuss your experiences with these services. Information from this interview will be used to study and improve the services and will not be used for any other purpose. Your identity will be kept confidential and your name will not be recorded here. This survey will take about 10 minutes. May I please talk with you or any other adult member in the family who can give me information on the services? Introduction*** The Asia Foundation, Dambulla, September 1-4, 2013

What not to do during an introduction! 14 In a previous CRC, an enumerator introduced himself by saying, “We are here to find out what problems you face when using services provided by the government.” This introduction immediately communicates a biased tone to the interview. Let the respondent tell you about their experience with service delivery—not the other way around! The Asia Foundation, Dambulla, September 1-4, 2013

Section 3 – Filter Questions “Have you, or anyone in your family, visited a Trade Licence Office in the past one year?” Yes [continue with interview] No [terminate interview] 15 Filters/ Qualifiers

Section 4 – Demographics Basic information about the household/respondent – age, gender, ethnicity, economic status, etc. 16

Sampling Population: The complete collection of individuals or objects that are of interest to us. Sample: A subset of the population which can help us study the population 17

Size of the sample has no meaning after a certain number Sample should be representative How? Sampling techniques: Ex: Simple Random Sampling Stratified sampling Cluster sampling etc… Some Simple Rules

Population – (People who live in the Eastern Province) Sampling (FOR COMMON SERVICES)

Simple Random Sampling (SRS) Randomly select 12 people Generate 12 random numbers between 1 – 30 11, 28, 4, 2, 21, 13, 19, 26, 16, 7, 23,30 Sample size - 12

Stratified Sampling Identify possible Strata

Strata Proportionately allocate people from strata ( 4 from each stratum). Then apply SRS Batti Ampara Kalmunai

How do we sample within a LA 2 methods a.Scientific Method – PPS b.Quick Method – Social Mapping 23 The Asia Foundation, Dambulla, September 1-4, 2013

What is PPS? Probability Proportionate to Size (PPS) -Selecting sample within a strata in the same proportion as they are represented in the population. -E.g., Ethnicity, location, 24 The Asia Foundation, Dambulla, September 1-4, 2013

How do we do a PPS selection a.First allocate the total sample for the LA (1500) across the GN Divisions using PPS b.Within each GND, select the sample on the basis of a pre determined criteria – ethnicity, location, economic status c.Randomly select households keeping the quotas in mind ….Let us see an example 25 The Asia Foundation, Dambulla, September 1-4, 2013

NUWARA ELIYA Municipal Council Ethnicity GN. DivisionsSinhalese SL Tamil Indian Tamil MoorOtherTotal Nuwara Eliya A - Magasthota B - Kalukele C - Kelegala D - Nuwara Eliya Central E - Sandathenna F - Hawaeliya West G - Hawaeliya North H - Hawaeliya East I - Bulu Ela K - Bambarakele L - Nuwara Eliya West M - Shanthipura N - Kalapura Total

Quick Method a.First allocate the total sample for the LA (1500) across the GN Divisions using PPS b.Within each GND, select the sample on the basis of a clusters (diversity) c.Select sample households randomly within each cluster 27 The Asia Foundation, Dambulla, September 1-4, 2013

SAMPLING (FOR REGULATORY) 3 Methods a.Census of HHs within GN Division b.Tracer Interviews c.Exit Interviews / Intercept Interviews 28 The Asia Foundation, Dambulla, September 1-4, 2013

1. Census of HHs in a LA a.Quick survey of all HHs to identify which HHs have used which of the 10 services. b.Target HHs where maximum number of services have been used. c.Proceed with the list till you get the required number for all services (50 respondents per service) 29 The Asia Foundation, Dambulla, September 1-4, 2013

2. Tracer Interviews a.Obtain a list of all users of a service who applied /interacted during the last 1 year. b.Generate a random list of 50 names from the list c.Carry out the interview for the identified names 30 The Asia Foundation, Dambulla, September 1-4, 2013

3. Exit/ Intercept Interviews a.Stand outside the centre/facility b.Interview persons coming out at a pre- determined frequency (every 3 rd person) – first determine the average number of transactions per day. c.Ensure that the quota is obtained (50) 31 The Asia Foundation, Dambulla, September 1-4, 2013