United Nations Regional Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys United Nations Conference Centre, Bangkok, Thailand 10 – 14 May 2010 Country Practices on Census Evaluation: 2000 Census Round

Objectives of the Questionnaire  To better understand census evaluation activities at the country level  To facilitate the sharing of experience on methods of census evaluation among countries in the region Total of 16 respondents

Respondent Profile: 2000 Round & PES Country2000 RoundCountry2000 Round Bangladesh2001Myanmar1983* Cambodia1998Nepal2001 China2000Pakistan1998-x India2001Philippines1995/2000 Rep of Korea1995/2000Sri Lanka2001 Malaysia2000Thailand2000 Maldives1995/2000-?Vietnam1999 Mongolia2000South Africa1996/2001

Respondent Profile: 2010 Round & PES Country2010 RoundCountry2010 Round Bangladesh2011Myanmar? Cambodia2008Nepal2011 China2010Pakistan2011 India2011Philippines2010-x Rep of Korea2010Sri Lanka2011 Malaysia2010Thailand2010 Maldives2006/201?-xVietnam2009 Mongolia2010South Africa2011

Objective of Evaluation (2000 Round)Yes Count Measure coverage errors: undercount; overcount Measure content errors: data quality Identify conceptual issues and methodological areas needing improvement 11

Objective of Evaluation (2000 Round)Yes Count Measure coverage errors: undercount; overcount Measure content errors: data quality Identify conceptual issues and methodological areas needing improvement 11 Adjust census results Evaluate suitability of census enumeration areas for intercensal sample surveys -

Objective of Evaluation (2010 Round)Yes Count Measure coverage errors: undercount; overcount Measure content errors: data quality Identify conceptual issues and methodological areas needing improvement 11 Adjust census results111

Organization and PlanningYes Count Planning & Implementing Agency National Statistical or Census Office Census team and PES team different Independent organization/other1 Part of census budget Adequate funding N=15 countries conducted PES

Operationalising IndependenceYes Count PES planning done by independent group11111 PES implementation independent from Census implementation Different set of supervisors and enumerators PES sample held confidential1 Different design: questionnaires111 Census information held confidential11 Independent data processing11 PES frame independent of Census frame-

Recruitment of PES StaffYes Count Recruitment from Census staff111 Others NSO Available in the labour market1 Mixed1 Selection criteria Different from census enumerators Experience Education11

Training of PES StaffYes Count Training duration: enumerators 1-3 days days Training duration: supervisors 1-3 days days11111

Sample DesignYes Count Number of stages 1 stage stages11111 Sample size (PSUs) Range: 54 (Nepal) to 3000 (India) 10% population (Maldives); 0.5% of urban areas (Mongolia) Stratification Urban-Rural Geographic, administrative groups

Domains of AnalysisYes Count National only11111 Urban-Rural11 Administrative areas (region/province/state)

Matching ProceduresYes Count Method Computer1 Manual Both1111 Rules were documented Made field reconciliation visits

Coverage MeasuresYes Count Coverage rate only11111 Net coverage rate only1111 Both coverage & net coverage rates111 Others: Coverage plus Net*/Omission rate Erroneous inclusion rate Gross coverage error rate Completeness rate

Content Analysis MeasuresYes Count Collected data for content analysis Measures Consistency: Index of Inconsistency Agreement: Rate of Agreement; Net/Gross Difference Rate Age accuracy indexes Coincidence rates between census and PES Omission rates by individual characteristics

Use of PES ResultsYes Count Report was produced For lay users Only for office use Time to release results [from start of data collection] One year or less [minimum = 2 months]11 More than one year [max = 3 years]111 Used to adjust census results11111

Lessons Learned Improving quality of PES results- Field issues Mismatches due to faulty EA maps Need for close monitoring of field work and use monitoring information for early detection of errors More efficient workload distribution (difficult areas: urban,...) Strategy for dealing with nonresponse More and better supervision Better training Improve sample design and weighting Improve implementation of matching procedures Make PES results available in time for census adjustments

United Nations Regional Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys United Nations Conference Centre, Bangkok, Thailand 10 – 14 May 2010 Country Practices on Census Evaluation: 2000 Census Round