1. Planning and Implementation of Post Enumeration Surveys Pres. 4

2. Some Requirements for a Good PES
Adequate planning
Technical personnel with requisite skills and experience in survey methodology and in designing and implementing the whole PES process
Sample design, implementation, matching and estimation
Develop an efficient sample design
A successful PES calls for a good sample design and survey implementation
The timing of PES should be soon after census
Maintain operational independence 2 2

3. Some Requirements for a Good PES (Contd.)
Ensure quality assurance in all the stages of the PES, thus from planning to data processing
Control of non-sampling errors is essential like in any other surveys, as unlike sampling errors, they are difficult to measure, therefore one is better off controlling them
Credible estimation methodologies and procedures 3 3

4. Planning of PES should be:
Judicious planning for the PES is critical in order to yield reliable results
Planning of PES should be:
Preceded by a clear and unambiguous statement of objectives as this facilitates to articulate planning of PES activities
Synchronized with planning for the census
Start early and adequate resources devoted to it as part of overall census programme
Develop a comprehensive survey plan showing budgetary and manpower requirements 4

5. Planning of PES (contd.)
Adequate Resources:
Financial allotment: Without sufficient funds the PES would be poorly implemented and therefore may not produce better results than the census. This would defeat the whole purpose of evaluating a census
Human resources: There is need to have requisite number of specialist staff such as survey methodologists; demographers; and analysts; qualified enumerators and supervisors 5

6. Planning of PES (contd.)
Commitment to the philosophy of a PES: it is very critical to have the top management of a statistical/census office committed to the philosophy of the PES, so that they can plan for resources and support its efficient implementation
Establishment of an independent unit: It is advisable that an independent PES planning and implementation unit is established. This also enhances the operational independence between the census and PES
Technical planning: It is necessary to have sub-technical teams to work on the sample design; plan for the implementation of the PES; the design of a Dual System of Estimation plan, matching and the reconciliation exercise 6

7. Planning of PES (contd.)
Elements of planning a PES
Preparatory activities
Data collection related activities
Matching
Reconciliation (if undertaken)
Data processing
Estimation of coverage and content error
Report preparation and dissemination 7

8. Planning of PES (contd.)
Publicity campaign
PES as a specialized data collection
Importance of not biasing potential sample population
Strategies used in different countries(??) 8 8

9. Implementation of PES
Pilot Test
This can be a dress rehearsal of the actual PES as the pilot census is a dress rehearsal of the census
It can be conducted in selected administrative divisions (taking into account costs)
The purpose of the pilot test is to test the adequacy of the entire PES plan and its organization
It should be conducted in conditions similar to the actual enumeration of the actual PES 9 9

10. Implementation of PES (contd.)
Pilot Test (Contd.)
The pilot test should follow immediately the census pilot test
While it is not a source of usable data it provides insights into operational aspects of data collection that can contribute to a successful conduct of a PES and census
Ideally it should be taken a year before the actual PES just as a pilot census is taken a year before a census (UN, 2008 P&R) 10 10

11. Implementation of PES (contd.)
Pilot Test (Contd.)
Provides an opportunity to test questions and the overall field methodology before mounting the PES
It also offers a chance to test the matching and analytical procedures
Results of the pilot test contribute to establishment of matching rules, reconciliation procedures and logistical flows of documents between PES and census 11 11

12. Implementation of PES (contd.)
Data collection
Method commonly used in a PES is the face-to-face interview
Enumerators go to households, in selected EAs/clusters, and interview respondents
They collect information by asking questions from a PES questionnaire
This method provides an opportunity for probing
Enumerators can explain the objectives of the PES to respondents 12 12

13. Implementation of PES (contd.)
Questionnaire
Should be based on the final census questionnaire
The format and size of questionnaire are important for recording of responses and for data capture
Pre-testing of questionnaire is imperative
Selection of items for the questionnaire deserves careful consideration
Items to be used in matching process should ideally be considered for the questionnaire 13 13

14. Implementation of PES (contd.)
Questionnaire (Contd.)
Variables for which information is to be collected on the PES should have been included on the census as well
Commonly considered variables include – age, sex, relationship to reference person, marital status, educational level and type of housing unit 14 14

15. Implementation of PES (contd.)
Selection and training of field staff
Enumerators are the interface with respondents
should be able to communicate effectively with respondents
Their work is critical to the success of the PES field work and therefore their selection is critical and should be done objectively
They should be thoroughly trained before being assigned field work
Main objective of training is to enhance uniformity and minimize measurement error during interviews 15 15

16. Implementation of PES (contd.)
Training
Qualified instructors well versed with the objectives of the PES should be responsible for training
It is advisable that the trainers should be part of the PES planning and implementation teams
Trainees should take turns in explaining to others various items in the questionnaire
Practical lessons are essential both in the classroom and the field. Based on performance trainees can be retained as enumerators or dismissed 16 16

17. Implementation of PES (contd.)
The role of supervisors
Despite good training of enumerators, without good supervision, in the field, there may be inaccurate results
Need for dedicated and effective supervision
Supervisors should be more experienced and better qualified than enumerators
Like enumerators, they should undergo extensive training in all aspects of the PES
Supposed to organize work for enumerators by determining field assignments 17 17

18. Implementation of PES (contd.)
The role of supervisors (Contd.)
They review completed work and maintain a high commitment of enumerators to the PES
A supervisor can make follow-up visits to non-respondents as they are better qualified and experienced
There should be a manageable ratio between enumerators and a supervisor (1 to 5 ratio should be okay) 18 18

19. Implementation of PES (contd.)
Field data collection
During data collection objective is to classify individuals by enumeration status relative to census night
Use of probing is necessary to adequately establish census night residence status 19 19

20. Planning of PES (contd.)
Reconciliation (if done)
Developing instructions for field reconciliation visits
Training of enumerators and supervisors
Carrying out reconciliation visits
Final decisions on unresolved cases with respect to final status
Data processing
Selection or development of computer programmes for data processing, tabulation & estimation
Recruitment and training of data processing staff
Carrying out data entry, editing and tabulation 20

21. Planning of PES (contd.)
Estimation of coverage and content error
(i) Estimation of coverage error
(ii) Estimation of content error
Report preparation and dissemination
(i) Analysis of PES results including producing and interpretation of sampling errors for key variables
(ii) Preparation of PES analytical report
(iii) Dissemination of results 21

22. Implementation of PES (contd.)
Control of non-sampling errors
Should be controlled and reduced to the level that their presence does not compromise the usefulness of the PES results
Particularly harmful when they are non-random because they introduce bias in the PES estimates
Bias is difficult to measure
Best way to control non-sampling error is to follow the right procedures in all PES activities 22 22

23. Implementation of PES (contd.)
Control of non-sampling errors (Contd.)
Should be controlled and reduced to the level that their presence does not compromise the usefulness of the PES results
Particularly harmful when they are non-random because they introduce bias in the PES estimates
Bias is difficult to measure
Best way to control non-sampling error is to follow the right procedures in all PES activities 23 23

24. Implementation of PES (contd.)
Factors contributing to non-sampling error
Vague objectives of the PES
Duplication or omissions due to imprecise definition of boundaries of EAs
Inappropriate methods of interviewing
Lack of trained and experienced field interviewers and supervisors
Inadequate identification particulars of sampling units
Errors occurring in data processing 24 24

25. Thank You!