Multiple Indicator Cluster Surveys Data Processing Workshop Secondary Editing MICS Data Processing Workshop

REMEMBER AND REMIND YOUR FIELD STAFF: The best place to correct data is in the field, where the respondent is available to resolve inconsistencies. Once the questionnaires reach the office, the best you can do is to apply carefully specified editing guidelines consistently and carefully.

Secondary Editing Flow Chart Backup Raw (unedited) Data File Secondary Editing Listing Backup Final (edited) Data File Resolve Inconsistencies on paper listing Enter Corrections into Raw Data File DP Supervisor Secondary Editor DP Supervisor Inconsistencies? No Yes

General Rules for Resolving Inconsistencies Review all pertinent responses in the questionnaire(s). –For skips, check responses preceding and following. Refer to the editing guidelines Do not make up an answer; if necessary, use the codes for inconsistent (7, 97, 997) or missing (9, 99, 999) Change the fewest pieces of information Leave the inconsistency without correction and document the inconsistency for users

Data Editing Philosophy Field Editing –Interviewer or field editor Using field editing manual can be fully (almost) corrected Office Editing - Use editing guidelines –Office editor ID and structure errors only –DE personnel Check for data entry errors; resolve only structural inconsistencies –Secondary editor Investigate and resolve (sometimes by taking no action) all inconsistencies

Four Examples 1. Woman’s age and date of birth inconsistent 2. DPT2 and Polio 2 vaccination dates differ 3. Level and grade of education inconsistent 4. Polio 3 vaccination date before Polio 1 vaccination date

Example 1: Basic Information The Data [DOI] WM6 = 04/2009 = 1312 [DOB] WB1 = 09/1966 = 801 [Age] WB2 = 41 The Error Message U 1003 E Age of woman (WB2=41) and her date of birth (DOB=09/1966) inconsistent [DOI=04/2009]

Example 1: The Inconsistency The Inconsistency –Age calculated age (calcage) = 42 reported age ( WB2 ) = 41 –Date of birth calculated LDOB: 1312-(12*41)-11 = 809 calculated UDOB: 1312-(12*41) = 820 reported DOB (using 09/1966) : 801

Example 1: Resolving the Inconsistency Variables to Check –WM6, WB1, WB2, HL5(LN), HL6(LN), CM2, MA8, MA9 Steps: 1.Check for data entry errors 2.If WM6M = WB1M, and WM2 = calcage - 1, leave unchanged 3.If WB1M and WB1Y valid, set WM2 = calcage 4.If WB1M invalid, set WB1Y = 9997 (inconsistent)

Example 2: Basic Information The Data –Polio 2: IM3C = 08/08/2008 –DPT 2: IM4B = 08/08/2009 The Error Message U 2705 M Date of Polio 2 vaccination (08/08/2008) and date of DPT2 vaccination (08/08/2009) different The Inconsistency –Polio and DPT shots are often given on the same date

Example 2: Other Information All Polio and DPT Vaccination Dates: –Polio 1: IM3P1 = 16/06/2008 –Polio 2: IM3P2 = 08/08/2008 –Polio 3: IM3P3 = 13/09/2008 –DPT1: IM3D1 = 16/06/2008 –DPT2: IM3D2 = 08/08/2009 –DPT3: IM3D3 = 13/09/2008

Example 2: Resolving the Inconsistency Steps: 1.Check for data entry errors 2.See if recording mistake was made on questionnaire 3.If no obvious recording mistake, leave data unchanged 4.We’re more interested in knowing whether the child was vaccinated—the exact timing of the event is less critical

Example 3: Basic Information The Data –ED4A = 2 { secondary } –ED4B = 11 The Error Message –U 0090 E ED1=02: Level (ED4A=2) and grade (ED4B=11) of education inconsistent The Inconsistency –ED4B records grade at the current level, and for this country (UK), the highest grade at the secondary level is 7

Example 3: Other Information Other Variables –Current schooling: ED6 = notappl –Schooling last year: ED8 = notappl –Highest level (woman’s questionnaire): WB4 = 2 WB5 = 11

Example 3: Resolving the Inconsistency Steps: 1.Check for data entry errors 2.Check for interviewer errors - Does ED4B include grades passed at lower levels? 3.If available, check values of WB4 and WB5 4.If you can’t resolve inconsistency, set ED4B = 97 (inconsistent)

Example 4: Basic Information The Data –IM3P1 = 25/11/2008 –IM3P3 = 08/01/2008 The Error Message U 2704 E Date of Polio 1 vaccination (25/11/2008) after date of Polio 3 vaccination (08/01/2008) The Inconsistency –Polio 3 vaccination given before Polio 1 vaccination

Example 4: Other Information All Polio and DPT Vaccination Dates: –Polio 1: IM3P1 = 25/11/2008 –Polio 2: IM3P2 = 03/03/2009 –Polio 3: IM3P3 = 05/01/2008 –DPT1: IM3D1 = 25/11/2008 –DPT2: IM3D2 = 05/02/2009 –DPT3: IM3D3 = notappl/notappl/notappl

Example 4: Resolving the Inconsistency Steps: 1.Check for data entry errors 2.See if recording mistake was made on questionnaire 3.If no obvious recording mistake, set day, month, and year of most inconsistent date to 97, 97 and 9997 respectively

Adding an Edit Add logic to the data entry application Add message text to the message file Add message to the editing guidelines

Defining the Editing Specifications Carefully review the questionnaire Define the edit –What is the possible inconsistency? –How should the inconsistency be handled during data entry? –How should the inconsistency be handled during secondary editing?

Editing Guidelines For each inconsistency: –Describe the issue if the error message doesn’t make it clear –Explain how to handle the inconsistency during data entry (if applicable) –Explain how to handle the inconsistency during secondary editing (if applicable) –In explanation of resolution(s), list all related variables that should be examined

Modifying the Editing Guidelines Add editing guidelines for your country specific questions that were added to the MICS questionnaire Modify the standard guidelines only after careful consideration by subject specialists Document any changes to the standard guidelines Ensure that all processing staff use the manual and apply it consistently

REMEMBER AND REMIND YOUR FIELD STAFF: The best place to correct data is in the field where the respondent is available to resolve inconsistencies. Once the questionnaires reach the office, the best you can do is to apply carefully specified editing guidelines consistently and carefully.