MICS Data Processing Workshop Structure Checking and Verification
Structure Checking Flow Chart Main Data Entry Structure Check Verification Data Entry Investigate Errors Correct Main Data File Data Entry Operator 1 DP Supervisor Data Entry Operator 2 Data Entry Operator 1 Check ok? Yes No
Structure Checking Check the number of questionnaires in the data file matches number of questionnaires on the cluster tracking form Check household information panel counts of women and under-fives (HH12-15) match number of questionnaires in the data file
The Cluster Tracking Form Allows supervisor to organize and track data entry progress Questionnaire totals entered by questionnaire administrator Other information entered by supervisor
Cluster Tracking Form
Cluster Tracking Checks Check questionnaires in data file equal questionnaires on cluster tracking form Check done for: – Complete, Incomplete and Total Households – Complete, Incomplete and Total Women – Complete, Incomplete and Total Children
Cluster Checks Womens questionnaires = Σ HH12 Completed womens questionnaires = Σ HH13 Under-five questionnaires = Σ HH14 Completed under-five questionnaires = Σ HH15
Sample Output - Cluster MICS Data Structure Check Cluster: 3 Households | Women | Children Total Comp Incomp | Eligible Interviewed | Eligible Interviewed | HH12 FOUND HH13 FOUND | HH14 FOUND HH15 FOUND | | Compare totals to those on cluster tracking form If totals different, check clusters questionnaires and resolve the difference
Household Checks Womens questionnaires = HH12 Completed womens questionnaires = HH13 Under-five questionnaires = HH14 Completed under-five questionnaires = HH15
Sample Output - Household MICS Data Structure Check Household: 1 Result: 1 Women | Children Eligible Interviewed | Eligible Interviewed HH12 FOUND HH13 FOUND | HH14 FOUND HH15 FOUND | Use listing of households to identify source of cluster level problems
Verification Flow Chart Verification Data Entry Verification Backup Raw Data File Determine Correct Values Correct Both Data Files Data Entry Operator 2 DP Supervisor Data Entry Operator 1 & 2 DP Supervisor Data Entry Operator 1 & 2 Differences? No Yes
Verification Purpose: Eliminating data entry errors Method: 1. program compares main and verification data files 2. program produces list of differences 3. data entry operators use listing and questionnaires to determine corrections 4. Corrections marked on listing 5. BOTH data files corrected by original operators 6. repeat 1-5 until no differences in listing!
A Differences Listing Input File: C:\MICS\CSPRO\RAW\HH003M.DAT Reference File: A:\HH003V.DAT Case Id Item Input File Reference File [ ] ED3(6) ED3B(6) DA11(9) 2 1 [ ] IM1 1 2 IM IM2D 31 IM2M 03 IM2Y 2004
Verification Application The file compare.cmp defines which items (i.e., variables) are to be excluded It is strongly recommended that this file not be changed