© 2008 Lockheed Martin Corporation. All Rights Reserved. Capture Data Quality Session 9 – Data Capture: Process Stages UNSD-ESCWA Regional Workshop on Census Data Processing in the ESCWA region Doha, State of Qatar, May 2008 Fred Highland Census Practice Architect Lockheed Martin Transportation & Security Solutions

1/12/2016 © 2008 Lockheed Martin Corporation. All Rights Reserved. 2 Objective of a Population Census “ … count everyone, count them once only, count them once only, and count them in the right place… ” and count them in the right place… ” Preston Jay Waite (US Census Bureau)

1/12/2016 © 2008 Lockheed Martin Corporation. All Rights Reserved. 3 It’s not just about paper – multi-channel data collectionIt’s not just about paper – multi-channel data collection  Telephone Voice capture accuracy (Service Quality v Data Quality)Voice capture accuracy (Service Quality v Data Quality)  Internet Self capture – no capture accuracy or image quality issuesSelf capture – no capture accuracy or image quality issues Inventory Control, Processing Integrity issuesInventory Control, Processing Integrity issues  Field Hand-held device Similar to internetSimilar to internet Admin Records (not addressed here)Admin Records (not addressed here)  Similar to internet  Data validation  Many issues with linkage/coherence A Comprehensive view must embrace all aspects and all channelsA Comprehensive view must embrace all aspects and all channels A Comprehensive View

1/12/2016 © 2008 Lockheed Martin Corporation. All Rights Reserved. 4 A Comprehensive View PaperInternetTelephone Hand Held Inventory Control √√√√ Questionnaire Integrity √√√√ ImageQuality √ Processing Integrity √√√√ Capture Accuracy √√√

1/12/2016 © 2008 Lockheed Martin Corporation. All Rights Reserved. 5 “Ensuring that questionnaires are accurately accounted for and managed” “Ensuring that questionnaires are accurately accounted for and managed” Accurate capture of data is irrelevant if you lose the questionnaireAccurate capture of data is irrelevant if you lose the questionnaire Inventory Control Delivery System Entry Storage Disposition Processing

1/12/2016 © 2008 Lockheed Martin Corporation. All Rights Reserved. 6 “Ensuring that the questionnaire and its component parts are kept together for the complete process” “Ensuring that the questionnaire and its component parts are kept together for the complete process” Maintain the linkage of a questionnaire to its componentsMaintain the linkage of a questionnaire to its components  Pages/sheets (paper)  Household  Persons  Response items Prevent mixing of data between questionnairesPrevent mixing of data between questionnaires Questionnaire Integrity Questionnaire Pages Household Person n Person 2 Person 1 Item 1 Item 2 Item n Item 1 Item 2

1/12/2016 © 2008 Lockheed Martin Corporation. All Rights Reserved. 7 Image Quality What is image quality?What is image quality?  Qualitative not Quantitative Capture of faithful images that are “fit for purpose”Capture of faithful images that are “fit for purpose” This is subjectiveThis is subjective No agreed-to measure exists !No agreed-to measure exists !  Operational definition Images are of sufficient resolution for processingImages are of sufficient resolution for processing Images represent the complete original documentImages represent the complete original document Images are free of artefacts introduced by processingImages are free of artefacts introduced by processing Questionnaires must be represented as digital images for:Questionnaires must be represented as digital images for: Automatic recognition (e.g. OCR, OMR)Automatic recognition (e.g. OCR, OMR) KeyingKeying Other image assisted functions (e.g. Coding)Other image assisted functions (e.g. Coding) ArchiveArchive Capture of high quality images is critical !Capture of high quality images is critical !

1/12/2016 © 2008 Lockheed Martin Corporation. All Rights Reserved. 8 Processing Integrity “Ensure all responses are processed in the proper sequence, priority and completely through all appropriate steps” Complicating factorsComplicating factors  Multiple response modes Paper, internet, telephone and hand-held devicePaper, internet, telephone and hand-held device  Quantity of questionnaires US - 140,000,000US - 140,000,000 UK - 30,000,000UK - 30,000,000 Canada – 13,500,000Canada – 13,500,000  Processing deadlines Non-response follow-upNon-response follow-up Census Coverage Survey (CCS)Census Coverage Survey (CCS)  Large number of processing steps….

1/12/2016 © 2008 Lockheed Martin Corporation. All Rights Reserved. 9 Data Capture Accuracy - Paper Questionnaire Scan Image OCR ASCII 20% 0.2% 80% 99.8% OMR Keying ASCII w/codes Edit Code “Capture all of the data accurately, regardless of source and be able to assess and manage the accuracy”

1/12/2016 © 2008 Lockheed Martin Corporation. All Rights Reserved. 10 A comprehensive approach to quality must consider more than just data capture issues….  Inventory Control  Questionnaire Integrity  Image Quality  Processing Integrity  Data Capture Accuracy … while ensuring accuracy and value for money … while ensuring accuracy and value for money Summary A comprehensive approach identifies issues early and enables timely corrective actions. It requires an operational focus on data quality.