Data management Key Issues in Data Entry and Management Cleaning Data, Who Should do What, When? Juan Muñoz.

Slides:



Advertisements
Similar presentations
SURVEY QUALITY CONTROL
Advertisements

Multiple Indicator Cluster Surveys Data Entry and Processing.
MICS4 Data Processing Workshop Multiple Indicator Cluster Surveys Data Processing Workshop Data Entry Editing.
MICS DATA PROCESSING Data Entry Editing. REMEMBER AND REMIND YOUR FIELD STAFF: The best place to correct data is in the field where the respondent is.
MICS Data Processing Workshop Overview. Data Processing Design Data processing is organized around clusters There is one set of data files for each cluster.
MICS4 Data Processing Workshop Multiple Indicator Cluster Surveys Data Processing Workshop Data Entry Applications with Logic.
MICS4 Data Processing Workshop Multiple Indicator Cluster Surveys Data Processing Workshop Overview of Data Processing System.
MICS4 Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Data Entry and Processing.
MICS4 Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Field Staff and Field Procedures.
MICS4 Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Survey Quality Control.
1 From the data to the report Module 2. 2 Introduction Welcome Housekeeping Introductions Name, job, district, team.
Managing data using CSPro
Mobile Surveyor A Windows PDA/Mobile based survey Software for easy, fast and error free data collection.
MANUFACTURING STATISTICS IN ETHIOPIA By Samuel Hailu Central Statistical Agency Ethiopia.
Key Stage 3 National Strategy Handling data: session 3.
1 Fieldwork logistics and data quality control procedures Kathleen Beegle Workshop 17, Session 2 Designing and Implementing Household Surveys March 31,
1 Assuring the Quality of your COSF Data. 2 What factors work to improve the quality of your data? What factors work to lessen the quality of your data?
Multiple Indicator Cluster Surveys Data Interpretation, Further Analysis and Dissemination Workshop Overview of Data Quality Issues in MICS.
Brief Overview of Data Processing of Afghanistan Household Listing, Pilot Census Results, Population and Housing Census and NRVA Survey Brief Overview.
MICS Data Processing Workshop Multiple Indicator Cluster Surveys Data Processing Workshop Data Quality Tables.
MICS Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Overview of MICS Tools, Templates, Resources, Technical Assistance.
Manual Data Processing of Census Data 2004 Population and Housing Census Statistics Sierra Leone Thekeka Moses Conteh Sierra Leone.
The Core Welfare Indicators Questionnaire: A CWIQ Option for Monitoring Poverty Reduction Strategies.
Identifying Problem Sources at Data Entry and Collection National Center for Immunization & Respiratory Diseases Influenza Division Nishan Ahmed Regional.
CHAPTER 5 Infrastructure Components PART I. 2 ESGD5125 SEM II 2009/2010 Dr. Samy Abu Naser 2 Learning Objectives: To discuss: The need for SQA procedures.
1 Software Construction Software Construction Chapter 1.
Data management in the field Ari Haukijärvi 2nd EHES training seminar.
D ATA P ROCESSING W ORKSHOP Bangkok, Thailand, 15-19, Sept 2008 By Mr. Pen Socheat, NIS, Cambodia 1.
GENDER BASED VIOLENCE: Violence against women quantitative survey Ms.J.Tsogzolmaa, Analyst NSO of Mongolia International Seminar on Gender Statistics 12-14,
Jordan National Behavioral Risk and Chronic Disease Survey Jordan 2004 / 2005 Dr. Meyasser Zindah Head of NCD Department Ministry Of Health.
ICT in Society A research Project By: Date:. Contents Key Question The Survey Getting Data Survey Examples Survey Summary Survey Conclusions Research.
Workshop on International Standards, Contemporary Technologies and Regional Cooperation, Noumea, New Caledonia, 04–08 February 2008 Results Generated from.
End HomeWelcome! The Software Development Process.
MICS Data Processing Workshop Multiple Indicator Cluster Surveys Data Processing Workshop Overview of MICS Tools, Templates, Resources, Technical Assistance.
United Nations Regional Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys Bangkok,
1 By; L.M. Gambamala - Senior Statistician, National Bureau of Statistics, Tanzania PLANNING, EXECUTION AND ANALYSIS OF AGRICULTURAL CENSUSES – A TANZANIA.
AADAPT Workshop South Asia Goa, December 17-21, 2009 Maria Isabel Beltran 1.
Copyright 2010, The World Bank Group. All Rights Reserved. ICT - a core management issue Part 1 Managing ICT resources Produced in Collaboration between.
The Core Welfare Indicators Questionnaire (CWIQ).
The British Household Panel Survey Began in September 1991 National sample of England, Scotland and Wales 5,000 households/10,000 interviewed adults 16+
Assuring good field work Juan Muñoz. What happens when fieldwork is poor? A long and frustrating process of “data cleaning” becomes unavoidable The data.
Post enumeration survey in the 2009 Pilot Census of Population, Households and Dwellings in Serbia Olga Melovski Trpinac.
User Interfaces 4 BTECH: IT WIKI PAGE:
MICS Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Data Entry Using Tablets / Laptops.
DECRG, World Bank, April 28, Linking LSMS and QSDS Kinnon Scott.
Unit 18 Advanced Database Design
By Phileo Don - Okhuofu. DATA COLLECTION  Data can be collected by the use of questionnaires or data collection forms.  These could be printed out and.
RESEARCH METHODS Lecture 29. DATA ANALYSIS Data Analysis Data processing and analysis is part of research design – decisions already made. During analysis.
Copyright 2010, The World Bank Group. All Rights Reserved. Managing Data Processing Section B.
RESEARCH METHODS IN TOURISM Nicos Rodosthenous PhD 25/04/ /4/20131Dr Nicos Rodosthenous.
UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation.
CISB113 Fundamentals of Information Systems IS Development.
POST ENUMERATION SURVEY TANZANIA EXPERIENCE BY Mrs RADEGUNDA MARO.
United Nations Regional Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys Asunción,
TIMOTHY SERVINSKY PROJECT MANAGER CENTER FOR SURVEY RESEARCH Data Preparation: An Introduction to Getting Data Ready for Analysis.
Designing LSMS Questionnaires Kinnon Scott Gero Carletto DECRG.
May I see (NAME)'s vaccination card?. Outline Training Fieldwork Example - Lesotho Skit.
Group 1 BDMPS Project Work The Survey on Use of ICT Facilities in TIC.
MICS Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Data Entry Using Tablets / Laptops.
1 Health Results-Based Financing Impact Evaluation Surveys Quality Assurance and Data Management Álvaro Canales, Beatriz Godoy, Juan Muñoz Sistemas Integrales.
Database Overview What is a database? What types of databases are there? How are databases more powerful than spreadsheets?
Coding Preparing The Research for Data Entry. Coding (defined) Coding is the process of converting questionnaire responses into a form that a computer.
UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation.
Session 5 – Questionnaire Checklists
Survey Training Pack Session 9 – Data Entry.
Census of Population & Housing 2001 Sri Lanka
PRESENTED BY: THABANG MPEKA
Rusinga DSS DATA MANAGEMENT.
User manual for extracting Dummy Payment Report from SAP
Timor-Leste Country Presentation
Presentation transcript:

Data management Key Issues in Data Entry and Management Cleaning Data, Who Should do What, When? Juan Muñoz

Levels of quality control Range checking Simple consistency checks Inter-record checks

Range checking Age should be a number less than 100 Gender should be coded either “1” for male or “2” for female No numbers in the name field etc

Simple consistency checks Age and birth date should be consistent with the date of the interview Head of the household should be 18 years or older A doctor should have completed university studies etc.

Inter-record checks Sub-totals Food consumption Checks with reference tables (anthropometrics) Cash balance Item-specific unit prices etc.

Levels of quality control Ranges Simple Inter-record consistency Easier to conceive and program Harder to conceive and program

Levels of quality control Ranges Simple Inter-record consistency Error likely to be due to miscoding or data entry Errors likely to be due to interviewing

Why concurrent data entry? Quality control Turnaround time General improvement of field procedures Eliminates encoding as a separate task

Data entry is an integral part of the LSMS, not an afterthought

What is needed to develop an LSMS data entry program? Integrated skills / tasks Development time Data entry software

Integrated skills Questionnaire and data entry program evolve synergistically (example: subtotals) Data manager needs to be a part of the core team from the beginning Integration will become even more important in future surveys

Tasks Data entry program development - screen design - range checks - consistency checks - reference data Data entry manual Training Supervision during field work Compilation and documentation

Development time First version to be completed before the field test Working version needs to be ready for training Debugging needed during first weeks of data collection

Data entry software In-house package Six packages evaluated in 1994, IMPS and ISSA found adequate

Data entry software In-house package Six packages evaluated in 1994, IMPS and ISSA found adequate Has evolved synergistically with acquired experience and available technology IMPS and ISSA now superseded by CSPro