Topic (i): Editing nearer the source Work Session on Statistical Data Editing Vienna, Austria 21-23 April 2008.

Slides:



Advertisements
Similar presentations
StEPS at EIAWhere We Are Now Paula Weir and Sue Harris Energy Information Administration, U.S. Department of Energy ICES3 Topic Contributed Session: Generalized.
Advertisements

Web Design Issues in a Business Establishment Panel Survey Third International Conference on Establishment Surveys (ICES-III) June 18-21, 2007 Montréal,
IMPACT OF ONLINE EDITS AND INTERNET FEATURES IN THE 2006 CANADIAN CENSUS Presented by Mike Bankier on behalf of: Danielle Laroche and Chantal Grondin Statistics.
Market Research Ms. Roberts 10/12. Definition: The process of obtaining the information needed to make sound marketing decisions.
Discussion of topic VI Censuses Work Session on Data Editing Vienna, April 21 st -23 rd 2008 Heather Wagstaff & Thomas Burg.
The Movement to EDR and the Impact on Editing: Electronic Approaches: Usage and Growth.
Association for Institutional Research Annual Forum May 2013 Angie L. Miller, Ph.D. Amber D. Lambert, Ph.D. Center for Postsecondary Research, Indiana.
5.00 Understand Promotion Research  Distinguish between basic and applied research (i.e., generation of knowledge vs. solving a specific.
Overview: Online Surveys Vasja Vehovar University of Ljubljana, Slovenia Handbook of Online Research Methods Colloquium March 2007.
T heme: To enable more effective facilitation of the DLHE survey. Background to problem or opportunity The DLHE collection changed in 2011/12 with a more.
Canada’s 2006 Census Online Experience MSIS 2008 Luxembourg, April 7-9, 2008 Karen Doherty Director General Informatics Branch Statistics Canada.
STATISTICS CANADA – 2006 CENSUS Internet Response Option Presentation at UN Statistical Commission February 28, 2007.
Ch 4 The Process page 1CS 368 Building Software is Difficult often delivered late often over budget always with errors must be a custom solution complexity.
Documentation and survey quality. Introduction.
Consumer Expenditure Survey Redesign Jennifer Edgar Bureau of Labor Statistics COPAFS Quarterly Meeting March 4, 2011.
Anabela Delgado Carlota Amorim Statistics Portugal - Census Unit « Simply2010 Ghent 2-3 December 2010 E-CENSUS: A new data collection system for the 2011.
FINAL REPORT: OUTLINE & OVERVIEW OF SURVEY ERRORS
Introduction of Internet Survey Methodology to the Emirate of Abu Dhabi Andrew Ward, Maitha Al Junaibi and Dragica Sarich.
Brief Overview of Data Processing of Afghanistan Household Listing, Pilot Census Results, Population and Housing Census and NRVA Survey Brief Overview.
Towards a corporate-wide electronic data collection system at the National Statistical Institute of Spain Work Session on Statistical Data Editing Ljubljana,
Vienna, 23 April 2008 UNECE Work Session on SDE Topic (v) Editing on results (post-editing) 1 Topic (v): Editing based on results Discussants: Maria M.
Arun Srivastava. Types of Non-sampling Errors Specification errors, Coverage errors, Measurement or response errors, Non-response errors and Processing.
Section 29.2 The Marketing Survey
3-6 6 th grade math Sampling Methods. Objective To understand how the method of sampling determines how representative the sample is of the population.
Surveys and Questionnaires Online Tutorial. What is a survey? A survey is a method of gathering information from a number of individuals, known as a sample,
Learning Objectives Copyright © 2002 South-Western/Thomson Learning Survey Research: The Profound Role of the Internet CHAPTER six.
Evaluating Survey Data Collection Methods 1 Copyright © 2014 Pearson Education, Inc.
Lesli Scott Ashley Bowers Sue Ellen Hansen Robin Tepper Jacob Survey Research Center, University of Michigan Third International Conference on Establishment.
UNIT 7: Using Excel in the Law Office. This Week’s Assignment You should be working on your three-part assignment Part 1 deals with the things you learned.
Copyright 2010, The World Bank Group. All Rights Reserved. Managing processes Core business of the NSO Part 2 Strengthening Statistics Produced in Collaboration.
Eurostat Data collection. Presented by Johan Erikson Statistics Sweden.
Internet versus paper mode effects in the 2011 Census of England and Wales: analysis of Census Quality Survey agreement rates Cal Ghee 26 September 2014.
Brown, Suter, and Churchill Basic Marketing Research (8 th Edition) © 2014 CENGAGE Learning Basic Marketing Research Customer Insights and Managerial Action.
European Conference on Quality in Official Statistics Session 26: Quality Issues in Census « Rome, 10 July 2008 « Quality Assurance and Control Programme.
First Thoughts on Editing in Mixed Modes in the 2011 Census Heather Wagstaff and Ruth Wallis Methodology Directorate Office for National Statistics, U.K.
Topic (iii): Electronic data reporting – editing nearer source and multimode collections Discussants: Pedro Revilla (Spain) and Paula Weir (United States)
NACEP Conference 2004 Capturing them in the Web: Using Web- Based Surveys to Increase Response Rates for College Freshman Debbie.
Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section A 1.
UNSD Regional Workshop on Census Data Processing for the English speaking African Countries: Contemporary technologies for data capture, methodology and.
CES Seminar on “Organization of data collection and sharing, and the management challenges for the implementation of SDMX” Session 1 Hank Hermans CES /
Survey Research.
1 1 Using traditional control systems to reveal changes when introducing new data collection instruments Sindre Børke Senior Adviser Division.
UNSD-UNESCAP Regional Workshop on Census Data Processing: Contemporary technologies for data capture, methodology and practice of data editing, documentation.
5 Marzo 2007 Session 1: 2010/2011 Round of Censuses – Innovations and Lessons Learned chaired by A. Mancini, Italy - Istat Conference of European Statisticians.
Data Editing in a Common Internet Data Collection System Work Session on Statistical Data Editing April 2008 Topic v: Editing of data acquired through.
© 2008 Lockheed Martin Corporation. All Rights Reserved. Capture Data Quality Session 9 – Data Capture: Process Stages UNSD-ESCWA Regional Workshop on.
Trying to improve editing tasks through EDR methods Pedro Revilla, Ignacio Arbués, Margarita Gonzalez and Isabel Yun National Statistical Institute, Spain.
1 Chapter 13 Collecting the Data: Field Procedures and Nonsampling Error © 2005 Thomson/South-Western.
The 2011 Census: Estimating the Population Alexa Courtney.
First meeting of the Technical Cooperation Group for the Population and Housing Censuses in South East Europe Vienna, March 2010 POST-ENUMERATION.
Managing Multi Mode Collection Instruments in the 2011 UK Census Frank Nolan, Heather Wagstaff, Ruth Wallis Office for National Statistics UK.
Best Practices for Implementing a Paradata Warehouse Presentation at the Washington Statistical Society Mini-Conference on Paradata Washington, D.C. Jason.
1 Handbook on Population and Housing Census Editing Department of Economic and Social Development United Nations Statistics Division Studies in Methods,
Questionnaire Design in Statistics Denmark
Conference of European Statisticians
28 November - 1 December 2016, Amman, Jordan
Data collection with Internet
28 November - 1 December 2016, Amman, Jordan
Multi-Mode Data Collection Approach
Use of handheld electronic devices for data collection in GeoStat
The Computer-Assisted Personal
Data collection with Internet
Multi-Mode Data Collection Approach
Changes in the Canadian Census of Population Program
Data collection with Internet
Multi-Mode Data Collection
Data collection with Internet
Innovations on the Canadian Census
Presentation transcript:

Topic (i): Editing nearer the source Work Session on Statistical Data Editing Vienna, Austria April 2008

Topic (i) Papers Invited papers:  Selective Automatic Editing of Mixed Mode Questionnaires for Structural Business Statistics—Netherlands  Data Editing in a Common Internet Data Collection System—U.S. Contributed papers:  First Thoughts on Editing in Mixed Modes in the 2011 England and Wales Census—United Kingdom  Impacts of Online Edits and Internet Features in the 2006 Canadian Census—Canada  Using “Traditional” Control (Editing) Systems to Reveal Changes When Introducing New Data Collection Instruments—Norway  Trying to improve editing tasks through EDR methods— Spain

Overview Two supporting papers addressed population census surveys and other papers deal with business surveys. Similar issues were presented. Common themes:  Respondent burden vs. data quality  Point at which to invoke an edit  Common look and feel  Usability testing  Decrease in edit failures post submission vs other modes; decrease in item non-response  Preserve paper process to reduce mode effects  Some problems solved; new problems introduced New finding (?):  First electronic response has higher error rate but is corrected before submission

Discussion How do we reconcile the differences between the edits and the edit process in electronic collection versus paper collection to reduce mode effects introduced in response and processing?

Discussion Are common/standard edit types available in generalized edit system being implemented in the electronic collection systems?

Discussion How do we tackle the problem that the objectives of improving data quality and improving response rates in electronic collection are in conflict?

Discussion What metrics should be maintained for electronic collection to determine how much editing to perform within the collection instrument to balance data quality with response burden and risk of non-response?

Discussion How should we address the balance between complex coding frames in on- line interfaces which are intended to reduce coding errors and the risk in building/maintaining complex coding frames which often can not be considered exhaustive?

Discussion Do messages, automated skips, and radio buttons allowing only a single response promote a perception of intelligence that can lead to unwanted behavior by the respondent, such as providing an answer that is really unknown and, therefore, is incorrect but “valid” in the sense that it passes the edits?

Discussion How can we best define and make use of paradata gathered in the electronic collections to improve the electronic questionnaire design and the edits in the electronic questionnaire, as well those used for the paper questionnaires?

Discussion Do respondents report less accurately when filling in the non-automatic entries in an electronic questionnaire?