Sources of Errors M&E Capacity Strengthening Workshop, Addis Ababa 4 to 8 June 2012 Arif Rashid, TOPS.

Slides:



Advertisements
Similar presentations
SURVEY QUALITY CONTROL
Advertisements

Multiple Indicator Cluster Surveys Survey Design Workshop
MICS4 Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Survey Quality Control.
Data Quality Considerations
Content of an M&E Matrix
Unido.org/statistics International workshop on industrial statistics 8 – 10 July, Beijing Non response in industrial surveys Shyam Upadhyaya.
+ Sampling and Surveys Inference for Sampling The purpose of a sample is to give us information about alarger population. The process of drawing conclusions.
Multiple Indicator Cluster Surveys Survey Design Workshop
Documentation and survey quality. Introduction.
These slides are additional material for TIES4451 Data Mining: Data Lecture 3 TIES445 Data mining Nov-Dec 2007 Sami Äyrämö.
CONFIDENCE INTERVALS What is the Purpose of a Confidence Interval?
Confidence Intervals: The Basics
Quiz 20 minutes.
Error and Sample Sizes PHC 6716 June 1, 2011 Chris McCarty.
1 1 Slide Slides Prepared by JOHN S. LOUCKS St. Edward’s University © 2002 South-Western College Publishing/Thomson Learning.
FINAL REPORT: OUTLINE & OVERVIEW OF SURVEY ERRORS
Dimensions of Data Quality M&E Capacity Strengthening Workshop, Addis Ababa 4 to 8 June 2012 Arif Rashid, TOPS.
Sampling Concepts Population: Population refers to any group of people or objects that form the subject of study in a particular survey and are similar.
Social Research Methods
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan,
Arun Srivastava. Types of Non-sampling Errors Specification errors, Coverage errors, Measurement or response errors, Non-response errors and Processing.
Sampling : Error and bias. Sampling definitions  Sampling universe  Sampling frame  Sampling unit  Basic sampling unit or elementary unit  Sampling.
Chapter 5 Section 3 Part 1.  Often when we hear of a sample we do not know the truth behind the sampling process.  The whole truth about opinion polls.
Sampling January 9, Cardinal Rule of Sampling Never sample on the dependent variable! –Example: if you are interested in studying factors that lead.
Sampling. Concerns 1)Representativeness of the Sample: Does the sample accurately portray the population from which it is drawn 2)Time and Change: Was.
Definitions Observation unit Target population Sample Sampled population Sampling unit Sampling frame.
BPS - 5th Ed. Chapter 81 Producing Data: Sampling.
Multiple Indicator Cluster Surveys Survey Design Workshop Sampling: Overview MICS Survey Design Workshop.
TOPS Gender Task Force M&E Capacity Strengthening Workshop, Addis Ababa 4 to 8 June 2012 Kristi Tabaj, TOPS/Save the Children.
Understanding Indicators M&E Capacity Strengthening Workshop Addis Ababa 4 to 8 June 2012 Arif Rashid, TOPS.
Development Hypothesis or Theory of Change M&E Capacity Strengthening Workshop, Maputo 19 and 20 September 2011 Arif Rashid, TOPS.
Sampling. Sampling Can’t talk to everybody Select some members of population of interest If sample is “representative” can generalize findings.
CHAPTER 8: Producing Data Sampling ESSENTIAL STATISTICS Second Edition David S. Moore, William I. Notz, and Michael A. Fligner Lecture Presentation.
Imputation in the 2001 Census Robert Beatty NILS User Forum 11 December 2009.
United Nations Regional Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Bangkok,
Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section A 1.
2008 Population Census of Cambodia Post Enumeration Survey Mrs. Hang Lina Deputy Director General National Institute of Statistics, Min. of Planning Regional.
May 12-15, Evaluating the Integrated Census Israel Pnina ZADKA Central Bureau of Statistics Israel.
Chapter 6: 1 Sampling. Introduction Sampling - the process of selecting observations Often not possible to collect information from all persons or other.
Copyright © 2014 by McGraw-Hill Higher Education. All rights reserved. Essentials of Business Statistics: Communicating with Numbers By Sanjiv Jaggia and.
Higher Education Statistics – collection and processing May 11, 2006 Anna Gärdqvist Mats Haglund Statistics Sweden Higher Education Statistics.
Data Collection: Enhancing Response Rates & Limiting Errors Chapter 10.
RESEARCH METHODS Lecture 26
3.04 Interpret marketing information to test hypotheses and/ or solve issues Marketing Management.
+ The Practice of Statistics, 4 th edition – For AP* STARNES, YATES, MOORE Chapter 8: Estimating with Confidence Section 8.1 Confidence Intervals: The.
Sampling Design and Analysis MTH 494 Ossam Chohan Assistant Professor CIIT Abbottabad.
Basic Business Statistics, 8e © 2002 Prentice-Hall, Inc. Chap 1-1 Inferential Statistics for Forecasting Dr. Ghada Abo-zaid Inferential Statistics for.
1 Aspects of Sampling for Household Surveys Kathleen Beegle Workshop 17, Session 1c Designing and Implementing Household Surveys March 31, 2009.
1 Chapter 13 Collecting the Data: Field Procedures and Nonsampling Error © 2005 Thomson/South-Western.
9-1 ESTIMATION Session Factors Affecting Confidence Interval Estimates The factors that determine the width of a confidence interval are: 1.The.
1 STAT 500 – Statistics for Managers STAT 500 Statistics for Managers.
SWBAT: Explain how undercoverage, nonresponse, and question wording can lead to bias in a sample survey. Do Now: An airline that wants to assess customer.
United Nations Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Amman, Jordan,
United Nations Regional Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Addis.
Survey Training Pack Session 7 – Basic Principles of Sampling.
Chapter 12 Inference for Linear Regression. Reminder of Linear Regression First thing you should do is examine your data… First thing you should do is.
FDI - Imputation. Overview Introduction Overview of Imputation Methods Overview of Outliering methods Overview of Estimation methods Aggregation Disclosure.
Methodologies and Procedures for Evaluating Coverage and Content Error Pres. 6 United Nations Regional Workshop on the 2010 World Programme on Population.
CHAPTER 4 Designing Studies
Survey phases, survey errors and quality control system
Sampling Distribution
Sampling Distribution

Sampling and Sample Size Calculations
Calculating Probabilities for Any Normal Variable
Educational Research Chapter 13 Post-Analysis Considerations
Dimensions of Data Quality
Inference for Sampling
Integrating Gender M&E Capacity Strengthening Workshop, Addis Ababa
Methodologies and Procedures for Evaluating Coverage and Content Error Pres. 6 United Nations Regional Workshop on the 2010 World Programme on Population.
Presentation transcript:

Sources of Errors M&E Capacity Strengthening Workshop, Addis Ababa 4 to 8 June 2012 Arif Rashid, TOPS

Type of Data Slide # 1 Routine Monitoring Data (Output and Process) Annual Monitoring/ Evaluation Survey Data

Routine Monitoring Data Slide # 2

Source of Errors Slide #3 What could be the source of errors?  Reporting  Recording  Aggregation  Manipulation It is important to keep all source documents

Survey Data: Sources of Errors Slide # 4 Sampling Error Non Sampling Error

Sampling Error  Standard Error or Margin of Error – Idea of precision of statistical estimate Slide # 5 Age: 29.7

Sampling Error Slide # 6 Age: 29.5 Age: 30.2 Age: 28.8 Population mean age: 29.7

Sampling Error Standard error A small standard error means that the sample statistic is closer to the population parameter. The larger the sample size, the smaller the standard error. Slide # 7

Non Sampling Error Specification Error: Concept implied by the question is different from the underlying construct to be measured Example: How many children do you have – interpretation could be different based on the culture Slide # 8

Non Sampling Error Sampling frame Error: Households can be omitted or appear in two “enumeration areas” (EA) if the EAs are not properly demarcated. Example: If not done carefully, households/ primary sampling units can easily be omitted from clusters or enumeration areas. More common in multi-stage cluster surveys. Slide # 9

Non Sampling Error Non-response: Failure to measure some of the sample units. Example: Respondent not-at-home, refuse to answer certain questions, or refuse to answer to the survey. Slide # 10

Non Sampling Error Measurement Error: What is observed or measured is different than the actual values of sample units. Example: Incorrect age, or weight or height. Slide # 11

Non Sampling Error Processing Error: Editing errors. Coding errors. Data entry errors. Programming errors etc. Example: Use of wrong codes, inconsistent values, incorrect computation of variables. Slide # 12

This presentation was made possible by the generous support of the American people through the United States Agency for International Development (USAID). The contents are the responsibility of Save the Children and do not necessarily reflect the views of USAID or the United States Government.