Recall Period in CE Surveys Program Norman M. Bradburn CE Survey Methods Workshop December 8-9, 2010.

Slides:



Advertisements
Similar presentations
DATA & STATISTICS 101 Presented by Stu Nagourney NJDEP, OQA.
Advertisements

Designing Questionnaires for Children and Young People
Split Questionnaire Designs for Consumer Expenditure Survey Trivellore Raghunathan (Raghu) University of Michigan BLS Workshop December 8-9, 2010.
Discussion of Plans for Designing the Recall Period for the Consumer Expenditure Interview Survey David Cantor Westat and Joint Program for Survey Methodology.
Evaluation Research Kodi D. Havins AED 615 Fall 2006 Dr. Franklin.
Questionnaire Design Sudman & Bradburn (1988).  Question wording is a crucial element in maximizing the validity of survey data obtained by a questionnaire.
Evaluating Creatives *  Concept Testing: Assessment of potential Creatives  Communication Research: A Look at the Advertising Creative  Copy Testing:
© Tefko Saracevic, Rutgers University1 digital libraries and human information behavior Tefko Saracevic, Ph.D. School of Communication, Information and.
Dr. Michael R. Hyman, NMSU Survey Error: Focus on Systematic Error.
Consumer Information Processing MKT 846 Professor West.
Focus on Systematic Error
© Tefko Saracevic, Rutgers University1 digital libraries and human information behavior Tefko Saracevic, Ph.D. School of Communication, Information and.
Consumer Expenditure Survey Redesign Jennifer Edgar Bureau of Labor Statistics COPAFS Quarterly Meeting March 4, 2011.
© Tefko Saracevic, Rutgers University1 digital libraries and human information behavior Tefko Saracevic, Ph.D. School of Communication, Information and.
3-1 Chapter 3 Learning and Memory. 3-2 The Learning Process Learning refers to a relatively permanent change in behavior that is caused by experience.
Basic Facts Knowledge A Staff Tutorial. This tutorial will: 1.Define basic fact knowledge and outline why it is important 2.Introduce a teaching, learning.
Creating Research proposal. What is a Marketing or Business Research Proposal? “A plan that offers ideas for conducting research”. “A marketing research.
CHAPTER FIVE (Part II) Sampling and Survey Research.
Survey Research and Other Ways of Asking Questions
Testing in the classroom: Using tests to promote learning Richard P. Phelps Universidad Finis Terrae, Santiago, Chile January 7, 2014.
(c) 2007 Worth Publishers Hockenbury and Hockenbury Discovering Psychology Fourth Edition Outline PowerPoints Chapter 6: Memory.
Cognitive Interviewing for Question Evaluation Kristen Miller, Ph.D. National Center for Health Statistics
SPECA Regional Wrokshop on Disability Statistics, Dec 13-15, 2006 Issues Related to Disability Measurement: Cognitive testing and mode Jennifer Madans.
SLB /04/07 Thinking and Communicating “The Spiritual Life is Thinking!” (R.B. Thieme, Jr.)
Gemini Project Overview Adam Safir Division of Consumer Expenditure Surveys December 2010.
Human Information Processor Model (Card, Moran & Newell, 1983)
Cognition free response question
Cognitive Rehabilitation: The Manual Dr Michelle Kelly BCBA-D.
MEMORY – CHAPTER 9 QUESTIONS
Context Effects: Interpreting the Question Should we ask specific questions before general ones? (e.g., rate course, then curriculum) What about with attitude.
Inability to retrieve information previously stored in LTM
Chapter 161 The Consumer Price Index and Government Statistics.
CJ490: Research Methods In Criminal Justice
Research into survey errors and interview bias has advance thinking about larger issues of how people create social meaning and achieve cultural understanding.
Copyright 2010, The World Bank Group. All Rights Reserved. Questionnaire Design Part II Disclaimer: The questions shown in this section are not necessarily.
Need estimates of prevalence? Objective answers by asking? Yes SURVEY Good Poor EXPLORATORY or SECONDARY RESEARCH FOCUS GROUPS Understanding of problem.
What do you remember?.  Attention facilitates encoding (it is a selective filter)  Levels of processing theory:  Memory codes depends on which aspects.
Copyright 2010, The World Bank Group. All Rights Reserved. Questionnaire Design Part I Disclaimer: The questions shown in this section are not necessarily.
Cross-Cultural Survey Research. Survey Research Laboratory 2 of 15 Cognitive Survey Response Model Question interpretation Memory retrieval Judgment formation.
Q Rome Italy, July The Mysterious 36% Difference: Studies on a Measurement Error Anette Björnram, Boris Lorenc, Andreas Persson, Klas Wibell.
Research Methods in Psychology How do we study Psychology?
Chapter Ten Constructivist Learning Theory, Problem Solving, and Transfer.
The Research Process Step 1-4 IBC464 International College
Sociological Research Methods. Survey Research - Interview - Questionnaire - Closed- end Questions - Open- ended Questions.
QUANTITATIVE MODELS OF MEMORY The value of explicit models –Precision of thinking –Explanatory power –Interval- or ratio-scale predictions –The macho factor.
Problem Recognition & Search
Marketing Research Process and Types of Marketing Research.
Chapter X Questionnaire and Form Design. Chapter Outline Chapter Outline 1) Overview 2) Questionnaire & Observation Forms i. Questionnaire Definition.
For Example…...The impact of different example types on frequency estimates Presented at the 2008 AAPOR annual conference in New Orleans, LA.
© 2013 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Memory Failure Why do we forget?. Retrieval Failure Some memories may still be encoded, but we fail to retrieve them Retrieval cues can sometimes help.
Memory is the mother of all wisdom – Aeschylus, 440BCE.
Professor: Chu, Ta Chung Student: Nguyen Quang Tung 徐啟斌.
Questionnaire & Form Design
1. Contrast two types of sensory information. 2. Describe the duration and working capacity of short-term memory. 3. Describe the capacity and duration.
QUESTIONNAIRE DESIGN: TYPE OF QUESTIONS Lu Ann Aday, Ph.D. The University of Texas School of Public Health.
Aiding Respondent Recall Researchers should be made aware of the realities of memory and the many factors affecting it. In addition, researchers should.
University of Sunderland Professionalism and Personal Skills Unit 11 Professionalism and Personal Skills Reflection Exercise.
Evidence Based Practice & Research in Nursing Level 8, Academic Year (AY) 1434—1435 H Vanessa B. Varona, RN, MAN.
Memory/Cognition Memory Encoding - Getting information in
Attitudes and Intentions
Levels of Processing Memory Model (LoP)
Forgetting.
RESEARCH METHODS Trial
The cognitive model in answering questions Marco Ballin
Problem Recognition and Information Search
You don’t know what you’ve got ‘til it’s gone
PRINCIPLES OF WRITING AND CLASSIFICATION OF QUESTIONS
What is it? Research into the effectiveness of CI Evaluation
Psychology in Everyday Life
Presentation transcript:

Recall Period in CE Surveys Program Norman M. Bradburn CE Survey Methods Workshop December 8-9, 2010

Question-Answering Process 1. Comprehending question 2. Retrieving relevant information 3. Formulating an answer 4. Formatting and editing the answer

Retrieving Relevant Information Event must be encoded in memory Cues important in aiding recall Cues may come from wording of question, lists, context Recall takes time. The more time the better the recall

Key Aspects of Recall Context Frequency of events Shape of forgetting curve Reference period Telescoping

Low Item-incidence Levels Two approaches: Vary recall period Vary sample size

Best Practices for Determining Recall Period Minimize net relative error from omissions and telescoping Negative Exponential function ae –bt fits much expenditure data (t is time, a and b are constants that vary by expenditure type

Grouping Questions Minimize cognitive effort Group by event sequences Group by expenditure setting Group by recall period

Next Steps Review findings on context effects on consumer expenditures Explore effects of different groupings Test hypotheses about groupings in laboratory and field Do field test to determine operational feasibility

Proposed Survey Design Conceptually separate surveys with different groupings and recall periods Sample sizes determined by desired level of precision Panel surveys to reduce telescoping Questionnaire as a matrix

Additional Issue Events cannot be recalled if they were never encoded Price of goods purchased with credit cards may not ever be encoded separately. Only total for mixed basket of goods may be encoded, if that