Re-engineered SIPP – Progress Update – Survey Redesign Seminar January 20 th, 1-3pm, BLS.

Slides:



Advertisements
Similar presentations
Developing Satisfaction Surveys: Integrating Qualitative and Quantitative Information David Cantor, Sarah Dipko, Stephanie Fry, Pamela Giambo and Vasudha.
Advertisements

Child Care Subsidy Data and Measurement Challenges 1 Study of the Effects of Enhanced Subsidy Eligibility Policies In Illinois Data Collection and Measurement.
An Assessment of the Impact of Two Distinct Survey Design Modifications on Health Insurance Coverage Estimates in a National Health Care Survey Steven.
1 Initial Plans for the Re-engineered SIPP 2010 Electronic Prototype Field Test Jason M. Fields, Housing and Household Economic Statistics Division, US.
Copyright 2010, The World Bank Group. All Rights Reserved. Agricultural Data Collection Procedures Section A 1.
Brian A. Harris-Kojetin, Ph.D. Statistical and Science Policy
Dependent questioning on the Longitudinal Study of Young People in England (LSYPE) Iain Noble, Strategic Analysis, DfES Patten Smith, BMRB.
Chapter 13 Survey Designs
Consumer Expenditure Survey Redesign Jennifer Edgar Bureau of Labor Statistics COPAFS Quarterly Meeting March 4, 2011.
UNDERSTANDING, PLANNING AND PREPARING FOR THE SCHOOL-WIDE EVALUATION TOOL (SET)
Survey Designs EDUC 640- Dr. William M. Bauer
Copyright ©2011 Pearson Education Inc. All rights reserved. Chapter 10 Social Work and Social Policy Social Work An Empowering Profession Seventh Edition.
CAHPS Overview Clinician & Group Surveys: Practical Options for Implementation and Use AHRQ ANNUAL MEETING SEPTEMBER 18, 2011 Christine Crofton, PhD CAHPS.
Census Census of Population, Housing,Buildings,Establishments and Agriculture Huda Ebrahim Al Shrooqi Central Informatics Organization.
Sudan Experience on Poverty Survey Somaia K.E.Omer Date 7-8 Aug بسم الله الرحمن الرحيم.
School-Wide Positive Behavioral Support School-wide Evaluation Tool January 2007.
Legislative Analyst’s Office Presented to: Ryan Woolsey, Fiscal and Policy Analyst CSDA/CWDA Policy Symposium March 4, 2015.
1 Reengineering the SIPP: The Evolution of a Phoenix Joint Statistical Meetings July 30, 2007 David Johnson.
Robin A. Cohen, PhD National Center for Health Statistics National Conference on Health Statistics August 7, 2012 Financial burden of medical care: Looking.
1 The SIPP: The Evolution of a Phoenix Population Association of America April 17, 2008 David Johnson.
A Comparison of Survey Reports Obtained via Standard Questionnaire and Event History Calendar Jeff Moore, Jason Fields, Joanne Pascale, Gary Benedetto,
ACS Update and ACS 2006 Content Test Susan Schechter Chief, American Community Survey Office SDC/BIDC and FSCPE Joint Session March 26, 2007.
1 Update on The Survey of Income and Program Participation Presentation to the Association of Public Data Users Annual Conference September 25, 2009 David.
Overview of Administrative Records on Population and Housing
1 An Overview Gregory D. Weyland Current Population Survey (CPS)
Assessing the Value of the NHIS for Studying Changes in State Health Coverage Policies: The Case of New York Sharon K. Long John A. Graves Stephen Zuckerman.
12th Meeting of the Group of Experts on Business Registers
© 2010 Principles of Healthcare Reimbursement Third Edition Chapter 4 Government-Sponsored Healthcare Programs.
Self-Sufficiency Matrix Short Services Option Based on Abt Associates Training PP Michigan Statewide HMIS Staff Training.
Burden and Loss: The Role of Panel Survey Recordkeeping in Self-report Quality and Nonresponse ITSEW 2010 Ryan Hubbard and Brad Edwards.
Dynamics of Economic Well-being System (DEWS) Census Bureau’s replacement for SIPP.
Guidelines for NHANES Research Proposal Submission by Natalie Dupree Margaret McDowell.
PADI Action Agenda for China(draft) History of Poverty Reduction in China History of Monitoring & Evaluation in Poverty Reduction Objectives.
Re-engineered SIPP – Progress Update – Survey Sponsors Meeting US Census Bureau January 28 th, 2010.
Welcome! Please join us via teleconference: Phone: Code:
1 Understanding Event History Calendars ( Update on Reengineering SIPP) COPAFS March 5, 2010 David Johnson Jason Fields US Census Bureau.
Overview of the National Health Interview Survey Jane F. Gentleman, Ph.D. U.S. DEPARTMENT OF HEALTH AND HUMAN SERVICES Centers for Disease Control and.
Longitudinal Data Recent Experience and Future Direction August 2012.
The SIPP Event History Calendar Field Test: Analysis Plans and Preliminary Report Jeff Moore Statistical Research Division, U.S. Census Bureau Jason Fields.
1 GENDER ISSUES in Labour Household Surveys TURIN, 9-12 Dec.2008 AHMAD HUSSEIN CONSULTANT BASED ON DOCUMENTS PREPARED.
Overview of 2010 EHC-CAPI Field Test and Objectives Jason Fields Housing and Household Economic Statistics Division US Census Bureau Presentation to the.
1 Reengineering the SIPP: An Assessment of the Use of Administrative Records Jim Farber and Sally Obenski US Census Bureau CNSTAT Panel January 26, 2007.
A Comparison of Survey Reports Obtained via Standard Questionnaire and Event History Calendar * Priming Evaluation * Jeff Moore, Jason Fields, Gary Benedetto,
October 28-30, 2009 UNECE Geneva Quality Assessment of 2008 Integrated Census - Israel Pnina ZADKA Central Bureau of Statistics Israel.
INTRODUCTIONS A TIME FOR SHARING Hello and Welcome back !
Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section B 1.
Building Wave Response Rates in a Longitudinal Survey: Essential for Nonsampling Error Reduction or Last In - First Out? Steven B. Cohen Fred Rohde and.
A Comparison of Survey Reports Obtained via Standard Questionnaire and Event History Calendar: Initial Results from the 2008 EHC “Paper” Test Jeff Moore.
VerdierView Graph # 1 OVERVIEW Problems With State-Level Estimates in National Surveys of the Uninsured Statistically Enhancing the Current Population.
Increasing Efficiency in Data Collection Processes Arie Aharon, Israel Central Bureau of Statistics.
1 Dependent Interviewing: Evidence from Field Tests The SIPP Methods Panel Nancy Bates and Joanne Pascale U.S. Census Bureau Seminar on Dependent Interviewing.
CAHPS PATIENT EXPERIENCE SURVEYS AHRQ ANNUAL MEETING SEPTEMBER 2012 Christine Crofton, PhD CAHPS Project Officer.
Analytical Example Using NHIS Data Files John R. Pleis.
Who’s Minding the Kids in the Summer? Child Care Arrangements for Summer 2006 Lynda Laughlin - U.S. Census Bureau Joseph Rukus - Cornell University Annual.
Medical Expenditure Panel Survey (MEPS), Health Care Expenditures for the Elderly with Chronic Conditions in 2012 Jeffrey Rhoades.
Why do we have programs like food stamps and Medicaid? Are they necessary? Why or why not? Call to Order.
1 Assuring the Quality of Data from the Child Outcomes Summary Form.
Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 13 Survey Designs.
1 Assessment of Potential Bias in the National Immunization Survey (NIS) from the Increasing Prevalence of Households Without Landline Telephones Meena.
Component D: Activity D.3: Surveys Department EU Twinning Project.
 Coming January 5, 2015 Idaho WIC Program:.  Session Objectives:  By the end of the session you will be able to… o Define one year certification and.
Support National Social Protection Strategy (NSPS) CARD/SPCU 1.
Selecting the ESCO, Part 2: Interviewing the ESCOs.
Utility of an overlapping panel design in the MEPS Steven B. Cohen, Ph.D.
Using Iterative, Small-Scale Studies to Redesign a Major Federal Government Survey A Review of 15 Years of Research to Redesign the CPS ASEC Health Insurance.
Family Engagement Coordinator Meeting July 25, 2018
Haksoon Ahn, PhD Associate Professor
Haksoon Ahn, PhD Associate Professor
Electronic Data Collection at Statistics Canada
Multi-Mode Data Collection
Presentation transcript:

Re-engineered SIPP – Progress Update – Survey Redesign Seminar January 20 th, 1-3pm, BLS

Current SIPP Basics National panel survey – Since 1984 with sample size between about 11,000 and 45,000 interviewed households The duration of each panel varies from 2½ yrs to 4 yrs The SIPP sample is a multistage-stratified sample of the U.S. civilian noninstitutionalized population The survey uses a 4-month recall period – 3 interviews / year The sample is divided into 4 rotation groups for monthly interviewing Interviews are conducted by personal visit and by decentralized telephone

The Save the SIPP Campaign New York Times Editorials Discovering What Happens Next Save our SIPP The Continuing Saga of SIPP NY Representative, Carolyn Maloney stated: “I want to thank all of the policy groups and economists who worked so hard to help reverse the Administration’s original SIPP decision. Because of their dedication and hard work, the Administration came to understand how important SIPP is to creating and implementing good public policy.”

SIPP Re-Engineering Implement Improvements to SIPP - reduce costs - reduce R burden - improve processing system - modernize instrument - expand/enhance use of admin records Key Design Change: - annual interview, 12-month reference pd., event history calendar methods

EHC Interviewing Human Memory - structured/organized - links and associations EHC Exploits Memory Structure - links between the occurrence and timing of events EHC Encourages Active Assistance to Rs - flexible approach to help elicit an autobiographical “story”

Evaluations of EHC Methods Many EHC vs. “Q-List” Comparisons - various methods - in general: positive data quality results BUT, Important Research Gaps - data quality for need-based programs? - comparison to 4-month reference period?

SIPP Re-engineering Field Test Plans -Proof of concept test paper and pencil reinterview test -EHC CAPI test Integrated Blaise and C# instrument prototype -CAPI Revised test Test improvements to the wave 1 instrument, training, and expand sample to all regional offices Test wave 2 concepts and instrument, examine movers and attrition issues, and refine training procedures.

2008 Paper Field Test Goals & Design Basic Goal: Can an EHC interview collect data of comparable quality to standard SIPP? - month-level data - one 12-month ref pd interview vs. three 4-month ref pd interviews - especially for need-based programs Basic Design: EHC re-interview of SIPP sample HHs Approximately 2000 HHs in IL and TX

First pg of EHC – 2008 Field Test Instrument

Field Test Overall Summary Successful “Proof of Concept” Overwhelming Finding: SIPP-EHC Agreement Valuable Lessons to Inform Next Test - larger, broader sample - “correct” timing of field period - automated questionnaire Specific Data Comparisons are Instructive

2010 EHC CAPI Test Goals & Design Basic Goal: Can a CAPI Event History Calendar interview be: - developed in-house (new/unknown requirements) - integrated with survey management systems - administered by regular field staff interviewers Develop and test new processing system Determine the comparability of data collected: - month-level data - (1) 12-month ref pd intvw vs. (3) 4-month ref pd intvws - especially for need-based programs Basic Design: 8000 HHs interviewed in 10 states limited to high poverty strata that can be matched to areas in 2008 Panel SIPP data.

Screenshot – 2010 EHC CAPI Instrument

LANDMARKS RESIDENCES PRESENCE OF PARENT - MOM PRESENCE OF PARENT - DAD REFERENCE YEAR 20XXINTERVIEW YEAR 20XX+1 INTV SCHOOL ENROLLMENT – (CURRENTLY ENROLLED fill) JOBS/BUSINESSES – (fill name of emp/bus from ehc as entered) + Job/Bus 2 – (fill name of emp/bus from ehc as entered) + Job/Bus 3 – (fill name of emp/bus from ehc as entered) + Job/Bus 4 – (fill name of emp/bus from ehc as entered) + Job/Bus 5 – (fill name of emp/bus from ehc as entered) ALL OTHER WORK FOR PAY TIME NOT WORKING MARITAL STATUS – (CURRENT MARITAL STATUS fill) SSI - SUPPLEMENTAL SECURITY INCOME SNAP - FOOD STAMPS/SUPPLEMENTAL NUTRITION ASSISTANCE PRGM TANF - TEMPORARY ASSISTANCE FOR NEEDY FAMILIES GA – GENERAL ASSISTANCE PROGRAM WIC – WOMEN, INFANTS AND CHILDREN PROGRAM HEALTH INSURANCE – PRIVATE COVERAGE + ADDITIONAL PRIVATE COVERAGE MEDICARE COVERAGE MEDICAID COVERAGE – (fill interview state program name) MILITARY COVERAGE – (VA, CHAMPUS, CHAMPVA) OTHER HEALTH INSURANCE COVERAGE TIME WITHOUT HEALTH INSURANCE COVERAGE Topic – (FILL TOPIC LABEL) * INTRO TO TOPIC QUESTION FILL – ASKS ABOUT STATUS NOW OR DIRECTS FR TO PROCEED[ ] (1) YES/PROCEED (2) NO (3) REFUSED * FOLLOW-UP ASKS ABOUT EVER DURING REFERENCE YEAR OR DIRECTS FR TO PROCEED[ ] (1) YES/PROCEED (2) NO (3) REFUSED * IDENTIFY NEW PERIOD OF TIME[ ] 0-NEW[F4 – EDIT SPELL] [CTRL-X DELETE SPELL] * WHEN DID THIS PERIOD OF (TOPIC FILL) END?[ ] CHOOSE MONTH * WHEN DID THIS PERIOD OF (TOPIC FILL) BEGIN?[ ] CHOOSE MONTH ANY MORE PERIODS OF (TOPIC FILL) DURING REFERENCE YEAR?[ ] (1) YES (2) NO IF YES TO ‘NOW’ INITIALIZE FIRST PERIOD AND FILL INTERVIEW MONTH IN THE ‘TO’ BOX AND SET FOCUS ON THE ‘FROM’ BOX RECORDING ‘NO’ ADDS STRIKEOUT TO ANY UNASSIGNED MONTHS IN THIS TOPIC – ANSWERING ‘YES’ CYCLES BACK TO NEW PERIOD – UPON SPELL COMPLETION YOU EXIT THE DETAILED QUESTIONS TO THE ‘ANY MORE’ ITEM. DEPENDENT DATA FILL UP TO LAST WAVES ‘INTV’ MONTH DATA ARE RECORDED UP TO THE MONTH OF INTERVIEW, WE ALLOW UP TO 6 MONTHS FROM THE END OF THE CALENDAR YEAR TO CONDUCT INTERVIEWS – MONTHS BEYOND THE INTERVIEW ARE GREY’ED OUT. FILL’S ARE USED TO LABEL INTERVIEW MONTH STATUS OR NAMES FROM JOBS/PROGR AM NAMES (FILL NAME OF PERSON FOR THIS EHC) Mockup (example of possible changes) for 2011 EHC CAPI Instrument

Challenges Faced Developing new technical capacity. - experimentation - limitations - evolution Crisis planning. - limited lead time / preparation - changing goals and required flexibility New procedures. - training and acceptance - development and refinement of procedures

Current Status Interviewing in 6 of 12 regional office areas (10 States) Interviews continue through March 13. Recording of the completed interviews – transcription will begin shortly. Reviewing and making changes to content and design. Reviewing and revising training materials and methods Planning for 2013 Production implementation

Comments: Jason Fields –

Assessing Users’ Needs URL: