Cell phone problem and alternative approaches

Slides:



Advertisements
Similar presentations
Address Frames and Mail Surveys as Complements (or Alternatives) to RDD Surveys Michael W. Link, Michael P. Battaglia, Martin R. Frankel, Larry Osborn,
Advertisements

Strategies for Increasing Efficiency of Cellular Telephone Samples Kurt Peters 1, William Robb 1, Cristine Delnevo 2, Daniel A. Gundersen 2 March 2014.
1 Sampling Telephone Numbers and Adults, and Interview Length, and Weighting in the California Health Survey Cell Phone Pilot Study J. Michael Brick, Westat.
Two Emerging Issues in Epidemiologic Research Access to populations for epidemiologic study Side effects of specialization.
Trying Out New Survey Techniques – Lessons Learned 2013 Northwest Hazardous Materials Management Conference Liz Tennant, Strategic Advisor, Office of the.
Cell phone problem and alternative approaches Chris McCarty University of Florida PHC 6716 May,
Wireless Substitution: Semiannual Estimates from the NHIS ER Program Centers for Disease Control and Prevention National Center for Health Statistics Stephen.
How America Shops & Spends 2014
COVERAGE AND SAMPLING Damon Burton University of Idaho.
1 Partner Solutions - Technology Tools for Better, Faster, Smarter Handling of Your Receivables.
Marketing Systems Group Southern California MRA Education Seminar Presentation September 17, 2005 Privacy and Current Issues.
Response rates and disposition coding PHC 6716 June 8, 2011 Chris McCarty.
1 Assessment of Potential Bias in the National Immunization Survey (NIS) from the Increasing Prevalence of Households Without Landline Telephones Meena.
INTRODUCTION TO RESEARCH METHODS IN ECONOMICS Topic 5 Data Collection Strategies These slides are copyright © 2010 by Tavis Barr. This work is licensed.
Weighting and imputation PHC 6716 July 13, 2011 Chris McCarty.
Aria Telecom Solutions Pvt. Ltd.
SESRI Workshop on Survey-based Experiments
Issue Testing Survey of US Consumers Relating to Individuals with Disabilities December 5, 2016.
Deciding on a Distribution Channel
CS410 – Professional Workforce Development Orange Team
Casey Eggleston, Jennifer Hunter Childs, & Gerson Morales
Young, Uninsured and In Debt:
Marketing Research Aaker, Kumar, Leone and Day Eleventh Edition
Sampling and Experimentation
Mesfin S. Mulatu, Ph.D., M.P.H. The MayaTech Corporation
Context for the experiment?
William E. Pollard, Ph.D. Centers for Disease Control and Prevention
2007 Household Travel Survey
A Comparison of Two Nonprobability Samples with Probability Samples
Conversely Mixed Mode in the Swedish Crime Survey Sanna Wallin, researcher The Swedish National Council for Crime Prevention Thank you! It’s very nice.
Market Research Unit 5 - slide 13.
Module 9 Designing and using EFGR-responsive evaluation indicators
Chapter 4 Marketing Research
Collecting Data with Surveys and Scientific Studies
of use among different online groups.
American Driving Survey: 2014 — 2015 September 2016
Manual Dialing Solution to Minimize TCPA Risk
The Telephone Consumer Protection Act
Planning efficient recruitment
Churches on the Digital Cloud
SESRI Workshop on Survey-based Experiments
The FCC’s Work on Robocalls
SESRI Workshop on Survey-based Experiments
AFTER 20 YEARS, IT’S TIME TO UPDATE THE TELEPHONE CONSUMER PROTECTION ACT (TCPA). Howard Waltzman Partner
Market Research Unit 3 P3.
Update and Overview of Administrative Records for the 2020 Census
Nonresponse Bias in a Nationwide Dual-Mode Survey
The European Statistical Training Programme (ESTP)
Rapid Risk Factor Surveillance System Conference
Lecture 2: Data Collecting and Sampling
Analysis of Parental Vaccine Beliefs by Child’s School Type
Surveys of Consumers: Mixed Mode Experiments
Assessing Quality of Paradata to Better Understand the Data Collection Process for CAPI Social Surveys François Laflamme Milana Karaganis European Conference.
BMTRY 738: The Study Population
UNODC-UNECE Manual on Victimization Surveys: Content
Joanne Pascale, US Census Bureau
Results from County Extension Educator Survey January 2017
Vice President, Health Care Coverage and Access
How the Affordable Care Act Has Improved Americans’ Ability to Buy Health Insurance on Their Own Findings from the Commonwealth Fund Biennial Health Insurance.
Non-sampling Errors in Polls and Surveys
SLSA Private Loan Committee Meeting: TCPA Update
Multi-Mode Data Collection
Berrien County FACT SHEET
Health and Health Care for Blacks in the United States
“How do [they] even do that
Chapter 5: The analysis of nonresponse
New Mexico Census outreach message/messenger testing survey
Wolves of the Internet: Where do fraudsters hunt for data online?
Karen Wooten, MA Elizabeth Luman, MS Lawrence Barker, PhD
New Mexico Census outreach message/messenger testing survey
Presentation transcript:

Cell phone problem and alternative approaches Chris McCarty University of Florida PHC 6716 May, 25 2011

2010 UFSRC Surveys by Mode

AASRO Survey Labs 2010

The Cell Phone Problem

Adults versus children

Demographic differences for wireless only households (Data from NHIS January to June 2010) More than half of adults aged 25–29 years (51.3%) lived in households with only wireless telephones More than two in three adults living only with unrelated adult roommates (69.4%) were in households with only wireless telephones Nearly half of all adults renting their home (47.1%) had only wireless telephones Men (26.2%) were more likely than women (23.7%) to be living in households with only wireless telephones Adults living in poverty (39.3%) and adults living near poverty (32.9%) were more likely than higher income adults (21.7%) to be living in households with only wireless telephones Adults living in the Midwest (26.6%), South (29.3%), and West (23.5%) were more likely than adults living in the Northeast (15.8%) to be living in households with only wireless telephones Hispanic adults (34.7%) were more likely than non-Hispanic white adults (22.7%) or non-Hispanic black adults (28.5%) to be living in households with only wireless telephones.

Health differences

Issues in calling cell phones – Dual frames Typically one land line per household Typically one cell phone per person Some households have both Results must be weighted (somehow) Respondent selection for household survey potentially different between cell and landline

Issues in calling cell phones – Getting numbers For listed sample there is no problem Cell phone companies differ in the way they release numbers Numbers may not conform to geography In Europe they often do In U.S. they conform to point of purchase, not where they live (you could easily be calling at inappropriate time) Cell phones are truly mobile People may live outside area code of their cell phone number This makes overlay of census information virtually impossible Turnover of cell numbers is high

Issues in calling cell phones – Legal Telemarketing Consumer Protection Act of 1991 (TCPA) enforced by the FCC Automatic telephone dialing systems cannot be used to contact a wireless telephone number for which the called party is charged without the user's “prior express consent” The TCPA defines “automatic telephone dialing system” as equipment that has the capacity to store or produce telephone numbers to be called using a random or sequential number generator, in conjunction with dialing such numbers Interpretation - Cell phone calls should be manually dialed (what is manual?) May prevent the use of “interviewer initiated dialing” (interviewer pushes a button and the dialer places the call Europe does not have this law Problems With landline portability could call cell phone and not know it Many (if not most) survey centers use Voice over IP (VOIP) technology, so dialing manually may be impossible

Issues in calling cell phones - Other Ethical Issues Respondent may be in hazardous circumstance (driving) Respondent may be in public area Children have cell phones, but may pose as adults to get incentive Cost Typically use incentive to defray cost of call (In Europe you don’t pay for calls received) Cell phone require more attempts Built-in caller id and ringtone identifying when not in memory Disposition codes Types and distribution of call outcome are different than land line This affects calculation of response rates Cell phones are often used for business and non-business

Solution 1 –RDD-only weighted using demographics from Census/ACS/CPS Conduct RDD landline survey Weight for demographic differences Some studies suggest that “Wireless mostly” are similar to “Wireless only” Weight for differences

Solution 2 - Cell phone only weighted The reverse of previous slide I am not aware of this in practice As of 2010 a cell phone only survey would be more biased than a land line only survey Over time this may become a more realistic option This depends on changes in the trends in land line use

Solution 3 - RDD using Cell phone only for comparison BRFSS solution 2007-2009 Separate RDD and cell phone samples Cell phone complete sharing between states to address geography issue Unclear how comparison data are used to weight results

Solution 4 - RDD/Cell phone dual frame weighted and combined At national level this is being developed Use NHIS data to develop model coefficients using 13 demographic variables to assign respondents to one of three groups: Landline only Cell only Landline and cell Apply weights to ACS adults in household data to assign probability to households Apply these to BRFSS data With national sample cell completes can be “shared” across states Not so at sub-national level

Example: Child Trust Design Options Dual frame RDD Miami-Dade survey of households with children Marketing Systems group generates probabilistic sample: Listed landline (probable children) Landline RDD unlisted and listed without children RDD cell phone

Update June 2010 May 2011

Solution 5 - Address based sampling with mixed modes Likely the solution of the future Currently address information relatively comprehensive U.S. Postal Service Are those days numbered with the funding problems of USPS?

Solution 6 - Existing internet panel Knowledge Networks or Harris How will this work with Medicaid and other disadvantaged populations? Expensive? Requirement to go through a small number of companies to do surveys Too much control

Solution 7 – Social Networking Sites Increasing use of social media as channel of communication Who would initiate survey, as users or site manager (e.g. Facebook)? Create a new network recruitment mode, similar to respondent driven sampling (RDS)? According to Pew Internet & American Life Project, as of 2008:

Typical Sequential Mixed Modes (Pricing Issues) Mail – Telephone (NCQA) Mail – Telephone – Face-to-face (ACS) Telephone – Mail (BEBR – CAHPS) Face-to-face - Telephone option (CPS) Telephone – Web (Knowledge Networks) Web – Telephone (USF Carpool)

Issues with simultaneous mixed modes Predicting the mix that comes in Costs differ dramatically by mode AHCA CAHPS rolling sample Pull records from AHCA Medicaid database Records with phone number are called Records without phone number are sent mail Non-contacts from phone are sent mail