Cell phone problem and alternative approaches Chris McCarty University of Florida PHC 6716 May, 25 2011.

Slides:



Advertisements
Similar presentations
Strategies for Increasing Efficiency of Cellular Telephone Samples Kurt Peters 1, William Robb 1, Cristine Delnevo 2, Daniel A. Gundersen 2 March 2014.
Advertisements

Internet Survey Methods. Sources of Error in Internet Surveys Coverage Error Mismatch between frame and target populations Web users not representative.
Recent Improvements for Dual-Frame RDD Sampling Methodology 29 th Annual Meeting March 26, 2012.
Connect Nevada Residential Technology Assessment Results.
POPULATION RESEARCH SEMINAR SERIES Sponsored by the Statistics and Survey Methods Core of the U54 Partnership Post Survey Adjustments Lee Hargraves, Ph.D.
An Assessment of the Impact of Two Distinct Survey Design Modifications on Health Insurance Coverage Estimates in a National Health Care Survey Steven.
Providing Insights that Contribute to Better Health Policy Trends in the Uninsured: Impact and Implications of the Current Economic Environment Len Nichols,
1 Sampling Telephone Numbers and Adults, and Interview Length, and Weighting in the California Health Survey Cell Phone Pilot Study J. Michael Brick, Westat.
STATISTICS FOR MANAGERS LECTURE 2: SURVEY DESIGN.
Challenges to Surveys Non-response error –Falling response rates over time Sample coverage –Those without landline telephones excluded –Growing.
Asthma Prevalence in the United States
Does Background Music Influence What Customers Buy?
1 Diversity & Civil Rights Workshop State of Broadband Adoption John B. Horrigan October 2, 2009.
Two Emerging Issues in Epidemiologic Research Access to populations for epidemiologic study Side effects of specialization.
Examining Best Practices for Sampling and Weighting Dual Frame Surveys Liz Kantor Advised by Dr. David Redlawsk Rutgers, The State University of New Jersey.
Knowledge is Power Marketing Information System (MIS) determines what information managers need and then gathers, sorts, analyzes, stores, and distributes.
Error and Sample Sizes PHC 6716 June 1, 2011 Chris McCarty.
Asthma Prevalence in the United States National Center for Environmental Health Division of Environmental Hazards and Health Effects June 2014.
Recurring Survey Data Sets Christopher McCarty PHC6716 June 29, 2011.
The Market Research Process
Trying Out New Survey Techniques – Lessons Learned 2013 Northwest Hazardous Materials Management Conference Liz Tennant, Strategic Advisor, Office of the.
Wireless Substitution: Semiannual Estimates from the NHIS ER Program Centers for Disease Control and Prevention National Center for Health Statistics Stephen.
Proactive Changes to the TCPA – It’s All about Communication Balaji “Raj” Rajan, Ceannate Corp James Schultz, The Sessions Firm Timothy Fitzgibbon, NCHER.
How America Shops & Spends 2014
The Market Research Process
How to conduct a network scale-up survey Christopher McCarty and H. Russell Bernard University of Florida February, 2009 © 2009 Christopher McCarty and.
COVERAGE AND SAMPLING Damon Burton University of Idaho.
Trends in Teen Communication and Social Media Use: What’s Really Going On Here? Wednesday, February 9, 2011 Kimberlee Salmond Senior Researcher Girl Scout.
Addressed Based Sampling as an Alternative to Traditional Sampling Approaches: An Exploration May 6, 2013.
KY Module 2 Household Travel Surveys Chapter 6 of TS Manual.
Telephone Surveys: Challenges for the Future Clyde Tucker Bureau of Labor Statistics.
1 Partner Solutions - Technology Tools for Better, Faster, Smarter Handling of Your Receivables.
THE MARKET RESEARCH PROCESS Chapter Steps of the Market Research Process 1. Define the Problem 2. _____________________ 3. Analyzing Data 4. Recommending.
Marketing Systems Group Southern California MRA Education Seminar Presentation September 17, 2005 Privacy and Current Issues.
Multiple Indicator Cluster Surveys Survey Design Workshop Sampling: Overview MICS Survey Design Workshop.
The Usage and Value of Local Search Sources comScore study findings / marketer application Stuart McKelvey, CEO - TMP Directional Marketing Search with.
Level 1 Business Studies AS90837 Demonstrate an understanding of internal factors of a small business.
American Community Survey (ACS) 1 Oregon State Data Center Meeting Portland State University April 14,
Chapter 6: Getting the Marketing Information We Need.
Panel Study of Entrepreneurial Dynamics Richard Curtin University of Michigan.
Small Area Health Insurance Estimates (SAHIE) Program Joanna Turner, Robin Fisher, David Waddington, and Rick Denby U.S. Census Bureau October 6, 2004.
Louisiana Health Insurance Survey, Provides detailed data on Louisiana’s uninsured population Assists in planning programs and targeting outreach.
Standard 3 - Marketing Information Management What you’ll learn: Describe the need for Marketing Information Understand marketing-research activities Understand.
Growing Challenges to State Telephone Surveys of Health Insurance Coverage: Minnesota as a Case Study Supported by a grant from the Minnesota Department.
The Challenge of Non- Response in Surveys. The Overall Response Rate The number of complete interviews divided by the number of eligible units in the.
U.S. Hispanic Population: 1999 Helping You Make Informed Decisions.
Teen Content Creators Shown at “The Power of Youth Voice:
Testing for Coverage Bias when Combining Directory-Listed And Cellphone Samples T. M. Guterbock, A. Diop, J. M. Ellis, J. L. P. Holmes and K. T. Le, Center.
Surveying Cell Phone Numbers in the United States Synthesis and Future Research Needs Paul J. Lavrakas, Ph.D. DC-AAPOR Workshop September 4, 2008.
PewInternet.org Asian-Americans and Technology Organization for Chinese Americans Wiltshire & Grannis January 6, 2011 Lee Rainie: Director, Pew Internet.
Effects of Sampling and Screening Strategies in an RDD Survey Anthony M. Roman, Elizabeth Eggleston, Charles F. Turner, Susan M. Rogers, Rebecca Crow,
The Use of Random Digit Dialing in Household Surveys: Challenges and Changes Chris Chapman 2008 IES Research Conference Washington, DC June 11, 2008
1 of 22 INTRODUCTION TO SURVEY SAMPLING October 6, 2010 Linda Owens Survey Research Laboratory University of Illinois at Chicago
Response rates and disposition coding PHC 6716 June 8, 2011 Chris McCarty.
Level 1 Business Studies AS90837 Demonstrate an understanding of internal factors of a small business.
Presented by: Khaleel S. Hussaini PhD Bureau Chief, Public Health Statistics Division of Public Health Preparedness Judy Bass Arizona’s BRFSS Coordinator.
1 Assessment of Potential Bias in the National Immunization Survey (NIS) from the Increasing Prevalence of Households Without Landline Telephones Meena.
E-Reading Rises as Device Ownership Jumps BY: KATHERINE ZICKUHR AND LEE RAINIE.
Washington State Department of Health Center for Health Statistics December 19, 2013 If you haven’t registered for this GoToWebinar, use this link: JoinWebinar.com.
Data Collecting Techniques Telephone interviews Traditional telephone interviews involve phoning a sample of respondents and asking them a series.
Weighting and imputation PHC 6716 July 13, 2011 Chris McCarty.
SESRI Workshop on Survey-based Experiments
Manual Dialing Solution to Minimize TCPA Risk
SESRI Workshop on Survey-based Experiments
The FCC’s Work on Robocalls
AFTER 20 YEARS, IT’S TIME TO UPDATE THE TELEPHONE CONSUMER PROTECTION ACT (TCPA). Howard Waltzman Partner
Cell phone problem and alternative approaches
Analysis of Parental Vaccine Beliefs by Child’s School Type
Surveys of Consumers: Mixed Mode Experiments
SLSA Private Loan Committee Meeting: TCPA Update
Presentation transcript:

Cell phone problem and alternative approaches Chris McCarty University of Florida PHC 6716 May,

2010 UFSRC Surveys by Mode

AASRO Survey Labs 2010

The Cell Phone Problem

Adults versus children

Demographic differences for wireless only households (Data from NHIS January to June 2010) More than half of adults aged 25–29 years (51.3%) lived in households with only wireless telephones More than two in three adults living only with unrelated adult roommates (69.4%) were in households with only wireless telephones Nearly half of all adults renting their home (47.1%) had only wireless telephones Men (26.2%) were more likely than women (23.7%) to be living in households with only wireless telephones Adults living in poverty (39.3%) and adults living near poverty (32.9%) were more likely than higher income adults (21.7%) to be living in households with only wireless telephones Adults living in the Midwest (26.6%), South (29.3%), and West (23.5%) were more likely than adults living in the Northeast (15.8%) to be living in households with only wireless telephones Hispanic adults (34.7%) were more likely than non-Hispanic white adults (22.7%) or non- Hispanic black adults (28.5%) to be living in households with only wireless telephones.

Health differences

Issues in calling cell phones – Dual frames Typically one land line per household Typically one cell phone per person Some households have both Results must be weighted (somehow) Respondent selection for household survey potentially different between cell and landline

Issues in calling cell phones – Getting numbers For listed sample there is no problem Cell phone companies differ in the way they release numbers Numbers may not conform to geography – In Europe they often do – In U.S. they conform to point of purchase, not where they live (you could easily be calling at inappropriate time) Cell phones are truly mobile – People may live outside area code of their cell phone number – This makes overlay of census information virtually impossible Turnover of cell numbers is high

Issues in calling cell phones – Legal Telemarketing Consumer Protection Act of 1991 (TCPA) enforced by the FCC Automatic telephone dialing systems cannot be used to contact a wireless telephone number for which the called party is charged without the user's “prior express consent” The TCPA defines “automatic telephone dialing system” as equipment that has the capacity to store or produce telephone numbers to be called using a random or sequential number generator, in conjunction with dialing such numbers Interpretation - Cell phone calls should be manually dialed (what is manual?) May prevent the use of “interviewer initiated dialing” (interviewer pushes a button and the dialer places the call Europe does not have this law Problems – With landline portability could call cell phone and not know it – Many (if not most) survey centers use Voice over IP (VOIP) technology, so dialing manually may be impossible

Issues in calling cell phones - Other Ethical Issues – Respondent may be in hazardous circumstance (driving) – Respondent may be in public area – Children have cell phones, but may pose as adults to get incentive Cost – Typically use incentive to defray cost of call (In Europe you don’t pay for calls received) – Cell phone require more attempts – Built-in caller id and ringtone identifying when not in memory Disposition codes – Types and distribution of call outcome are different than land line – This affects calculation of response rates – Cell phones are often used for business and non-business

Solution 1 –RDD-only weighted using demographics from Census/ACS/CPS Conduct RDD landline survey Weight for demographic differences Some studies suggest that “Wireless mostly” are similar to “Wireless only” – Weight for differences

Solution 2 - Cell phone only weighted The reverse of previous slide I am not aware of this in practice As of 2010 a cell phone only survey would be more biased than a land line only survey Over time this may become a more realistic option This depends on changes in the trends in land line use

Solution 3 - RDD using Cell phone only for comparison BRFSS solution Separate RDD and cell phone samples – Cell phone complete sharing between states to address geography issue Unclear how comparison data are used to weight results

Solution 4 - RDD/Cell phone dual frame weighted and combined At national level this is being developed Use NHIS data to develop model coefficients using 13 demographic variables to assign respondents to one of three groups: 1.Landline only 2.Cell only 3.Landline and cell Apply weights to ACS adults in household data to assign probability to households Apply these to BRFSS data With national sample cell completes can be “shared” across states Not so at sub-national level

Example: Child Trust Design Options Dual frame RDD Miami-Dade survey of households with children Marketing Systems group generates probabilistic sample: – Listed landline (probable children) – Landline RDD unlisted and listed without children – RDD cell phone

Update June 2010 May 2011

Solution 5 - Address based sampling with mixed modes Likely the solution of the future Currently address information relatively comprehensive – U.S. Postal Service – Are those days numbered with the funding problems of USPS?

Solution 6 - Existing internet panel Knowledge Networks or Harris How will this work with Medicaid and other disadvantaged populations? Expensive? Requirement to go through a small number of companies to do surveys – Too much control

Solution 7 – Social Networking Sites Increasing use of social media as channel of communication Who would initiate survey, as users or site manager (e.g. Facebook)? Create a new network recruitment mode, similar to respondent driven sampling (RDS)? According to Pew Internet & American Life Project, as of 2008:

Typical Sequential Mixed Modes (Pricing Issues) Mail – Telephone (NCQA) Mail – Telephone – Face-to-face (ACS) Telephone – Mail (BEBR – CAHPS) Face-to-face - Telephone option (CPS) Telephone – Web (Knowledge Networks) Web – Telephone (USF Carpool)

Issues with simultaneous mixed modes Predicting the mix that comes in – Costs differ dramatically by mode AHCA CAHPS rolling sample – Pull records from AHCA Medicaid database – Records with phone number are called – Records without phone number are sent mail – Non-contacts from phone are sent mail