Surveying Cell Phone Numbers in the United States Synthesis and Future Research Needs Paul J. Lavrakas, Ph.D. DC-AAPOR Workshop September 4, 2008

Surveying U.S. Cell Phones What did we learn today? What do we still need to learn? Cell Phone Numbers and Telephone Surveying in the US; DC-AAPOR Workshop; 09/04/082

Surveying U.S. Cell Phones Coverage and Frames ◦What to do when conducting a non-national telephone survey? ◦Is within-unit coverage an issue? ◦When will an RDD survey have nonignorable coverage error if it does not include sampling from the cell phone frame? Cell Phone Numbers and Telephone Surveying in the US; DC-AAPOR Workshop; 09/04/083

Surveying U.S. Cell Phones Sampling Designs ◦Should a cell phone sample be screened to eliminate those who also have landline service or should everyone reached by a cell phone sample be interviewed? Cell Phone Numbers and Telephone Surveying in the US; DC-AAPOR Workshop; 09/04/084

Surveying U.S. Cell Phones Cooperation and Nonresponse ◦When are response rates tied to nonignorable nonresponse? ◦Should their be a practical limit on the number of call-backs used? ◦Are refusal conversion attempts cost-effective? ◦How should remuneration and incentives be used? Cell Phone Numbers and Telephone Surveying in the US; DC-AAPOR Workshop; 09/04/085

Surveying U.S. Cell Phones Legal Issues ◦Will federal and state regulations change to allow the use of dialers in placing calls to cell phone numbers and the sending of advance text messages? Cell Phone Numbers and Telephone Surveying in the US; DC-AAPOR Workshop; 09/04/086

Surveying U.S. Cell Phones Safety and Other Ethical Issues ◦What, if any, liabilities will cell phone researchers face regarding respondent and by- stander safety? ◦What, if any, ethical imperatives should guide circumstances in which interviewers should terminate contact with someone reached on a cell phone? Cell Phone Numbers and Telephone Surveying in the US; DC-AAPOR Workshop; 09/04/087

Surveying U.S. Cell Phones Measurement and Data Quality ◦Are there circumstances under which the data quality gathered from someone on a cell phone is lower in nonignorable ways than the same data would be if gathered on a landline? Cell Phone Numbers and Telephone Surveying in the US; DC-AAPOR Workshop; 09/04/088

Surveying U.S. Cell Phones Weighting ◦What variables must be gathered during a cell phone interview to aid weighting? ◦How should a cell phone sample be weighted to integrate data with data from a landline sample? ◦What non-national population parameters should be used to adjust for nonresponse in a cell phone sample? Cell Phone Numbers and Telephone Surveying in the US; DC-AAPOR Workshop; 09/04/089

Surveying U.S. Cell Phones Costs ◦How can the Cost Per Interview in a cell phone sample be reduced without compromising data quality in nonignorable ways? Cell Phone Numbers and Telephone Surveying in the US; DC-AAPOR Workshop; 09/04/0810

Surveying U.S. Cell Phones Additional New Research Needed ◦What proportion of adults answer calls on their cell phone, as opposed to only making out- bound calls and, if they do, what proportion of the time do they do this? ◦What proportion of adults routinely shares a cell phone with someone else for receiving in- bound calls? Cell Phone Numbers and Telephone Surveying in the US; DC-AAPOR Workshop; 09/04/0811

Surveying U.S. Cell Phones Additional New Research Needed ◦Is there differential nonresponse and non- ignorable nonresponse error associated with those who have both cell phone and landline service that are sampled and interviewed via their landline versus those who are sampled and interviewed via their cell phone? ◦Does the location where someone on a cell phone is reached and the activities in which they are engaged affect the quality of the data they provide in nonignorable ways? Cell Phone Numbers and Telephone Surveying in the US; DC-AAPOR Workshop; 09/04/0812

Surveying U.S. Cell Phones Additional New Research Needed ◦If cell phone surveys need to deploy within-unit respondent selection, what is the best procedure to use? Cell Phone Numbers and Telephone Surveying in the US; DC-AAPOR Workshop; 09/04/0813

Surveying U.S. Cell Phones Additional Q&A Cell Phone Numbers and Telephone Surveying in the US; DC-AAPOR Workshop; 09/04/0814

Surveying U.S. Cell Phones Thank you! Cell Phone Numbers and Telephone Surveying in the US; DC-AAPOR Workshop; 09/04/0815