Journalism 614: Non-Response and Cell Phone Adoption Issues
Nonresponse Declining contact and cooperation rates –Especially for “gold standard” RDD National Telephone Surveys Early research suggests the issues are rather small, with little bias on results –Examined by comparing “easy to contact” individuals to “hard to contact” –More systematic version is to compare between standard 5-day and “rigorous” survey
Accelerating Problem Survey firms reporting increasingly high rates of non-contact and non-cooperation –Americans leading increasingly busy lives –More and more unsolicited calls to home –Sophisticated technologies to avoid calls Big drop offs in last years –Call screening (I only take known callers) –Cell phones (I pay for minutes during survey)
Hard to Gauge the Effect Initial work conducted in late 90s Curtain et al - Low effort “restricted call” design versus high effort “all call” design –See no difference in population estimates Keeter et al – Two parallel surveys, one using standard 5 day vs. “rigorous” –On average, a two percentage point difference Seem to suggest that lower response rate does not effect survey quality
Non-response in this Century Lot has changed in last decade + –More legislative restrictions –More mobile technologies –More VOIP technologies Re-ran the study and found similar results comparing 5-day and rigorous –5-day – 10 call backs, one refusal conversion –Rigorous – 21 weeks, advance letters, left messages, additional call backs, etc. –Little difference in findings
The Problem of Cell Phones By 2006, 13% of cell phone only HHs –Increasing 1% every six months –Increasing 2% every six months after 2006 Bias in terms of who is missed is most prominent among young people. –“Serious coverage problem” –“Particular challenge”
Some substantial differences Big differences between cell and non-cell respondents to a range of questions Especially for issues that affect younger people, and behaviors such as voting –Register to vote? –Political knowledge? –Media usage?