© Marek Fuchs, Universität Kassel The Video-Enhanced Web Survey Data Quality and Cognitive Processing of Questions Marek Fuchs University of Kassel, Germany.

Slides:



Advertisements
Similar presentations
Sampling and Response: The experience of conducting an online student survey. Donna Poade.
Advertisements

1 NEW YORK CHIGAGO DETROIT SAN FRANCISCO LONDON PARIS HAMBURG.
Survey Methodology Nonresponse EPID 626 Lecture 6.
Self-Administered Surveys: Mail Survey Methods ChihChien Chen Lauren Teffeau Week 10.
Descriptive Research methods Dr. Surej P John. Main Topics Conceptual Framework Hypothesis development Descriptive research methods Survey Observation.
Chapter 11: Collecting Data by Communication. Key Issues for Collecting Information by Communication.
1 Health Surveys January 2008 Diane Martin, MA, PhD.
Research methods – Deductive / quantitative
What determines student satisfaction with university subjects? A choice-based approach Twan Huybers, Jordan Louviere and Towhidul Islam Seminar, Institute.
Survey Design Steps in Conducting a survey.  There are two basic steps for conducting a survey  Design and Planning  Data Collection.
Survey Questionnaire Research
The Information Content of Initial Firm Rating Announcements Paper Presenter: Chih-Hsiang Chang Department of Finance National University of Kaohsiung.
Online Mass Customization and the Customer Experience Arnold Kamis, Bentley College Marios Koufaris, Baruch College Tziporah Stern, Baruch College NJIT.
Social Presence in Web Surveys by Mick P. Couper, Roger Tourangeau, Darby M. Steiger presented by Neal Audenaert.
1 A Comparison of Traditional, Videoconference-based, and Web-based Learning Environments A Dissertation Proposal by Ming Mu Kuo.
Information Seeking Behavior of Scientists Brad Hemminger School of Information and Library Science University of North Carolina at Chapel.
Social Science Department
Company LOGO B2C E-commerce Web Site Quality: an Empirical Examination (Cao, et al) Article overview presented by: Karen Bray Emilie Martin Trung (John)
Meeting Scheduling in Higher Education An Experimental Design & Evaluation CS 294 Fall 2001 Sabrina Hsueh Saifon Obromsook Juha Johansson Stephen Morris.
Privacy & Self-disclosure online: Implications for Web surveys Carina Paine (1), Adam Joinson (1), Tom Buchanan (2) & Ulf-Dietrich Reips (3) (1) The Open.
CJ 526 Statistical Analysis Research methods and statistics.
2/9/00 Survey Methodology Survey Design EPID 626 Lecture 5.
Online Research An introduction to the use of the internet in primary marketing research.
The PULSE: SAAS (Software as a Service) By Debjit Biswas, ,
EMR 6500: Survey Research Dr. Chris L. S. Coryn Kristin A. Hobson Spring 2013.
ICT TEACHERS` COMPETENCIES FOR THE KNOWLEDGE SOCIETY
25 th September 2009 Managing Cross-Organisational Research Teams Aaron Jarden.
Understanding Web Completion in a Survey of New Businesses David DesRoches Tom Barton Janice Ballou Third International Conference on Establishment Surveys.
Estimating the Market for Internet Service Provider-Based Cyber Security Solutions Brent Rowe – RTI International Doug Reeves – NC State University Dallas.
Survey Methods By Shivakumaraswamy, K N
Introduction to Survey Research. What kind of data can I collect? Factual Knowledge Factual Knowledge Cognitive Beliefs or Perceptions Cognitive Beliefs.
Market Research Results for East Devon AONB 8 th March 2013.
Please use the following two slides as a template for your presentation at NES. Analyze, Visualize & Socialize to Integrate Your Property Management System.
Assessment of Staff Needs and Satisfaction in an Evergreen Environment David Green NC Cardinal Consultant State Library of North Carolina.
Comparing the Effectiveness of Alternative Approaches for Displaying Edit-Error Messages in Web Forms Bill Mockovak Office of Survey Methods Research Bureau.
Data gathering. Overview Four key issues of data gathering Data recording Interviews Questionnaires Observation Choosing and combining techniques.
©2007, Harris Interactive Inc. All rights reserved. Anheuser-Busch Support For Education vs. Restrictions January 27, 2009 Revised.
Online Research An introduction to the use of the internet in primary marketing research.
Chapter 29 conducting marketing research Section 29.1
1 Politeness Effect: Pedagogical Agents and Learning Gains 報 告 人:張純瑋 Wang, N., Johnson, W.L., Mayer, R.E., Rizzo, P., Shaw, E., and Collins, H. (2005).
Use of new technologies in first year biology teaching Mary Peat, Sue Franklin, Rob Mackay-Wood & Aida Yalcin School of Biological Sciences,
Is research in education important?. What is the difference between Qualitative and Quantitative Research Methods?
Seungwon Yang, Haeyong Chung, Chris North, and Edward A. Fox Virginia Tech, Blacksburg, VA USA 1ETD 2010, June 16-18, Austin, TX.
AIR 2000 On-line vs. Paper-and-Pencil Surveying of Students’ Willingness to Re-enroll: A Case Study Phil Handwerk, Cristi Carson, and Karen Blackwell University.
Advanced FrontPage Forms, Page Templates and Wizards, Behaviors, CSS, DWT and Page Layout.

Introduction Disordered eating continues to be a significant health concern for college women. Recent research shows it is on the rise among men. Media.
Teens, Social Networks & Safety An Overview Amanda Lenhart Family Online Safety Institute Launch February 13, 2007 Washington, DC.
Sociological Research Methods. Survey Research - Interview - Questionnaire - Closed- end Questions - Open- ended Questions.
Questionnaires Questions can be closed or open Closed questions are easier to analyze, and may be done by computer Can be administered to large populations.
McGraw-Hill/IrwinCopyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved. SURVEYS Chapter 10.
CHAPTER 3: METHODOLOGY.
What is Communication?. Types of Communication Intrapersonal Interpersonal Small Group Public Mass On-line.
All or Nothing: Levels of Sociability of a Pedagogical Software Agent and its Impact on Student Perceptions and Learning. 報 告 人:張純瑋 Dirkin, K., Mishra,
1 Cognitive Aspects Associated with Sample Selection Conducted by Respondents in Establishment Surveys La Toya Barnett Thomas Rebecca L. Morrison Grace.
Measuring Time Preference and the Elasticity of Intertemporal Substitution with Web Surveys Miles S. Kimball, Claudia R. Sahm and Matthew D. Shapiro October.
Data gathering (Chapter 7 Interaction Design Text)
The measurement and comparison of health system responsiveness Nigel Rice, Silvana Robone, Peter C. Smith Centre for Health Economics, University of York.
Action Research: Resistance to Computer Training Suzanne Stear BTST 656 – May 8, 2013.
Research Methodology Lecture No :32 (Revision Chapters 8,9,10,11,SPSS)
1. 2 Issues in the Design and Testing of Business Survey Questionnaires: Diane K. Willimack U.S. Census Bureau Economic Census The International.
Continuing Education Provincial Survey Winter 2012 Connie Phelps Manager, Institutional Research & Planning.
UKZN Employee Engagement Survey – 2013 Overall Report 1.
Step Up to Quality Pilot Data Presentation of Step Up to Quality Pilot Data Cynthia K. Buettner, Ph.D. July 25, 2006.
Summary of presentation Introduction of the dissertation.
Improving Survey Response Rates: The Effect of Embedded Questions in Web Survey Invitations Nick Inchausti, SurveyMonkey Mingnan Liu, Facebook.
Effects of Design in Web Surveys
Chapter Two: Review of the Literature
What drives merger waves? Jarrad Harford 汇报人 孙毅.
Salience of Survey Burden and Its Effects on Response Behavior
Presentation transcript:

© Marek Fuchs, Universität Kassel The Video-Enhanced Web Survey Data Quality and Cognitive Processing of Questions Marek Fuchs University of Kassel, Germany

Humanizing Elements in Survey Data Collection © Marek Fuchs, Universität Kassel

Introduction  Layout kept constant  Same location for text and video  Response scale identical

Social Interface Theory  „Computers as social actors” (Reeves & Nass, 1997) Respondents ascribe social properties to computers React to questions administered by computers similarly to interviews with human interviewers.  Hypotheses Higher levels of social presence More pronounced social desirability Increased underreporting of sensitive information © Marek Fuchs, Universität Kassel

Survey Methods Research  Survey methodology AV-CASI: More positive responses to sensitive questions (Katz et al., 2007) AV-CASI: Less contaminated by social desirability (Gerich, 2007) Web surveys: marginal effects of humanizing elements (Couper, Tourangeau, & Steiger, 2003)  Hypotheses Anthropomorphizing elements increase respondents‘ motivation and involvement Audio-visual channel will promote comprehensive question understanding Increased reporting © Marek Fuchs, Universität Kassel

Methods  Universe Student online access panel at the University of Kassel, Germany  Sample N = (880 for this experiment) Response rate (within the panel): 49%  Field work Summer 2007, invitation and 2 reminders Incentive: lottery drawing of book vouchers  Experiment Text vs. video/male vs. female Between subjects design  Fuchs/Funke 2007, 2008

Results © Marek Fuchs, Universität Kassel

Results © Marek Fuchs, Universität Kassel

Structural Equation Models for Text vs. Video  Text-based version Negative effect -Social presence -Social desirability Positive effect -Question understanding -Flow  Video-enhanced version No effect -Social desirability -Question understanding Positive Effect -Social presence -Flow © Marek Fuchs, Universität Kassel

Summary  Video version vs. text version Social presence lower in video version Social desirability does not differ Message understanding does not differ Slightly higher flow in the video version

Summary  Video and text version yield similar results No overall differences for sensitive behaviors  However, the cognitive processes differ Text version -Social presence and social desirability promote underreporting -Question understanding and flow increases reporting Video version -Social presence and flow increase reporting -Social desirability and message understanding have no effect © Marek Fuchs, Universität Kassel

Discussion  Implications It is not only the visual presence of the interviewer It is also the communicative channel used to convey the question meaning  Caveats Student population restricts generalization Backchannel is keyboard and mouse only  Next steps More active interviewer behavior Heterogeneity of interviewer „Choose your interviewer“

© Marek Fuchs, Universität Kassel End Thank you! Marek Fuchs University of Kassel, Germany