What is an Opinion Survey or Poll?

Slides:



Advertisements
Similar presentations
Research methods – Deductive / quantitative
Advertisements

GCSE Sociology Research Methods.
B121 Chapter 7 Investigative Methods. Quantitative data & Qualitative data Quantitative data It describes measurable or countable features of whatever.
Qualitative Methods Lisa Harrison: Chapter 5. Qualitative and Quantitative (74) Quantitative: Focuses on the analysis of numerical data (statistics, polling),
Polling/Surveys Lisa Harrison: Chapter 3. Surveys Useful for Gathering Five (5) Types of Information (41) Facts: age, income, etc. Perceptions: What people.
Chapter 2 – Tools of Positive Analysis
Sociological Research Chapter Two. Copyright © 2004 by Nelson, a division of Thomson Canada Outline  Why is Sociological Research Necessary?  The Sociological.
Media Effects and Public Opinion GV917. Mediated and Unmediated Opinions Mediated opinions are those which come from the mass media rather than personal.
5. The Structuring of Beliefs. Are Many Opinions Random? (re Converse) GV917.
How To Write A questionnaire
1 ©IRWIN a Times Mirror Higher Education Group, Inc., company 1997 Collecting and Using Marketing Information.
Sampling Theory and Surveys GV917. Introduction to Sampling In statistics the population refers to the total universe of objects being studied. Examples.
1 Types and Sources of Data UAPP 702 Research Methods for Urban & Public Policy Based on notes by Steven W. Peuquet, Ph.D.
Business and Management Research
How a media industry identifies audiences for its products.
Survey Methods By Shivakumaraswamy, K N
Survey Research Slides Prepared by Alison L. O’Malley Passer Chapter 7.
MANAGEMENT OF MARKETING
Market Research Sampling & reliability Aims: To recap intro to Market research – market research methods, qualitative & quantitative methods. To understand.
British Election Study Harold Clarke, David Sanders, Marianne Stewart, Paul Whiteley.
By: Christopher Prewitt & Deirdre Huston.  When doing any project it is important to know as much information about the project and the views of everyone.
Sociological Research Methods and Techniques
4.2 Statistics Notes What are Good Ways and Bad Ways to Sample?
Making Sense of the Social World 4th Edition
Research methods in psychology Simple revision points.
Methods of Media Research Communication covers a broad range of topics. Also it draws heavily from other fields like sociology, psychology, anthropology,
Data Collection Methods
CONDUCTING A SURVEY Adapted from Del, Balso Michael, and Aland Lewis D. First Steps: A Guide to Social Research. Toronto: Nelson Thomson Learning
Sampling is the other method of getting data, along with experimentation. It involves looking at a sample from a population with the hope of making inferences.
Level 1 Business Studies AS90837 Demonstrate an understanding of internal factors of a small business.
Aim: What are the types of surveys and sampling techniques used by researchers?
The 2005/06 British Election Study David Sanders Paul Whiteley Harold Clarke Marianne Stewart.
Outline 1. Definition 2. When and why to use surveys
Non-Experimental designs: Surveys Psych 231: Research Methods in Psychology.
1 Learning Objectives: 1.Understand data collection principles and practices. 2.Describe the differences between collecting qualitative and quantitative.
Psychology 2020 Introduction to Psychological Methods Unit 3 Surveys!
Market research for a start-up. LEARNING OUTCOMES By the end of this lesson I will be able to: –Define and explain market research –Distinguish between.
Public Opinion Public Opinion is the aggregation of people’ view about issues, situations, and public figures. Why is Public Opinion important? Public.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Aim: Review Session 1 for Final Exploratory Data Analysis & Types of Studies HW: complete worksheet.
Random Samples 12/5/2013. Readings Chapter 6 Foundations of Statistical Inference (Pollock) (pp )
Currently cohabiting: relationship attitudes and intentions in the BHPS. Ernestina Coast.
Journalism 614: Public Opinion & Research Design.
Outline 1.Definition 2.Three major characteristics 3.When and why to use surveys 4.Two distinct forms of survey research 5.Advantages of survey research.
Survey Research.
Interviews By Mr Daniel Hansson.
Unit 2 AS Sociology Research Methods Examination Technique.
Production and Operations Management Forecasting session II Predicting the future demand Qualitative forecast methods  Subjective Quantitative.
Survey Research. Sampling and Inference June 9, 2008 Ivan Katchanovski, Ph.D. POL 242Y-Y.
Write revision cards for the following topics: n Advantages & disadvantages of questionnaires n Advantages & disadvantages of using structured interview.
Interviews.
Survey Research And a few words about elite interviewing.
American National Election Studies ANES studies have been held in conjunction with every Presidential election since 1952 (and most off-year) Congressional.
Currently cohabiting: relationship attitudes and intentions in the BHPS. Ernestina Coast.
Organization of statistical investigation. Medical Statistics Commonly the word statistics means the arranging of data into charts, tables, and graphs.
2 February, Office hours  Georgios Tuesdays 1-2; 4-5 (A236B)  Siim Thursday 2pm-3pm (A232) Friday 10am-11am (A232)
Descriptive Research & Questionnaire Design. Descriptive Research Survey versus Observation  Survey Primary data collection method based on communication.
Primary Research HSB 4UI ISU. Primary Research Quantitative Quantify (measure) Quantify (measure) Large number of test subjects Large number of test subjects.
Level 1 Business Studies AS90837 Demonstrate an understanding of internal factors of a small business.
PREPARATION OF QUESTIONNAIRES PREPARATION OF QUESTIONNAIRES Chapter - 4 Dr. BALAMURUGAN MUTHURAMAN
Receive-Accept-Sample Model an information-processing model GV917.
Democracy and Public Opinion  Core beliefs are shared  Political attitudes differ  What is public opinion?  Public opinion is critical to democracy.
Britain Says NO: Voting in the 2011 AV Ballot Referendum Paul Whiteley Harold Clarke David Sanders Marianne Stewart.
Research in natural settings 2 Qualitative research: Surveys and fieldwork Macau University of Science and Technology.
The effects of panel conditioning on party support and political interest in Understanding Society Nicole Martin University of Essex.
Inference for Sampling
Lisa Harrison: Chapter 5
Public Opinion Belief & Behaviors.
Presentation transcript:

What is an Opinion Survey or Poll? GV917

Opinion Surveys and Polls An Opinion Survey is a conversation between people made possible by a relationship of trust between them This relationship differs in different survey modes, but it is always a ‘conversation’ and so subject to the complexities of human interaction There are different types of opinion surveys and they all have advantages and disadvantages

Factors influencing responses to surveys Relationships between interviewer and interviewee (interviewer effects) The type of survey being done (mode effects) The type of questions asked: factual, attitudinal – question wording and balance are important The subject matter of the survey – some things are easy to ask about, others much less so The order of the questions in a survey The type of responses sought – closed or open questions

An illustration of Complexities of Survey Questions: A Simple Factual Question from the European Social Survey 2002 F30 CARD 56 Using this card, if you add up the income from all sources, which letter describes your household's total net income? If you don't know the exact figure, please give an estimate. Use the part of the card that you know best: weekly, monthly or annual income. J 01 R 02 C 03 M 04 F 05 S 06 K 07 P 08 D 09 H 10 U 11 N 12 (Refused) 77 (Don’t know) 88

A Simple Factual Question from the European Social Survey 2002 - (look at Non-Response)

A Simple Attitudinal Question from the European Social Survey 2002 How interested are you in Politics? are you (READ OUT)

The Interview ‘Conversation’ Public opinion is dynamic and varied Some people are well informed and give comprehensive answers to questions; Others are not very well informed and give very sketchy answers Some people really don’t have an opinion about some issues and so will say that they don’t know or alternatively answer randomly We have to know what polls can do and what they can’t do

What can Opinion Surveys Do? Opinion surveys can measure facts about individuals quite well– their social characteristics, backgrounds and experiences They can measure people’s attitudes quite well in relation to straightforward issues concerning politics and society and their own behaviour They can give us a representative picture of what the nation is thinking about key political issues like the future of European politics If they are panels they can give us trend data about the way people think or behave over time

What Can’t Opinion Surveys Do? Opinion surveys are not good at getting in-depth narratives from people such as their life histories or detailed accounts of their time use – these should use qualitative in-depth studies They are not good at probing really complicated issues in which people need to think about things a lot before answering They have a limited ability to predict what people will do or say in the future – some things are predictable but other things not

Question Wording Effects – Rules of Thumb for drafting questions Keep questions simple not complicated “Are you interested in politics?” NOT “Are you interested in Parliamentary politics as opposed to wider issues like Global Warming or the Debt Crisis?” Avoid ambiguity “Have you travelled by air in the last year?” NOT: ‘Do you ever travel by air and by car?”

Question Wording Effects – Rules of Thumb for drafting questions Be specific not vague ‘Do you think the Conservative Government is doing a good job or a bad job?’ NOT ‘What do you think of the political situation right now?’ Avoid leading questions ‘How likely is that you will vote at the next election?’ ‘What party are you going to vote for at the next election?’

A Question Wording Experiment- the Case of Party Identification The traditional wording of the party identification question in election studies was inherited from the American National Election Study of the early 1950s, and used by Butler and Stokes in the first British Election Study in 1963. It appears in all subsequent surveys ‘Generally speaking, do you think of yourself as Labour, Conservative, Liberal Democrat (Scottish Nationalist/Plaid Cymru) or what? If respondents say ‘None’ it is followed by a supplementary question: ‘Do you generally think of yourself as a little closer to one of the parties than the others?’ This is then followed up with: Would you call yourself very strong {Party}, fairly strong, or not very strong?

Criticisms of the Traditional Partisanship Question It is too leading – it assumes people are attached to a political party, when many may not be. This may have been OK in 1963 but not any more when fewer people are attached to political parties. For analysis purposes responses to the supplementary question are often added to the responses to the first question – making the bias in analysis even bigger.

Revised Party Identification Sequence ‘Some people think of themselves as usually being a supporter of one political party rather than another. Do you usually think of yourself as being a supporter of one particular party or not?’ IF YES ‘Which party is that?’ Note this is much less leading – giving respondents ‘permission’ to say that they don’t support a party

What Difference Does it Make? Response Category Traditional wording Revised Wording None 17.1 47.8 Labour 35.9 26.9 Conservatives 26.1 18.3 Liberal Democrats 14.6 5.1 Scottish Nationalists 1.4 0.5 Plaid Cymru 0.4 0.3 Greens 0.6 UKIP 1.0 BNP 0.2 0.1 Others 1.9

Question Wording Revisited Question wording is really important. If one wants to bias answers, then it is easily done by phrasing the question in a given way. However, a biased question can still be useful. The traditional question has been used in every election study since 1963 and it will be included in the next study. Why? Because it provides a time series.

The Decline of Partisanship in Britain, 1964 to 2005

Mode Effects These are associated with different ways of administering a survey Face-to-face or ‘in-person’ surveys Telephone surveys Internet surveys Postal Surveys There are advantages and disadvantages of different modes

Face-to-Face Surveys - Advantages We can get national probability samples. This is very important for inferring the characteristics of populations from sample The interviewer can persuade individuals to participate and thus increase the response rate The interviewer can respond to individuals who don’t understand a question and clarify or explain things The interviewer can report on how the interview went – eg.was the respondent attentive or not?

Face-to-Face surveys - Disadvantages Face-to-Face surveys are very Expensive (e.g., $5500 per voter in the US National Election Study in 2004) Because they are expensive the N’s are often small – 792 voters in 2004 ANES Slooooow Moving – they take an average of 6 weeks to complete Limited Ability for Panels – that is interviewing the same people on more than one occasion One Study Only! Data Mining, Pre-Test Biases, replication is very difficult In the case of election studies there is limited or No Inter-Election surveys

MODE EFFECTS 1 Reported Party Choice in Face-to-Face and Internet Post-Election Surveys and Actual Vote in Britain, 2005 General Election

Mode Effect II - Turnout

Advantages of Internet Surveys They are cheap – in the election study the face-to-face survey costs up to ten time more than an internet survey They are fast – one can get 5,000 respondents within 48 hours on the internet while this would take 6 weeks face-to-face It is possible to do experiments (eg. Feedback to voters experiment) BUT – at the moment they are not probability samples

Conclusions Opinion Surveys are the core methodology for empirical social science and are essential for studying individuals A lot of aggregate analysis – such as modelling the relationship between the economy and behaviour is based on national data such as GDP per capita and spending by consumers which is collected by surveys But users of surveys have to know their limitations