Journalism 614: Concept Explication. Research Concepts  What do we mean when we want to study… –Prejudice?, Participation?, or Patriotism?  Research.

Slides:



Advertisements
Similar presentations
Allyn & Bacon 2003 Social Work Research Methods: Qualitative and Quantitative Approaches Topic 7: Basics of Measurement Examine Measurement.
Advertisements

Chapter 11 Direct Data Collection: Surveys and Interviews Zina OLeary.
Developing a Questionnaire
What is a Survey? A scientific social research method that involves
Conceptualization and Measurement
Research Methodology Lecture No : 11 (Goodness Of Measures)
Surveys and Questionnaires. How Many People Should I Ask? Ask a lot of people many short questions: Yes/No Likert Scale Ask a smaller number.
Designing Research Concepts, Hypotheses, and Measurement
QUESTIONNAIRES ORANGE BOOK CHAPTER 9. WHAT DO QUESTIONNAIRES GATHER? BEHAVIOR ATTITUDES/BELIEFS/OPINIONS CHARACTERISTICS (AGE / MARITAL STATUS / EDUCATION.
Indexes, Scales and Typologies. Content validity Achieved by including all the dimensions of a concept Most non-demographic variables require more than.
Designing and Analyzing Questionnaires
Measurement and Observation. Choices During Operationalization Researchers make a number of key decisions when deciding how to measure a concept Researchers.
CH. 9 MEASUREMENT: SCALING, RELIABILITY, VALIDITY
Scaling, Reliability and Validity
Measurement in Marketing Research. Ch 102 Basic Question-Response Formats Open-ended Closed-ended Scaled-response.
Survey Design & Item Construction Lindsay Couzens, M.S. UNLV’s 2009 Academic Assessment Workshop May 14 th & 15 th.
MEASUREMENT. Measurement “If you can’t measure it, you can’t manage it.” Bob Donath, Consultant.
Beginning the Research Design
1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION.
Chapter10 Measurement in Marketing Research. The Measurement Process Empirical System (MKT Phenomena) Abstract System (Construct) Number System measurement.
Social Research Methods: Qualitative and Quantitative Approaches, 5e
Survey Research Definition Importance of
Chapter 9 Descriptive Research. Overview of Descriptive Research Focused towards the present –Gathering information and describing the current situation.
Survey Research. Structured interview of: Structured interview of: Sample of individuals in order to generalize to a larger population Sample of individuals.
Non-true-experimental Designs PSY 231 Research Methods in Psychology.
Measuring Social Life Ch. 5, pp
1 Major topics to be addressed  Types of research  Fundamental concepts.
© 2001 Dr. Laura Snodgrass, Ph.D.1 Non-experimental Methods Observation and Survey Research.
The Practice of Social Research
Indexes, Scales, and Typologies
Measurement and Scaling
MEASUREMENT OF VARIABLES: OPERATIONAL DEFINITION AND SCALES
Overview of Survey Research Methods  Large-scale research design procedures for collecting large amounts of raw data using questionnaires.
Chapter 7: surveys.
ASSESSMENT OF STUDENT LEARNING Manal bait Gharim.
Data Collection Methods
6. Conceptualization & Measurement
Measurement Cameron G. Thies University of Iowa. The Measurement Process What is measurement? – The process of assigning numbers or labels to units of.
Chapter 12 Survey Research.
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
Chapter Thirteen Measurement Winston Jackson and Norine Verberg Methods: Doing Social Research, 4e.
4.12 U NDERSTAND DATA - COLLECTION METHODS TO EVALUATE THEIR APPROPRIATENESS FOR THE RESEARCH PROBLEM / ISSUE Understand promotion and intermediate.
1 Learning Objectives: 1.Understand data collection principles and practices. 2.Describe the differences between collecting qualitative and quantitative.
Designing Survey Instruments. Creating a Survey Instrument  Survey instruments should help researchers collect the most accurate data and reach the most.
Learning Objectives Copyright © 2002 South-Western/Thomson Learning Using Measurement Scales to Build Marketing Effectiveness CHAPTER ten.
March 22,2007Lisa A. Lauxman, Ph.D On-Line Surveys Arizona Cooperative Extension Professional Development Workshop.
RESEARCH METHODS Lecture 15. MEASUREMENT OF CONCEPTS.
Measurement Theory in Marketing Research. Measurement What is measurement?  Assignment of numerals to objects to represent quantities of attributes Don’t.
Creating A Good Questionnaire
Methods of Data Collection Survey Methods Self-Administered Questionnaires Interviews Methods of Observation Non-Participant Observation Participant Observation.
Creating A Good Questionnaire IB Geography. Advantages and Disadvantages of Questionnaires Advantages –Can assess a large group quickly –Easy to analyze.
Journalism 614: Survey Research. Survey Research  Structured interview of: –Sample of individuals in order to generalize to a larger population  Survey.
Quantitative Data Collection In Advertising Research.
Quantitative and Qualitative Methods Sebastian M. Rasinger Research Methods in Linguistics. An Introduction. Second Edition London: Bloomsbury S.M.Rasinger.
Concept Explication.
By Dr Hidayathulla Shaikh. Objectives  At the end of the lecture student should be able to –  Define survey  Mention uses of survey  Discuss types.
Evidence Based Practice & Research in Nursing Level 8, Academic Year (AY) 1434—1435 H Vanessa B. Varona, RN, MAN.
DESIGNING GOOD SURVEYS Laura P. Naumann Assistant Professor of Psychology Nevada State College.
Measurement of Attitude
Concept Explication.
Measurement and Observation
Survey Research.
Journalism 614: Survey Research
Data Collection Methods
Research strategies & Methods of data collection
Measuring Social Life: How Many? How Much? What Type?
RESEARCH METHODS Lecture 15
Research strategies & Methods of data collection
4.13 Explain characteristics of effective data-collection instruments.
Presentation transcript:

Journalism 614: Concept Explication

Research Concepts  What do we mean when we want to study… –Prejudice?, Participation?, or Patriotism?  Research concepts –Labels given to: Objects and ideas –Basic functions of concepts: Organize our everyday experiences Facilitate communication with others –Research functions of concepts: Classification Comparison –Require careful explicit definitions Conceptual Operational

Desirable Concept Qualities  Abstractness –applies to more than one case  Clarity –label conveys the meaning of the concept  Operationalizability –translates into observation  Precision –Exact, consistent, and reproducible

Concept Explication  The process by which abstract concepts are systematically linked to observed variations in those concepts in the real world –Conceptual definitions Essential properties the researcher intends to be included within the concepts meaning –Operational definitions Procedures by which the concept is to be observed, measures, or manipulated

Processes of Concept Explication Meaning Analysis Empirical Analysis Observation

Meaning Analysis  Logical procedures are used to: –define concepts clearly –connect conceptual and operational definitions  Stages: –Preliminary identification of concept –Literature review –Empirical description –Define conceptually –Define operationally –Data gathering

Concepts, Dimensions, Indicators

Reconstructing Concept Definitions

Relationship Between Theory and Research

Measuring Concepts: Operationalization  Simple concepts: –Can be measured with single items –E.g., gender, age  Complex concepts have many dimensions –Necessitating multiple items –Items get combined in indexes or scales –E.g., SES, Racism

Value of Using Multiple Items  1. Capturing various dimensions –Representing the complexity of the concept –Capturing range, depth and complexity of an opinion  2. Creating a more sensitive measure  3. Scales reduce complex info from multiple items  4. Assessing reliability of items –Items measuring the same concept should be correlated

Likert items  Likert scale items: –Statements with range of responses: Strongly agree, agree, neutral, disagree, strongly disagree –Alternative: Averaging responses across multiple items: –“ I am interested in politics ” –“ Elections are fascinating ”  Strength and direction of opinions –Can be used to compare: People Items

Semantic differential items  Paired antonyms –Fast vs. slow, good vs. bad –Subjects allowed to indicate gradations on continuum –Scales from matched pairs of antonyms: Brave vs. Cowardly, Unafraid vs. Afraid

Forced choice alternatives  Useful when agreement is high due to social desirability: –Which would you prefer, hiring more teachers or police officers? Measures whether education or crime is seen as a more important issue –People often agree with both; forced to choose

Thermometer scales

Open-ended vs. Closed-ended  Open: –E.g., What is the most important reason you watch reality shows?_____________________  Closed: –E.g., On a five-point scale, how much do you agree or disagree with the following statements: “ I watch reality shows to escape daily stress ” “ I watch reality shows to bond with my friends ” “ I watch reality shows to learn about life ”

Problematic questions:  Social desirability –“ On a scale from 1 to 10, how comfortable are you working with people from other ethnic backgrounds? ”  Pseudo-opinions –“ Do you agree with U.S. policy in the Balkans? ”  Hypothetical questions lack valid answers –“ If you won the lottery, would you quit your job? ”  Leading questions –“ Should the government increase funding for education in order to improve our schools? ”

More problematic questions:  Double-barreled questions –“ Do you favor building new schools and increasing money for teachers? ”  Question-ordering –“ Have you been a victim of a crime in the last year? ” –“ What ’ s the most important problem facing the country? ”  Questions requiring difficult mental calculus –“ On the average, how many minutes per day do you spend composing messages? ”

Interviewing  Training interviewers how to accurately collect data and complete a survey –Two parts: (1) preparing for basics of interviewing and (2) learning the specific interview questionnaire –Best learned through experience A mutual exchange between interviewer/interviewee

Interviewing Skills  Interviewing is an communication skill  Interviewing is a learned skill –Read interviewing instructions –Read and listen to instructions –Practice with someone else –Be positive and confident –Edit each interview immediately afterwards

Questionnaire Construction  Objective: –To develop a standardized instrument: gathers reliable and valid information –To elicit a response: accurately and completely reflects each respondent ’ s position or behavior –To help the interviewer: motivate respondent to build and maintain “ rapport ”

Question Wording  Language: Need to approximate general parlance –Must communicate with least sophisticated without appearing over-simplified to most sophisticated  Frame of reference: Words have multiple meanings –Words like “ news ” can mean many things  Information level: Complexity of language –Confusing terms and technical language - Ex. “ Cookies ”  Skewed phrasing: Biases response in a direction –Ex. “ Feed the starving homeless women and children ”

Questionnaire Construction  Length: –:30 for telephone, longer for personal/self-administered  Ordering: –Put easy questions first, funnel toward specific –Save sensitive question for later  Transitions: –Ease them from one section to another  Probes: –Encouragement, Explanation, Emphasis, Instruction