Operationalizing Concepts Issues in operationally defining your concepts, validity, reliability and scales.

Slides:

Advertisements

Similar presentations

Ch 5: Measurement Concepts

Advertisements

Taking Stock Of Measurement. Basics Of Measurement Measurement: Assignment of number to objects or events according to specific rules. Conceptual variables:

MEASUREMENT CONCEPTS © 2012 The McGraw-Hill Companies, Inc.

4/25/2015 Marketing Research 1. 4/25/2015Marketing Research2 MEASUREMENT  An attempt to provide an objective estimate of a natural phenomenon ◦ e.g.

Part II Sigma Freud & Descriptive Statistics

CH. 9 MEASUREMENT: SCALING, RELIABILITY, VALIDITY

5/15/2015Marketing Research1 MEASUREMENT  An attempt to provide an objective estimate of a natural phenomenon ◦ e.g. measuring height ◦ or weight.

RELIABILITY & VALIDITY What is Reliability? What is Reliability?What is Reliability?What is Reliability? How Can We Measure Reliability? How Can We Measure.

RELIABILITY & VALIDITY

MEASUREMENT. Measurement “If you can’t measure it, you can’t manage it.” Bob Donath, Consultant.

Definition & Measurement “measurement is the beginning of science, … until you can measure something, your knowledge is meager and unsatisfactory” Lord.

Beginning the Research Design

Measurement Concepts. CONSTRUCT VALIDITY OF MEASURES Indicators of Construct Validity Face validity Aggression questionnaire Not enough to really determine.

Chapter 4: Conceptualization & Measurement

Lecture 7 Psyc 300A. Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other.

1 Measurement PROCESS AND PRODUCT. 2 MEASUREMENT The assignment of numerals to phenomena according to rules.

Measurement: Reliability and Validity For a measure to be useful, it must be both reliable and valid Reliable = consistent in producing the same results.

PSYC512: Research Methods PSYC512: Research Methods Lecture 5 Brian P. Dyre University of Idaho.

Sampling Basics 2011, 9, 13. Last Class: Measurement  Scale of measurement –Nominal scale –Ordinal scale –Interval-ratio scale  Reliability: Free of.

SOWK 6003 Social Work Research Week 5 Measurement By Dr. Paul Wong.

1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION.

1 Measurement Adapted from The Research Methods Knowledge Base, William Trochim (2006). & Methods for Social Researchers in Developing Counries, The Ahfad.

Conceptualization and Operationalization

Measurement in Survey Research MKTG 3342 Fall 2008 Professor Edward Fox.

Business Research Method Measurement, Scaling, Reliability, Validity

Collecting Quantitative Data

Slide 9-1 © 1999 South-Western Publishing McDaniel Gates Contemporary Marketing Research, 4e Understanding Measurement Carl McDaniel, Jr. Roger Gates Slides.

MEASUREMENT OF VARIABLES: OPERATIONAL DEFINITION AND SCALES

Measurement in Exercise and Sport Psychology Research EPHE 348.

Collecting Quantitative Data Creswell Chapter 6. Who Will You Study? Identify unit of analysis Specify population Describe sampling approach  Class =

1 Lecture 2: Types of measurement Purposes of measurement Types and sources of data Reliability and validity Levels of measurement Types of scale.

VALIDITY, RELIABILITY, and TRIANGULATED STRATEGIES

Measurement Neuman and Robson Ch. 6. What is it? The process of creating measurable concrete variables from abstract concepts Extends the senses (empirical)

Final Study Guide Research Design. Experimental Research.

What is a Measurement? Concept of measurement is intuitively simple  Measure something two concepts involved  The thing you are measuring  The measurement.

Chapter 5 Conceptualization, Operationalization, and Measurement.

ScWk 240 Week 6 Measurement Error Introduction to Survey Development “England and America are two countries divided by a common language.” George Bernard.

Chapter Five Measurement Concepts. Terms Reliability True Score Measurement Error.

METHOD in Personality Research. How do we gather data? 1. From whom??? 1. From whom??? A. Self A. Self B. Others B. Others Plus/Minus? Plus/Minus?

Measurement Models: Exploratory and Confirmatory Factor Analysis James G. Anderson, Ph.D. Purdue University.

Learning Objective Chapter 9 The Concept of Measurement and Attitude Scales Copyright © 2000 South-Western College Publishing Co. CHAPTER nine The Concept.

Asking Good Questions Chapter 7. Scales of Measurement Nominal Nominal Ordinal Ordinal Interval Interval Ratio Ratio.

Chapter 4-Measurement in Marketing Research

Measurement and Questionnaire Design. Operationalizing From concepts to constructs to variables to measurable variables A measurable variable has been.

Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.

Reliability: The degree to which a measurement can be successfully repeated.

Reliability & Validity  Reliability  “dependability”  is the indicator consistent?  same result every time?  Does not necessary measure what you think.

Introducing Communication Research 2e © 2014 SAGE Publications Chapter Five Measurement: Research Using Numbers.

Measurement and Scaling

Measurement Issues General steps –Determine concept –Decide best way to measure –What indicators are available –Select intermediate, alternate or indirect.

Political Science Scope and Methods Observation, Measurement, and Political Implications.

Cmpe 589 Spring Measurement Theory Front-End –Design –Design Review and Inspection –Code –Code Inspections –Debug and Develop Test Cases  Integration.

What is a Number?. What is a number? Names and symbols are arbitrary.

DENT 514: Research Methods

Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.

Planning an Applied Research Project Chapter 9 – Validity, Reliability, and Credibility in Research © 2014 John Wiley & Sons, Inc. All rights reserved.

Data Collection Methods NURS 306, Nursing Research Lisa Broughton, MSN, RN, CCRN.

Chapter 2 Theoretical statement:

Ch. 5 Measurement Concepts.

Selecting the Best Measure for Your Study

QUESTIONNAIRE DESIGN AND VALIDATION

Associated with quantitative studies

Social Research Methods MAN-10 Erlan Bakiev, Ph. D.

Measurement with Numbers Scaling: What is a Number?

Sociological Research Methods

Reliability & Validity

Reliability & Validity

Measurement Concepts and scale evaluation

Ch 5: Measurement Concepts

Presentation transcript:

Operationalizing Concepts Issues in operationally defining your concepts, validity, reliability and scales

Review  What is conceptualization?  What is operationalization?  Null Hypothesis construction: H o (p. 605) Logical, Value-neutral Asserts no difference between dependent and independent variables Alternative Hypothesis: H a (p. 145) Hypotheses and research questions

Operationalization  Can anything be operationalized?  “Those who get to ask the questions get to determine the context of answers.” Operationalization and social justice Avoiding bias (p. 152)  Simple and complex operationalizations “covering the construct”

Operationalization in Action  Try to operationalize these variables: Teen mother Elderly Male homosexual Person with dementia Drug-abusing adolescent Criminal

Operationalization in Action, cont.  Try to operationalize these variables Love Peace Anxiety Insomnia Attachment Cognitive-behavioral therapy

Levels of Measurement (p. 172)  Nominal  Ordinal  Interval  Ratio

Measurement Error  Random Error  Systematic Error

How We Collect Data  Direct self-report  Indirect self-report  Observation  Archival records

Two Principles in Reducing Measurement Error  Reliability Definition: gives the same answer over time and among different populations and circumstances Types of reliability  Interrater reliability  Test-retest reliability  Internal consistency reliability  Inter-item correlations (p. 187)

Two Principles in Reducing Measurement Error  Validity (p. 194) Definition: Measures what it means to measure Face validity Content validity Criterion-related validity  Concurrent validity  Predictive validity Construct validity

Validity and Reliability, final words  P. 198, for permutations  Valid, but not reliable  Reliable, but not valid  Valid and Reliable

Constructing Measurement Instruments  Why construct measurement instruments? “Covering the construct” Complex constructs, subtle constructs Convergent and discriminant validity  No-nos when constructing measurement instruments (pp. 208 – 212)  Tools: Likert scaling Semantic differential scaling (p. 226)

Single-Systems Design Experiment  Consider a behavior you want to extinguish or increase  Consider a reward and/or punishment