Definition & Measurement “measurement is the beginning of science, … until you can measure something, your knowledge is meager and unsatisfactory” Lord.

Slides:



Advertisements
Similar presentations
Taking Stock Of Measurement. Basics Of Measurement Measurement: Assignment of number to objects or events according to specific rules. Conceptual variables:
Advertisements

MEASUREMENT CONCEPTS © 2012 The McGraw-Hill Companies, Inc.
Professor Gary Merlo Westfield State College
4/25/2015 Marketing Research 1. 4/25/2015Marketing Research2 MEASUREMENT  An attempt to provide an objective estimate of a natural phenomenon ◦ e.g.
Part II Sigma Freud & Descriptive Statistics
From Concepts to Variables Sociology 690 – Measurement.
MEQ Analysis. Outline Validity Validity Reliability Reliability Difficulty Index Difficulty Index Power of Discrimination Power of Discrimination.
CH. 9 MEASUREMENT: SCALING, RELIABILITY, VALIDITY
5/15/2015Marketing Research1 MEASUREMENT  An attempt to provide an objective estimate of a natural phenomenon ◦ e.g. measuring height ◦ or weight.
Measurement. Scales of Measurement Stanley S. Stevens’ Five Criteria for Four Scales Nominal Scales –1. numbers are assigned to objects according to rules.
Concepts, Operationalization, & Measurement
Operationalizing Concepts Issues in operationally defining your concepts, validity, reliability and scales.
MEASUREMENT. Measurement “If you can’t measure it, you can’t manage it.” Bob Donath, Consultant.
Beginning the Research Design
Measurement Concepts. CONSTRUCT VALIDITY OF MEASURES Indicators of Construct Validity Face validity Aggression questionnaire Not enough to really determine.
MEASUREMENT the process of determining the value or level of a particular CONSTRUCT for every unit of analysis or subject involves OPERATIONALIZATION –translating.
Lecture 7 Psyc 300A. Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other.
Measurement: Reliability and Validity For a measure to be useful, it must be both reliable and valid Reliable = consistent in producing the same results.
SOWK 6003 Social Work Research Week 5 Measurement By Dr. Paul Wong.
FOUNDATIONS OF NURSING RESEARCH Sixth Edition CHAPTER Copyright ©2012 by Pearson Education, Inc. All rights reserved. Foundations of Nursing Research,
Variables cont. Psych 231: Research Methods in Psychology.
Research Methods in MIS
1 Measurement Adapted from The Research Methods Knowledge Base, William Trochim (2006). & Methods for Social Researchers in Developing Counries, The Ahfad.
Descriptive Statistics: Part One Farrokh Alemi Ph.D. Kashif Haqqi M.D.
Conceptualization and Operationalization
Research Operationalization 13/08/5811. Research design – operationalization of variables –Chapter 6 in Babbie & Mouton (2001) The construction of actual,
Measurement and Data Quality
Business Research Method Measurement, Scaling, Reliability, Validity
Experimental Research
MEASUREMENT OF VARIABLES: OPERATIONAL DEFINITION AND SCALES
Instrumentation.
Copyright © 2008 by Nelson, a division of Thomson Canada Limited Chapter 11 Part 3 Measurement Concepts MEASUREMENT.
CRJS 4466 PROGRAM & POLICY EVALUATION LECTURE #4 Test #1 results Evaluation projects Questions?
Measurement Neuman and Robson Ch. 6. What is it? The process of creating measurable concrete variables from abstract concepts Extends the senses (empirical)
1 Psychology 2020 Measurement & Observing Behavior Unit 2.
What is a Measurement? Concept of measurement is intuitively simple  Measure something two concepts involved  The thing you are measuring  The measurement.
Validity and Reliability THESIS. Validity u Construct Validity u Content Validity u Criterion-related Validity u Face Validity.
Chapter Five Measurement Concepts. Terms Reliability True Score Measurement Error.
Counseling Research: Quantitative, Qualitative, and Mixed Methods, 1e © 2010 Pearson Education, Inc. All rights reserved. Basic Statistical Concepts Sang.
Research methods in clinical psychology: An introduction for students and practitioners Chris Barker, Nancy Pistrang, and Robert Elliott CHAPTER 4 Foundations.
Advanced Research Methods Unit 3 Reliability and Validity.
Learning Objective Chapter 9 The Concept of Measurement and Attitude Scales Copyright © 2000 South-Western College Publishing Co. CHAPTER nine The Concept.
Chapter 4-Measurement in Marketing Research
Validity Validity: A generic term used to define the degree to which the test measures what it claims to measure.
Chapter 2: Behavioral Variability and Research Variability and Research 1. Behavioral science involves the study of variability in behavior how and why.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
The Theory of Sampling and Measurement. Sampling First step in implementing any research design is to create a sample. First step in implementing any.
Reliability: The degree to which a measurement can be successfully repeated.
Introducing Communication Research 2e © 2014 SAGE Publications Chapter Five Measurement: Research Using Numbers.
What is a Number?. What is a number? Names and symbols are arbitrary.
 Measuring Anything That Exists  Concepts as File Folders  Three Classes of Things That can be Measured (Kaplan, 1964) ▪ Direct Observables--Color of.
MEASUREMENT: PART 1. Overview  Background  Scales of Measurement  Reliability  Validity (next time)
DENT 514: Research Methods
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
Measurement Chapter 6. Measuring Variables Measurement Classifying units of analysis by categories to represent variable concepts.
Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.
Measurement and Scaling Concepts
Ch. 5 Measurement Concepts.
Product Reliability Measuring
Research Process Define Problem, Research Objectives
Measurement: Part 1.
Associated with quantitative studies
CHAPTER 5 MEASUREMENT CONCEPTS © 2007 The McGraw-Hill Companies, Inc.
Journalism 614: Reliability and Validity
Definition & Measurement
Introduction to Measurement
پرسشنامه کارگاه.
Ch 5: Measurement Concepts
Reliability and validity
Presentation transcript:

Definition & Measurement “measurement is the beginning of science, … until you can measure something, your knowledge is meager and unsatisfactory” Lord Kelvin Nominal/Conceptual Definition - define concept in terms of other concepts, links concepts without tying them to real world Operational definition - equates definition with measurement, specify procedures/operations to generate the concept.

EXAMPLE 1. CONCEPTUAL DEFINITION - Length of table is the distance from one end to the other. OPERATIONAL DEFINITION - Place a yardstick along one edge of the table, place additional yardsticks end to end until one extends over the other edge. Read the numeric marking for inches on the final yardstick at the point where it is exactly over the other edge of the table (call this X inches). Count the number of yardsticks you have used (call this N). Compute (N-1) * 36 + X. Repeat this process on the edge perpendicular to this one. The length of the table in inches is the larger of these two numbers.

EXAMPLE 2. CONCEPTUAL DEFINITION - Age- the number of years that have passed since a person's date of birth. OPERATIONAL DEFINITION - A. Ask an individual for his name, place of birth (county and state), and names of both parents. Go to the county records office for the given county and find the record for the person with the given name. If there are more than one such records, check for names of parents. Identify the date of birth from this record. Subtract the year of birth from If the month and day of birth has not yet been reached in the current year, subtract 1.

AGE : Operational Definition B Give the subject a slip of paper with the following question. ENTER YOUR AGE IN YEARS AT YOUR LAST BIRTHDAY ______. The number written in the blank is the person's age.

Levels of Measurement Nominal - unordered categories, race Ordinal - ordered categories, sm, med, lg Interval - consistent distance between levels Temperature Fahrenheit Ratio - natural zero Temperature Kelvin

Levels of Measurement

NOMINAL Middle income if income is between $30K and $50K Not middle if less than $30K or more than $50K. ORDINAL LOW is less than 30K MID if between 30K and 50K HIGH if greater than 50K INTERVAL Income in dollars from Line 17 of 1997 tax return. RATIO Income in dollars + $10,000. Examples of Measurement scales- Income

Reliability and Validity of Measures RELIABILITY = Absence of random error (noise), refers to repeatability of the measure. Do we get same answer each time we make measurement? Inter-rater, test-retest, split half, parallel forms, Internal consistency-Cronbach’s alpha, KR VALIDITY = Absence of systematic error (bias). Are we measuring what we purport to be measuring? Content validity ( Trochim- Translation validity ) Criterion-related validity: predictive, concurent, convergent, discriminant Construct validity: MTMM

Validity vs Reliability

Statistics & measurement level A dichotomous variable (0 or 1) can be treated as interval

Assessing Reliability Inter-rater reliability Test-retest Alternative forms Internal consistency –Inter-item correlations –Split half –Cronbach's alpha

Types of Validity Translation validity (face, content) Criterion-related validity – check against other criteria –Predictive validity – can predict –Concurrent validity – distinguish groups –Convergent validity- correlates with similar measures –Discriminant validity – neg correlation with dissimilar measures