1 Announcement Movie topics up a couple of days –Discuss Chapter 4 on Feb. 4 th –[ch.3 is on central tendency: mean, median, mode]

Slides:



Advertisements
Similar presentations
Conceptualization, Operationalization, and Measurement
Advertisements

Conceptualization and Measurement
The Research Consumer Evaluates Measurement Reliability and Validity
Taking Stock Of Measurement. Basics Of Measurement Measurement: Assignment of number to objects or events according to specific rules. Conceptual variables:
1 COMM 301: Empirical Research in Communication Kwan M Lee Lect4_1.
VALIDITY AND RELIABILITY
Professor Gary Merlo Westfield State College
MGT-491 QUANTITATIVE ANALYSIS AND RESEARCH FOR MANAGEMENT
Designing Research Concepts, Hypotheses, and Measurement
CH. 9 MEASUREMENT: SCALING, RELIABILITY, VALIDITY
RESEARCH METHODS Lecture 18
Measurement ConceptualizationOperationalization Level of Measurement Validity and Reliability.
Beginning the Research Design
Chapter 4: Conceptualization & Measurement
1 Measurement PROCESS AND PRODUCT. 2 MEASUREMENT The assignment of numerals to phenomena according to rules.
Chapter 5 Measuring Variables. DESCRIBING VARIABLES Correspondence Standardization Quantification Duplication.
Reliability and Validity. Criteria of Measurement Quality How do we judge the relative success (or failure) in measuring various concepts? How do we judge.
Test Validity S-005. Validity of measurement Reliability refers to consistency –Are we getting something stable over time? –Internally consistent? Validity.
Conceptualization and Operationalization
The Practice of Social Research
Measurement and Data Quality
The Vocabulary of Research. What is Credibility? A researcher’s ability to demonstrate that the study is accurate based on the way the study was conducted.
MEASUREMENT OF VARIABLES: OPERATIONAL DEFINITION AND SCALES
Research Method Step 1 – Formulate research question Step 2 – Operationalize concepts ◦ Valid and reliable indicators Step 3 – Decide on sampling technique.
Instrumentation.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Bryman: Social Research Methods, 4 th edition What is a concept? Concepts are: Building blocks of theory Labels that we give to elements of the social.
MEASUREMENT CHARACTERISTICS Error & Confidence Reliability, Validity, & Usability.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.
LECTURE 06B BEGINS HERE THIS IS WHERE MATERIAL FOR EXAM 3 BEGINS.
Copyright © 2008 by Nelson, a division of Thomson Canada Limited Chapter 11 Part 3 Measurement Concepts MEASUREMENT.
What is a Measurement? Concept of measurement is intuitively simple  Measure something two concepts involved  The thing you are measuring  The measurement.
Chapter 5 Conceptualization, Operationalization, and Measurement.
6. Conceptualization & Measurement
The Basics of Experimentation Ch7 – Reliability and Validity.
ScWk 240 Week 6 Measurement Error Introduction to Survey Development “England and America are two countries divided by a common language.” George Bernard.
Reliability & Validity
Chapter 7 Measurement and Scaling Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin.
Measurement Validity.
Research: Conceptualization and Measurement Conceptualization Steps in measuring a variable Operational definitions Confounding Criteria for measurement.
Appraisal and Its Application to Counseling COUN 550 Saint Joseph College For Class # 3 Copyright © 2005 by R. Halstead. All rights reserved.
Developing Measures Concepts as File Folders Three Classes of Things That can be Measured (Kaplan, 1964) Direct Observables--Color of the Apple or a Check.
Research: Conceptualization and Measurement Conceptualization Steps in measuring a variable Operational definitions Confounding Criteria for measurement.
Validity Validity: A generic term used to define the degree to which the test measures what it claims to measure.
1 Statistics A new language Specific notations that differ across disciplines Statistics and math are very different.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.
 Measuring Anything That Exists  Concepts as File Folders  Three Classes of Things That can be Measured (Kaplan, 1964) ▪ Direct Observables--Color of.
Chapter 6 - Standardized Measurement and Assessment
Educational Research Chapter 8. Tools of Research Scales and instruments – measure complex characteristics such as intelligence and achievement Scales.
Measurement Chapter 6. Measuring Variables Measurement Classifying units of analysis by categories to represent variable concepts.
Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.
Chapter 5 Conceptualization, Operationalization, and Measurement.
Measurement and Scaling Concepts
Consistency and Meaningfulness Ensuring all efforts have been made to establish the internal validity of an experiment is an important task, but it is.
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
Reliability and Validity
Chapter 2 Theoretical statement:
Ch. 5 Measurement Concepts.
CHAPTER 3: Practical Measurement Concepts
QUESTIONNAIRE DESIGN AND VALIDATION
Reliability & Validity
Tests and Measurements: Reliability
Journalism 614: Reliability and Validity
5. Reliability and Validity
Chapter 5 Conceptualization, Operationalization, and Measurement
RESEARCH METHODS Lecture 18
Reliability & Validity
Reliability & Validity
Measurement Concepts and scale evaluation
Presentation transcript:

1 Announcement Movie topics up a couple of days –Discuss Chapter 4 on Feb. 4 th –[ch.3 is on central tendency: mean, median, mode]

2 Conceptualization Process of specifying what we mean when we use particular terms. Produces an agreed upon meaning for a concept for the purposes of research. Describes the indicators we'll use to measure the concept and the different aspects of the concept.

3 Developing Measures Real Definitions –The true essence - Not practical Nominal Definition –Using a convention or consensus Operational Definition –Specify precisely how a concept will be measured

4 Babbie’s Example Anomie What does this mean? Societal condition of normlessness; social instability How do we define this concept? Durkheim uses it to describe societies Others use it to describe individuals –Some experience anomie

5 Anomie How do we measure anomie? Ask respondents if they agree with a set of statements See page 142 (Chapter 5) in Babbie –The lot of the average man is getting worse –Not fair to bring children into world the way things look for the future –Don’t know who you can count on –Public officials not interested in problems of average man

6 Political Science Example Political Apathy What does this mean? How are we going to measure this concept

7 Concepts A concept may have multiple dimensions –Religiosity examples –A belief dimension –A ritual dimension –A knowledge dimension Indicators –How do we observe religiosity? –Attending religious services Complex concepts are likely to have multiple dimensions and require multiple indicators

8 Reliability GENERAL DEFINITION: - Accuracy or precision of a measuring instrument. - Consistency - Similar results: stability, dependability predictability

9 Tests for Checking Reliability Test-retest method - take the same measurement more than once. Equivalence: use "essentially the same" measurement items on the same instrument or on different instruments and compare the answers (same time period). Split-half, Random half, alternate forms. Use established measures.

10 Internal Validity DEFINITION: the ability of the measuring instrument to measure one's theoretical concepts. METHODS OF ASSESSING VALIDITY: CRITERIAL-RELATED VALIDITY (predictive): predict to an outside criterion and compare the outcome to the outside criterion a. Concurrent: comparison to an existing or current outside criterion b. Predictive: comparison to a future outside criterion

11 Validity (cont.) CONTENT VALIDITY: representativeness of what is being measured to the intended concepts. Does it cover the range of meanings. FACE VALIDITY: obvious and self-evident content CONSTRUCT VALIDITY: degree to which a measure is related to other variables as expected within a system of theoretical relationships. A measure of martial satisfaction should be associated with a measure of marital fidelity. SAT score with college success. EXTERNAL -- concerned with the generalizability of the test/method