Bryman: Social Research Methods, 4 th edition What is a concept? Concepts are: Building blocks of theory Labels that we give to elements of the social.

Slides:



Advertisements
Similar presentations
Cross Cultural Research
Advertisements

Reliability and Validity
© 2006 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Validity and Reliability Chapter Eight.
Professor Gary Merlo Westfield State College
From Concepts to Variables Sociology 690 – Measurement.
Designing Research Concepts, Hypotheses, and Measurement
Social Research Methods
RESEARCH METHODS Lecture 18
RELIABILITY & VALIDITY
MEASUREMENT. Measurement “If you can’t measure it, you can’t manage it.” Bob Donath, Consultant.
Concept of Measurement
Beginning the Research Design
Research Design Week 4 Lecture 1 Thursday, Apr. 1, 2004.
Lecture 7 Psyc 300A. Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other.
Research Methods in MIS
Validity and Reliability EAF 410 July 9, Validity b Degree to which evidence supports inferences made b Appropriate b Meaningful b Useful.
Reliability and Validity. Criteria of Measurement Quality How do we judge the relative success (or failure) in measuring various concepts? How do we judge.
Rosnow, Beginning Behavioral Research, 5/e. Copyright 2005 by Prentice Hall Ch. 6: Reliability and Validity in Measurement and Research.
Validity Lecture Overview Overview of the concept Different types of validity Threats to validity and strategies for handling them Examples of validity.
Test Validity S-005. Validity of measurement Reliability refers to consistency –Are we getting something stable over time? –Internally consistent? Validity.
Conceptualization and Operationalization
Measurement and Data Quality
POSC 202A: Lecture 1 Introductions Syllabus R Homework #1: Get R installed on your laptop; read chapters 1-2 in Daalgard, 1 in Zuur, See syllabus for Moore.
Identify and List… Theory behind the study Aim of study.
VALIDITY, RELIABILITY, and TRIANGULATED STRATEGIES
Validity & Reliability Trustworthiness
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.
Measurement Neuman and Robson Ch. 6. What is it? The process of creating measurable concrete variables from abstract concepts Extends the senses (empirical)
Principles of Test Construction
WELNS 670: Wellness Research Design Chapter 5: Planning Your Research Design.
The Scientific Method in Psychology.  Descriptive Studies: naturalistic observations; case studies. Individuals observed in their environment.  Correlational.
6. Conceptualization & Measurement
Introduction to Research
Psychology 290 Lab #2 Sept. 26 – 28 Types & Parts of Articles Operational Definition Variables Reliability & Validity.
Validity. Face Validity  The extent to which items on a test appear to be meaningful and relevant to the construct being measured.
The Nature of Quantitative Research
Measurement Validity.
Developing Measures Concepts as File Folders Three Classes of Things That can be Measured (Kaplan, 1964) Direct Observables--Color of the Apple or a Check.
Lecture 02.
Reliability, Validity, and Bias. Reliability Reliability Reliability is the extent to which an experiment, test, or any measuring procedure yields the.
Validity Validity: A generic term used to define the degree to which the test measures what it claims to measure.
1 Statistics A new language Specific notations that differ across disciplines Statistics and math are very different.
Question paper 1997.
METHODS IN BEHAVIORAL RESEARCH NINTH EDITION PAUL C. COZBY Copyright © 2007 The McGraw-Hill Companies, Inc.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.
MEASUREMENT. MeasurementThe assignment of numbers to observed phenomena according to certain rules. Rules of CorrespondenceDefines measurement in a given.
MOI UNIVERSITY SCHOOL OF BUSINESS AND ECONOMICS CONCEPT MEASUREMENT, SCALING, VALIDITY AND RELIABILITY BY MUGAMBI G.K. M’NCHEBERE EMBA NAIROBI RESEARCH.
Reliability & Validity  Reliability  “dependability”  is the indicator consistent?  same result every time?  Does not necessary measure what you think.
Criteria for selection of a data collection instrument. 1.Practicality of the instrument: -Concerns its cost and appropriateness for the study population.
Validity and Reliability in Instrumentation : Research I: Basics Dr. Leonard February 24, 2010.
Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.
Chapter 6 - Standardized Measurement and Assessment
Writing A Review Sources Preliminary Primary Secondary.
1 Announcement Movie topics up a couple of days –Discuss Chapter 4 on Feb. 4 th –[ch.3 is on central tendency: mean, median, mode]
Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.
Measurement and Scaling Concepts
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
Reliability and Validity
Chapter 2 Theoretical statement:
Reliability and Validity in Research
Understanding Results
Tests and Measurements: Reliability
Journalism 614: Reliability and Validity
Week 3 Class Discussion.
Reliability and Validity of Measurement
Social Research Methods
Reliability & Validity
Reliability & Validity
Reliability, Validity, and Bias
Presentation transcript:

Bryman: Social Research Methods, 4 th edition What is a concept? Concepts are: Building blocks of theory Labels that we give to elements of the social world Categories for the organization of ideas and observations (Bulmer, 1984) Concepts are useful for: Providing an explanation of a certain aspect of the social world Standing for things we want to explain Giving a basis for measuring variation Page 163

Bryman: Social Research Methods, 4 th edition Why measure? To delineate fine differences between people, organizations, or any other unit of analysis To provide a consistent device for gauging distinctions To produce precise estimates of the degree of the relationship between concepts Page 164

Bryman: Social Research Methods, 4 th edition Produced by the operational definition of a concept Less directly quantifiable than measures Common sense understandings of the form a concept might take Multiple-indicator measures concept may have different dimensions Indicators of concepts Pages 164, 165

Bryman: Social Research Methods, 4 th edition Why use more than one indicator? Single indicators may incorrectly classify many individuals Single indicators may capture only a portion of the underlying concept or be too general Multiple indicators can make finer distinctions between individuals Multiple indicators can capture different dimensions of a concept Pages 166, 167

Bryman: Social Research Methods, 4 th edition What does reliability mean? Stability is the measure stable over time? e.g. test–retest method Internal reliability are the indicators consistent? e.g. split-half method Inter-observer consistency is the measure consistent between observers? Key concept 7.3 Page 169

Bryman: Social Research Methods, 4 th edition Does the indicator measure the concept? It does if it has: Face validity (right for the concept?) Concurrent validity (supported by a relevant criterion today?) Predictive validity (likely to be supported by a relevant criterion tomorrow?) Construct validity (are useful hypotheses produced?) Convergent validity (supported by results from other methods? What does validity mean? Page 171, 172

Bryman: Social Research Methods, 4 th edition Causality Explanation why things are the way they are Direction of causal influence relationship between dependent & independent variables Confidence in the researcher's causal inferences Pages 175, 176

Bryman: Social Research Methods, 4 th edition Generalization Can findings be generalized beyond the confines of the particular context? Can findings be generalized from sample to population? How representative are samples? Page 176

Bryman: Social Research Methods, 4 th edition Replication Minimizing contamination from researcher biases or values Explicit description of procedures Control of conditions of study Ability to replicate in differing contexts Page 177

Bryman: Social Research Methods, 4 th edition The process of quantitative research Figure 7.1, page 161

Bryman: Social Research Methods, 4 th edition Failure to distinguish between objects in the natural world and social phenomena Artificial and spurious sense of precision and accuracy Lack of ecological validity reliance on instruments and measurements Static view of social life Criticisms of quantitative research Pages 178, 179

Bryman: Social Research Methods, 4 th edition Published accounts of quantitative research rarely report evidence of reliability and validity (Podsakoff & Dalton, 1987) Researchers are primarily interested in the substantive content and findings of their research Running tests of reliability and validity may seem an unappealing alternative! But researchers remain committed to the principles of good practice Pages 180, 181