Psychlotron.org.uk Why is it important that psychological research be valid and reliable?

Slides:

Advertisements

Similar presentations

The Research Consumer Evaluates Measurement Reliability and Validity

Advertisements

Taking Stock Of Measurement. Basics Of Measurement Measurement: Assignment of number to objects or events according to specific rules. Conceptual variables:

1 COMM 301: Empirical Research in Communication Kwan M Lee Lect4_1.

Some (Simplified) Steps for Creating a Personality Questionnaire Generate an item pool Administer the items to a sample of people Assess the uni-dimensionality.

Reliability and Validity checks S-005. Checking on reliability of the data we collect  Compare over time (test-retest)  Item analysis  Internal consistency.

MEASUREMENT CONCEPTS © 2012 The McGraw-Hill Companies, Inc.

Psychometrics William P. Wattles, Ph.D. Francis Marion University.

VALIDITY AND RELIABILITY

MEQ Analysis. Outline Validity Validity Reliability Reliability Difficulty Index Difficulty Index Power of Discrimination Power of Discrimination.

RELIABILITY & VALIDITY What is Reliability? What is Reliability?What is Reliability?What is Reliability? How Can We Measure Reliability? How Can We Measure.

Reliability Analysis. Overview of Reliability What is Reliability? Ways to Measure Reliability Interpreting Test-Retest and Parallel Forms Measuring and.

Reliability and Validity Dr. Roy Cole Department of Geography and Planning GVSU.

RELIABILITY & VALIDITY

Lecture 7 Psyc 300A. Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other.

Conny’s Office Hours will now be by APPOINTMENT ONLY. Please her at if you would like to meet with.

Measurement: Reliability and Validity For a measure to be useful, it must be both reliable and valid Reliable = consistent in producing the same results.

SOWK 6003 Social Work Research Week 5 Measurement By Dr. Paul Wong.

Psych 231: Research Methods in Psychology

Validity, Reliability, & Sampling

Test Validity S-005. Validity of measurement Reliability refers to consistency –Are we getting something stable over time? –Internally consistent? Validity.

Choosing tests for EEF evaluations – reliability and validity and other issues Steve Higgins & Carole Torgerson

Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.

Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.

Psychometrics William P. Wattles, Ph.D. Francis Marion University.

Principles of Test Construction

1 Psychology 2020 Measurement & Observing Behavior Unit 2.

Unit 11 – Intelligence and Personality Assessing Intelligence and Test Construction.

Chapter Five Measurement Concepts. Terms Reliability True Score Measurement Error.

AS Psychology Self-report: Evaluation. AS Psychology By the end of this lesson you should... Be able to evaluate the strengths ad weaknesses of self-report.

Advanced Research Methods Unit 3 Reliability and Validity.

Psychometrics & Validation Psychometrics & Measurement Validity Properties of a “good measure” –Standardization –Reliability –Validity A Taxonomy of Item.

Validity Validity: A generic term used to define the degree to which the test measures what it claims to measure.

Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.

Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.

Reliability: The degree to which a measurement can be successfully repeated.

Psychometrics. Goals of statistics Describe what is happening now –DESCRIPTIVE STATISTICS Determine what is probably happening or what might happen in.

MEASUREMENT: PART 1. Overview  Background  Scales of Measurement  Reliability  Validity (next time)

Reliability and Validity Themes in Psychology. Reliability Reliability of measurement instrument: the extent to which it gives consistent measurements.

Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.

Chapter 6 - Standardized Measurement and Assessment

Reliability and Validity in Testing. What is Reliability? Consistency Accuracy There is a value related to reliability that ranges from -1 to 1.

Reliability a measure is reliable if it gives the same information every time it is used. reliability is assessed by a number – typically a correlation.

Characteristics of Psychology Tests

Validity & Reliability. OBJECTIVES Define validity and reliability Understand the purpose for needing valid and reliable measures Know the most utilized.

Classroom Assessment Chapters 4 and 5 ELED 4050 Summer 2007.

Language Assessment Lecture 7 Validity & Reliability Instructor: Dr. Tung-hsien He

Measurement Chapter 6. Measuring Variables Measurement Classifying units of analysis by categories to represent variable concepts.

WHS AP Psychology Unit 7: Intelligence (Cognition) Essential Task 7-3:Explain how psychologists design tests, including standardization strategies and.

Measurement and Scaling Concepts

Consistency and Meaningfulness Ensuring all efforts have been made to establish the internal validity of an experiment is an important task, but it is.

VALIDITY What is validity? What are the types of validity? How do you assess validity? How do you improve validity?

1 Measurement Error All systematic effects acting to bias recorded results: -- Unclear Questions -- Ambiguous Questions -- Unclear Instructions -- Socially-acceptable.

ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.

Chapter 2 Theoretical statement:

Unit 8: Intelligence (Cognition)

Ch. 5 Measurement Concepts.

Reliability & Validity

Tests and Measurements: Reliability

Reliability and Validity

Reliability and Validity

پرسشنامه کارگاه.

5. Reliability and Validity

Measurement Concepts and scale evaluation

AS Psychology Research Methods

Reliability and validity

Presentation transcript:

psychlotron.org.uk Why is it important that psychological research be valid and reliable?

psychlotron.org.uk Today’s session You are learning about...You are learning to... Types and ways of assessing reliability and validity Check the reliability and validity of a quantitative questionnaire

psychlotron.org.uk Validity The extent to which something measures what it purports to measure Research studies InternalExternal EcologicalSampling Measurements ConcurrentConstructPredictiveFace

psychlotron.org.uk Reliability The extent to which something produces consistent results Research studies Measurements Split halfTest-retest QuestionnairesInter-observer/ inter-rater

psychlotron.org.uk A while ago you completed a questionnaire to measure stress. We are going to assess its reliability and validity.

psychlotron.org.uk We will use correlations to assess reliability and some aspects of validity. Which statistical test should we use and why?

psychlotron.org.uk Reliability Test-retest – Test-retest reliability is high if a measure yields similar scores on different occasions Split half – Split-half reliability is high if the odd scale items yield a similar score to the even scale items

psychlotron.org.uk Validity Face validity – Does it look OK? (Weak) Concurrent – Does it agree with other measures of the same thing? Predictive – Does it accurately predict what will happen in the future? Construct – Does it capture the entirety of the phenomenon it measures?

psychlotron.org.uk How would you assess the predictive validity of our stress questionnaire?

psychlotron.org.uk Is it necessarily desirable... – For a questionnaire to give consistent results – For a measure to agree with other measures?

psychlotron.org.uk Homework Write a short report about the reliability and validity of the stress questionnaire. Use the data from today’s class to comment on its test-retest and split half reliability and its concurrent validity (assume the other questionnaire is a valid measure of stress).