Principles of Test Construction

Slides:



Advertisements
Similar presentations
Psychlotron.org.uk Why is it important that psychological research be valid and reliable?
Advertisements

© 2006 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Validity and Reliability Chapter Eight.
Psychometrics William P. Wattles, Ph.D. Francis Marion University.
Reliability And Validity
VALIDITY AND RELIABILITY
RESEARCH METHODS Lecture 18
Reliability and Validity Dr. Roy Cole Department of Geography and Planning GVSU.
RELIABILITY & VALIDITY
Lecture 7 Psyc 300A. Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other.
1 Assessing Intelligence Module Intelligence Assessing Intelligence  The Origins of Intelligence Testing  Modern Tests of Mental Abilities  Principles.
1 Intelligence Chapter What is Intelligence? Intelligence (in all cultures) is the ability to learn from experience, solve problems, and use our.
Validity of Selection. Objectives Define Validity Relation between Reliability and Validity Types of Validity Strategies.
INTELLIGENCE AND PSYCHOLOGICAL TESTING. KEY CONCEPTS IN PSYCHOLOGICAL TESTING Psychological test: a standardized measure of a sample of a person’s behavior.
Assessing Intelligence
Classroom Assessment A Practical Guide for Educators by Craig A
What is Intelligence? Definition: 3 main characteristics 1) 2) 3)
1 Intelligence. 2 What is Intelligence? Intelligence - the ability to learn from experience, solve problems, and use our knowledge to adapt to new situations.
Characteristics of Psychological Tests
Athleticism, like intelligence, is many things
Unit 6: Testing and Individual Differences
PSYCHOMETRICIANS: develop tests -try to make constructs measurable and quantifiable -purpose is to differentiate between test- takers 3 Qualities of Tests:
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.
It may be varied in different cultures.
Chapter 1: Research Methods
Unit 11. * intelligence: * aggregate or global capacity * to act purposefully * to think rationally * to deal effectively with the environment * fluid.
WELNS 670: Wellness Research Design Chapter 5: Planning Your Research Design.
Unit 11 – Intelligence and Personality Assessing Intelligence and Test Construction.
Assessing Intelligence Chapter 10, Lecture 3 “As heirs to Plato’s individualism, people in Western societies have pondered how and why individuals differ.
Principles of Test Construction How does the College Board assessyou?
Validity. Face Validity  The extent to which items on a test appear to be meaningful and relevant to the construct being measured.
Reliability & Validity
+ Intelligence 1. + Intelligence Assessing Intelligence  The Origins of Intelligence Testing  Modern Tests of Mental Abilities  Principles of Test.
Advanced Research Methods Unit 3 Reliability and Validity.
Validity Validity: A generic term used to define the degree to which the test measures what it claims to measure.
Intelligence Lecture 11 Chapter What is Intelligence?
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.
Validity and Item Analysis Chapter 4.  Concerns what instrument measures and how well it does so  Not something instrument “has” or “does not have”
Assessing Intelligence
Reliability and Validity Themes in Psychology. Reliability Reliability of measurement instrument: the extent to which it gives consistent measurements.
How do we Assess Intelligence?
Psychologist use statistics for 2 things
Chapter 6 - Standardized Measurement and Assessment
Characteristics of Psychology Tests
Testing. Psychological Tests  Tests abilities, interests, creativity, personality, behavior  Must be standardized, reliable, and valid  Timing, instructions,
Testing Intelligence. ARE YOU OVER-TESTED?  Your age group is the most tested group in the history of the United States.
Reliability EDUC 307. Reliability  How consistent is our measurement?  the reliability of assessments tells the consistency of observations.  Two or.
Intelligence. What is Intelligence? ▪ Definition: – The mental abilities to adapt to and shape the environment ▪ Involves reacting to and forming your.
Chapter 11 Intelligence “Just Think Mr. Thompson”.
WHS AP Psychology Unit 7: Intelligence (Cognition) Essential Task 7-3:Explain how psychologists design tests, including standardization strategies and.
Assessing Intelligence. Test Construction Standardization – defining the meaning of scores by comparing to a pretested “standard group”. Reliability –
Measurement and Scaling Concepts
Consistency and Meaningfulness Ensuring all efforts have been made to establish the internal validity of an experiment is an important task, but it is.
Test construction and assessment
Vocab Unit 11. = a method of assessing an individual's mental aptitudes and comparing them with those of others, using numerical scores.
Unit 11 Vocabulary Individual Differences and Intelligence.
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
Principles of Language Assessment
Unit 8: Intelligence (Cognition)
Assessing Intelligence
Lecture 5 Validity and Reliability
Reliability and Validity
Intelligence Chapter 11 Notes 11-4 (obj.11-15)
Tests and Measurements: Reliability
Outline the steps خطوات in the selection اختيار process عملية
Modern Tests of Mental Abilities
Week 3 Class Discussion.
پرسشنامه کارگاه.
Methodology Week 5.
Presentation transcript:

Principles of Test Construction For a psychological test to be acceptable it must fulfill the following three criteria: Standardization Reliability Validity

Standardization Standardizing a test involves administering the test to a representative sample of future test takers in order to establish a basis for meaningful comparison. OBJECTIVE 10| Discuss the importance of standardizing psychological tests, and describe the distribution of scores in a normal curve.

Normal Curve Standardized tests establish a normal distribution of scores on a tested population in a bell-shaped pattern called the normal curve.

Reliability A test is reliable when it yields consistent results. To establish reliability researchers establish different procedures: Split-half Reliability: Dividing the test into two equal halves and assessing how consistent the scores are. Reliability using different tests: Using different forms of the test to measure consistency between them. Test-Retest Reliability: Using the same test on two occasions to measure consistency. OBJECTIVE 11| Explain what it means to say that a test is reliable.

Verbal Intell

Validity Reliability of a test does not ensure validity. Validity of a test refers to what the test is supposed to measure or predict. Content Validity: Refers to the extent a test measures your definition of the construct Criterion-related validity: Relationship between scores on a test and an independent measure of what the test is supposed to measure Predictive Validity: Refers to the function of a test in predicting a particular behavior or trait. For instance, we might theorize that a measure of math ability should be able to predict how well a person will do in an engineering-based profession. Convergent Validity: we examine the degree to which the operationalization is similar to (converges on) other operationalizations we might correlate the scores on our test with scores on other tests that purport to measure basic math ability, where high correlations would be evidence of convergent validity. OBJECTIVE 12| Explain what it means to say that a test is valid, and describe two types of validity.