LECTURE 14 NORMS, SCORES, AND EQUATING EPSY 625. NORMS Norm: sample of population Intent: representative of population Reality: hope to mirror population.

Slides:



Advertisements
Similar presentations
Psychometrics to Support RtI Assessment Design Michael C. Rodriguez University of Minnesota February 2010.
Advertisements

Standardized Tests What They Measure How They Measure.
IRT Equating Kolen & Brennan, IRT If data used fit the assumptions of the IRT model and good parameter estimates are obtained, we can estimate person.
Scales, Transformations, & Norms
Overview Revising z-scores Revising z-scores Interpreting z-scores Interpreting z-scores Dangers of z-scores Dangers of z-scores Sample and populations.
The Normal Curve Z Scores, T Scores, and Skewness.
Z - SCORES standard score: allows comparison of scores from different distributions z-score: standard score measuring in units of standard deviations.
VERTICAL SCALING H. Jane Rogers Neag School of Education University of Connecticut Presentation to the TNE Assessment Committee, October 30, 2006.
Probability & Using Frequency Distributions Chapters 1 & 6 Homework: Ch 1: 9-12 Ch 6: 1, 2, 3, 8, 9, 14.
The Normal Distribution. Distribution – any collection of scores, from either a sample or population Can be displayed in any form, but is usually represented.
By Dr. Mohammad H. Omar Department of Mathematical Sciences May 16, 2006 Presented at Statistic Research (STAR) colloquium, King Fahd University of Petroleum.
Introduction to Educational Statistics
Interpreting Standardized Tests Gronlund, Chapter 12 Burke, Chapter 2.
Chapter Six z-Scores and the Normal Curve Model. Copyright © Houghton Mifflin Company. All rights reserved.Chapter The absolute value of a number.
ALGEBRA II WEDNESDAY, JANUARY 28, 2015 B DAY DRILL: How many students will be taking the SAT or have taken it? What is the scoring range ? What do you.
z-Scores What is a z-Score? How Are z-Scores Useful? Distributions of z-Scores Standard Normal Curve.
Lecture 5 Psyc 300A. Agenda Return quizzes & homework Descriptive statistics review New –Types of distributions –Z-scores –Area under the normal curve.
Measurement Joseph Stevens, Ph.D. ©  Measurement Process of assigning quantitative or qualitative descriptions to some attribute Operational Definitions.
Why Scale -- 1 Summarising data –Allows description of developing competence Construct validation –Dealing with many items rotated test forms –check how.
Standardized Test Scores Common Representations for Parents and Students.
Classroom Assessment A Practical Guide for Educators by Craig A
Chapter 5 DESCRIBING DATA WITH Z-SCORES AND THE NORMAL CURVE.
Quiz 5 Normal Probability Distribution.
Chapter 5: z-Scores. 5.1 Purpose of z-Scores Identify and describe location of every score in the distribution Take different distributions and make them.
EPSY 8223: Test Score Equating
Basic Statistics Standard Scores and the Normal Distribution.
The ABC’s of Pattern Scoring Dr. Cornelia Orr. Slide 2 Vocabulary Measurement – Psychometrics is a type of measurement Classical test theory Item Response.
2.5 Normal Distribution SWBAT calculate areas under a standard normal curve in writing by converting between values and z- scores using a GCD or Table.
Measuring Mathematical Knowledge for Teaching: Measurement and Modeling Issues in Constructing and Using Teacher Assessments DeAnn Huinker, Daniel A. Sass,
Understanding the scores from Test 2 In-class exercise.
Evaluation of Nelson-Denny Reading Test Mini Project I By Becky Brandl.
Review and Validation of ISAT Performance Levels for 2006 and Beyond MetriTech, Inc. Champaign, IL MetriTech, Inc. Champaign, IL.
Scores & Norms Derived Scores, scales, variability, correlation, & percentiles.
Instrumentation (cont.) February 28 Note: Measurement Plan Due Next Week.
Points in Distributions n Up to now describing distributions n Comparing scores from different distributions l Need to make equivalent comparisons l z.
Counseling Research: Quantitative, Qualitative, and Mixed Methods, 1e © 2010 Pearson Education, Inc. All rights reserved. Basic Statistical Concepts Sang.
Measures of Dispersion & The Standard Normal Distribution 9/12/06.
Educational Psychology: Theory and Practice Chapter 14 Standardized Tests This multimedia product and its contents are protected under copyright law. The.
NORMS. Scores on psychological tests are most commonly interpreted by reference to norms ; which represent the test performance of the standardized sample.
Quick Review Central tendency: Mean, Median, Mode Shape: Normal, Skewed, Modality Variability: Standard Deviation, Variance.
Chapter 2 ~~~~~ Standardized Assessment: Types, Scores, Reporting.
NORMAL DISTRIBUTION AND ITS APPL ICATION. INTRODUCTION Statistically, a population is the set of all possible values of a variable. Random selection of.
A COMPARISON METHOD OF EQUATING CLASSIC AND ITEM RESPONSE THEORY (IRT): A CASE OF IRANIAN STUDY IN THE UNIVERSITY ENTRANCE EXAM Ali Moghadamzadeh, Keyvan.
Psychology 290 – Lab 9 January Normal Distribution Standardization Z-scores.
Chapter 4 & 5 The Normal Curve & z Scores.
TYPES OF SCORES (PP IN HUTCHINSON; MERRELL & PLANTE; SECOND PART OF HAYNES AND PINDZOLA )
Scaling and Equating Joe Willhoft Assistant Superintendent of Assessment and Student Information Yoonsun Lee Director of Assessment and Psychometrics Office.
The ABC’s of Pattern Scoring
STATISTICS Educational Research. OBJECTIVES ä THE Normal Curve ä Skewed Distributions ä Standard Scores: z and t ä Test score interpretations.
University of Ostrava Czech republic 26-31, March, 2012.
1 LINKING AND EQUATING OF TEST SCORES Hariharan Swaminathan University of Connecticut.
Perspectives on Developing and Publishing Clinical Tests David S. Herzberg, PhD.
Latent regression models. Where does the probability come from? Why isn’t the model deterministic. Each item tests something unique – We are interested.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
The Design of Statistical Specifications for a Test Mark D. Reckase Michigan State University.
Z-Scores. Histogram A bar chart of a frequency distribution. 0 — 2 1 — 3 2 — 0 3 — 2 4 — 4 5 — 3 6 — 3 7 — 5 8 — 3 9 — 2 10—2.
© 2011 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part, except for use as permitted in a license.
Educational Research Descriptive Statistics Chapter th edition Chapter th edition Gay and Airasian.
Chapter 2 Norms and Reliability. The essential objective of test standardization is to determine the distribution of raw scores in the norm group so that.
IRT Equating Kolen & Brennan, 2004 & 2014 EPSY
Chapter 5 z-Scores PowerPoint Lecture Slides Essentials of Statistics for the Behavioral Sciences Seventh Edition by Frederick J. Gravetter and Larry.
Terra Nova By Tammy Stegman, Robyn Ourada, Sandy Perry, & Kim Cotton.
STANDARD ERROR OF SAMPLE
Booklet Design and Equating
Inferring Population Parameters
SCORING TERMINOLOGY USED IN ASSESSMENT
Weschler Individual Achievement Test
Margaret Wu University of Melbourne
BOY Composite ↔ MOY Composite
Presentation transcript:

LECTURE 14 NORMS, SCORES, AND EQUATING EPSY 625

NORMS Norm: sample of population Intent: representative of population Reality: hope to mirror population characteristics (no means to get representative samples, except NAEP)

NORMS Norming study Construct test Pilot items Construct test(s) Testlets/item packets Parallel forms Revise items/tests Test norm sample

Test Scores Types of scores Smoothing distributions Equating scores for different forms horizontal (same difficulty/population) vertical (different difficulty/population)

Types of scores Raw scores Standardized scores linear transformations of raw scores z-scores (mean=0, SD=1) T-scores (mean=50, SD=10) Stanines (mean=5, SD=2) nonlinear transformations of raw scores percentile scores smoothed standard scores grade equivalents (GEs)

RAW SCORE TIME OF TESTING IN GRADE UNITS SAMPLE A GRADE 1 SAMPLE B GRADES 1-2 SAMPLE C GRADE

Smoothing Distributions Normal curve fitting trait-theoretic (ability, physical performance) Nonnormal curve fitting trait theoretic (abnormal behavior) Procedures graphical fitting mathematical curve-fitting

Test Equating Horizontal equating: parallel forms Equipercentile: match scores for each percentile score (eg. 1%ile on form A to 1%ile on B) IRT ability equating (mean score for ability value of -.5 on A to mean score on B) Regression/linear procedures Vertical equating: overlapping difficulties IRT ability equating Grade equivalent equating

Test Equating Horizontal equating: parallel forms Equipercentile: match scores for each percentile score (eg. 1%ile on form A to 1%ile on B) FORM A FORM B

Test Equating Vertical equating: overlapping difficulties Scores are overpredicted based on easy forms Scores are underpredicted based on difficult forms Chance scores are overpredicted