E NSURING S TATISTICAL L ITERACY FOR PRE - SERVICE EDUCATION MAJORS Stacy M. Bjorkman, Ph.D., NCSP Walden University & Kelly H. Summers Northern Illinois.

Slides:



Advertisements
Similar presentations
Measurement, Evaluation, Assessment and Statistics
Advertisements

Measurement Concepts Operational Definition: is the definition of a variable in terms of the actual procedures used by the researcher to measure and/or.
Standardized Tests: What Are They? Why Use Them?
Understanding Grade Level and School Growth Reports Office of Assessment and Accountability.
© 2006 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Validity and Reliability Chapter Eight.
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 5 Reliability.
Reliability for Teachers Kansas State Department of Education ASSESSMENT LITERACY PROJECT1 Reliability = Consistency.
Traditional Norm-Reference Testing Chapter 4 Florida Memorial University Ms. Yohana Lopez.
General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
Issues of Technical Adequacy in Measuring Student Growth for Educator Effectiveness Stanley Rabinowitz, Ph.D. Director, Assessment & Standards Development.
Reports and Scores Fen Chou, Ph.D. Louisiana Department of Education August 2006.
© 2008 McGraw-Hill Higher Education. All rights reserved. CHAPTER 16 Classroom Assessment.
Copyright 2001 by Allyn and Bacon Standardized Testing Chapter 14.
INTELLIGENCE AND PSYCHOLOGICAL TESTING. KEY CONCEPTS IN PSYCHOLOGICAL TESTING Psychological test: a standardized measure of a sample of a person’s behavior.
Classroom Assessment A Practical Guide for Educators by Craig A
Standardized Test Scores Common Representations for Parents and Students.
Robert delMas (Univ. of Minnesota, USA) Ann Ooms (Kingston College, UK) Joan Garfield (Univ. of Minnesota, USA) Beth Chance (Cal Poly State Univ., USA)
Descriptive Statistics: Part One Farrokh Alemi Ph.D. Kashif Haqqi M.D.
Shawna Williams BC TEAL Annual Conference May 24, 2014.
ASSESSMENT& EVALUATION Assessment is an integral part of teaching. Observation is your key assessment tool in the primary and junior grades.
The Data Analysis Plan. The Overall Data Analysis Plan Purpose: To tell a story. To construct a coherent narrative that explains findings, argues against.
ASSESSMENT Formative, Summative, and Performance-Based
Standardized Testing (1) EDU 330: Educational Psychology Daniel Moos.
SCORING. INTRODUCTION & PURPOSE Define what SCORING means for the purpose of these modules Explain how and why you should use well-designed tools, such.
NEXT GENERATION BALANCED ASSESSMENT SYSTEMS ALIGNED TO THE CCSS Stanley Rabinowitz, Ph.D. WestEd CORE Summer Design Institute June 19,
Assessment Analysis Statistical Analysis and Unit Improvement Plan Book pgs Classroom Curriculum Continuous Improvement Data-Based Decision Making.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
LECTURE 06B BEGINS HERE THIS IS WHERE MATERIAL FOR EXAM 3 BEGINS.
Lynn Thompson Center for Applied Linguistics Startalk Network for Program Excellence Chicago, Illinois October 16-18, 2009 Formative and Summative Assessment.
Test item analysis: When are statistics a good thing? Andrew Martin Purdue Pesticide Programs.
1 An Introduction to Language Testing Fundamentals of Language Testing Fundamentals of Language Testing Dr Abbas Mousavi American Public University.
The World of Assessment Consider the options! Scores based on developmental levels of academic achievement Age-Equivalent scores.
WELNS 670: Wellness Research Design Chapter 5: Planning Your Research Design.
Instrumentation (cont.) February 28 Note: Measurement Plan Due Next Week.
Listening to Bob Marley makes me think of statistics and standardized testing….. Said no one ever But… it is still your responsibility.
Counseling Research: Quantitative, Qualitative, and Mixed Methods, 1e © 2010 Pearson Education, Inc. All rights reserved. Basic Statistical Concepts Sang.
EDU 8603 Day 6. What do the following numbers mean?
Standardized Testing (1) EDU 330: Educational Psychology Daniel Moos.
APRIL 16, 2013 A review of Chapters CHAPTER FOURTEEN The Role of Assessment VOCABULARY.
Cut Points ITE Section One n What are Cut Points?
Experimental Research Methods in Language Learning Chapter 9 Descriptive Statistics.
Basic Measurement and Statistics in Testing. Outline Central Tendency and Dispersion Standardized Scores Error and Standard Error of Measurement (Sm)
Selecting a Sample. Sampling Select participants for study Select participants for study Must represent a larger group Must represent a larger group Picked.
USING GRAPHICAL DISPLAY by John Froelich A Picture is Worth a Thousand Words:
JS Mrunalini Lecturer RAKMHSU Data Collection Considerations: Validity, Reliability, Generalizability, and Ethics.
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
Nurhayati, M.Pd Indraprasta University Jakarta.  Validity : Does it measure what it is supposed to measure?  Reliability: How the representative is.
Standardized Testing. Basic Terminology Evaluation: a judgment Measurement: a number Assessment: procedure to gather information.
Chapter 6 - Standardized Measurement and Assessment
Reliability and Validity in Testing. What is Reliability? Consistency Accuracy There is a value related to reliability that ranges from -1 to 1.
S TATISTICAL R EASONING IN E VERYDAY L IFE. In descriptive, correlational, and experimental research, statistics are tools that help us see and interpret.
Chapter 3 Selection of Assessment Tools. Council of Exceptional Children’s Professional Standards All special educators should possess a common core of.
Michigan Assessment Consortium Common Assessment Development Series Module 16 – Validity.
Assessment Assessment is the collection, recording and analysis of data about students as they work over a period of time. This should include, teacher,
Chapter 6: Descriptive Statistics. Learning Objectives Describe statistical measures used in descriptive statistics Compute measures of central tendency.
Dr. Jeffrey Oescher 27 January 2014 Technical Issues  Two technical issues  Validity  Reliability.
Chapter 2 Norms and Reliability. The essential objective of test standardization is to determine the distribution of raw scores in the norm group so that.
Interpreting Test Results using the Normal Distribution Dr. Amanda Hilsmier.
Nuts and Bolts of Assessment
Assessment of Learning 1
CHAPTER 3: Practical Measurement Concepts
Analyzing Reliability and Validity in Outcomes Assessment Part 1
Scoring: Measures of Central Tendency
Validity and Reliability II: The Basics
Ass. Prof. Dr. Mogeeb Mosleh
Descriptive Statistics
Descriptive statistics for groups:
Presentation transcript:

E NSURING S TATISTICAL L ITERACY FOR PRE - SERVICE EDUCATION MAJORS Stacy M. Bjorkman, Ph.D., NCSP Walden University & Kelly H. Summers Northern Illinois University

W HY IS THIS IMPORTANT ? In almost every state there has been a shift in the way teachers are evaluated. Most states are including student achievement data as part of the teacher evaluation process. Teachers’ livelihoods depend on knowing about assessments. Most education degree programs do not include coursework in statistics.

E NSURING STATISTICAL LITERACY Determine the role of assessments in the teacher evaluation process in your state. Build a pre-service workshop that discusses the role of assessments in teacher evaluations. Design the workshop so the focus is on statistical concepts with real-world educational data. Include key components of assessment and statistical literacy in the workshop. Be sure to include frequent checks for understanding.

P OSSIBLE CONCEPTS TO INCLUDE IN A PRE - SERVICE WORKSHOP Summative vs. Formative Assessments The concept of reliability The concept of validity Measures of central tendency and variability Reading various types of graphs Types of test scores

K EY D IFFERENCES IN FORMATIVE & S UMMATIVE ASSESSMENTS SummativeFormative Reasons for AssessingDocument individual or group achievement or mastery of standards; measure achievement status at a point in time for purposes of reporting Increase achievement; to help students meet more standards; support ongoing student growth To InformOthers about studentsStudents about themselves Focus of AssessmentAchievement standards for which schools, teachers, and students are held accountable Specific achievement targets selected by teachers that enable students to build toward standards Driving ForceAccountabilityImprovement Place in timeEvent after learning is supposed to have happened Process during learning Chapius, J. & Chapius, C. (2002). Understanding school assessment: A parent and community guide to helping students learn. Assessment Training Institute: Portland, OR.

T HE CONCEPT OF R ELIABILITY What do we mean by reliable? The consistency of a measurement tool Not good or bad, just consistent Want to minimize “measurement error” Test-taker variables Hot, cold, noise, lack of sleep, lack of food, etc. Test administration Lack of standardization either knowingly or unwittingly Test scoring and interpretation Is the test more subjective? Then there will likely be more measurement error.

T YPES OF RELIABILITY TO CONSIDER Inter-rater reliability: consistency between scorers Test-retest reliability: variability over time for one person’s score Internal consistency: How well the items on a test measure the same construct

W HAT EXACTLY IS VALIDITY ? What do we mean by a valid measure? A judgment or estimate of how well a test measures what it purports to measure in a particular context Reliability is solely a statistical measure Validity is determined statistically as well as through common sense judgments

C ENTRAL T ENDENCY Mean, Median, Mode Range Standard deviation Consider the impact of… Small sample sizes Range restriction & outliers High & low achieving students

W HAT ’ S IN A SCORE ? Raw scores How many items a test taker got correct Standard score A raw score that has been converted from one scale to another scale Percentiles Divides performance into 100 equal parts Percentage correct

T HANK YOU ! P LEASE CONTACT US WITH QUESTIONS &