Fairness Issues and Test-based Educational Accountability Katherine Ryan and Bill Trent University of Illinois at Urbana.

Slides:



Advertisements
Similar presentations
Open Hearing on Revising the Standards for Educational and Psychological Testing National Council on Measurement in Education March 25, 2008 New York,
Advertisements

The Role of the Principal Going Forward. What Leon School District is Required to Do Florida Department of Educations Supports that might impact you What.
Fairness in Testing: Introduction Suzanne Lane University of Pittsburgh Member, Management Committee for the JC on Revision of the 1999 Testing Standards.
Contextualised teacher judgments in a high-stakes assessment system John A Pitman Queensland, Australia.
Session 3 The evidence should be credible & helpful. Implications: the assessments should – ◦ Be grounded in real-world applications, supplemented as.
Developing a Framework for Examining Validity in State Accountability Systems Ellen Forte Fast edCount, LLC AERA Division H Paper Presentation April 15,
Culturally Responsive Literacy Academy 1: Literacy for What?
A Collaborative Project between the Texas Education Agency and the Texas Higher Education Coordinating Board.
Issues of Technical Adequacy in Measuring Student Growth for Educator Effectiveness Stanley Rabinowitz, Ph.D. Director, Assessment & Standards Development.
Robert J. Mislevy & Min Liu University of Maryland Geneva Haertel SRI International Robert J. Mislevy & Min Liu University of Maryland Geneva Haertel SRI.
Jon Mueller Professor of Psychology North Central College
Language Testing Introduction. Aims of the Course The primary purpose of this course is to enable students to become competent in the design, development,
AACC 1 Helping States and Regional Centers Meet NCLB Goals: State Accountability Systems Stanley Rabinowitz, Ph.D. WestEd CRESST Conference January 22-23,
Special Education in the Calgary Board of Education Presented by: Debra Caso-Rohland Pat Loewen.
African Librarianship and the Academic Enterprise Prepared By: Kay Raseroka Director: Library Services University of Botswana.
Professional Standards 2009 Suzanne Scott, Ph.D., IDEC, ASID, Megan Scanlan, Director of Accreditation,
Job Analysis Employer and Employee Perspectives. Strategic Importance of Job Analysis and Competency Modeling Job analysis and competency modeling are.
Critical Resources to Support School and Community Partnerships: The School Counselor’s Role Sabri Dogan, Doctoral Student, OSU David Julian, Ph.D., OSU.
Laws, Policy, Theory & Research.  Teacher Evaluation As a Policy Target for Improved Student Learning: A Fifty-State Review of Statute and Regulatory.
Capability Assessment Process
Students in the Gap: Understanding Who They Are & How to Validly Assess Them.
Mainstream/Integration Po-tay-to/Po-tah-to Maryce Ramsey, Senior Gender Advisor, FHI 360 June 16, 2014.
ISSUES PERSPECTIVES KNOWLEDGE ACTIONS CONSEQUENCES THE FIVE STEPS OF REFLECTIVE PRACTICE.
PSYCHOEDUCATION: APPLICATIONS FOR CROSS- SYSTEMS PRACTICE IN INTERNATIONAL CONTEXT Mainstreaming Mental Health in Public Health Paradigms: Global Advances.
WHO Report 2000 Comments of experts panel. The four functions WHR 2000 described four functions of the health system – financing, resource generation,
ATTRIBUTEDESCRIPTION Focal Knowledge, Skills, Abilities The primary knowledge / skills / abilities (KSAs) targeted by this design pattern. RationaleHow/why.
Copyright © 2013 by Educational Testing Service. All rights reserved. Vertical Articulation in the Context of States’ Transition to the Common Core State.
Organization behavior 11 th edition by Fred Luthans Teacher : Azhar Ali Shah AZHAR. ALI1.
The Role of Patients in Defining Value: Benefits for HTA KEN BOND, DIRECTOR, STRATEGIC INITIATIVES.
A Principled Approach to Accountability Assessments for Students with Disabilities CCSSO National Conference on Student Assessment Detroit, Michigan June.
Urban Mathematics Education Leadership Academy Session 1 February 4-6, 2009 Dallas, TX.
STATE-WIDE COOPERATIVE EDD UNIVERSITY OF MISSOURI - COLUMBIA.
Encouragement learners to share their personal history and experiences.
CT 854: Assessment and Evaluation in Science & Mathematics
Dr. Nancy S. Grasmick July 26,2012.  Maryland is proud to be the top-ranked state in U.S. growth as reported in this study, and judged by Education Week.
Training and Development Prof R K Singh AIMA CME.
Race to the Top Assessment Program General & Technical Discussion Lizanne DeStefano University of Illinois.
Introduction. What is Pathways to Results? Improve student transition to college and careers Develop outcomes- and equity-focused Programs of Study Engage.
Pathways to Results ToTo Pathways Results. What is Pathways to Results? Improve student transition to college and careers Develop outcomes- and equity-focused.
ENDING YOUTH POVERTY THROUGH EMPOWERMENT Managing your Board- Community Leadership & Governance Leadership that’s Right for You.
1 Oregon Content Standards and Assessment System Evaluation Prepared for the Oregon Department of Education by WestEd Dr. Stanley Rabinowitz Dr. Edynn.
Community Planning 101 Disability Preparedness Summit Nebraska Volunteer Service Commission Laurie Barger Sutter November 5, 2007.
Victorian Curriculum: Introduction and overview
How does engaging in metacognitive strategies help students own their own learning? I can create a plan for helping students become aware of the importance.
1 Evaluation Utilization: the case of the Paris Evaluation (Phase 1) and its use in the Accra HLF3 process Paris Evaluation Phase 2 Planning Meeting, Feb.
Foundations of American Education: Perspectives on Education in a Changing World, 15e © 2011 Pearson Education, Inc. All rights reserved. Chapter 11 Standards,
© 2005 Prentice-Hall, Inc. 6-1 Chapter 6 Groups and Teams.
Neo-Conservative Ideas Berliner and Biddle ( ) Neo-conservative “centrist” thought won out in school reform. Main approaches to school reform: Get.
How to Prepare an MLA Annotated Bibliography. WHAT IS AN ANNOTATED BIBLIOGRAPHY? An annotated bibliography is a list of citations for books, articles,
Developing the Tests for NCLB: No Item Left Behind Steve Dunbar Iowa Testing Programs University of Iowa.
Saint Anne School Barrington, IL Sister Ann Busch, Principal Donna Konie, Teacher Portfolio Assessment for Teachers.
Introducing Ethical Capability Focus on Objectives  an overview of the Ethical Capability curriculum  introduction of an ethical issue planning.
Implementation—Group E Timothy Strauman, presenter Bruce Chorpita, group chair.
The Demographic Definition of a City This definition was first codified by sociologist Louis Wirth in his influential 1938 paper, “Urbanism as a way.
New Survey Questionnaire Indicators in PISA and NAEP
Chapter 6 Internal Analysis McGraw-Hill/Irwin
Overview of SB 191 Ensuring Quality Instruction through Educator Effectiveness Colorado Department of Education Updated: June 2012.
The Scientific Basis for the Art of Teaching
Subject Development in History
Assessment to Support Competency-Based Pathways
PSY 302 STUDY Imagine Your Future /psy302study.com
Chapter 18 Assessment Issues in Education
Multiliteracies for the 21st Century Schools Written by Dr
MODULE 5 – SELF AWARENESS AND GROUP EMPOWERMENT
Global Trends, Development Dynamics and the Role of the OECD
CJS 221 Possible Is Everything/snaptutorial.com
CJS 221 RANK Lessons in Excellence-- cjs221rank.com.
Competency 007: E.
Understanding and Using Standardized Tests
Ch.2 Discussion Questions
Presentation transcript:

Fairness Issues and Test-based Educational Accountability Katherine Ryan and Bill Trent University of Illinois at Urbana

Fairness and Bob Linn Influential technical contributions Commitment and expertise involving assessment and accountability fairness A leader and champion

Our paper Brief history of assessment fairness Assessment fairness and test-based accountability Assessment fairness Models Consequences Information about resources, instructional practices, and organizational characteristics

Assessment Fairness and Educational Accountability Educational accountability and inequities Changes in educational testing context Implications for educational measurement practice

Educational Accountability NCLB goals are noteworthy Fundamental right Educational accountability meanings Identify inequities

High Stakes and Assessment Shift from description and placement to accountability Bias Four distinct perspectives on fairness Defining assessment fairness (Willingham and Cole)

Implications for Measurement Practice Context Item and test characteristics Student responses Population Moderation of group differences

More Implications Multiple Measures Definitions Assessment information Non-cognitive measures Obstacles Costs Traditional validity notions

OTL and Test-based Accountability NCLB highlights differences in learning by subgroup Fairness and OTL knowledge and skills OTL and resources

Educational resources Quality of education Quality of educators School finances

Fairness Issues and Test- based Accountability Models Tests and measures are foundation Accountability Models Assessment fairness issues Fairness issues related to rules Bob Linn’s work revealed critical fairness concerns with models (e.g., high poverty schools with large minority populations)