June 23, 2003 Council of Chief State School Officers What Does “Proficiency” Mean for Students with Cognitive Disabilities Dr. Ron Cammaert Riverside Publishing.

Slides:



Advertisements
Similar presentations
Presented to: CCSSO 2012 National Conference on Student Assessment June 27, 2012 Quality Assurance in a Chaotic World An External Perspective.
Advertisements

Student Portfolios presented by Career Services Personal mission statement Resume Academics Skills/Aptitudes Career Exploration Interests References Summary/Future.
National Accessible Reading Assessment Projects Principles and Guidelines NARAP Goal 3.
Gwinnett Teacher Effectiveness System Training
Virginia Teacher Performance Evaluation System 0 August 2012.
Round Table Discussion- Evaluating Arts Teachers William Kohut, Principal- Denver School of the Arts Dr. Mark Hudson- Director of Arts- Denver Public Schools.
Advanced Topics in Standard Setting. Methodology Implementation Validity of standard setting.
1 New England Common Assessment Program (NECAP) Setting Performance Standards.
Setting Performance Standards Grades 5-7 NJ ASK NJDOE Riverside Publishing May 17, 2006.
Presented by Denise Sibley Laura Jean Kerr Mississippi Assessment Center Research and Curriculum Unit.
Modified High School Assessment (Mod-HSA) Maryland State Board of Education August 26, 2008.
Alternative Maryland School Assessment (Alt-MSA)
Prepared by Jan Sheinker, Ed.D Points of view or opinions expressed in the paper are not necessarily those of the U.S. Department of Education, or Offices.
New Hampshire Enhanced Assessment Initiative: Technical Documentation for Alternate Assessments Standard Setting Inclusive Assessment Seminar Marianne.
National Center on Educational Outcomes N C E O What the heck does proficiency mean for students with significant cognitive disabilities? Nancy Arnold,
Setting Alternate Achievement Standards Prepared by Sue Rigney U.S. Department of Education NCEO Teleconference March 21, 2005.
Large Scale Assessment Conference June 22, 2004 Sue Rigney U.S. Department of Education Assessments Shall Provide for… Participation of all students Reasonable.
The State of the State TOTOM Conference September 10, 2010 Jim Leigh Office of Assessment and Information Services Oregon Department of Education.
Washington Group on Disability Statistics Pre-test implementation documents Catriona Bate September 2005.
Virginia Teacher Performance Evaluation System
Facts About the Florida Alternate Assessment Created from “Facts About the Florida Alternate Assessment Online at:
PRO-EAST Workshop1 Achievement of Learning Outcomes: Assessment Methods and Procedures Ian Freeston Engineering Council UK IET Academic Accreditation Committee.
Today’s website:
Stronge Teacher Effectiveness Performance Evaluation System
Exploring Alternate AYP Designs for Assessment and Accountability Systems 1 Dr. J.P. Beaudoin, CEO, Research in Action, Inc. Dr. Patricia Abeyta, Bureau.
Overview of Standard Setting Leslie Wilson Assistant State Superintendent Accountability and Assessment August 26, 2008.
Setting Performance Standards for the Hawaii State Alternate Assessments: Reading, Mathematics, and Science Presentation for the Hawaii State Board of.
Implementing Systemwide Advanced Placement (AP) Equivalencies Academic Senate for the California Community Colleges Spring Plenary; April 18, 2008 Dave.
1 New England Common Assessment Program (NECAP) Setting Performance Standards.
Assessing Students With Disabilities: IDEA and NCLB Working Together.
Alternative Assessment
ADEPT 1 SAFE-T Evidence. SAFE-T 2 What are the stages of SAFE-T? Stage I: Preparation  Stage I: Preparation  Stage II: Collection.
Providing Effective Descriptive Feedback: Designing Rubrics, Part 2 --Are you assessing what you think you’re assessing? Princess Anne Middle School Instructional.
Modified Achievement Tests for Students with Disabilities: Design Strategies and Experimental Results Stephen N. Elliott Vanderbilt University CCSSO’s.
Reporting student achievement Human Society and Its Environment © 2007 Curriculum K-12 Directorate, NSW Department of Education and Training.
Developing High Quality Student Learning Objectives
PSSA-M January 19, 2012 LEA meeting January 19, 2012 LEA meeting.
Virginia Alternate Assessment Program Standard Setting Richmond, Virginia September 18-21, 2001.
Standard Setting Results for the Oklahoma Alternate Assessment Program Dr. Michael Clark Research Scientist Psychometric & Research Services Pearson State.
PORTFOLIO ASSESSMENT OVERVIEW Introduction  Alternative and performance-based assessment  Characteristics of performance-based assessment  Portfolio.
Candidate Assessment of Performance (CAP): an Overview August 4, 2015 and August 10, 2015 Presented by: Jennifer Briggs.
Assessment in Special Education, SPED 4131 Professor Dr. Regina Blair
Summative Jeopardy Summing Up Summative Decision- Making.
Student Learning Objectives. Introductions Training Norms Be present Actively participate in activities Respect time boundaries Use electronics respectfully.
Helping Students Focus on Learning, Not Grades
Rubric Assessment On the path to Common Writing Assessments.
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov February 16, 2011.
Identifying Assessments
Vertical Articulation Reality Orientation (Achieving Coherence in a Less-Than-Coherent World) NCSA June 25, 2014 Deb Lindsey, Director of State Assessment.
NAEP Achievement Levels Michael Ward, Chair of COSDAM Susan Loomis, Assistant Director NAGB Christina Peterson, Project Director ACT.
Ohio’s Alternate Assessments for Students with Disabilities Thomas Lather Office for Exceptional Children (614)
Evaluation Results MRI’s Evaluation Activities: Surveys Teacher Beliefs and Practices (pre/post) Annual Participant Questionnaire Data Collection.
Presentation to the Nevada Council to Establish Academic Standards Proposed Math I and Math II End of Course Cut Scores December 22, 2015 Carson City,
APPROVED CLINICAL INSTRUCTOR WORKSHOP Evaluation.
Setting Performance Standards EPSY 8225 Cizek, G.J., Bunch, M.B., & Koons, H. (2004). An NCME Instructional Module on Setting Performance Standards: Contemporary.
High School Proficiency Exam Nevada Department of Education.
Candidate Assessment of Performance (CAP): an Overview CAP Practicum Workshop for AIC Teacher Candidates Practicum Workshop Pt.2.
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov March 23, 2011.
Still Building a Brighter Future for Young People through Sport
Next-Generation MCAS: Update and review of standard setting
Transforming Grading Robert Marzano
Award in Education and training
RELATING NATIONAL EXTERNAL EXAMINATIONS IN SLOVENIA TO THE CEFR LEVELS
Creating Your Portfolio
Accessibility Supports Training
Transitioning to Next Generation Assessment: A Framework of Performance Assessment Approaches Emily R. Lai 1.
Accessibility Supports Training
Accessibility Supports Training
Standards-based Individualized Education Program (IEP) Module Two: Developing the Present Level of Academic Achievement and Functional Performance (PLOP)
Deanna L. Morgan The College Board
Presentation transcript:

June 23, 2003 Council of Chief State School Officers What Does “Proficiency” Mean for Students with Cognitive Disabilities Dr. Ron Cammaert Riverside Publishing Company

June 23, 2003 Council of Chief State School Officers Introduction  Goal - recommend performance thresholds  Variation on a holistic method - consider whole of individual’s work  Loosely based on Jaeger and Mills’ method (Cizek, 2001)

June 23, 2003 Council of Chief State School Officers Introduction  Classify student work into one of four categories  Category decided from a minimum subject rating and a minimum rating on generalization skills

June 23, 2003 Council of Chief State School Officers Description of Scores Part I Content Area Part II Generalized Skill Total score = progress in content area (Part I score) + mod + set + soc+ self

Decision Rule for Determining Level of Performance on WAAS portfolio LevelTotal ScorePart I Score Required 416 to 203 or to 152 or 3 or 4 28 to 111 or 2 or 3 or 4 15 to 71 or 2 or 3 *

Relationship Among Total Score, Level and Score Patterns Score LevelConM/AS/CS RS D

June 23, 2003 Council of Chief State School Officers Initial Procedure  A sample of portfolios from 2001 and 2002 with adequate evidence selected  14 portfolios selected - 32 different scoring patterns

June 23, 2003 Council of Chief State School Officers Step 1 - Training  Information about standard setting and how results will be used

June 23, 2003 Council of Chief State School Officers Step 2 - Review of the Assessment Material  Participation criteria for WAAS  Content validity evidence for the assessment and the scoring processes  Exemplars of student work for each score point  The Portfolio Scoring Summary  EALR Extensions

June 23, 2003 Council of Chief State School Officers Step 3 - Understanding the Definitions of the Standards  Brainstorm - students and student work that typifies each category  Academic Achievement Standard Descriptions

June 23, 2003 Council of Chief State School Officers Step 4 - Round 1  Using the table of frequencies of scoring patterns and the descriptors for each standard panelists decided on the category (“meets” or “not meets” proficiency) for each score pattern

June 23, 2003 Council of Chief State School Officers Step 5 - Round 2  Feedback on the panel cut scores  Given the set of 14 scored portfolios  Working individually reviewed each portfolio  Decisions for each portfolio and reset, if needed, the minimum score for each level  In groups discuss ratings  Individually completed the rating form for Round 2

June 23, 2003 Council of Chief State School Officers Step 6 - Review of Impact Data  Statewide frequencies for each score pattern from 2002 portfolio scores  Panelists discussed the impact of standards  Gave final rating  The final cut scores the mean of the minimum total scores for each category

June 23, 2003 Council of Chief State School Officers Step 7 - Evaluation of the Standard-Setting Process  Questionnaire

June 23, 2003 Council of Chief State School Officers Documentation  Minutes from National TAC  Script developed  Observer during session – follow script  Technical Report