1 Module 3: Scoring Rubrics  After you have reviewed the examples of scoring rubrics: identify what you consider to be the most useful approaches and.

Slides:



Advertisements
Similar presentations
Assessing Student Performance
Advertisements

Aligning and Integrating General Education and the Majors at a Large Public Research University Anthony Ciccone William Keith Jeffrey Merrick University.
Rubric Design Denise White Office of Instruction WVDE.
Parkland School Division
Assessment Assessment should be an integral part of a unit of work and should support student learning. Assessment is the process of identifying, gathering.
 Reading Assessment informs instruction  We base our reading instructional program on the student’s reading strengths and weaknesses  Differentiate.
Teacher Evaluation Model
Part II Sigma Freud & Descriptive Statistics
1 Module 2: Tasks that Prompt Students’ to Represent Your Outcome Statements “ Every assessment is also based on a set of beliefs about the kinds of tasks.
Assessment Literacy Series 1 -Module 4- Scoring Keys and Rubrics.
Using Rubrics to Enhance Learning Connie Schroeder, Ph.D. Center for Instructional and Professional Development University of Wisconsin-Milwaukee.
Assessment Rubrics Los Angeles City College Assessment Team.
Developing and Validating Scoring Rubrics Presented at CCRI September, 2005 Peggy Maki
Lamar State College-Port Arthur February 16 & 17, 2011.
Introduction to Rubrics. What is a rubric? Rubrics classify behaviors or abilities into categories that vary along a continuum, and they are tools that.
Learning targets: Students will be better able to: ‘Unpack’ the standards. Describe the purpose and value of using a rubric Evaluate whether a rubric can.
Performance Management
5 Criteria of Performance Measures
Emily H. Wughalter, Ed.D. Measurement & Evaluation Spring 2010.
PEGGY MAKI, PH.D. EDUCATION CONSULTANT IN ASSESSING STUDENT LEARNING PRESENTED AT CCRI SEPTEMBER 21, 2012 Assessment at Three Levels: Institution, Program,
1 Selecting Appropriate Assessment Methods Presented at the Teaching & Learning Innovations 17 th Annual Conference At the University of Guelph May 12,
Classroom Assessment LTC 5 ITS REAL Project Vicki DeWittDeb Greaney Director Grant Coordinator.
Classroom Assessments Checklists, Rating Scales, and Rubrics
ACCESS for ELLs® Interpreting the Results Developed by the WIDA Consortium.
Assessing General Education Workshop for College of the Redwoods Fred Trapp August 18, 2008.
Classroom Assessment A Practical Guide for Educators by Craig A. Mertler Chapter 7 Portfolio Assessments.
Measuring Complex Achievement
Checklists and Rubrics
Student assessment Assessment tools AH Mehrparvar,MD Occupational Medicine department Yazd University of Medical Sciences.
TRUSTWORTHINESS OF THE RESEARCH Assoc. Prof. Dr. Şehnaz Şahinkarakaş.
1 Orientation Session at 2003 Assessment Conference A Richer and More Coherent Set of Assessment Practices Peggy L. Maki Senior Scholar Assessing for Learning.
Richard Woods, Georgia’s School Superintendent “Educating Georgia’s Future” gadoe.org Assessment for Learning Series Module 4: Working through Complex.
PORTFOLIO ASSESSMENT OVERVIEW Introduction  Alternative and performance-based assessment  Characteristics of performance-based assessment  Portfolio.
Presented to GETSI by Ellen Iverson, SERC, Carleton College Developed as InTeGrate talk by David Steer Department of Geosciences The University of Akron.
Rubrics. What is a Rubric? A rubric is a set of guidelines for scoring performance against criteria. Performance is described along a scale of quality.
SHOW US YOUR RUBRICS A FACULTY DEVELOPMENT WORKSHOP SERIES Material for this workshop comes from the Schreyer Institute for Innovation in Learning.
DPASII Criterion Rubrics for Teachers. Component 1: Planning and Preparation Criterion 1a: Selecting Instructional Goals ELEMENT Value, sequence and alignment.
Core Competencies for Adolescent Sexual and Reproductive Health Performance Assessment and Human Resources Toolkit.
Alternative Assessment Chapter 8 David Goh. Factors Increasing Awareness and Development of Alternative Assessment Educational reform movement Goals 2000,
Consistency of Moderation
Identifying Assessments
Writing Effective Rubrics
Developing Rubrics within the Context of Assessment Methods Peggy Maki Senior Scholar Assessing for Learning AAHE
MAVILLE ALASTRE-DIZON Philippine Normal University
Rubrics Staff development workshop 19/9/2014 Dr Ruth Fazakerley.
Using the framework to ground decisions in the quality of teacher practice.
GRADING n n Grading that reflects the actual ability of the student n n Grading as a personal communication.
Rubrics.
Developing Rubrics to Measure Learning at MICA
Classroom Assessments Checklists, Rating Scales, and Rubrics
C H A P T E R 3 Rubrics Chapter 3 Rubrics.
Presented by Deborah Eldridge, CAEP Consultant
Rubric Development and Design
Creating Analytic Rubrics April 27, 2017
The Open Ended Response
Classroom Assessments Checklists, Rating Scales, and Rubrics
Rubrics.
Rubrics.
Module 9: Category III: Monitoring Student Progress
Preparation for the American Literature Eoc
Authentic Assessment: Texas Core
Designing and Using Rubrics
Effective Use of Rubrics to Assess Student Learning
Text Dependent Analysis: Building teacher capacity to instruct for a new item type Susan Lyons, Ph.D. CCSSO 2016 National Conference on Student Assessment.
Georgia Department of Education
jot down your thoughts re:
jot down your thoughts re:
Georgia Department of Education Assessment and Accountability Division
Dr. Huda Sarraj Bouchra Bakach
Presentation transcript:

1 Module 3: Scoring Rubrics  After you have reviewed the examples of scoring rubrics: identify what you consider to be the most useful approaches and explain why you think those approaches are useful o identify questions these examples raise about how to develop useful scoring rubrics

2 Scoring rubrics--A set of criteria that identifies the: (1) expected characteristics/traits of student work/behavior (2) levels of achievement along those characteristics/traits

3 Are criterion-referenced, providing a means to assess the multiple dimensions of student learning. Are collaboratively designed based on how and what students learn (based on curricular-co- curricular coherence) Are aligned with ways in which students have received feedback (students’ learning histories)

4  Are useful to students, assisting them to improve their work and to understand how their work meets standards (can provide a running record of achievement). Make them public.  Raters use them to derive patterns of student achievement to identify strengths and weaknesses and thus verify the efficacy of educational practices as well as those that need to be changed

5 Interpretation through Scoring Rubrics  Criteria descriptors (ways of thinking, knowing or behaving represented in work)  Creativity  Self-reflection  Originality  Integration  Analysis  Disciplinary logic

6  Criteria descriptors (traits of the performance, work, text)  Coherence  Accuracy or precision  Clarity  Structure

7  Performance descriptors (describe how well students execute each criterion or trait along a continuum of score levels). Use numbers or words with descriptive elaboration, such as: Exemplary—Commendable– Satisfactory- Unsatisfactory Excellent—Good—Needs Improvement— Unacceptable Expert—Practitioner—Apprentice—Novice

8 Development of Scoring Rubrics  Emerging work in professional and disciplinary organizations  Research on learning (from novice to expert)  Student work itself—derive traits and levels beginning with high to low achievement  Interviews with students or integration of them in the creation of a scoring rubric  Experience observing students’ development

9 Creating Your Scoring Rubric through a Review of Student Work  Identify the learning outcome or outcomes your method is designed to prompt students to represent  From your own students’ work, describe the traits or characteristics or behaviors you expect students’ to demonstrate  Identify student work that demonstrates exemplary achievement of those traits or characteristics or behaviors

10  In a sentence describe each of those traits or behaviors  Identify student work that that demonstrates the lowest levels of achievement under each of your criterion  In a sentence describe each of those traits or behaviors

11  Identify work that demonstrates ranges of abilities or behaviors inbetween the lowest and highest student work  In one sentence describe those ranges in your emerging rubric

12 Pilot-test Your Scoring Rubric  Share your rubric with a colleague and ask him or her to apply it to samples of student work to see if a scorer understands your criteria and performance levels and if a scorer has difficulty with overlap in the criteria or performance descriptors you have developed.

13  Discuss that scorer’s difficulties or uncertainties  Be prepared to discuss with the larger group your rubrics and experiences as a scorer

14 Pilot-Testing Scoring Rubrics to Establish Inter-rater Reliability  Schedule inter-rater reliability times: -independent scoring -comparison of scoring -reconciliation of responses -repeat cycle until scorers are calibrated -provide anchor examples for scorers so they can continue to calibrate their scores during real-time scoring