Scoring Rubrics: Validity and Reliability Barbara M. Moskal Colorado School of Mines.

Slides:



Advertisements
Similar presentations
Assessment types and activities
Advertisements

Confirming Student Learning: Using Assessment Techniques in the Classroom Douglas R. Davenport Dean, College of Arts and Sciences Truman State University.
Creating and Using Rubrics for Evaluating Student Work Prepared by: Helen Jordan Mathematics Coordinator Normandie Avenue Elementary.
I Came, I Saw, I Rubric-ed: Conquering Grading Learning College Conference 2009 Jeanne Ann Graham.
Vivian Mun, Ed.D. Accreditation What is a rubric? A rubric is a scoring tool that lists the criteria for a piece of work, or “what counts” (for.
Systematic Assessment of Student Achievement February 5, 2007.
Chapter 8 Criteria and Validity PERSIAN GROUP. ارزیابی امتحان آزمون ارزیابی امتحان آزمون ارزیابی امتحان آزمون ارزیابی امتحان آزمون ارزیابی امتحان آزمون.
Let’s Get Creative!. Solving the Assessment Puzzle What are rubrics ? Why we should use them? How do we create them?
Developing Rubrics Presented by Frank H. Osborne, Ph. D. © 2015 EMSE 3123 Math and Science in Education 1.
Paul J. Charpentier. How do you use them?  Holistic  Analytical.
Performance Assessment for California Teachers PACT PACT is a consortium of teacher preparation programs that have joined together to develop a teacher.
Middle Years Programme
Education 3504 Week 3 reliability & validity observation techniques checklists and rubrics.
Rubrics Source: Schultz, K. A. (2004). Rubrics: Roadmaps to success. Educational Leadership, 58(4).
Giving Quality Feedback
The Literacy and Numeracy Secretariat Le Secrétariat de la littératie et de la numératie October – octobre 2007 The School Effectiveness Framework A Collegial.
Principles of Assessment
Your PowerQuest Title A ? PowerQuest for ? Grade By: Insert Your Name and School.
Educational Psychology: Theory and Practice Chapter 13 Assessing Student Learning.
Classroom Assessment and Grading
Changes to Assessing and Reporting Shawn Whyte Assessment Coach.
Lynn Thompson Center for Applied Linguistics Startalk Network for Program Excellence Chicago, Illinois October 16-18, 2009 Formative and Summative Assessment.
Classroom Assessment A Practical Guide for Educators by Craig A
Threshold Concepts & Assessment Ahmed Alwan, American University of Sharjah Threshold Concepts For Information Literacy: The Good, the Bad and the Ugly.
Alternative Assessment
Assessment Mr. Galusha. Assessment What is it? Why do it?
Student Growth in the Washington State Teacher Evaluation System Michelle Lewis Puget Sound ESD
Reporting progress and achievement: Creating informative and manageable technology reports Selena Hinchco.
What is it we expect students to learn? Curriculum learning tasks need to be clearly stated 1.What policies and practices, regarding curriculum development,
APRIL 16, 2013 A review of Chapters CHAPTER FOURTEEN The Role of Assessment VOCABULARY.
Second session of the NEPBE I in cycle Dirección de Educación Secundaria February 22, 2013.
Basic Sewing BY: Phibie S. Bate Cathyrine F. Gonzales.
EDU 385 CLASSROOM ASSESSMENT Week 1 Introduction and Syllabus.
Performance-Based Assessment HPHE 3150 Dr. Ayers.
PRIJ, 3030 January the 22nd Assessment. Guiding questions… What are the implications for your general practices around planning and assessment? How will.
PORTFOLIO ASSESSMENT OVERVIEW Introduction  Alternative and performance-based assessment  Characteristics of performance-based assessment  Portfolio.
Creating Quality Rubrics: 4 Central Questions about Rubrics
Formative and Summative Evaluation. Formative Evaluation The goal of formative assessment is to Monitor student learning Provide ongoing feedback Improve.
Effective Grading Strategies Alison Morrison-Shetlar Faculty Center for Teaching and Learning Adapted from the book Effective Grading by Barbara Walvoord.
TASK PROCESS RESOURCES EVALUATION CONCLUSION TEACHER INTRO STUDY GUIDE PowerQuest Creation Using this template PowerPoint can be used to create a WebQuest,
InAction!.   PBL is curriculum fueled and standards based.  PBL asks a question or poses a problem that ALL students can answer. Concrete, hands-on.
© 2008 Gatsby Technical Education Projects. These slides may be used solely in the purchaser’s school or college. Evaluating scientific writing.
An Assessment For Learning. A rubric is a scoring tool that lists the criteria for a piece of work, or “what counts” and clearly defines gradations of.
Reflective Learner.
Rubric Assessment On the path to Common Writing Assessments.
Challenge Question: What is the value of keeping logs and journals as an educator? Self-Test Questions: 1.How do you determine appropriate uses of logs.
Session 1 Introduction: Assessment & Evaluation Assessment & Evaluation.
The School Effectiveness Framework
Checklists and Rubrics EDU 300 Newberry College Jennifer Morrison.
 Teaching: Chapter 14. Assessments provide feedback about students’ learning as it is occurring and evaluates students’ learning after instruction has.
Grading based on student centred and transparent assessment of learning outcomes Tommi Haapaniemi
GRADING n n Grading that reflects the actual ability of the student n n Grading as a personal communication.
RUBRICS Presented by: Dan, Chanel & Nancy. What is a rubric? For TEACHERS:a tool for assessment, for providing instructions to students, and for outlining.
Assessment in Education ~ What teachers need to know.
The Achievement Chart Mathematics Grades The primary purpose of assessment and evaluation is to improve student learning.
AAC Assessment Glossary
Is what you say you teach, what your students learn?
Classroom Assessment A Practical Guide for Educators by Craig A
Rubrics for teachers Using Rubrics to Evaluate Written Work Dunja Frković, Medicinska škola u Rijeci, za ŽSV u Bakru,
Writing Rubrics and exemplars
Design & Use of Rubrics General Thoughts Regarding Rubrics
Critically Evaluating an Assessment Task
VaNTH-PER Workshop June 2, 2004 Barbara A Austin
How will YOU know when you have LEARNED it?
Unit 4 - A06 – Review Grade Criteria To get a c
Alternative Assessment
Kindergarten Student Assessing Writing
The Teacher Work Sample: An Authentic Assessment
Teacher Report Card Grade 5/6 2011/12
Presentation transcript:

Scoring Rubrics: Validity and Reliability Barbara M. Moskal Colorado School of Mines

Goals Reflect on the importance of clearly defining criteria for evaluation. Define what a scoring rubric is and how rubrics may be used in the grading of essays. Discuss the different types of rubrics. Examine an example scoring rubric. Discuss the validity and reliability of a scoring rubric.

Reflection Think back on your own education. Think of a personal experience in which you received an unfair grade or test score. What made the experience unfair? How did it make you feel? How did it impact your subsequent learning? What would have you done differently had you been the instructor?

Scoring Rubrics Descriptive Scoring Schemes. Provide teachers with guidance during the scoring process. Provide students with guidance as to the scoring criteria. Provides students with feedback as to how to improve their performances.

Types of Rubrics Holistic/Analytic General/Task specific

How to begin? Write a clear statement of the goals and objectives of the assessment. Determine the type of rubric that you will need.

Validity Does a task measure the target achievement?

Guiding Questions How well does your rubric address your learning objectives? Does your rubric assess unintended skills or concepts? What are the critical pieces of your rubric that students will need to know in order to be successful on the assessment?

Reliability Can a task be scored consistently?