Designing and Using Rubrics David Steer Department of Geosciences The University of Akron October 2013

Pilot Materials, Make changes Identify Course & Module Learning Goals Identify learning objectives for individual lessons Determine how to assess and measure student success on goals and objectives Design teaching resources and materials to match assessments Plan Instructional Strategies to implement teaching resources Pilot Materials, Make changes Students work together in small groups determined by experience, skills, or demographic factors (e.g., gender) Formative exercises during class used to assess student understanding and progress and to challenge students to think beyond comfort level Classes incorporate most or all of 7 good practices How can feedback devices produce learner-centered classes?

What are Scoring Rubrics? Scoring rubrics are descriptive scoring schemes used to evaluate effort Two Major Types Holistic: set of descriptions used to assign a score to the whole Analytic: Set of components that are independently evaluated (sum for score) Students work together in small groups determined by experience, skills, or demographic factors (e.g., gender) Formative exercises during class used to assess student understanding and progress and to challenge students to think beyond comfort level Classes incorporate most or all of 7 good practices How can feedback devices produce learner-centered classes? For other types of rubrics see: http://www.utexas.edu/academic/ctl/assessment/iar/students/report/rubrics-types.php

Designing Rubrics Determine the most important attributes needed to evaluate the LO Decide analytic or holistic Define levels Success Part Way There Needs Work Students work together in small groups determined by experience, skills, or demographic factors (e.g., gender) Formative exercises during class used to assess student understanding and progress and to challenge students to think beyond comfort level Classes incorporate most or all of 7 good practices How can feedback devices produce learner-centered classes?

Good Rubrics … Have clear criteria Have distinctive levels Each criteria is distinct, clearly delineated and fully appropriate for the outcome Have distinctive levels Each level is distinct and progresses in a clear and logical order Can be used reliably by multiple raters Provide guidance to learners Rubric serves as primary reference point for discussion and guidance for program/supporting outcome as well as evaluation of assignment(s) Support Metacognition Rubric is regularly referenced and used to help learners identify the skills and knowledge they are developing throughout the program Students work together in small groups determined by experience, skills, or demographic factors (e.g., gender) Formative exercises during class used to assess student understanding and progress and to challenge students to think beyond comfort level Classes incorporate most or all of 7 good practices How can feedback devices produce learner-centered classes?

Holistic Example Outcome: Students will demonstrate the ability to properly process and interpret data Students work together in small groups determined by experience, skills, or demographic factors (e.g., gender) Formative exercises during class used to assess student understanding and progress and to challenge students to think beyond comfort level Classes incorporate most or all of 7 good practices How can feedback devices produce learner-centered classes?

Analytic Example Outcome: Material developers will demonstrate the ability to incorporate InTeGrate Guiding Principles in their curriculum Students work together in small groups determined by experience, skills, or demographic factors (e.g., gender) Formative exercises during class used to assess student understanding and progress and to challenge students to think beyond comfort level Classes incorporate most or all of 7 good practices How can feedback devices produce learner-centered classes?

Pilot Materials, Make changes Identify Course & Module Learning Goals Identify learning objectives for individual lessons Determine how to assess and measure student success on goals and objectives Design teaching resources and materials to match assessments Plan Instructional Strategies to implement teaching resources Pilot Materials, Make changes Students work together in small groups determined by experience, skills, or demographic factors (e.g., gender) Formative exercises during class used to assess student understanding and progress and to challenge students to think beyond comfort level Classes incorporate most or all of 7 good practices How can feedback devices produce learner-centered classes?