Rubrics

What is a rubric? An evaluation tool As simple as a checklist (holistic) to highly complex (analytic) Quality control Provide feedback for areas of improvement Can be developed and used by students, instructors, & administrators

Rubrics can be used: For assessment of an assignment By students for self-assessment or peer assessment For course assessment For program assessment

Rubric Components Dimension/ Characteristic Exemplary Competent Developing

Score of 3 Proficient Project had a hypothesis, procedure, collected data, and analyzed results. Project is thorough and finding(s) are in agreement with data collected. May have minor inaccuracies that do not effect quality of project. Score of 2 Adequate Project may have a hypothesis, procedure, collected data, and analyzed results. Project not as thorough as it could be; there are a few overlooked areas. Has a few inaccuracies that effect quality of project. Score of 1 Limited Has several inaccuracies that effect quality of project. Holistic Rubric entire product or assignment evaluated & scored as a single dimension or category Source: Luft, J. (1997). Design Your Own Rubric. Science Scope, Feb. 97, p. 25-27

Analytical Rubric multiple dimensions or categories evaluated & scored

Assessment rubric for open-ended concept questions. Regassa and Morrison-Shetlar, JCST 2009

Assessment rubric for open-ended concept questions. Regassa and Morrison-Shetlar, JCST 2009

Why is RNAse added to the initial buffer in the DNA extraction kit? Assessment rubric for open-ended concept questions. Why is RNAse added to the initial buffer in the DNA extraction kit? Specifically, what does it do and when does it do it?  Student 1 Response: cuts up the RNA into different fragments Student 2 Response: The RNAse A was added to digest the RNA.  It is added in the P1 [buffer].  However, it does not begin to work until the cells have been lysed which comes from the addition of Buffer P2 Regassa and Morrison-Shetlar, JCST 2009

Designing a Rubric- Draft Refer to course objectives Choose ONE task for rubric generation (e.g. oral presentation, lab report, position paper) Use assignment description to choose dimensions or criteria – these should be important, measurable, feasible Select a scale & number of levels

Designing a Rubric - Draft Select a scale & number of levels novice - intermediate - advanced exceeds expectations - meets expectations - below expectations unacceptable - marginal - good - exemplary excellent - quite satisfactory - needs revisions - unacceptable novice - developing - proficient - expert missing - poor - satisfactory - good - exceptional almost always - often - occasionally - rarely – never numeric scale: 1 2 3 4 5

Designing a Rubric - Draft For each criteria, describe an acceptable or “middle” level of performance; then upper & lower levels Hints for performance level descriptions Look at examples of existing rubrics and adapt them. Describe the characteristics of the “ideal” and the “worst” case. Identify the most common errors that make an example fall short of “ideal” or the qualities that make it better than the “worst” case. Using samples of existing work, divide into levels corresponding to the levels you set. What are the qualities of the best work? The poorest work? Add descriptors to the appropriate categories.

Designing a Rubric - Draft Decide on weighting/points for categories (if desired)

Designing a Rubric - Refine Colleague feedback Attempt to use with prior class results Evaluate consistency of rubric scoring Pilot

Designing a Rubric – Tools

Designing a Rubric – Resources Books Arter, J. & McTighe, J. (2001). Scoring Rubrics in the Classroom. Huba, M.E. & Freed, J.E. (2000). Learner-Centered Assessment on College Campuses. Maki, P.L. (2004). Assessing for Learning. Levi, Antonia J. and Dannelle D. Stevens. (2004). Introduction To Rubrics: An Assessment Tool To Save Grading Time, Convey Effective Feedback and Promote Student Learning. Stevens, D.D. & Levi, A.J. (2005) Introduction to Rubrics. Online Resources Good “how to” site focusing on assessment, including rubrics http://jonathan.mueller.faculty.noctrl.edu/toolbox/rubrics.htm Grading & performance rubrics with links to sample rubrics http://www.cmu.edu/teaching/designteach/teach/rubrics.html Links to rubrics samples from University of Alabama http://www.assessment.ua.edu/Rubrics/Non_UA_Rubrics.html Rubistar online primary traits analysis rubric generator http://rubistar.4teachers.org/ Another free online analytical rubric generator http://myt4l.com/index.php?v=pl&page_ac=view&type=tools&tool=rubricmaker