1. Calibrated Peer Review TM A Case Study http://cpr.molsci.ucla.edu Arlene A. Russell, UCLA NLII Focus Session June 15-16, 2005

2. Case Study Detailed look at –a well-crafted assignment –the instructor interfaces –student performance data –the support structure that facilitates effective implementation of this innovation

3. Overview The CPR process Elements of a well-crafted assignment Selected features of the instructor interface Details of monitoring student performance Support structures that facilitate effective CPR implementation

4. The CPR Process http://cpr.molsci.ucla.edu Select “TOUR”

5. Assignment Elements Goals Source material Student instructions for studying source material Guiding questions for directing the essay outline Writing prompt Training (calibration) essays - 3 Rubrics and answer keys for each calibration

6. Example Assignment http://cpr.molsci.ucla.edu Select “Assignment Library Scroll to #65 Interpreting Single Substance Phase Diagrams

7. Instructor Tools http://cpr.molsci.ucla.edu Select “Downloads” from sidebar menu Quick Start for Instructors

8. Instructor Tools Managing courses –Set up an assignment (activate) –Monitor student progress during assignment –Review student performance after assignment –Download grades into Excel spreadsheet

9. Instructor Tools Managing courses –Setting up an assignment (activation) Choose assignment Set grading parameters Set due dates Temporarily stop an assignment

10. Instructor Tools Managing courses –Monitoring progress during assignment Submit text for a student Change due dates for a student Change activation decisions

11. Instructor Tools Managing courses –Reviewing performance after assignment Check evaluations on “problem list” Resolve disputed reviews

12. Administrator Tools http://cpr.molsci.ucla.edu Select “Downloads” from sidebar menu Quick Start for Administrators

13. Support Structure for Faculty CPR administrator –Creates courses, uploads student roster, resets passwords when students forget their CPR usernames AND challenge question answers Colleague –Reviews, proofs, and checks new assignments CPR specialist (optional but effective) –Assists students who miss deadlines, have questions, etc

14. Student Tools Provided by instructor http://cpr.molsci.ucla.edu Select “Downloads” from sidebar menu Student Handout Student Results

15. Support Structure for Students CPR administrator –Resets student passwords when they forget their CPR username AND challenge question Instructor –Responds to all student questions and concerns (Content specialist) –Assists with problem list, disputed reviews, missed deadlines, etc.

16. Questions? cpr@nslc.ucla.edu