Tests & Quizzes (aka SAMigo) Christine Doherty, Stanford University June 16, 2011

Agenda Future of T&Q: Development Dilemmas Community Contribution 2.8 Highlights 2.9 Plans Q&A

Future of T&Q: Development Dilemmas

Guiding Principles Flexibility/Freedom Reliability/Error-Free

Development Focus Improve UI/Interaction Add New Features

Project Management Stanford as Gatekeeper Modularize/Distribute

Community Contribution

New Release Process

Rationale User experience reviews are critical: New features can cause clutter in UI, confusion, bad user experience New features can clash with existing or planned features and lead to unexpected behavior Stanford only has one designer to tackle the workload, so we need help

Requirements for Contributions Clear specs are a must: Rationale for new feature/enhancement Description of expected behavior Documentation of all affected screens Screen shots desirable

Timeline DateMilestone June 1Contributor submits design specs for new feature or enhancement via JIRA. SAMigo developers route spec to UX team for review. Jun 15Stanford provides initial feedback on specs July 1Contributor responds with revisions July 15Stanford gives second round of feedback August 15Contributed code QA'ed to revised spec and submitted to Stanford September 1SAMigo code freeze for release; Sakai QA team begins

2.8 Highlights

Respondus Integration before 2.8 RespondusSakai – T&Q Question Types Changed Missing Metadata

Respondus Integration in 2.8 Respondus Sakai – T&Q QTI XML or Zip file from Respondus Imports to Sakai Tests & Quizzes

Respondus Integration

RespondusSakai – T&Q RespondusSakai – T&Q

Record Average Score New Feature: ability to record average score for multiple submissions Redesigned UI for student’s Submitted Assessments list to accommodate displaying average scores Contributed by Rice University

Record Average Score

Release Scores Only Based on feedback from instructors wanting to show students their scores without allowing them to see questions again (since questions are reused in subsequent tests) Solution is to separate out scores from rest of feedback options

Release Scores Only to Students

Release Scores Only

Clarification of Settings

Send zero scores to Gradebook for non-submission records Clash of scoring rules in Tests & Quizzes and Gradebook caused inability to set zero scores for non-submission records for inclusion in course grade calculation Solution is to allow instructors to explicitly enter a zero score for a non-submission record that gets sent to gradebook Patch contributed by Longsight

Send zero scores to Gradebook for non-submission records

Send zero scores to Gradebook

Send zero scores to Gradebook for non-submission records

Rich Text Entry for Short Answer/Essay Instructors from several institutions requested a way for students to enter rich text in essay questions for equations, foreign characters, or just general formatting Solution is to present students with the ability to use the FCKeditor in Short Answer/Essay questions. Contributed by Longsight

Rich Text Entry for Short Answer/Essay

Rich-text for Short Answer

Publish Action Based on feedback that Settings and Publish actions were redundant, both leading to Settings page Solution is to link Publish action to Publish Assessment page where settings are verified and notification added (if desired)

Publish Action

Remove Assessment Types Assessment Types often prove to be confusing to instructors, since they may not know what the labels mean and what settings go with them One solution is to remove any trace of assessment types with a sakai property (samigo.showAssessmentTypes=False) Contributed by Longsight

Remove Assessment Types

2.9 Plans

Stanford contributions for 2.9 Restyling and rewriting of warning messages Reset selection and warning messages redraw at current question, instead of top of page Reworking automatic submission logic Validation for numeric response questions Count Characters button for Short Answer/Essay questions Render part information and images in Print view

Community contributions for 2.9 Redesign of main Assessments page (Longsight) Calculated question type (University of Dayton) Survey – Matrix of Choices question type (Rutgers) Extended Matching Item question type (University of Cape Town)

Redesign of Main Assessments Page

Contacts Questions and feedback: Lydia Li, Stanford University Project Manager Karen Tsao Samigo Developer Homepage:

Online Final Exams Using Sakai at Stanford University Jamie Tsui 9:45 AM - 10:15 AM in Beaudry B

Questions?