1. Christine Doherty Lydia Li Karen Tsao Stanford University (aka Tests & Quizzes) S akai A ssessment M anager I G O

2. Agenda Feature Overview Demo of Features 2.5 Highlights 2.6 Roadmap Quick Create Demo Q&A

3. What are SAMigo’s features: Assessment Authoring Assessment Publishing Assessment-Taking Management Assessment Grading Question Pools Management Assessment-Type Management

4. Pedagogical Flexibility Online test Self-study questions Homework, problem-sets Paper, code, or project submission Language drills Quick knowledge probes Surveys Others???

5. Organize & Publish Assessments Core (pending) Assessments for a course –Starting page for assessment authoring –Can be exported/imported in QTI XML format –When ready, published via Settings Published Assessments for student assessment-taking –When students respond, Scores link appears –Can change release, due, retract dates, plus some feedback and grading settings –Can remove published assessments * New in 2.5

7. Question Types Auto-scored Multiple Choice (single and multiple correct) Survey (multiple choice, different rating scales available) Fill in the Blank Numeric Response Matching True/False Manually scored Short Answer/Essay Audio Recording File Upload

10. Rich-Text & Attachments At all levels of assessment authoring: –Assessment/Part Headers –Questions –Selections –Feedback

11. Create an Assessment

26. * New in 2.5

39. Import/Export Supports QTI v 1.2 Export types: IMS QTI-compliant XML or IMS Content Packaging (for use with attachments) Useful for –Making copies of core assessment in same site –Copying assessment to different site

46. Settings Configures delivery of assessments (how they appear to students) Options include: –display/organization –late handling –number of submissions –feedback options –high security and time limit for high stakes testing Most settings are not editable after publishing, so it is very important for instructors to review these carefully before publishing

50. * New in 2.5

51. Save Settings and Publish - to release to students Save Settings - to make changes to core assessment settings, can publish assessement at later time

53. Publishing Release assessment to students Copy of core assessment -- core assessment can be modified without affecting published version (and released with new title) Can set Available Date in future -- useful for instructors who want to do bulk of setup early Can retract any time, making assessment unavailable to all students

56. Published Inactive Assessments Retracted assessments will not appear to any students Assessments that are past the due date will not appear to students, with following exception: –When late submission is allowed, students who have not submitted will get “one last chance” to submit

58. Taking an Assessment (Students) Take an Assessment section –List determined by available, due, and retract dates –Submit for Grading and Save for Later options –Table of Contents and Mark for Review features available in non-linear assessment organization Submitted Assessments section –Provides submission confirmation with timestamp –Depending on settings, students can review scores, feedback, grader’s comments, statistics

67. Grading Workflows Ability to grade all questions for one student or grade all responses to one question Manual adjustments can be made to individual questions or entire assessment Comments can be made for individual questions or entire assessment Display of scores can be filtered by section

68. Other Grading Features Email students from Scores page Allow Retake for individual student Download All function for file upload questions -- generates zip file of all student submissions Statistics and histograms Export students' responses to Excel file (New in 2.5)

69. Grading Settings Anonymous grading OR show student identities Send scores to Gradebook -- this can be toggled on and off after assessment is published Record highest score OR last score

77. * New in 2.5

85. Question Pools Organize questions into multiple subpools Move/copy/remove multiple questions to other pool * New in 2.5 Author questions from within Pool Manager Import questions from IMS QTI-compliant XML file Randomly draw from pools for an assessment IMPORTANT NOTE: Question pools belong to an individual user only, available across all user’s sites

88. Assessment Types Create assessment “types” for different disciplines, different uses Hide complexity by selecting which settings are visible to the instructor. Pre-set defaults by making setting choices for the type (e.g., Self-study always has immediate feedback)

89. Assessment Creation Workflow

95. 2.5 Highlights Adjust score in edit assessment screen * Remove published assessments Allow feedback to be viewed right after an assessment is submitted Export students' responses to Excel file ** Reset point values of questions when a random draw from pool part is created * Move/copy/remove multiple questions to other pool * Copy all questions in a part to a selected pool * Event logging for user operations * Contributed by Rutgers University ** Partly based on contributions from Rutgers University

96. 2.6 Roadmap Edit a published assessment –Includes editing content of existing questions and most settings –Does not include editing parts, reordering parts or questions, adding or removing questions –Ability to regrade auto-scored questions for existing submissions Copy a (core) pending assessment Share question pools * Release assessment to one or more groups/sections ** Statistics for item analysis ** * Based on contributions from Universidad Politecnica de Valencia ** Contributed by University of Cape Town

97. Quick Create Contributed by Claremont McKenna College and UC Davis Disabled by default, but can be turned on in sakai properties Efficiency created by reducing number of clicks, pages loading and saving Useful for transferring assessments created in other applications or LMS (e.g., MS Word, WebCT), no need to paste into different fields Rich text and attachments can be added later, through edit assessment screen

103. Questions?

104. Contacts Questions and feeback: samigo-dev@lists.stanford.edu Lydia Li, Stanford University Project Manager lydial@stanford.edu Homepage: http://confluence.sakaiproject.org/confluence/display/SAM