Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License. Opening Embedded Assessment Brandon Muramatsu, David Wiley, Justin Ball, Joel Duffin, 1 Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License. Cite as: Muramatsu, B., Wiley, D., Ball, J. and Duffin, J. (2014, April). Open Embedded Assessment. OER14: Building communities of open practice. Newcastle, UK.

openassessments.org 2 Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License. Tweet Questions #oer14oea openassessments.org

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License. Where in the World… 3

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License. Outline  Motivation and Background  Demo  Shared Open Assessment Banks 4

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License. Content and Assessment are Separate 5 OER Content Videos, Lectures, Textbooks, Webpages, Assessments Current State of OER Assessments PDF Files, Static, Contained in Separate Quiz & Test Systems The Challenge

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License. The Potential?  Do for assessments and items, what’s been done for content (whole courses, lectures, videos)  Embed Anywhere  Share  Don’t reinvent the wheel for every course  Evaluate, Record and Track Responses  Scale  More use of items/assessments for validity  May lead to evidence of impact? 6

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License. Focus: Formative Assessment  Putting mechanisms for students to check their understanding / mastery of concepts directly in course materials  Primarily for formative (self-check, understanding) not summative (exams or formal assignments) 7

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License. What’s done today in OER with embedded formative assessment? 8

Saylor Foundation – saylor.org 9 Credit: Saylor Foundation, CC BY

Saylor.org Precalculus II  Course Assessments  &resourcetype=4 10 Credit: Saylor Foundation, CC BY

Saylor.org – “Assessment”  content/uploads/2011/11/MA PART2.pdf 11 Credit: Washington SBCTC, CC BY

12 MIT OpenCourseWare: Massachusetts Institute of Technology, (Accessed 7 Nov, 2013). License: Creative Commons BY-NC-SA

OCW Scholar – 8.03SC 13 Lewin, Walter, Wit Busza, George Stephans, and Martin Connors. 8.03SC Physics III: Vibrations and Waves, Fall (MIT OpenCourseWare: Massachusetts Institute of Technology), (Accessed 7 Nov, 2013). License: Creative Commons BY-NC-SA

OCW Scholar – BCS9.00SC 14 Gabrieli, John. 9.00SC Introduction to Psychology, Fall (MIT OpenCourseWare: Massachusetts Institute of Technology), (Accessed 7 Nov, 2013). License: Creative Commons BY-NC-SA

OCW Scholar – 8.01SC 15 Lewin, Walter, Peter Dourmashkin, Thomas Greytak, Craig Watkins, Andy Neely, Sahana Murthy, J. Litster, and Matthew Strafuss. 8.01SC Physics I: Classical Mechanics, Fall (MIT OpenCourseWare: Massachusetts Institute of Technology), classical-mechanics-fall-2010 (Accessed 7 Nov, 2013). License: Creative Commons BY-NC-SA

16 Lewin, Walter, Peter Dourmashkin, Thomas Greytak, Craig Watkins, Andy Neely, Sahana Murthy, J. Litster, and Matthew Strafuss. 8.01SC Physics I: Classical Mechanics, Fall (MIT OpenCourseWare: Massachusetts Institute of Technology), classical-mechanics-fall-2010 (Accessed 7 Nov, 2013). License: Creative Commons BY-NC-SA

17 Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

6.002x 18 Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

6.002x 19 Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

Our Approach openassessments.org 20 Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License. OpenAssessments.org Tweet Questions #oer14oea

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License. Open Assessments (Beta) OpenAssessments.org  Embed an assessment in any web content  QTI-player  Sends analytics  Focus on formative assessments  Start with limited question types  multiple-choice/single answer 21

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License. Demo! (cross your fingers) 22

openassessments.org 23 Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License. OpenAssessments.org Tweet Questions #oer14oea

openassessments.org 24 Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

OEA Stats 25 Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License.

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License. Shared Open Assessment Banks 26

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License. Questions? Tweet them using #oer14oea 27

Unless otherwise specified this work is licensed under a Creative Commons Attribution 4.0 License. Opening Embedded Assessment Brandon Muramatsu, David Wiley, Justin Ball, Joel Duffin, 28 Unless otherwise specified this work is licensed under a Creative Commons Attribution 3.0 License. Cite as: Muramatsu, B., Wiley, D., Ball, J. and Duffin, J. (2014, April). Open Embedded Assessment. OER14: Building communities of open practice. Newcastle, UK.