© 2001 By Default! A Free sample background from www.pptbackgrounds.fsnet.co.uk Slide 1 An eejit’s guide to IMS Question and Test Interoperability Niall.

Slides:

Advertisements

Similar presentations

18 March 2004 Colin Milligan funded by. © RELOAD 2003, funded by Workshop Structure Session I Introduction: Interoperability and Reload Session II Content.

Advertisements

RELOAD Reusable E-Learning Object Authoring and Delivery Phil Beauvoir Colin Milligan funded by.

Computer Aided Assessment using QuestionMark Perception by Catherine Ogilvie Educational Development Officer.

Copyright © 2001 Bolton Institute Centre for Educational Technology Interoperability Standards CETIS an introduction and overview Lisa Corley CETIS Pedagogy.

Blackboard/Common Cartridge and Open Educational Resources with SoftChalk Jeff Kahn.

Learning Standards & Language Projects Bob Godwin-Jones Virginia Commonwealth University Calico 2009 Bob Godwin-Jones Virginia Commonwealth University.

Overview of IMS Content Packaging Sheila MacNeill.

Designing, Deploying and Managing Workflow in SharePoint Sites Steve Heaney Product Development Manager OBS

© 2001 By Default! A Free sample background from Slide 1 Interoperability: future- proofing CAA Niall Sclater CETIS Manager,

Assessment Delivery for QTI v2.1 Tests Jonathon Hare School of Electronics and Computer Science University of Southampton.

Update on the SWORD Protocol & Future Directions.

Technical update on ISO 9001:2015 Colin MacNee Duncan MacNee Limited

IDAHO DIGITAL CARAVAN CURRICULUM MATERIALS ADOPTION FOR SCIENCE – ANATOMY & PHYSIOLOGY (A&P) THANKS FOR YOUR CONSIDERATION Eve Lancaster National Accounts.

University of Piraeus Department of Technology Education and Digital Systems Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics.

© 2001 By Default! A Free sample background from Slide 1 CAA Pedagogy, standards and interoperability LTSN 27 th Jan 2003.

E-Learning: No Standards; No Coalitions - No Boom Ed Walker 7 December 2000.

8 Steps for an Effective Storyboard By Cristina Rodriguez.

E-Learning Workshop May Learning Objectives By the end of this workshop you will be know how to: plan and structure an e-learning resource use Articulate.

Online Assessments: SafeAssign + Tips and Pitfalls “Whats” and “Whys” of assessments Assessment types Types of test questions Assignments Rubrics SafeAssign.

Bringing XBRL tax filing to the UK Jeff Smith, Customer Contact, Online Services,

ADL Slide 1 December 15, 2009 Evidence-Centered Design and Cisco’s Packet Tracer Simulation-Based Assessment Robert J. Mislevy Professor, Measurement &

Annual SERC Research Review - Student Presentation, October 5-6, Extending Model Based System Engineering to Utilize 3D Virtual Environments Peter.

Accelerating e-Learning Interoperability Introducing the CLEO Lab Tyde Richards IBM Mindspan Solutions Daniel R. Rehak Carnegie Mellon University.

LCMS: What is thriving the Dutch, hype or need? Jocelyn Manderveld Educational Technology Expertise Centre Open University of the Netherlands.

EContent Developers Different Perspectives The FE Dimension Clive Church and Steve Jeyes: eLearning Managers, Edexcel International. Co-ordinators, CETIS.

IMS Europe Kevin Riley IMS, European Development

DoD Architecture Registry System DARS 16 September 2009 Walt Okon Senior Architect Engineer Senior Architect Engineer for Information Sharing Enterprise.

IMS Overview and ePortfolio Specification 3 Nov 2004 Steve Griffin Executive Dir. Int’l Developer and Adopter Support, Co-Founder IMS Global Learning Consortium.

Becta CETIS FE Tools Seminar Steve Jeyes CETIS /Edexcel / Newark and Sherwood College Becta 15 th January 2004 eLearning Frameworks.

Addressing Metadata in the MPEG-21 and PDF-A ISO Standards NISO Workshop: Metadata on the Cutting Edge May 2004 William G. LeFurgy U.S. Library of Congress.

1 Sakai Assessment Manager “Samigo” Charles Kerns, Stanford University Lance Speelmon, Indiana University.

Learning Technology Interoperability Standards Niall Sclater, and Lorna M. Campbell,

An Overview of MPEG-21 Cory McKay. Introduction Built on top of MPEG-4 and MPEG-7 standards Much more than just an audiovisual standard Meant to be a.

Sousa: Content Authoring and Delivery in Sakai Mark J. Norton Nolaria Consulting July 2008.

Uniqurate and QTIDI Projects Paul Neve - Kingston University Sue Milne & Niall Barr – University of Glasgow Feedback-Rich Formative Assessment.

Mary Beth Youse Wilmington University TLT Symposium May 5, 2012 Devise and Deliver - Online Assessments in Blackboard 1.

Assessing Online Learners: Basic Tools Presented By Darek Sady Blackboard University April 12, 2005.

© 2001 By Default! A Free sample background from Slide 1 Does interoperability actually work? A case study carried out with.

1 Phillips Andover Academy 2/22/ :30 – 1:00 Darek Sady Blackboard Learning System (Release 6.3) Assessments, Surveys, and Pools.

This document will help you plan your online course. Complete it before you begin developing your course in Mzinga Publisher. The next three pages with.

Mike Collett Schemeta Interoperability in E-learning.

Questionmark’s 2005 Users Conference  New Orleans Copyright © Questionmark Corporation and/or Questionmark Computing Limited, known collectively.

An Overview of Learning Technology Specifications and Standards Bill Olivier Director, CETIS.

Blackboard Learn 9.1 © 2010 Blackboard Inc. All rights reserved. Assessments, Part One.

Measured Progress ©2011 Guide to the Smarter Balanced IT Architecture Connecticut Assessment Forum August 14, 2012.

Creating and Managing Assessments Erin Shelley. Today’s Workshop Overview of Assessments Creating Questions Creating Assessments and Adding Questions.

Learning Activity Reference Model Charles Duncan, Ed Barker

SAMigo Assessment Tool (aka Tests and Quizzes ) Marc Brierley, Stanford University Interaction Designer display/SAM.

QTI 2.1 Overview Pierre Gorissen, SURF SiX / Fontys University of Applied Science

Overview Collected learning resources Competencies Registry/ Authority Course Delivery system Student Pedagogy Tests/ assessment Activities Communication.

CETIS Educational Content SIG, Learning and Teaching Scotland, September 2004 Content Specifications Update Wilbert Kraan Lorna M. Campbell CETIS.

Agenda Debrief on past module development Tools for online content development Module development template Timeline Suggested guidelines for developing.

1 Prints: The Language of Industry. Learning Objectives Identify the importance of prints. Discuss historical processes and technologies related to prints.

Introduction to Blackboard Rabie A. Ramadan Session 3.

CDA Overview HL7 CDA IHE Meeting, February 5, 2002 Slides from Liora Alschuler, alschuler.spinosa Co-chair HL7.

Section 4: Technical Approach Nancy gets up and introduces the overall technical approach –ISD process across the top –Technical approach process/ procedures.

Blackboard Learn 9.1 © 2013 Blackboard Inc. All rights reserved. Assessments, Part One.

IMS Developer Briefing ECC Singapore ADL BlackBoard FD Learning DEST.

Introduction to Learning Technology Interoperability Standards & CETIS Lorna M. Campbell CETIS Assistant Director Glenrothes College, August 2003.

Learning Technology Interoperability Standards Lorna M. Campbell and Boon Low CETIS and the University of Strathclyde LMC, SURF Presentation, April 2002.

Third meeting of the Valkenburg Group  Informal network of EML implementers and developers.  Established following the “Developing an EML Authoring and.

Specs & Standards Update: December 2003

Perception Orientation

IMS Update Content Packaging; InterActive Content SIG

Training with the Techs: Importing Items into Perception

Becta CETIS FE Tools Seminar

Overview The designer role in CE 4 has been separated into two new roles in CE6: Designer Role Instructor Role The Auditor role has been added as.

Documentation Overview

CIC BIM Competition Presentation Template & Content Guide

Interoperability in Action

Presentation transcript:

© 2001 By Default! A Free sample background from Slide 1 An eejit’s guide to IMS Question and Test Interoperability Niall Sclater CETIS Manager, Educational Systems University of Strathclyde

© 2001 By Default! A Free sample background from Slide 2 Why do I need to know about QTI? I’m authoring a bank of questions in my subject area I’m authoring a bank of questions in my subject area I’m involved in the selection of a CAA system for my institution I’m involved in the selection of a CAA system for my institution I have a general interest in online learning and assessment I have a general interest in online learning and assessment

© 2001 By Default! A Free sample background from Slide 3 The basics IMS QTI is a means for exchanging assessment information IMS QTI is a means for exchanging assessment information It uses XML It uses XML 2 key parts of the spec: 2 key parts of the spec: –Assessment Section Item –Results Report Can be implemented separately Can be implemented separately

© 2001 By Default! A Free sample background from Slide 4

© 2001 By Default! A Free sample background from Slide 5 Response types Multiple choice Multiple choice True false True false Multiple response Multiple response Image hot spot Image hot spot Fill in the blank Fill in the blank Select text Select text Slide Slide Drag object Drag object Drag target Drag target Order objects Order objects Match item Match item Connect the points Connect the points

© 2001 By Default! A Free sample background from Slide 6 The concept of rendering The same item can be “rendered” in different ways to allow for different The same item can be “rendered” in different ways to allow for different –delivery platforms –technical capabilities –participant challenges (eg visual, audio, physical etc)

© 2001 By Default! A Free sample background from Slide 7 Rendering example

© 2001 By Default! A Free sample background from Slide 8 Basic response & render types Response types Response types –logical identifier –xy coordinate –string –number –logical group Render types Render types –choice –hot spot –fill in blank –slider –‘object’

© 2001 By Default! A Free sample background from Slide 9 True false example

© 2001 By Default! A Free sample background from Slide 10 True false example XML This is a simple True/False multiple-choice example. The rendering is a standard radio button style. No response processing is incorporated. Paris is the Capital of France ? True False

© 2001 By Default! A Free sample background from Slide 11 Response processing … T 1 Yes, you are right …

© 2001 By Default! A Free sample background from Slide 12 Multiple choice example

© 2001 By Default! A Free sample background from Slide 13 Multiple choice example XML Which one of the listed standards committees is responsible for developing the token ring specification ? IEEE IEEE IEEE IEEE None of the above.

© 2001 By Default! A Free sample background from Slide 14 Response processing … A 1 Yes, you are right. …

© 2001 By Default! A Free sample background from Slide 15 Multiple response example

© 2001 By Default! A Free sample background from Slide 16 Image hot spot example

© 2001 By Default! A Free sample background from Slide 17 Fill in blank (string) example

© 2001 By Default! A Free sample background from Slide 18 Numerical example

© 2001 By Default! A Free sample background from Slide 19 Composite example

© 2001 By Default! A Free sample background from Slide 20 Results reporting Specific to a single participant Specific to a single participant 4 constructs 4 constructs –summary (eg max score, num attempts) –assessment –section –item Each construct contains a context which specifies details such as name of participant Each construct contains a context which specifies details such as name of participant

Elect Drafts Scope IMS Spec Development Process IMS Members Technical Board Public Working Group Final Scope Base Document Public Draft Feedback Approval

© 2001 By Default! A Free sample background from Slide 22 What’s next with QTI? V1.2 currently being approved V1.2 currently being approved –selection and ordering of sections and items –scoring roll-up in sections and assessments (from question scores to test scores) –results reporting Question and test metadata Question and test metadata Harmonisation with other specs Harmonisation with other specs Integration with ADL SCORM Integration with ADL SCORM Implementations now needed Implementations now needed V1.3 early in 2002 V1.3 early in 2002

© 2001 By Default! A Free sample background from Slide 23 UK Interoperability Developments Strong representation in QTI working group Strong representation in QTI working group CETIS QTI SIG CETIS QTI SIG –meetings –online discussions –repository of open source tools –hosting workshops CAA Centre & SCAAN CAA Centre & SCAAN JISC MLE CAA Project JISC MLE CAA Project e3an e3an

© 2001 By Default! A Free sample background from Slide 24 CETIS Assessment Group QTI Repository Strathclyde IMS creation and rendering tool Strathclyde IMS creation and rendering tool Leeds rendering tool Leeds rendering tool e3an (Southampton) Excel creation templates e3an (Southampton) Excel creation templates Steve Lay’s UCLES systems Steve Lay’s UCLES systems Steve & Clive’s FE examples Steve & Clive’s FE examples Question Mark QTI XML viewer Question Mark QTI XML viewer xDLSoft’s IMS Asset Designer xDLSoft’s IMS Asset Designer Can studios Can studios

© 2001 By Default! A Free sample background from Slide 25 IMS and other initiatives IMS Europe IMS Europe SCORM SCORM Open Knowledge Initiative Open Knowledge Initiative Prometeus Prometeus Questionmark, Blackboard, IBM/Lotus Questionmark, Blackboard, IBM/Lotus

© 2001 By Default! A Free sample background from Slide 26 The IMS QTI documents ASI Information Model ASI XML Binding Document ASI Best Practice Guide QTI Lite Specification ASI Selection and Ordering Specification ASI Outcomes Processing Specification Results Reporting Information Model Results Reporting XML Binding Results Reporting Best Practice Guide

© 2001 By Default! A Free sample background from Slide 27

© 2001 By Default! A Free sample background from Slide 28 QTI page

© 2001 By Default! A Free sample background from Slide 29 Standards IMS is not a standards body IMS is not a standards body ISO / IEEE ISO / IEEE high stakes assessments need a standard high stakes assessments need a standard British Standards Learning Technology Committee British Standards Learning Technology Committee –BS7988 “Using information technology in delivering assessment”

© 2001 By Default! A Free sample background from Slide 30 Further information