Modeling Units of Assessment for Sharing Assessment Process Information: towards an Assessment Process Specification Yongwu Miao, Peter Sloep, and Rob.

Slides:

Advertisements

Similar presentations

License: CC BY-NC-SA 3.0 © 2009 ICOPER Best Practice Network Introduction to IMS Learning Design Michael Derntl, Susanne Neumann, Petra.

Advertisements

A practitioner’s view of Learning Design Mark Baxendale, Liverpool Hope University, UK.

Some Basic Ideas Behind IMS Learning Design Prof. Dr. Rob Koper Director of R&D into Learning Technologies Keynote 2 nd Scientific LORNET Conference Vancouver,

University of Piraeus Department of Technology Education and Digital Systems Centre for Research and Technology - Hellas(C.E.R.T.H.) Informatics and Telematics.

CSCL and Standards for Learning Technologies Ola Berge Netværket IKT og Læring, e-Learning Lab at Aalborg University,

Slide 1 © 2004 By Default! A Free sample background from Learning Design Implementation in SCORM E-Learning Environment Elena.

Object-Oriented Analysis and Design

ALFANET September 23th, 2005UNFOLD-PROLEARN workshopValkenburg Authoring a full life cycle model in standards-based adaptive elearning Peter van Rosmalen.

Dai Griffiths, SPDECE 21 October 2005 Grup de Tecnologies Interactives GTI 1/15 The state of IMS LD three years on Dai Griffiths Universitat.

Software Testing and Quality Assurance

Educational Modelling Language (EML): Adding instructional design to existing learning technology specifications Rob Koper

Sharing Learning Design with LAMS: The Learning Activity Management System James Dalziel Professor of Learning Technology and Director, Macquarie E-Learning.

© 2004 Setting up a Learning Design system in your institution: OUNL experiences Colin Tattersall, The Open University of the Netherlands.

Knowledge Acquisitioning. Definition The transfer and transformation of potential problem solving expertise from some knowledge source to a program.

Sharing Knowledge in Adaptive Learning Systems Miloš Kravčík Dragan Gašević Fraunhofer FIT, GermanySimon Fraser University, Canada

DCS Architecture Bob Krzaczek. Key Design Requirement Distilled from the DCS Mission statement and the results of the Conceptual Design Review (June 1999):

ALFANET April 29th, 2005ALFANET, IST rd Review Meeting Adaptation in aLFAnet Peter van Rosmalen Open Universiteit Nederland.

SCA Introduction to Multimedia

IMS Learning Design A new standard for eLearning Professor Rob Koper, July 2003 Director of RTD into Learning Technologies Open University of the Netherlands.

IMS Learning Design Rob Koper Educational Technology Expertise Centre Open University of the Netherlands IET Seminar, September,

Using Open Technical E-learning Standards and Service-orientation to Support New Forms of E-assessment Yongwu Miao, Colin Tattersall, Judith Schoonenboom,

1/19. 2/19 WP6 Presentation Pythagoras Karampiperis, WP6 Leader Demetrios Sampson, CERTH CB Representative Antonis Kokkonos, CERTH WP6 Team Member Advanced.

A Domain-specific Modeling Approach to the Development of Online Peer Assessment Yongwu Miao and Rob Koper Educational Technology Expertise Centre Open.

Bridging the Gap between Practitioners and E-learning Standards: A Domain-specific Modeling Approach Yongwu Miao, Tim Sodhi, Francis Brouns, Peter Sloep,

© 2005 LO  LA From a Learning Object centric view towards a Learning Activity perspective Hans Hummel & Rob Koper Open University of the Netherlands.

EML, IMS Learning Design and IMS Simple Sequencing Colin Tattersall Educational Technology Expertise Centre Open University of the Netherlands.

David Harrison Senior Consultant, Popkin Software 22 April 2004

Asst.Prof.Dr.Surasak Mungsing. By: Akshay Kumar Sharable Content Object Reference Model.

Promoting Learning Styles Through ICT By Miss T.Magi (E-learning Specialist: Butterworth)

SCORM By: Akshay Kumar. SCORM 2 What we want? What is SCORM? What is SCORM? Connection with e-learning Connection with e-learning Application of XML Technology.

1 Overview of WP6 Colin Tattersall, the Open University of the Netherlands.

The killer app in LAMS V2.1: Branching James Dalziel Professor of Learning Technology, and Director, Macquarie E-Learning Centre Of Excellence (MELCOE)

LCMS: What is thriving the Dutch, hype or need? Jocelyn Manderveld Educational Technology Expertise Centre Open University of the Netherlands.

Are we ready for mass adoption of Learning Design? James Dalziel Professor of Learning Technology and Director, Macquarie E-Learning Centre Of Excellence.

New trends in Semantic Web Cagliari, December, 2nd, 2004 Using Standards in e-Learning Claude Moulin UMR CNRS 6599 Heudiasyc University of Compiègne (France)

The Learning Design Revolution: Implementing the Learning Activity Management System (LAMS) Professor James Dalziel Director, Macquarie University E-learning.

E-learning Overview Presentation

Self-Organized Learning Networks for Lifelong Learning RTD Programme Rob Koper, Peter Sloep, Colin Tattersall, Peter van Rosmalen Educational.

© 2004 How to create a learning design expressed in Learning Design Colin Tattersall, The Open University of the Netherlands.

Learning Technology Interoperability Standards Niall Sclater, and Lorna M. Campbell,

ADALE’06 DublinJune 20, 2006 Issues in developing adaptive learning management systems for higher education institutions Jesus G. Boticario, Olga C. Santos.

An Introduction to Design Patterns. Introduction Promote reuse. Use the experiences of software developers. A shared library/lingo used by developers.

Architecting Web Services Unit – II – PART - III.

2007 © Giunti Labs – No reproduction without written permission Visualizing IMS Learning Design for easier editing Marco Luccini, Giunti Labs R&D Project.

CEN WS/BII Standards and Interoperability The path towards more efficient procurement in Europe Alcalá de Henares September 15, Jostein Frømyr CEN.

1 Facilitating ICT Skills for Teachers in a Third World Country: Imperatives and Offline Strategies Prof O.O. Anowor Dr. Leonard Chinaedum Anigbo.

A Gradual Process for Integrating E-learning in a Higher Education Institute © Igor Kanovsky & Rachel “The New Educational Benefits of ICT in.

Sharing Design Knowledge through the IMS Learning Design Specification Dawn Howard-Rose Kevin Harrigan David Bean University of Waterloo McGraw-Hill Ryerson.

Origins of IMS Learning Design & its conceptual framework, Oleg Liber, CETIS May 2008.

Telmo Zarraonandia Laboratorio DEI. Dpto. de Informática U. Carlos III de Madrid A Late Modelling Approach for the Definition of Computer-Supported Learning.

Colin Milligan funded by Reload Update: LD is coming.

Jim Dorward Sarah Giersch Kaye Howe Rena Janke Mimi Recker Andy Walker NSF Awards: NSDL ;TPC Using Online Science & Math Resources in Classrooms.

Learning Object Metadata Application Profiles: Lithuanian Approach E. Kurilovas S. Kubilinskienė Centre for IT in Education, MoE Lithuania.

EML and Learning Design Colin Tattersall Educational Technology Expertise Centre Open University of the Netherlands.

Developing networked learner support in UK higher education Perspectives from the NetLinkS project Phil Levy, UK-Nordic Conference 1997.

EGR 335 Technical Communications for Engineers and Computer Scientists Coordinator: Leo Finkelstein, Jr. Course Review.

1 TOOL5100-CSCL Presentation of 2 papers by Jan Are Otnes Stahl (2000): A Model of Collaborative Knowledge-Building Stahl (2000): A Model of Collaborative.

Prometeus-Mallorca (Nov18&19,2001) EML: definition What is an Educational Modelling Language? (Provisional definition:) … a semantic rich information model.

31 March Learning design: models for computers, for engineers or for teachers? Jean-Philippe PERNIN (*,**) Anne LEJEUNE (**) (*) Institut national.

2 EC SIG 7/12/06 JISC Design for Learning Programme What is it?  2 year project - till May 2008  Part of the pedagogy strand of the JISC eLearning Programme.

Towards a Benchmark for the Evaluation of LD Expressiveness and Suitability Manuel Caeiro Rodríguez

Three Instructional Design Models Shaun Rosell EDCI 888 Proseminar II Kansas State University.

Teaching Children About Food Safety Food Safety Professional Development for Early Childhood Educators.

Integrating LAMS using Blackboard Building Blocks and PowerLinks James Dalziel Managing Director, LAMS International Pty Ltd & Professor of Learning Technology.

Modelling a team-based astronomy task using LAMS James Dalziel Professor of Learning Technology, and Director, Macquarie E-Learning Centre Of Excellence.

Improving teaching and learning through open education: Examples from Learning Design James Dalziel Professor of Learning Technology and Director, Macquarie.

Learning Design: The Birth of Open Source Teaching? James Dalziel Professor of Learning Technology Macquarie E-Learning Centre Of Excellence (MELCOE) Macquarie.

Learning Technology Interoperability Standards Lorna M. Campbell and Boon Low CETIS and the University of Strathclyde LMC, SURF Presentation, April 2002.

Computable Contracts as Functional Elements

Chapter 5 Architectural Design.

Presentation transcript:

Modeling Units of Assessment for Sharing Assessment Process Information: towards an Assessment Process Specification Yongwu Miao, Peter Sloep, and Rob Koper Educational Technology Expertise Centre Open University of The Netherlands ICWL 2008, August 2008, Jinhua, Zhejiang, China

Overview Where are we from: OUNL What we have done: EML => IMS LD What is missing in IMS LD: Assessment What is our objective: A New Specification What is the current status: Conceptual Model How can it be used: Olympic Games Summary

Where are we from: OUNL

The Open University of the Netherlands (OUNL) –Started in 1984; national institute; –Open distance education provider 7 faculties, students 24 study centres in Netherlands and Belgium education delivered using a variety of technologies (print, cd-rom, internet, face to face contact sessions, practical rooms, etc.) –R&D: Educational Technology Expertise Center

What we have done: EML => IMS LD Educational Modelling Language (EML) IMS Learning Design (LD): An e-learning technical specification IMS LD is derived from EML IMS Global Learning Consortium, Inc. OUNL is contributing member (voting rights) of IMS –Also Apple, Blackboard, Microsoft, Cisco, Sun, Texas Instruments, … 1998 * Information model * Best practice guide * XML binding 2003

What we have done: EML => IMS LD Basic idea: Develop a ‘language’ to describe the learning/teaching processes with associated content in a formal, semantic way, so that it can be interpreted by computers. Compare: music notation This description should be independent of any delivery platform => can be deployed in any platform that provides the adequate functionality

What we have done: EML => IMS LD Learning object: - Book, - Audio & video Which notations are needed to describe a lesson plan?

What we have done: EML => IMS LD IMS LD, an education-specific process modelling language, can be used to describe a wide variety of pedagogical strategies or approaches in terms of a play including acts and role-parts (based on metaphor of theatrical play) People act in different roles working towards certain objectives by performing learning and/or support activities within an environment, consisting of learning objects and services used in the performance of the activities. Moving focus from what to learn to how to learn: Lesson plan or learn-flow

play Act 1Act 2Act 3Act 4Act 5 Role-part 1 Role-part 2 Role-part 3 Role-part … Role Activity Environment Learning objects Learning services Activity- Description method components What we have done: EML => IMS LD

LD authoring tool LD-compatible run-time environment actual or imaged pedagogical processes a formal pedagogical model multiple executions of the same model carried out by different groups the events that can be observed or expected represented in LD (in the form of XML) Run-time Design-time author learner, teacher, and other stakeholder

What is missing in IMS LD: Assessment LD can not explicitly support various types of assessment. Assessment components within the Educational Modeling Language were excluded when LD was adopted by IMS, because of the existence of IMS Question and Test Interoperability (IMS QTI). QTI is also an open e-learning technical standard, which describes a data model for the representation of assessment item/test and their results. It defines a set of interaction types which can be used to specify basic question types (e.g., multiple-choice, fill_in_the_blank, and slider) and complicated question types through combination.

What is our objective: A New Specification 1.facilitating representation, understanding, communication, comparison, and reuse of a variety of assessment practices at design-time; 2.guiding and scaffolding learner, tutors, and other stakeholders to perform a variety of activities at run-time by providing guidance and awareness information, by configuring a workspace for carrying out prescriptive tasks, by controlling and changing the sequence of activities based on the execution state and circumstantial information, and by orchestrating the efforts made by different roles/participants. Develop a high-level assessment process modeling language for facilitating both experts and practitioners to share assessment process information by extending QTI and LD with an additional layer.

What is the current status: Conceptual Model Semantic aggregation model Conceptual structure model Process structure model Developed a conceptual model, the core of the specification, which can be represented as: The first validation study has been conducted through investigating whether the conceptual model of specification meets the requirements of completeness, flexibility, adaptability, and compatibility.

What is the current status Semantic aggregation model:

What is the current status Conceptual structure model:

What is the current status Process structure model

What is the current status Restrictions between stages and activities:

How can it be used: in Olympic Games It is not necessary to develop a software applications for supporting each assessment

How it can be used: in Olympic Games

Use existing Run-time Environment Player.1Player.2Player.n internet Dispatcher/Service broker IMS LD engineIMS QTI engine AA Assessment service UoL management and enactment service … an assessment model multiple instances server

How can it be used: in Olympic Games An assessment model can be reused and modified to support other assessment

Summary IMS LD can support interoperability and reusability of a variety of pedagogical models and systems. IMS LD provides insufficient expressiveness to model integrated learning, teaching and assessment processes. A high-level assessment process modeling language can be developed by extending IMS QTI and IMS LD with an additional layer. The conceptual model of the specification has been developed and validated.

Thanks for your attention Questions?