1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Adapting for Adaptivity Authoring of Adaptive e-content for a Commercial Environment Angelo Wentzler

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Supervisors Commission members Dr. A.I. Cristea (TU/e) Ing. E. Heuvelman (Turpin Vision) Prof. Dr. P.M.E. De Bra (TU/e) Dr. J. Broekstra (TU/e)

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Outline 1.Goal and Motivation 2.Problem description 3.Environment 4.Theory and Systems 5.Content-e/LAOS 6.Demo 7.Evaluation 8.Conclusions

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Goal and Motivation Goal: a LAOS based Adaptive Hypermedia System (AHS) authoring tool that will see commercial use MOT is the only simple generic tool available, but not very user-friendly Turpin Vision wants to add adaptive capabilities to Content-e

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Problem description Adapt Content-e so it can be used to author LAOS layers Playable in AHA! (at the least) Author existing MOT courses Challenges: LAOS untested in commercial environment; model conflicts with normal Turpin Vision approach

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Environment Turpin Vision is a SME (15 empl.) Informal atmosphere Clients: schools and publishers Development primarily client-demand driven No clear picture of adaptivity; no client- demand for adaptivity (yet)

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 What is adaptivity? An adaptive system can adapt itself to a user automatically at runtime Transparent if done well Applications: recommender systems, online education, games Different from adaptable! Adaptive hypermedia system

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 What is adaptivity? Domain model: describes the domain (the ‘subject matter’) User model: describes the user (e.g. knowledge of the domain) Adaptation engine: changes user model and view on domain, depending on user model and user actions, according to adaptation rules

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 ‘Adaptive’ is not always really adaptive CLIX “How adaptive is CLIX?” “CLIX enables adaptation to a particular look and feel…” (CLIX is actually adaptable)

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 ‘Adaptive’ is not always really adaptive Learning Design Claims adaptivity because a ‘live’ teacher can interact with users (All humans are adaptive: this does not make the system adaptive)

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 ‘Adaptive’ is not always really adaptive Blackboard Adaptive release feature unlocks (releases) content based on certain criteria (Actually pre-adaptation: learning paths are set beforehand and do not change)

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 ‘Adaptive’ is not always really adaptive WebCT “WebCT has incorporated adaptive technology into its products to comply with the US Rehabilitation Act” (Not even close: talking about accessibility adjustments for the disabled)

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Adaptivity is not always recognized Kobsa’s experiment: fake recommender system Side effect: users ‘fell for it’ Like a placebo, the illusion of personalization seems to be sufficient Conversely, real adaptivity is not always noticed!

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Environment: a ‘good’ system Academic: study, novelty Stability or visual appeal not essential Demonstrations often purely theoretical Commercial: profit Stability and visual appeal essential Technology must be proven in practice Confidence

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Environment: authoring complexity Linear: content and structure Hypermedia: hyperspace Adaptive hypermedia: knowledge space, adaptation process (e.g. labeling) Not everything must be done by one person, still complex

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Environment: ‘selling’ AHS Graphical user interface, visual themes and metaphors Simplify authoring task (automation, presets) Facilitate transition between linear and adaptive (conversion, standards) Convincing demonstrations Evaluations and user studies.

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Existing Theory and Systems LAOS / LAG MOT CAF AHA! Content-e

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 LAOS, MOT and AHA! authoring framework Conceptual view of an AHS More parts Resulting AHS do not necessarily look like this LAOS: Layered WWW Adaptive AHS Authoring Model and their corresponding Algebraic OperatorS

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 LAOS, MOT and AHA! Domain Model: concepts and relations Goal Model: filters, reorders, annotates Adaptation Model: adaptation rules User Model: overlay, free variables Presentation Model: visibility, style, display settings

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 LAOS, MOT and AHA! MOT: My Online Teacher CAF: Common Adaptivity Format XML based Only DM and GM (so far)

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 LAOS, MOT and AHA! Layers of Adaptation Granularity

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 LAOS, MOT and AHA! Adaptive Hypermedia Architecture

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Content-e

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Content-e/LAOS Turpin Vision desired an extension to their Content-e tool New sub-goals: At least replicate MOT functionality Improve user interface significantly Extend MOT functionality based on LAOS Evaluate result

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Content-e/LAOS: Initial solution

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Content-e/LAOS: Actual Solution

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Content-e/LAOS in more detail.ASP / JavaScript Collection of add-ons: 2 ‘XML paragraphs’ (concept, goal model) 1 import module (from CAF) 1 publish module (to CAF)

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Content-e/LAOS: changes

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Content-e/LAOS: XML editor

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Content-e/LAOS: Publication to CAF Concepts and goal models are represented with XML already Compose into single XML structure (use XML Writer) Transform Content-e representation to actual CAF elements

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Content-e/LAOS: Import from CAF Transform CAF to Content-e XML Insert content (obtain id’s) Postprocess: insert id’s into references Update content Problem: existing code did not function inside transaction

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Demo

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Evaluation: setup MOT vs Content-e/LAOS comparison ‘Politehnica’ university, Bucharest 1 week theory Exam: 63 -> 43 students in 7 groups 1 week project System Usability Scale (SUS) and custom questionnaires

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Evaluation: results MOT: more stable Content-e/LAOS: more appealing “if it had less bugs I would use Content-e/LAOS” MOT: functional (SUS) C-e/LAOS: overall impression (specific questionnaire)

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Evaluation Opinion not influenced by acquired skill with systems Opinion probably influenced by problems during project (book labels, server reinstall) Longer exposure to Content-e/LAOS might lead to better evaluation

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Conclusions: goals MOT functionality almost completely replicated Extensions: typed DM attributes, relation authoring, CAF import UI improvements: single-screen concept authoring, click and drag GM authoring

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Conclusions: other results Improvements to Content-e Tree component Transactions ASP data limit Course material (Gipf, Sun-Tzu) Practical evaluation Two papers (AH’06, ICALT’06)

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Recommendations Content-e needs to be more stable More tests and evaluations Extensions to the system Graph author Default adaptation and user models Real “student view” Adaptation model XML paragraph? “Player”

1313 Final Master PresentationDepartment of Computing Science Authoring of Adaptive e-content for a Commercial Environment Adapting for Adaptivity 14/8/2006 Any questions?