© LeActiveMath, 2006 annual review Source: Erica Melis Language-enhanced, user-adaptive,interactive eLearning for Mathematics A Project funded by the European Community under the Sixth Framework Programme for Research and Technological Development LeActiveMath Status and Prospectus Erica Melis Coordinator Scuola de Athene, Socrates in dialogue with Alexander

2 Source: Erica Melis annual review 2006 Objectives: ONE Distributed System Adaptivity and personalisation Distributed architecture and services Open student modeling Diagnosis and support of motivational state (autonomy & approval) Variety of learning tools Tutorial dialogues, other language facilities Moderate constructivist material and ped strategies Variety of evaluations

3 Source: Erica Melis annual review 2006 Work Packages WP1 Requirement analysis (DFKI) WP2 Knowledge representation (UdS) WP3 Components and tools (DFKI) WP4 Student modeling (Glasgow) WP5 Natural language facilities (Edinburgh) WP6 Content (Augsburg) WP7 Exercise repository (Tue) WP8 Implementation, evaluation (Augsburg) WP9 Dissemination (Klett) WP10 Management (Eurice)

4 Source: Erica Melis annual review 2006 Interdisciplinary Work AI Learning psychology Education Web technology Computational Linguistics mathematics LeActiveMath

5 Source: Erica Melis annual review 2006 Ambition of LeActiveMath Large and complex project! Some of best of (semantic) Web + ITS worlds! Research + practical results! Cutting edge themes from various disciplines Basic research + stable system Practical goals One system Thorough evaluations Recommendations for future research

6 Source: Erica Melis annual review 2006 Some Cutting Edge Themes Reuse and interoperability Services, architecture Semantics and its usage (search, services, ontologies) Presentation of Maths on the Web Student modelling (competencies, motivation..) Open learner modeling (man-machine interaction) NLU and NLG for tutoring and maths, coherent dialogue Pedagogical + technological innovations

7 Source: Erica Melis annual review 2006 Progress, status requirements KR architecture presentation Dialogue corpus internationalization LM CASintegration phrasebooks dictionary SietteInteg content dialogue pedStrategies repository+ design+GUI Input editor OLM iCMap CASinteraction Copy&paste diagnosis usability translations Experiment design

8 Source: Erica Melis annual review 2006 Event-based MVC Architecture

9 Source: Erica Melis annual review 2006 Components Tutorial component: course planner, mediato exercise choice suggestor xLM LM, history SM OLM Dialogue component iCMap Search Semantic Input editor Function plotter Exercise repository Assessment tool

10 Source: Erica Melis annual review 2006 Exercises CAS interaction Architecture (broker, phrasebooks) Queries, context Extension to domain reasoner Diagram of FSM exercise

11 Source: Erica Melis annual review 2006 Student Modelling: novel approaches Need input from Glasgow: Architecture diagram Diagnoses algos

12 Source: Erica Melis annual review 2006 Tutorial Dialogues: basic research Need input from Edinburgh: DM architecture - issues

13 Source: Erica Melis annual review 2006 User Tests and Evaluations Usability tests (FHG with Klett, UdS, DFKI ) GUI design (progress bar, TOC, menu..) Small formative tests Midterm formative evaluation in schools (partial) Midterm evaluation at university User-tests of components Plan for main evaluations in several countries

14 Source: Erica Melis annual review 2006 SE Work and Management Tasks Professional software engineering Version management Maintenance of 3 versions Integration of vairety of modules Efficiency of implementations Release management Amendments New partner: Glasgow New partner Munich Leaving partners Some delays Communication of partners

15 Source: Erica Melis annual review 2006 Issues Raised (interim review 2005) D11 corpus collection Number interactions Few derivative examples English only D15 search – evaluation: precision and recall? D20 pedagogical strategies methodology of validation? D21 exercise repository links to other modules? D22 authoring tool feedback for learner, state-of-art? D23 design of GUIs evaluation methodology, state-of-art? Demos needed

16 Source: Erica Melis annual review 2006 D11 Number of interactions for corpus Standard among research in tutorial dialogues (BEE, Monroe,Why2- Atlas) For exploratory purposes to inform initial system results statistically significant (symbolic and natural language) Only derivative Recommended by domain experts Various phenomena and skills (deriv, algebraic transformations) 13 hours interaction Domain reasoner feasible Only English Difficulty of task, stated in DoW, reusable for other languages

17 Source: Erica Melis annual review 2006 D15 evaluation? Precision of common sample (found relevant/found) Recall of common sample (found relevant/ overall relevant) No common samples with maths Comparison with text search od Google search (special access preparation)

18 Source: Erica Melis annual review 2006 D20 evaluation of pedagogical strategies Questionnaires for teachers and students Attitudes, acceptance, suggestions, when Online questionnaires Small scale comparative lab studies (LearnNew)

19 Source: Erica Melis annual review 2006 D22 authoring tool Exercise feedback in LeAM Flag feedback Process help Product help authorable Diagnosis capabilities (multi-step exercises) Media files help illustrate task, motivate tasks, make task understandable (multi- channel) Sound sometimes helpful Interactions, answer maps

20 Source: Erica Melis annual review 2006 D23 usability study Total Quality Management DIN ISO 9004 Heuristic expert evaluation Discussion and implementation possibilities New design FHG Usability lab tests 10 subjects school, university Re-design and dynamic implementation UdS/DFKI

21 Source: Erica Melis annual review 2006 Conclusion: Ambitious research project, practical usage Good progress in second year Deliverables essentially completed Demos ahead

22 Source: Erica Melis annual review 2006 Demonstrations Overall system Input editor Content GUI design search Tutorial dialogue xLM + open learner model Services: repository, Siette iCMap Copy and paste CAS interaction

23 Source: Erica Melis annual review 2006 THIS ENDS OVERVIEW TALK The other slides can answer more questions

24 Source: Erica Melis annual review 2006 Additional Work and Deviations Domain reasoner Exercise system competency-pedagogy postponed deliverables OLM dialogue TC Univ. content Midterm evaluation More time for WP5 More time for system consolidation Due to changing places personell problems:

25 Source: Erica Melis annual review 2006 Multi-disciplinary Research Cognitive and pedagogical basis Specialists from various Intelligent tutoring Web technology Adaptive hypermedia User modeling Knowledge representation Computational linguistics Socio-linguistics HTN planning Computer algebra systems Data bases Competency-based pedagogy Test theory

26 Source: Erica Melis annual review 2006 WP6 Pedagogy, Content Knowledge is constructed by humans Learning is an active and self-directed situated, contextual, social process Learners’ active role and responsible for own learning exploration, tool usage, dialogue, reflection, etc Moderate constructivism: sensible balance between construction and briefing Competence connection between knowledge and ability competence- levels determined by theory and empirical tests

27 Source: Erica Melis annual review 2006 WP9 Dissemination Press releases Talks Scientific publications Conferences and workshops D36 Web site, leaflet, poster …

28 Source: Erica Melis annual review 2006 WP10 Management Arno Schwarz, ministry of education, Saarland Christian Bokhove, teacher secondary school Zaandam, NL Hermann K. Baeumel, teacher secondary school Scotland Rolf Schulmeister, multi-media pedagogy, Germany Edith Schneider, teacher eduaction, Austria Donald Peterson, IoE London UK Sofoklis Sotiriou, EU-project CONNECT Advisory Board

29 Source: Erica Melis annual review 2006 WP10: External Cooperations Kaleidoscope NoE ProLearn NoE iClass COLDEX MKM Others: CMU, IU

30 Source: Erica Melis annual review 2006 Title Erste Ebene Zweite Ebene Dritte Ebene Vierte Ebene

31 Source: Erica Melis annual review 2006 Meeting, Place, Date, Author, Workpackage, © The LeActiveMath Consortium