MeMoML Master project MeMoML for the MeModules project Seminar: tangible user interfaces University of Fribourg David Bächler

MeMoML: Content MeModules project  Description  Goals State of the art  Markup languages for TUIs MeMoML project  MeMoML  MeMoEngine  MeMoML-GUI  Schema

MeMoML: MeModules project MeModules  tangible links between the human memory and reachable information Collaboration EIA ( - UniFrwww.eif.ch  Co-financed by the Hasler foundation years from January 1 st on

MeMoML: Lost in the “InfoSpace” effect: Information overload in our daily life

MeMoML: Lost in the “InfoSpace” effect: Information overload in our daily life

MeMoML: MeModules project Designing and implementing a system for creating and managing tangible shortcuts to multimedia information Change the traditional way of communication with computers  GUI  TUI associative memory physical reminder real association

MeMoML: MeModules project Two main goals  Easy interaction with devices in the everyday life  Information categorization in order to improve information access and retrieval Secondary goal  Collaboration of academic university (UniFr) and university of applied sciences (EIA)

MeMoML: State of the art of TUI MLs Markup languages for tangible user interfaces Why MLs?  Heterogeneous environment  All devices must be formally described  Multitude of particular accesses to devices  Standardized access to devices

MeMoML: State of the art of TUI MLs Not a lot of existing work in the field of meta- or markup-languages for tangible user interfaces Very new area

MeMoML: State of the art of TUI MLs TUIML  high-level description language for TUIs  Small part of the TUIMS project TUIMS  Laying the Foundations for a Tangible User Interface Management System   2/report.pdf ( ongoing work) 2/report.pdf

MeMoML: State of the art of TUI MLs UserML  User Modeling Markup Language (UserML) for Ubiquitous Computing  Based on XML  A User Model Editor transforms UserML into XForms with XSLT  pdf (published 2003) pdf

MeMoML: UserML Example partial user model which uses categories from the ontology ”UserOL” userproperty.timepressure low-medium-high high " </UserData

MeMoML: State of the art of TUI MLs MRIML  Mixed Reality Interface Markup Language  Interface markup language for defining cross- platform user interfaces  Contained in the VR and AR framework A Framework for Realizing Multi-Modal VR and AR User Interfaces  Frauenhofer Institut  reality/publications/broll05.pdf (published 2005) reality/publications/broll05.pdf

MeMoML: MRIML Example Description of a button pushButton false …

MeMoML: State of the art of TUI MLs PML  Physical Markup Language « for communicating a description of physical environments and the objects within them, their relationships to you, each other and the space »  Philips  _softw/pml/downloads/pml.pdf _softw/pml/downloads/pml.pdf  _softw/pml/ _softw/pml/

MeMoML: State of the art of TUI MLs TouchMe  Diploma project of Andy Gonzalez at EIA (2005)  Communication with RFID tags Causes actions at computer (e.g. Open browser, show photos, play music)  Started work towards categorization of objects and actions  But the main goal was to have a running application  MeMoML will continue the categrozation and formalization

MeMoML: MeMoML MeModules Markup Language Every tangible link described via a predefined scenario  physical objects  communication processes  targeted actions flexible, device-independent and easy-to-use language for describing scenarios

MeMoML: MeMoML Objects  Source with Attributes (simple, complex)  Target with Attributes (simple, complex) Communications  Cable, Wireless Actions  Send, Read, Play

MeMoML: MeMoML Example 

MeMoML: MeMoEngine identify objects ensure communication processes execute actions, described in the scenario (with MeMoML)

MeMoML: MeMoEngine Physical level  PC with several devices attached Configuration file for all devices  formal description of the device  location information (path)  communication capabilities CD player, beamer, video player, …

MeMoML: MeMoEngine Example 

MeMoML: MeMoEngine Functioning of the MeMoEngine 1. Configuration 2. Use of MeMoML 3. Create scenario + + = slideshow holidaymusicpictures

MeMoML: MeMoML-GUI facilitate the interaction with the MeMoML language  The MeMoML code is created “behind the scene” Result: the person receives the pictures of the slideshow send Business card Seashell + Pictures

MeMoML: Schema

MeMoML: Schema

MeMoML:

MeMoML:

MeMoML:

MeMoML:

MeMoML:

MeMoML:

MeMoML: Further information Omar Abou Khaled (Supervisor EIA)  Elena Mugellini (Assistant EIA)  Denis Lalanne (Unifr)  Questions? Website: MeModules homepage (coming soon)