Visual Model-based Design of Multi- platform Interactive Applications HCI Group/ISTI-CNR 23 September 2002 Pisa (I)

2 EUD-Net Workshop, Pisa, September 22 nd 2002 Rationale Ever-increasing introduction of new types of interactive devices Applications often need to be accessed through different interactive devices How to support designers and developers? How to obtain interfaces able to adapt to different targets while preserving usability?

3 EUD-Net Workshop, Pisa, September 22 nd 2002 Goals Express context-dependent information in a set of models that can be used at design-time and run-time Develop tools using information contained in the models to drive the design and development of usable interfaces for multi-target applications Techniques/components supporting development of adaptive/context-dependent applications Address some case studies for validating the methods, techniques and tools

4 EUD-Net Workshop, Pisa, September 22 nd 2002 Task –related issues in multiplatform applications Same task on multiple platforms in the same manner Tasks meaningful only on a single platform type Dependencies among tasks performed on different platforms Same task on multiple platforms but performed in different manner

5 EUD-Net Workshop, Pisa, September 22 nd 2002 One model, many interfaces

6 EUD-Net Workshop, Pisa, September 22 nd 2002 TERESA in the Reference Framework

7 EUD-Net Workshop, Pisa, September 22 nd 2002 The Method Task model for envisioned nomadic applications System task model – desktop (XML) System task model – cellphone (XML) System task model (pda) (XML) … Filter + Refine Abstract UI – cellphone (XML) Openwave … Nokia (WML, XHTML Mobile, VoiceXML, …) Abstract UI – desktop (XML) Multimedia PC Graphical PC Low res PC ( HTML, …) Abstract UI – Pda (XML) Palm … Compaq

8 EUD-Net Workshop, Pisa, September 22 nd 2002 Related Work The User Interface Markup Language (UIML) ( Mainly developed by Harmonia and Virginia Tech. The Abstract User Interface Markup Language (AUIML) is an XML vocabulary designed to allow the intent of an interaction with a user to be defined. This work has mainly been carried out at IBM. The eXtensible Interface Markup Language (XIML) ( is an extensible XML specification language for multiple facets of multiple models in a model- based approach. This is developed by a forum driven by RedWhale software (HP and Applied materials).

9 EUD-Net Workshop, Pisa, September 22 nd 2002 Interface Presentation+ Structure Connection? Interaction_ai o_name presentation_ai o_name aio aio_composition interaction_aioapplication_aio selection_aio control_aio edit_aio single_choice_aiomultiple_choice_aio+ singlechoice_l ow_card_aio+ singlechoice_me dium_card_aio+ singlechoice_ high_card_aio + multiplechoice_ low_card_aio+ multiplechoice_m edium_card_aio+ multiplechoice_hi gh_card_aio+ operator 1st_ expression + 2nd_ expression ? name sub_present ation text_aio graphic_aio text_edit_aio graphic_edit_aio aio aio_composition Structure of the language for abstract user interfaces

10 EUD-Net Workshop, Pisa, September 22 nd 2002 Composition operators Grouping (G) Relation (R) Ordering (O) Hierarchy (H)

11 EUD-Net Workshop, Pisa, September 22 nd 2002 TERESA XML WML XHTML Mobile Xml spec of CTT task model Xml spec of operators & abstract interactors Xml spec of Enabled Task Sets XHTML Abstract User Interface Transformation Environment for inteRactivE Systems representAtions

12 EUD-Net Workshop, Pisa, September 22 nd 2002 Current TERESA layout

13 EUD-Net Workshop, Pisa, September 22 nd 2002 Filtering the model

14 EUD-Net Workshop, Pisa, September 22 nd 2002 XML AIU language

15 EUD-Net Workshop, Pisa, September 22 nd 2002 Initial layout for the prototyping phase

16 EUD-Net Workshop, Pisa, September 22 nd 2002 Defining implementation of composition operators

17 EUD-Net Workshop, Pisa, September 22 nd 2002 Changing design decisions

18 EUD-Net Workshop, Pisa, September 22 nd 2002 Summary of the design decision

19 EUD-Net Workshop, Pisa, September 22 nd 2002 Example of phone presentation

20 EUD-Net Workshop, Pisa, September 22 nd 2002 Example of desktop presentation

21 EUD-Net Workshop, Pisa, September 22 nd 2002 From system task model to abstract user interface Shift from task to abstract interaction objects: Shift from task to abstract interaction objects: 1)Calculation of enable task sets 2)Heuristics for optimization in terms of presentation sets and transitions 3)Mapping presentation task sets into sets of abstract interaction objects and dialogue