Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November Tayeb Lemlouma & Nabil Layaïda Presented by Sébastien Laborie November 2005 WAM Research Team, INRIA Rhône-Alpes Content Interaction and Formatting for Mobile Devices

Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November Plan 1.Introduction 2.Architecture overview 3.Media and structural adaptation 4.User interaction and navigation 5.Content adaptation and formatting 6.Experimental results 7.Conclusion

Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November Introduction Multimedia systems become more and more heterogeneous Complexity of multimedia applications and content is increasing Several heterogeneous devices are used today Increasing need to use the content on small devices any time and anywhere (example in mobility) Problem: mobile devices are different and subject of many limitations : screen, memory, processor, network, etc. Current adaptation systems use transformation languages and media objects adaptation such as video and images transcoding

Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November Introduction Current techniques are usually not sufficient to guarantee a correct handling in particular for very limited devices such as mobile phones Structural adaptation can generate a non adapted content for the displaying limitations of the terminal (large amount of data) Media transcoding may result in an important degradation of the quality compared to the original content. Current techniques are based on a one pass adaptation process : no interaction between the user and the original content How can we enable an optimized use of the Web and multimedia applications for limited terminals?

Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November Architecture Overview NAC (Negotiation and Adaptation Core): a proxy-based architecture, negotiation and adaptation services for heterogeneous environments ProfilesProtocol Negotiation Client ProxyServer Client / Proxy Adaptation Structural adaptation Resources adaptation Content selection Proxy / Serveur Proxy / Repository

Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November Architecture Overview The interactive adaptation system : NAC enriched by 1.Adaptation component processes the interaction requests of the user and applies a structural and media adaptation on the original content the result of the adaptation is transmitted to the client formatter 2.Client formatter presents the different parts of the adapted content The user can start an interaction with the adapted content Interactions trigger navigation requests which are sent to the adaptation components Proxy Servers Adaptation component Client formatter Adapted content Interaction

Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November Media and Structural Adaptation Structural adaptation is used to adapt textual information within a given structure Media adaptation is used to adapt resources used in different multimedia languages SMIL regions construct is used and extended to provide more flexibility in the presentation process and the displaying size allocation

Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November User Interaction and Navigation A region is associated with a set of events that triggers the interaction with the content presented within the region Linear content navigation: the user can select a particular region, and, via the proxy, navigate in the different parts of the content Hierarchical navigation: the user can request the current part of the document in more details

Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November User Interaction and Navigation Formatting regions on mobile platforms

Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November User Interaction and Navigation A region is associated with a set of events that triggers the interaction with the content presented within the region Linear content navigation: the user can select a particular region, and, via the proxy, navigate in the different parts of the content Hierarchical navigation: the user can request the current part of the document in more details

Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November User Interaction and Navigation Hierarchical navigation within regions

Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November Content Adaptation and Formatting The formatter component presents the content of the regions and adds listeners in order to intercept the user interactions A user interaction triggers a request sent to the adaptation component of the proxy. A request includes a set of parameters such as: the selected region, the part of the content currently displayed, the user interaction event. The proxy replies to the client request by an adapted content portion extracted from the original content The different parts of the content can be navigated progressively and are only sent when necessary

Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November Experimental Results An adaptation module, implemented in Java, is integrated to the negotiation and adaptation module of the NAC architecture (proxy level) The module ensures : –content decomposition in streaming –linear and hierarchical navigation –user interactions processing A formatting module is implemented for mobile phones using J2ME: version 1.0 of Mobile Information Device Profile (MIDP) and Connected Limited Device Configuration (CLDC) The formatter uses the Portable Network Graphics (PNG) format various text fonts (the combination of the three supported faces, styles and sizes of MIDP 1.0)

Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November Experimental Results Regions formatting time Displaying time

Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November Conclusion The proposed system is based on interactive adaptation techniques The system includes a stream-based text formatter together with an interaction-based access to adapted rich multimedia content The interaction-based system allows to: consider the user preferences optimize the adaptation and the environment resources improve the adaptation quality of service

Content Interaction and Formatting, Tayeb LEMLOUMA & Nabil Layaïda. November Thank you