1. Forschungszentrum Telekommunikation Wien An initiative of the K plus Programme MONA Mobile Multimodal Next Generation Applications Rudolf Pailer pailer@ftw.at

2. © ftw. 2000 25-Sep-02 / 2 ftw. research in the Tech Gate Vienna  ftw. Forschungszentrum Telekommunikation Wien - Telecommunications Research Center Vienna  Project MONA in specification phase.  Duration 1.1.2003 - 31.12.2004  Project volume: ~ 150 person months  Cooperative research -Vienna University of Technology -Telecom industry -Network providers

3. © ftw. 2000 25-Sep-02 / 3 MONA key topics  Feasibility and usability of multi-modal applications in today’s mobile network (computational costs, data rate, latency).  Selection and combination of modalities and media for content delivery based on presence information, profiles and terminal capabilities.  Integration of speech technologies, such as TTS, ASR and DSR into advanced application frameworks, i.e. the OSA/Parlay architecture.

4. © ftw. 2000 25-Sep-02 / 4 MONA project goals  Realization of multi-modal applications based on the experiences gained with the Lol@ tourist guide application of the ftw. research project „C1 - UMTS Application Development“. Target platforms are PDAs, pocket PCs and Smartphones.  Advanced speech services Enhance mobile applications with TTS, ASR and DSR systems as investigated by the ftw. research project „B2 – Speech & More“.  Distributed, modular and object oriented design Use the OSA/Parlay based service framework based on the ftw. research project „A1 – Service Platform and Interoperability“. Optimize the solution for mobile networks (GPRS / UMTS).

5. © ftw. 2000 25-Sep-02 / 5 A1 - Service Platform and Interoperability Each network with own access, transport, switching and service architecture PLMN Service CATV Service PSTN/ISDN Service Data/IP Service Application Servers / Applications Parlay API Unified Service Network Connectivity/ Backbone Network Connectivity/ Access Networks Parlay API Application Servers / Applications Network with unified service network architecture Tomorrow’sNetworkTomorrow’sNetworkToday’sNetworksToday’sNetworks

6. © ftw. 2000 25-Sep-02 / 6 A1- Service Platform Architecture Service Platform Container implementation is based on CORBA Component specification. Developed Components: Click2Dial, CPL Routing, Location, User Status, VoiceXML server, calendar, Service Discovery, AAA, Subscription Business interfaces according to OMGs Telecom Service Access & Subsription (TSAS) Network Interfaces according to OSA/Parlay SIP based Multimedia Services

7. © ftw. 2000 25-Sep-02 / 7 B2 – Speech & More  Speech for multimodal interfaces on mobile phones -Voice I/O is an integral part of mobile phones -Mobile phone displays are small, but growing (a bit) -Key pads are small, may be replaced by touch screens -Text entry is and will remain cumbersome -Maps and other visual information call for display -Limited space for visual menus and buttons  Multi-modal interfaces (voice control + display) are important for attractive data services  GSM technology does not support simultaneous use of voice and display for interfaces  GPRS: first steps with sessions, WAP Push

8. © ftw. 2000 25-Sep-02 / 8 B2 multimodal demonstrator Flexible interface for entering text without a keyboard, combining speech and drop-down lists. Uses VoiceXML for speech application design.  Satisfaction with interface, scale 1(best)-5 -Speech input2.90 -GUI input2.17 -Multi-modal input 1.92  Which input do you prefer? (in percent) -Speech only33% -GUI only17% -Multi-modal50%

9. © ftw. 2000 25-Sep-02 / 9 C1 - UMTS Application Development  Lol@ - Tourist guide for 1 st district of Vienna  Application for UMTS and GPRS networks  Suitable for MExE/classmark 2 (JAVA) terminals  Location based service. Navigation concepts: location, routing, maps, landmarks  Key Concepts: OSA/Parlay API, User Profile Management, User Interface, Localization/Navigation, Multimedia and QoS

10. © ftw. 2000 25-Sep-02 / 10 Lol@ Network Architecture TerminalMobile Network Domain (extended bit pipe) Network Operator: Service Capability Features Mobile Term. SGSNGGSNHLR HSS LCS Module SIP UA Appl. Core GUI Application/ Content Provider Platform Provider SIP Speech Server Application Platform Platform database Application Core Web Server Content database OSA API LCSCSCF Server Domain

11. © ftw. 2000 25-Sep-02 / 11 MONA Research Topics - Scenarios  Feasibility and usability investigations for multimodal application scenarios on mobile devices -Mobile office -Collabroative Workspaces -Education -Entertainment

12. © ftw. 2000 25-Sep-02 / 12 MONA Research Topics - Presentation  Presentation of multimodal application interfaces on mobile devices -Dynamic user interface and content adaptation depending on terminal capabilities and user profile

13. © ftw. 2000 25-Sep-02 / 13 MONA Research Topics – Network I  SIP based multimedia communications -Coordination of real-time, user intercation and data SIP sessions for shared applications  Evaluating OSA/Parlay framework -Mapping of multimodal application requirements to OSA/Parlay model -Distributed system architecture – scalability, performance, security -Service platform design  Web services -Application development -Integration of multimodal systems (e.g. voice servers), production systems

14. © ftw. 2000 25-Sep-02 / 14 MONA Research Topics – Network II  Network QOS -VPNs between sites -MPLS based provisioning with bandwidth reservation  Telecom-aware Service Management -presence and availability for resource management (staff, machines) -groupware communication (workspaces, multimedia messaging, notifications, meeting support, conferencing) -mobility support (SIP, conferencing, push systems), location based services -security (authentication, message integrity, encryption)

15. © ftw. 2000 25-Sep-02 / 15 MONA Research Topics - Speech  Distributed Speech recognition (DSR) -Feature extraction in the terminal, pattern recognition in a central server -Performance evaluation versus standard codecs (bandwidth, transfer delay, processor load, robustness against bit errors and packet loss)

16. © ftw. 2000 25-Sep-02 / 16 For more information...  please contact:  ftw. research: http://www.ftw.at Rudolf Pailer Research and Methodology Management System&Technology Ericsson Enterprise GmbH mailto:Rudolf.Pailer@abg.ericsson.se Rudolf Pailer MONA Project Manager mailto:pailer@ftw.at ftw. Forschungszentrum Telekommunikation Wien