Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering Verbmobil from a Software Engineering point of view System Design and Software Integration Andreas Klüter sonicson GmbH, Kaiserslautern, Germany

Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering Many partners delivered software...

Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering Software Technology Challenges The goal Build an integrated system The situation Researchers do research Using different programming languages Researchers don’t want to be bothered with technical details The solution Introducing: the System Group Introducing: the Testbed

Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering The Graphical User Interface

Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering Visualization and Debug Tools ….... and much more

Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering Service Modules: Convenient development, integration, testing,... Visualization Manager Automatic Test Module Synchronization Module User Command Mapper Arbitration of Concurrent Modules GUI Testbed Manager

Chennai, 17./18. Feb 04NLP System Software Engineering The Testbed: Integration Framework for NLP-Systems Black- board X Black- board Y Black- board Z Testbed Manager GUI Module A Module B Module C

Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering PCA - Pool Communication Architecture M1 M2M3 M5 M6M4 BB 2BB 1 BB 3 M1 M2 M3 M4 M5 M6 Verbmobil I Verbmobil II Multi-Agent ArchitectureMulti-Blackboard Architecture Modules know all communication partners Direct communication between modules Reconfiguration difficult Software: ICE and ICE Master Basic Platform: PVM Modules know their I/O data pools No direct communication between modules 198 blackboards vs direct comm. paths Reconfiguration easy Several instances of one module/functionality Software: PCA and Module Manager Basic Platform: PVM Blackboards (= „Pools“)

Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering Audio Data Word Hypotheses Graph with Prosodic Labels VITs Underspecified Discourse Representations Command Recognizer Spontaneous Speech Recognizer Channel/Speaker Adaptation Prosodic Analysis Statistical Parser Dialog Act Recognition Chunk Parser HPSG Parser Semantic Construction Robust Dialog Semantics Semantic Transfer Generation Sample Pool Structure

Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering Distributed Execution Supports Distributed Development server 2 server 1 controlling terminal User 2 User 1 Pool Communication Architecture

Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering Thank you for your interest! Andreas Klüter sonicson GmbH, Kaiserslautern, Germany The Testbed has already been reused: Philips Catholic University of Nijmegen SmartKom Comic

Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering Audio Processing („fast“) and Phonetic Fuzzy Match(„fil Kollins“) combined Audio Processing („fast“) and Phonetic Fuzzy Match(„fil Kollins“) combined

Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering Genre Classification („pop“), Audio Processing („slow“) and Access to Meta Data („80s“) Genre Classification („pop“), Audio Processing („slow“) and Access to Meta Data („80s“)

Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering Automatic Classification („lovesongs“)

Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering Music Simliarity and Recommendations …

Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering … Plus Constraints („not madonna“)

Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering … Even More Constraints („only english songs“) … We Leed the Users to What He‘s Looking For !

Chennai, 17./18. Feb 04Andreas KlüterNLP System Software Engineering Installation Example: Phonetic Fuzzy Match at musicline.de