James A. Larson Developing & Delivering Multimodal Applications 1 EMMA Extensible MultiModal Annotation markup language Canonical structure for semantic.

Slides:

Advertisements

Similar presentations

1 Drafting Preparing the Initial Composition. 2 Drafting Basics While prewriting activities and tools can assist the writer during initial drafting, the.

Advertisements

An overview of EMMA— Extensible MultiModal Annotation Michael Johnston AT&T Labs Research 8/9/2006.

Irek Defée Signal Processing for Multimodal Web Irek Defée Department of Signal Processing Tampere University of Technology W3C Web Technology Day.

Empirical and Data-Driven Models of Multimodality Advanced Methods for Multimodal Communication Computational Models of Multimodality Adequate.

XISL language XISL= eXtensible Interaction Sheet Language or XISL=eXtensible Interaction Scenario Language.

A Language Environment for Second Language Writers Ola Knutsson KTH Nada.

Frontiers in Interaction The Power of Multimodal Standards Deborah Dahl Principal, Conversational Technologies Chair, W3C Multimodal Interaction Working.

Structure of rest of course - I Practical tactical generation –writing and testing simple grammars: the importance of choice –issues of semantics for text.

Augmented assembly using a multimodal interface Muscle Showcase Sanni Siltanen, VTT Alex Potamianos, TUC.

Exercise Exercise3.1 8 Exercise3.1 9 Exercise

Exercise Exercise Exercise Exercise

Exercise Exercise Exercise Exercise

Exercise Exercise6.1 7 Exercise6.1 8 Exercise6.1 9.

CALL: Computer-Assisted Language Learning. 2/14 Computer-Assisted (Language) Learning “Little” programs Purpose-built learning programs (courseware) Using.

Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Slide

Office 2003 Tablet Enabled. Office 2003 The Biggest Addition Is Ink.

VoiceXML Basic COCOMO Calculator By Greg Kutcher.

Mobile Multimodal Applications. Dr. Roman Englert, Gregor Glass March 23 rd, 2006.

Should Intelligent Agents Listen and Speak to Us? James A. Larson Larson Technical Services

Website Accessibility

Standard Development Languages—Are They Important? Disadvantages of standards – May be restrictive – May not include recent technology advances – May be.

1 Skip Cave Chief Scientist, Intervoice Inc. Multimodal Framework Proposal.

Tutorial Developing and Deploying Multimodal Applications James A. Larson Larson Technical Services larson-tech.com SpeechTEK West February 23, 2007.

SCXML State Chart Markup Language. SCXML controls the flow of an application SCXML controls modalities –VoiceXML –XHTML –Others, e.g., InkML, SVG SCXML.

Speaking to Computers Alex Acero Manager, Speech Research Group Microsoft Research Feb 14 th 2003.

Some Thoughts on HPC in Natural Language Engineering Steven Bird University of Melbourne & University of Pennsylvania.

Conversational Applications Workshop Introduction Jim Larson.

Multimodal user interfaces: Implementation Chris Vandervelpen

ITCS 6010 SALT. Speech Application Language Tags (SALT) Speech interface markup language Extension of HTML and other markup languages Adds speech and.

MediaHub: An Intelligent MultiMedia Distributed Platform Hub Glenn Campbell, Tom Lunney & Paul Mc Kevitt School of Computing and Intelligent Systems Faculty.

PRESENTED BY: Nadia Qamoum Suzanne Blasingame Rachael Reano Hunza Iqbal.

What it’s ? “parsing” Parsing or syntactic analysis is the process of analysing a string of symbols, either in natural language or in computer languages,

Standard Grade Computing General Purpose Packages WORD-PROCESSING WORD-PROCESSING Chapter 2.

Using VoiceXML, XHTML, and SCXML to Build Multimodal Applications James A. Larson.

Forcier and Descy The Computer as an Educational Tool (Fifth Edition) Copyright © 2008 by Pearson Education, Inc. Columbus, Ohio All rights reserved.

Microsoft Word The Help function. Under the “File” menu, click “Help”

Python – Part 1 Python Programming Language 1. What is Python? High-level language Interpreted – easy to test and use interactively Object-oriented Open-source.

Integrating Educational Technology into Teaching Integrating Word Processing, Spreadsheets, & Data Base Software Tools into Teaching & Learning.

Outline Grammar-based speech recognition Statistical language model-based recognition Speech Synthesis Dialog Management Natural Language Processing ©

Outline Grammar-based speech recognition Statistical language model-based recognition Speech Synthesis Dialog Management Natural Language Processing ©

(c) 2007 Larson Technical Services1 VoiceXML Overview James A. Larson Intel Corporation

Basic Programming Lingo. A program is also known as a  Sequence of instructions  Application  App  Binary  Executable.

Las vegas By:nELSON.

ICT II Information and Communication Technology II Course Introduction.

GUI Meets VUI: Some Possible Guidelines James A. Larson VP, Larson Technical Services 4/21/20151© 2015 Larson Technical Services.

1 An Introduction to Computational Linguistics Mohammad Bahrani.

Text Annotation By: Harika kode Bala S Divakaruni.

VoiceXML – Speech Recognition Yousef Rabah. VoiceXML Markup Language Dialogs Dependencies Standalone Vs. Hosted Speaker Dependent Vs. Speaker Independent.

Section 2B. Objectives List two reasons why some people prefer alternative methods of input over a standard keyboard or mouse. List three categories of.

We walk in and wash our hands. Check in to class.

Writing with Figurative Language Grade

The idea of adding markup instructions to documents is not new. Before computers, authors would make annotations by hand in their written or typed documents.

Daily Language Warm Up PPT. Day 3: Essential Questions What reading strategies can help me interpret and analyze texts in the course? How do I apply reading.

W3C Multimodal Interaction Activities Deborah A. Dahl August 9, 2006.

©2003 Paula Matuszek CSC 9010: AeroText, Ontologies, AeroDAML Dr. Paula Matuszek (610)

Presented By Sharmin Sirajudeen S7 CS Reg No :

What Do Computers Do? A computer system is

Multimodal Input of Mathematical Symbols (Model 1)

The toolbox for language description Kuiper and Allan 1.2

Team Members: Ethan Byler Luke Johnston Dhruv Lamba Andy Robison

Group “A” Researchers 7/20/2005

Office of Chief Financial Officer

(No need of Desktop computer)

Video Processing Steps Face Detection Activity Recognition

مفاهیم بهره وري.

HTML HYPERTEXT MARKUP LANGUAGE.

المدخل إلى تكنولوجيا التعليم في ضوء الاتجاهات الحديثة

Put the on A on the keyboard.

LANGUAGE EDUCATION.

Artificial Intelligence 2004 Speech & Natural Language Processing

Presentation transcript:

James A. Larson Developing & Delivering Multimodal Applications 1 EMMA Extensible MultiModal Annotation markup language Canonical structure for semantic interpretations for a variety of inputs including: – Speech – Natural language text – GUI – Ink

James A. Larson Developing & Delivering Multimodal Applications 2 EMMA Keyboard Interpretation Speech Recognition Merging/ Unification Speech Keyboard EMMA Grammar + Semantic Interpretation Instructions Interpretation Instructions Applications

James A. Larson Developing & Delivering Multimodal Applications 3 EMMA Keyboard Interpretation Speech Recognition Merging/ Unification Speech Keyboard EMMA Grammar + Semantic Interpretation Instructions Interpretation Instructions Applications Tuesday

James A. Larson Developing & Delivering Multimodal Applications 4 EMMA Keyboard Interpretation Speech Recognition Merging/ Unification Speech Keyboard EMMA Grammar + Semantic Interpretation Instructions Interpretation Instructions Applications Tuesday Las Vegas Portland

James A. Larson Developing & Delivering Multimodal Applications 5 Tuesday Las Vegas Portland EMMA Keyboard Interpretation Speech Recognition Merging/ Unification Speech Keyboard EMMA Grammar + Semantic Interpretation Instructions Interpretation Instructions Applications Las Vegas Portland Tuesday

James A. Larson Developing & Delivering Multimodal Applications 6 Exercise savings checking Given the following two EMMA specifications, what is the unified EMMA specification? ______ _______ ______ Unified EMMA specification: