Vishwa Ranjan Program Management Microsoft Albert Kooiman Product Management Microsoft Session Code: UNC325

Agenda Microsoft and Speech Technology Introduction to UCMA 2.0 UCMA 2.0 Workflow Introduction Scenarios Component hierarchy UC Capabilities Demo & Code OCS 2007 R2, Speech Server Conversational Grammar Builder Demo & Code

Microsoft and Speech Technology

Warning!! Satisfaction Alert Speech Server (2007) supports Speech Recognition in: North American English American Spanish Canadian French UK English German And beta previews Portuguese (Brazil, Portugal) And 12 TTS Languages OCS 2007 R2 UCMA 12 languages ASR plus TTS OCS ‘14’ 26 languages

Languages available Speech Server (2007) vs. OCS 2007 R2 vs. OCS '14' LanguageCountry/RegionSpeech Server (2007) ASRSpeech Server (2007) TTSOCS 2007 R2 ASROCS 2007 R2 TTSOCS “14” Chinese (Mandarin)China Available (RealSpeak 4.0)AvailableAvailable (MS)Planned Chinese (Traditional)Taiwan, Singapore Available (RealSpeak 4.0)AvailableAvailable (MS)Planned EnglishUnited KingdomAvailableAvailable (RealSpeak 4.0)AvailableAvailable (MS)Planned EnglishUnited StatesAvailableAvailable (RealSpeak 4.0)AvailableAvailable (MS)Planned FrenchCanadaAvailableAvailable (RealSpeak 4.0)AvailableAvailable (MS)Planned FrenchFrance Available (RealSpeak 4.0)AvailableAvailable (MS)Planned GermanGermanyAvailableAvailable (RealSpeak 4.0)AvailableAvailable (MS)Planned ItalianItaly Available (RealSpeak 4.0)AvailableAvailable (MS)Planned JapaneseJapan Available (RealSpeak 4.0)AvailableAvailable (MS)Planned KoreanKorea Available (RealSpeak 4.0)AvailableAvailable (MS)Planned PortugueseBrazilBetaAvailable (RealSpeak 4.0)AvailableAvailable (MS)Planned SpanishAmericas Available (RealSpeak 4.0)AvailableAvailable (MS)Planned SpanishSpain Available (RealSpeak 4.0) Planned PortuguesePortugal BetaOn request Planned EnglishAustralia Available (RealSpeak 4.0) Planned EnglishCanadaPlanned EnglishIndiaPlanned SpanishCatalanPlanned Chinese (Cantonese)South China/Hong KongPlanned Norwegian (Bokmal)NorwayPlanned SwedishSweden, FinlandPlanned FinnishFinlandPlanned DanishDenmarkPlanned DutchNetherlands On request Planned PolishPolandPlanned RussianRussiaPlanned

Research Technologies Automatic Speech Recognition and Conversational Understanding Speech Synthesis Deep language support Signal processing like noise filtering Speech Application Programming Interfaces Audio Search Microsoft’s Investments in Speech Founded in 1993 Leading scientists and engineers Code bases of Carnegie Mellon and Cambridge Over 188 patents since 1993

Taking Speech to the Mainstream Windows Vista Microsoft Auto Microsoft Voice Command Microsoft Streets and Trips Microsoft Autoroute Microsoft MapPoint Live Search 411 (1-800-CALL-411) Live Search for Mobile Tellme Mobile Tellme Voice Services ( TELL) Microsoft Exchange Server 2007 Unified Messaging Microsoft Exchange Server 2010 Beta Unified Messaging (Voice Mail Preview) Microsoft Office Communications Server 2007 Speech Server (2007) Tellme Business Solutions Microsoft Response Point SAPI 5.3.NET 3.0 and up (System.Speech namespace) Unified Communications Managed API

Server-side Speech Roadmap* Speech Server 2004 Speech Server 2004 R2 Speech Server (2007) Exchange 2007 UMSpeech Server (2007)OCS 2007 R2 UCMA 2.0 OCS ‘14’ UCMA 3.0 OCS ‘13’ OCS 2007 Speech Server (2007) ‘OCS14’ E’14’ SP1 OCS ‘12’ ‘E12’ Exchange 2010 UM Speech Server (2007)+ *Subject to Change Exchange 2010 SP1 UM Speech Server (2007)+ E’15’ UM UCMA 3.0 E’15’ E’14’

OCS 2007 R2: Speech Server & UCMA VoIP Gateway PBX/IP PBX VoIP Gateway PSTN Windows Server OCS Standard Server SQL Server Logging OCS Mediation Server SQL Server Logging Speech Server (2007) Web Server VoIP Gateway PBX/IP PBX VoIP Gateway PSTN OCS 2007 R2 UCMA 2.0 Speech Server (2007)

UC Managed API 2.0 Workflow Activities

New in UCMA 2.0 Collaboration IM or AudioVideo Call Conferencing Presence publication and subscription Speech Speech Synthesis (TTS) Automatic Speech Recognition Workflow Simple Call Control Query Presence IM Dialog Speech Dialog UCMA 1.0 SIP Signaling Text IM

UCMA 2.0 Workflow Activities Target Use Cases Adds UC features to WF IM and Speech modalities Presence information Use Cases Contextual Collaboration Presence Based Routing Business Process Communications Alerts and Notifications Surveys Anywhere Information Access Automated Agents IM based Query/Response Bots Voice based Query/Response Bots

UCMA 2.0 Workflow Basics Built on Windows Workflow Foundation UCMA Workflow leverages many of WF features e.g.: Activities Designer Surface Rules Engine Runtime services etc. UCMA 2.0 Core and Microsoft Speech Abstracts a subset of UCMA 2.0 Core SDK functionality Combines them with MS Speech functionalities like TTS and ASR to provide dialog components Visual Studio 2008 Requires.NET 3.5 SP1

High Level View Host Process.NET 3.5 SP1 Windows Workflow Foundation (WF) Base Activity Library and Framework Runtime Engine Runtime Services Custom Activity Libraries An Activity A Workflow Custom Runtime Services

UCMA 2.0 UC Workflow UC Workflow Activities “Call” Control Statement Question Answer Commands Events Query Presence

Student Helpline UCMA 2.0 Workflow in action

Infrastructure UCMA Workflow Runtime Services CommunicationsWorkflowRuntimeService Enables Interaction with non-workflow API (UCMA Core & Microsoft.Speech) Passing data/objects between host and workflow TrackingDataWorkflowRuntimeService Track specific data during execution of the workflow instance that can be transferred to human agent

Student Helpline Code Walkthrough

Speech Server (2007)

Speech Server (2007): IVR Platform Microsoft’s IVR Platform Can be deployed stand-alone Use Cases Full fledged IVR applications Inbound applications Outbound applications Statistical Language Model support Supports: Speech Server Workflow Activities VoiceXML 2.1 SALT 1.0 Visual Studio 2005 only.NET 2.0 Tested Telephony integration: Audiocodes gateways Dialogic gateways Operations, Administration & Maintenance (OA&M) MMC WMI MOM Pack Speech Debugging and Tuning Logging and Reporting Business Analytics Tools (OLAP cubes) SQL Server Reporting Services support

Speech Server (2007) Speech Server Runtime Service SALT Browser VXML 2.1 Browser Speech Server Windows Workflow Engine Speech Server Managed API Prompt Engine ASR TTS Applications Logging & Reporting Operations, Administration & Maintenance Infrastructure Speech Tools Visual Studio 2005 Support Data Mining Tools Speech Debugger Soft Phone Applications Telephony Interfaces Speech Server Windows Workflow Activities

Can be deployed Stand-alone Visual Studio 2005 only Supports: Speech Server Workflow Activities VoiceXML 2.1 SALT 1.0 Telephony integration tested against Audiocodes gateways Dialogic gateways OA&M MMC WMI MOM Pack Speech Debugging and Tuning Logging and Reporting Business Analytics Tools (OLAP cubes) SQL Server Reporting Services support Speech Server (2007) Speech Server Runtime Service SALT Browser VXML 2.1 Browser Speech Server Windows Workflow Engine Speech Server Managed API Prompt Engine ASR TTS Applications Logging & Reporting Operations, Administrati on & Maintenance Infrastructur e Speech Tools Visual Studio 2005 Support Data Mining Tools Speech Debugger Soft Phone Applications Telephony Interfaces Speech Server Windows Workflow Activities

Deployment requires OCS 2007 R2 or higher Visual Studio 2008 Supports: Windows Workflow (.NET 3.5 SP1) UC Open Interop Program Need to write your own Application Host / Service Prompt Engine Logging & Management Reporting Application Provisioning Application Reporting Planned: VoiceXML 2.1 Speech Tools Using UCMA for Speech Applications VXML 2.1 Browser.NET 3.5 SP1 Windows Workflow Engine Unified Communications Managed API 2.0 Prompt Engine ASR TTS Logging & Reporting Operations, Administration & Maintenance Infrastructure Speech Tools Visual Studio 2008 Support Data Mining Tools Visual Studio Debugging combined with Communicator Applications Application Runtime Service OCS 2007 R2 Telephony Interface only UCMA Core API UCMA Speech API Unified Communications Windows Workflow Activities

Speech Server to UCMA Migration Separate by design: 1. Dialog flow Managed code Windows Workflow VoiceXML Business Logic Managed Code JavaScript (typical with VXML) 3. Back-end Integration Managed Code 4. Speech Resource Files Grammars Lexicons Etc.

Student Helpline Conversational Grammar Builder

Resources Visit the Microsoft Unified Communications Developer Portal Visit the Microsoft Unified Communications Developer Portal Visit the Microsoft Office Communications Developer Portal Visit the Microsoft Office Communications Developer Portal Visit the Microsoft Exchange Developer Center Visit the Microsoft Exchange Developer Center Join the UC Developer Community and Sign-up for the Dev Sandbox! Join the UC Developer Community and Sign-up for the Dev Sandbox! Download the Exchange 2010 EWS Managed API 1.0 Exchange Web Services Managed API 1.0 Exchange Web Services Managed API 1.0 Download the Exchange 2010 EWS Managed API 1.0 Exchange Web Services Managed API 1.0 Exchange Web Services Managed API 1.0

Get the Book! Intro to UC Overview of all UC APIs OC Automation API Embedding Contextual Collab UCMA Workflow API Building a UC-enabled WF App UCMA Core API Publishing Custom Presence Setup of OCS Environment Debugging UC Applications

Resources UNC201 - Lap around Release 2 of the Microsoft Unified Communications Platform UNC301 - Adding Communication to Your Applications with Microsoft Office Communicator 2007 R2 UNC322 - Building Communication Services with the UCMA 2.0 and Microsoft Office Communications Server 2007 R2 UNC Windows Workflows Activities That Talk and IM with Microsoft Office Communications Server 2007 R2 UNC324 - What's New in Exchange Web Services in Microsoft Exchange Server 2010 UNC401 - UNC401 - Building Rich Calendaring Experiences with Exchange Web Services

Sessions On-Demand & Community Resources for IT Professionals Resources for Developers Microsoft Certification and Training Resources Microsoft Certification & Training Resources Resources Required Slide Speakers, TechEd 2009 is not producing a DVD. Please announce that attendees can access session recordings at TechEd Online. Required Slide Speakers, TechEd 2009 is not producing a DVD. Please announce that attendees can access session recordings at TechEd Online.

Complete an evaluation on CommNet and enter to win! Required Slide

© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. Required Slide