Globalizing apps and UX with Microsoft Translator text and speech translation API Kelly Altom Program Manager translator@microsoft.com

What is Microsoft Translator? 5/30/2018 5:18 AM What is Microsoft Translator? Cet outil de traduction est un moyen facile d'étendre la portée de vos contenus internes et externes. Client app or webpage 此翻译工具是可以轻松地扩展您的内部和外部内容的覆盖范围。 WEB API Microsoft Translator…. Is an automatic machine translation cloud API (REST) Text translation: ~60 languages Speech translation: 9 speech to speech languages. All speech languages to ~60 text Languages Customization of translation engines (text only) Priced by monthly volume Text by millions of characters per month Speech by hours per month Microsoft Translator powers… Bing.com/translator webpage, Edge add-in Translator mobile apps: Windows, Android and iOS Office: Word, Outlook - SharePoint, Yammer, Visual Studio Skype Translator and Meeting Broadcast Etsy, Twitter, Ask.com, Rakuten etc… © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Cognitive Services Cortana Intelligence Microsoft Build 2016 5/30/2018 5:18 AM Cortana Intelligence Microsoft Cognitive Services preview Vision Computer Vision | Emotion | Face | Video | Content Moderator Speech Custom Recognition | Speaker Recognition | Speech Cognitive Services Give your solutions a human side Language Bing Spell Check | Language Understanding | Linguistic Analysis | Text Analytics | Web Language Model | Translator Text and Speech Knowledge Academic Knowledge | Entity Linking | Knowledge Exploration | Recommendations Search Bing Auto Suggest | Bing Image Search | Bing News Search | Bing Video Search | Bing Web Search © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Text Translation API – Key Scenarios Microsoft Translator Text API ~60 languages allows users to reach more than 95% of world's GDP. Readiness and Training Provide sales, marketing, technical or human resources content and training in multiple languages to your organization. Internal Communications Foster communication among employees by enabling multi-lingual information sharing over instant messaging, or on team or community sites. Customer Support Integrate automatic translation in your pre-existing customer support workflows. Community and Social Multiply the value of your customer forums, consumer content, or user groups with scalable cost-effective multi-language support. Web Localization Localize your website by combining human and automatic translation. Multi-Lingual Business Intelligence Empower comprehensive analysis of Multi-Lingual Business Intelligence for BDM needs.

Demo Bing Translator Document Translator Interactive Documentation Microsoft Connect 2016 5/30/2018 5:18 AM Demo Bing Translator Document Translator Interactive Documentation © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Speech Translation API – Key Scenarios Translator Speech API is the world’s only end-to-end cloud-based automatic speech translation service. In-person and remote communications Integrate the speech translation API into your communication apps and infrastructure. Customer Support Integrate speech translation into your call center infrastructure by extending language coverage to 24x7 or providing additional languages, and adding extra localized support during peak times. Real-time Presentation Translation Provide real time subtitling of your presentations or classes in 50+ languages. Multi-Lingual Business Intelligence Analyze your audio files by translating them into searchable text for business decision makers. Media Subtitling Provide automatic close captioning and subtitling in 50+ languages for your live or recorded media events: webcasts, broadcasts.... Multi-Lingual AI Interactions Enable natural multi-lingual interaction with your AI powered solutions by integrating Speech translation in the experience.

Demo Speech Translator Code Walkthrough Microsoft Connect 2016 5/30/2018 5:18 AM Demo Speech Translator Code Walkthrough © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

UWP-SpeechTranslate-App 5/30/2018 5:18 AM private byte[] GetWaveHeader() { var channels = (short)1; var sampleRate = 16000; var bitsPerSample = (short)16; var extraSize = 0; var blockAlign = (short)(channels * (bitsPerSample / 8)); var averageBytesPerSecond = sampleRate * blockAlign; using (MemoryStream stream = new MemoryStream()) BinaryWriter writer = new BinaryWriter(stream, Encoding.UTF8); writer.Write(Encoding.UTF8.GetBytes("RIFF")); writer.Write(0); writer.Write(Encoding.UTF8.GetBytes("WAVE")); writer.Write(Encoding.UTF8.GetBytes("fmt ")); writer.Write((int)(18 + extraSize)); // wave format length writer.Write((short)1);// PCM writer.Write((short)channels); writer.Write((int)sampleRate); writer.Write((int)averageBytesPerSecond); writer.Write((short)blockAlign); writer.Write((short)bitsPerSample); writer.Write((short)extraSize); writer.Write(Encoding.UTF8.GetBytes("data")); stream.Position = 0; byte[] buffer = new byte[stream.Length]; stream.Read(buffer, 0, buffer.Length); return buffer; } © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Continued unsafe internal static void SendAudioFrameNative(AudioFrame frame, DataWriter writer) { using (var buffer = frame.LockBuffer(AudioBufferAccessMode.Read)) using (IMemoryBufferReference reference = buffer.CreateReference()) byte* dataInBytes; uint capacityInBytes; // Get the buffer from the AudioFrame ((IMemoryBufferByteAccess)reference).GetBuffer(out dataInBytes, out capacityInBytes); // convert the bytes into float float* dataInFloat = (float*)dataInBytes; for (int i = 0; i < capacityInBytes / sizeof(float); i++) // convert the float into a double byte for 16 bit PCM writer.WriteInt16(FloatToInt16(dataInFloat[i])); }

How to use Text Translator and Speech Translator API

Resources Sample Apps on Github API documentation About Translator Bing Translator Text Translation API Speech Translation API Translator@Microsoft.com