5/14/2018 7:32 PM BRK3299 Microsoft Cognitive Services: Infusing language and speech capabilities into your apps Giampaolo Battaglia Luis Cabrera Sr.

5/14/2018 7:32 PM BRK3299 Microsoft Cognitive Services: Infusing language and speech capabilities into your apps Giampaolo Battaglia Luis Cabrera Sr. Product Marketing Manager Principal Program Manager © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

TechReady12 5/14/2018 © 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

What if the machine… .. could understand language …could see …could talk …could learn from experiences …could predict the future

Amplifying human ingenuity with intelligent technology
Paul Microsoft AI Amplifying human ingenuity with intelligent technology

Paul Microsoft AI Intelligence

Paul Microsoft AI Intelligence Data Experiences Infrastructure

Microsoft AI Intelligence Data Experiences AI PLATFORM
Paul Microsoft AI Intelligence Data Experiences AI PLATFORM INTELLIGENT AGENTS AI SOLUTIONS APPLICATIONS

Microsoft AI INTELLIGENT AGENTS CORTANA Paul
Knows you | Knows your work + life | Knows the world 1,000+ skills and knowledge 133 million users | 12 billion questions

Microsoft AI AI SOLUTIONS Solution Accelerators Partner Ecosystem
Paul Microsoft AI AI SOLUTIONS Solution Accelerators Partner Ecosystem New AI-based solutions Infrastructure

Microsoft AI INTELLIGENT APPS Office 365 Skype Dynamics 365 Teams
Paul Microsoft AI INTELLIGENT APPS Office 365 Skype Dynamics 365 Teams Calendar.help Presentation Translator Microsoft Garage Project

Presentation Translator
5/14/2018 7:32 PM Presentation Translator DEMO © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Industry-leading investments
Microsoft AI DATA + AI PLATFORM Industry-leading investments Infrastructure + Analytics in Big Data Stores

Microsoft AI DATA + AI PLATFORM Machine Learning – Deep Learning
GP Microsoft AI DATA + AI PLATFORM Azure Machine Learning Cognitive Toolkit Machine Learning – Deep Learning Infrastructure + Analytics in Big Data Stores

Microsoft AI DATA + AI PLATFORM Microsoft Cognitive Services
GP Microsoft AI Microsoft Cognitive Services DATA + AI PLATFORM Machine Learning – Deep Learning Infrastructure + Analytics in Big Data Stores

Microsoft Cognitive Services
Microsoft Build 2016 5/14/2018 7:32 PM Microsoft Cognitive Services Give your apps a human side Vision From faces to feelings, allow your apps to understand images and video Speech Hear and speak to your users by filtering noise, identifying speakers, and understanding intent Language Process text and learn how to recognize what users want Knowledge Tap into rich knowledge amassed from the web, academia, or your own data Search Access billions of web pages, images, videos, and news with the power of Bing APIs © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Microsoft Build 2016 5/14/2018 7:32 PM Microsoft Cognitive Services Give your apps a human side Vision Speech Knowledge Language Search Computer Vision Content Moderator Emotion Face Video Video Indexer Custom Vision Service Bing Speech Speaker Recognition Custom Speech Service Bing Spell Check Linguistic Analysis Text Analytics Translator Text & Speech Web Language Model Language Understanding Academic Knowledge Entity Linking Knowledge Exploration Recommendations QnA Maker Custom Decision Service Bing Autosuggest Bing Image Search Bing News Search Bing Video Search Bing Web Search Bing Entity Search Bing Custom Search © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Microsoft Build 2016 5/14/2018 7:32 PM Microsoft Cognitive Services Give your apps a human side Vision Speech Knowledge Language Search Computer Vision Content Moderator Emotion Face Video Video Indexer Bing Speech Speaker Recognition Bing Spell Check Linguistic Analysis Text Analytics Translator Text & Speech Web Language Model Academic Knowledge Entity Linking Knowledge Exploration Recommendations QnA Maker Bing Autosuggest Bing Image Search Bing News Search Bing Video Search Bing Web Search Bing Entity Search © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Microsoft Cognitive Services Customization
Microsoft Build 2016 5/14/2018 7:32 PM Microsoft Cognitive Services Customization Vision Speech Language Knowledge Search The broadest set of custom AI services available, allowing customers to use their own data with algorithms that are customized for their specific needs. Customizable web service that learns to recognize specific content in imagery Fine-tune speech recognition for anyone, anywhere Teach your apps to understand commands from your users Create custom experiences with adaptive, contextual decision-making Create a highly- customized web search experience Custom Vision Service Custom Speech Service Language Understanding Custom Decision Service Bing Custom Search © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Linguistic Analysis API Language Understanding Intelligent Service
5/14/2018 7:32 PM Language Bing Spell Check API Web Language Model API Linguistic Analysis API Detect and correct spelling mistakes within your app Leverage the power of language models trained on web-scale data Easily parse complex text with language analysis Language Understanding Intelligent Service Text Analytics API Translator Teach your apps to understand commands from your users Detect sentiment, key phrases, topics, and language from your text Easily perform speech and text translation

Let’s start with the Basics
5/14/2018 7:32 PM Let’s start with the Basics TEXT ANALYTICS API DEMO © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Brainshark Problem Solution MGX FY17 5/14/2018 7:32 PM
Power your Content. Power your Sales. Problem Training sales people through experience is ridiculously expensive. Every deal lost due to lack of confidence costs the company real money. Solution Create a training platform that allows sales reps to perfect their pitch through video and Cognitive Services. Utilizing Face API, Emotion API, and Text Analytics, we both analyze their pitch, and feed an ML model to provide feedback on their performance. “Now, companies are simply pushing sales people into the field and they’re learning through experience— a ridiculously expensive way to train. Every deal lost due to lack of confidence costs the company real money. If we can minimize that and actually get sales people ready to sell, it’ll have a huge impact on productivity,” Jim Ninivaggi Senior Vice President Business Development © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

BlueBolt Problem Solution MGX FY17 5/14/2018 7:32 PM
We deliver solutions that matter to business Problem Document classification required an expensive manual process and a lot of time from subject- matter experts. Solution Use Text Analytics Cognitive Service to extract key-phrases and use them as facets for Azure Search to improve the document search experience. “Machine learning in general is a very advanced topic that can take months of both research and development to begin to obtain value. With two days of working with Microsoft and their services, the difference is night and day. When pairing our solution with Azure and Cognitive Services, the sky is the limit, potentially saving dozens or hundreds of hours of data processing for our customers.” Mike Michaels Software Developer BlueBolt © 2016 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

A new canvas: Conversations
1980s: PC Command Line Interface 1990s GUI and Internet Search User “visits” websites 2000s NUI and Mobile A new canvas: Conversations Natural language between people and technology Contextual Bots and agents

Language Understanding
When does flight _______ arrive? Where is the nearest bathroom? Please book a flight to __________. AF32 Orlando

Language understanding intelligent service
5/14/2018 7:32 PM Language understanding intelligent service Reduce labeling effort with interactive featuring Use visualizations to gauge performance and improvements Leverage speech recognition with seamless integration Deploy using just a few examples with active learning Define concepts Provide examples Active learning Deploy

The “Hello World” of Language Understanding
5/14/2018 7:32 PM The “Hello World” of Language Understanding DEMO © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

What about spoken language?
5/14/2018 7:32 PM What about spoken language? © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Speaker Recognition API
5/14/2018 7:32 PM Speech Bing Speech API Speaker Recognition API Custom Speech Service Convert speech to text and back again, and understand its intent Give your app the ability to know who's talking Fine-tune speech recognition for anyone, anywhere

5/14/2018 “The only reason we can build a product like this is because we are building on the deep learning and speech recognition expertise at Microsoft to deliver an entertainment experience that will be revolutionary.” Alexander Mejia, Owner and Creative Director, Human Interact © 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

A common pattern… Speech Text Intent & Entities
5/14/2018 7:32 PM A common pattern… Speech Bing Speech API or Custom Speech API Text Language Understanding Intelligent Service Intent & Entities © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Custom Speech Service Customize both language and acoustic models
Tailor speech recognition to your app and environment Record audio Transcribe Deploy Adapt

Airport Kiosk Demo Bing Speech API vs Custom Speech Service
5/14/2018 7:32 PM Airport Kiosk Demo Bing Speech API vs Custom Speech Service © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Are you ready to be part of this revolution?

Please evaluate this session
Tech Ready 15 5/14/2018 Please evaluate this session From your Please expand notes window at bottom of slide and read. Then Delete this text box. PC or tablet: visit MyIgnite Phone: download and use the Microsoft Ignite mobile app Your input is important! © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Resources for Microsoft employees
5/14/2018 Resources for Microsoft employees Can’t find the image that you have in mind for your presentation? The Media Acquisitions team can help you find and license imagery through our stock photography providers. You will also find imagery and information via these links: Mediaacq Microsoft Brand Central Presentation guidelines Microsoft photography Microsoft illustrations There are agreements in place with these providers. For information on the use of third-party copyrighted content please contact visit this site. © 2015 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Creating accessible content
5/14/2018 7:32 PM Creating accessible content Take the following steps to create accessible content that everyone can consume effectively. Contrast Use high contrast colors for maximum readability The recommended contrast ratio is at least 4.5:1 Color Contrast Analyzer Download this tool to determine the legibility of text and the contrast of visual elements Shape and color Use different shapes with a legend to indicate statuses to accommodate for color blindness Example: Alt text Alt text helps people with screen readers understand the content of slides You can create alternative text for shapes, pictures, charts, tables, SmartArt graphics, or other objects. Here’s how: Right click the image or shape Select Format Picture… or Format Shape… Select the Size & Properties icon Expand the Alt Text field Enter a Title and Description of your image or object Slide layouts Using a built-in slide layout that matches your content ensures a hierarchical reading order of text blocks Example: If a new slide will have a title, rather than starting with a blank layout and adding a text block for the title, choose one of the built-in layouts with a title placeholder Reading order Screen readers describe content on the screen in the order it was created To ensure your content is read back in the order you prefer, arrange your objects in the Selection Pane appropriately. Objects on the bottom of the selection pane are read first. Here’s how: Click the Home tab In the Drawing group, select the Arrange drop-down menu Click Selection Pane… Text Subject 1 Subject 2 Subject 3 C3 C2 C1 Download Additional Tips! Be sure to run the Accessibility Checker! Go to File click the Check for Issues drop down menu click Check Accessibility Videos need to be accessible: If your presentation includes a video, ensure it is captioned and audio described (if appropriate) Visit the Office Accessibility Center to learn more about accessibility in PowerPoint © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5/14/2018 7:32 PM Software code slide This slide layout uses Consolas, a monotype font which is ideal for showing software code. © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Notes (hidden) NEXT: <next slide title> Slides 5/14/2018 7:32 PM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Foodservice retailer increased revenue with a cloud-based mobile solution
Challenge Inability to identify or connect with customers. Lack measures of customer loyalty. Untargeted promotions erode revenue and profit. Solution Added an analysis and insights system based on Microsoft Azure. Gathered data on customers’ behaviors and preferences to target offers. Benefits Expanded reach to millions of customers in five countries. Enabled personal, relevant, contextual content that adds value for the users. Improved promotion efficacy. “The company saw a huge increase in customers, and those customers spent 47 percent more. It was all driven at the device level.” — Scott Bradley, CEO and founder of Plexure (Vmob)

A new canvas: Conversations
1980s: PC Command Line Interface 1990s GUI and Internet Search User “visits” websites 2000s NUI and Mobile A new canvas: Conversations Natural language between people and technology Contextual Bots and agents

Vision Computer Vision API Face API Emotion API Video API
5/14/2018 7:32 PM Vision Computer Vision API Face API Emotion API Video API Distill actionable information from images Detect, identify, analyze, organize, and tag faces in photos Personalize experiences with emotion recognition Analyze, edit, and process videos within your app Content Moderator Custom Vision Service Video Indexer Machine-assisted moderation of text and images, augmented with human review tools Customizable web service that learns to recognize specific content in imagery Process and extract smart insights from videos

Knowledge Academic Knowledge API Knowledge Exploration Service
5/14/2018 7:32 PM Knowledge Academic Knowledge API Knowledge Exploration Service Entity Linking Service Explore relationships among academic papers, journals, and authors Add interactive search over structured data to your project Contextually extend knowledge of people, locations, and events Recommendations API Custom Decision Service QnA Maker Provide personalized product recommendations for your customers Create custom experiences with adaptive, contextual decision-making Distill information into conversational, easy-to-navigate answers

Search Bing Web Search API Bing Image Search API Bing Video Search API
5/14/2018 7:32 PM Search Bing Web Search API Bing Image Search API Bing Video Search API Connect powerful search to your apps Bring advanced image and metadata search to your app Trending videos, detailed metadata, and rich results Bing News Search API Bing Autosuggest API Bing Entity Search Bing Custom Search Link your users to robust and timely news searches Give your app intelligent autosuggest options for searches Enrich user experiences with contextual entity search results Create a highly-customized web search experience

Microsoft Cognitive Services Labs
5/14/2018 7:32 PM Microsoft Cognitive Services Labs An early look at emerging Cognitive Services technologies: discover, try, and give feedback on new technologies before general availability Project Prague Project Cuzco Project Johannesburg Gesture based controls Event associated with Wikipedia Route logistics Project Nanjing Project Abu Dhabi Project Wollongong Isochrones calculations Distance matrices Score location attractiveness

Industry-leading investments
GP Microsoft AI DATA + AI PLATFORM Azure Machine Learning Cognitive Toolkit Microsoft Cognitive Services Industry-leading investments Machine Learning – Deep Learning Infrastructure + Analytics in Big Data Stores

Please evaluate this session
Tech Ready 15 5/14/2018 Please evaluate this session From your Please expand notes window at bottom of slide and read. Then Delete this text box. PC or tablet: visit MyIgnite Phone: download and use the Microsoft Ignite mobile app Your input is important! © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5/14/2018 7:32 PM BRK3299 Microsoft Cognitive Services: Infusing language and speech capabilities into your apps Giampaolo Battaglia Luis Cabrera Sr.

Similar presentations

Presentation on theme: "5/14/2018 7:32 PM BRK3299 Microsoft Cognitive Services: Infusing language and speech capabilities into your apps Giampaolo Battaglia Luis Cabrera Sr."— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

5/14/2018 7:32 PM BRK3299 Microsoft Cognitive Services: Infusing language and speech capabilities into your apps Giampaolo Battaglia Luis Cabrera Sr.

Similar presentations

Presentation on theme: "5/14/2018 7:32 PM BRK3299 Microsoft Cognitive Services: Infusing language and speech capabilities into your apps Giampaolo Battaglia Luis Cabrera Sr."— Presentation transcript:

Similar presentations

About project

Feedback