Let’s talk about Conversation Design 5/20/2018 1:36 AM BRK3301 Let’s talk about Conversation Design Vishwac Sena Kannan Senior Program Manager vkannan@microsoft.com © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Explosive growth 10,000,000+ messages/day 1,000,000+ unique users/day 190,000+ developers 14,000+ active bots 1,000+ companies 100+ new features (so far!) this year

What is a Bot? TYPE TAP TALK Channels Connected Services Cortana Facebook Messenger Connected Services Custom – Direct Line Skype Intelligent tools Bing

Conversational and Business Logic What is a Bot? Platform Platform services HTTP REST Endpoint AI Intelligent tools { Your Code } SDK Bot builder SDK REST Endpoint Direct Line Protocol Conversational and Business Logic Canvas Aware Context Sensitive

What is the Bot Framework? Channels – 1’st and 3’rd party Hosting services – Azure Bot Service, Conversation Designer Tools – Emulators, Webchat, Client controls, SDK’s, Analytics Customer’s business logic and data Bot Connector Why? Implements standard protocols Modeling conversations is hard. Tools help! UI across multiple canvases is hard. Cards rock! Language understanding is hard Common and well understood patterns C# BOT BUILDER Third-Party Bot Controls LUIS Query over database via Azure Search Form filling Q&A Goals Start simple. Add complexity. No dead-ends Bot adapts to the user, based on context Composable and intelligent controls to manage complexity Skype Bing Web Chat LUIS Skype for Business Cortana Direct Line

5/20/2018 1:36 AM Demo © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Conversation Design 5/20/2018 1:36 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

What makes a bot great? Not how much AI it has 5/20/2018 1:36 AM What makes a bot great? Not how much AI it has Not how sophisticated the language model is Not whether it uses voice or not Not whether it uses Buttons/Cards © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5/20/2018 1:36 AM Great bots are like great apps; they appeal to users because they do whatever they're trying to do WELL © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Building conversational experiences 5/20/2018 1:36 AM Building conversational experiences Language understanding: Utterance → [domain X intent X slots] LU Dialogue: Conversational flow/ model between bot and user DIA Language generation: Spoken, display strings for the agent LG User Experience Cards on-screen or speech-out for given turn in a conversation UX Business logic Business rules that help direct conversational flow <> Speech Recognition Speech → Utterance SR Text to speech: Utterance → Speech TTS © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Cognitive services LU DIA LG UX <> SR TTS Cognitive Services 5/20/2018 1:36 AM Cognitive services LU DIA LG UX Business logic Business rules that help direct conversational flow <> Language understanding: Utterance → [domain X intent X slots] Dialogue: Conversational flow/ model between bot and user Language generation: Spoken, display strings for the agent User Experience Cards on-screen or speech-out for given turn in a conversation Cognitive Services SR TTS Speech Recognition Speech → Utterance Text to speech: Utterance → Speech Vision Speech Language Knowledge Search © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Ubiquitous conversations 5/20/2018 1:36 AM Ubiquitous conversations 1st and 3rd Party Channels Custom app or website Custom devices © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Designing for Bot’s Input/ Output 5/20/2018 1:36 AM Designing for Bot’s Input/ Output TALK TAP User TYPE Bot TYPE TALK CARD 1st and 3rd Party Channels Custom app or website Custom devices © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Type, Tap & Talk – where & why 5/20/2018 1:36 AM Type, Tap & Talk – where & why Great for communication apps User is already typing in these experiences Type Supplement conversational experiences in custom apps/ website On PC/ mobile form factors Users are accustomed to click/ tap experience Tap IoT/ speech-first device form factor and experience Assistant experiences like Cortana Talk © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Demo ContosoCafeOnTheWeb, different channels 5/20/2018 1:36 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Modelling conversations - Types of dialogue 5/20/2018 1:36 AM Modelling conversations - Types of dialogue Single turn conversation Modelled like simple question and answer pairs Typically there are no follow up questions from the user No bot-initiated questions either E.g. Q&A, Facts, Answers Requires collecting pieces of missing information required for task completion On-the-rails conversation. Multi-turn capable; but can be single-turn Can include business logic to direct conversational flow E.g. Ticket booking, form filling, Order stuff Structured directed flows Context carry-over Open ended conversation in a specific domain or intent Multi-turn capable Context (domain, intent, entities) carried forward across conversation E.g. Search refinement © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Demo ContosoCafeOnTheWeb 5/20/2018 1:36 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Qnamaker.ai One of the Microsoft Cognitive Services Build, train and publish a simple question and answer bot based on FAQ URLs, structured documents or editorial content in minutes. Offers a no-code experience to build single-turn conversations Supports a variety of content sources you could start from – Existing FAQ pages Import question and answer pairs from .tsv, .pdf, .doc, .docx, .xlsx Friendly user interface to enter question and answer pairs in the knowledge base table © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5/20/2018 1:36 AM Demo Qnamaker.ai © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Conversational experiences 5/20/2018 1:36 AM Conversational experiences Easier and more natural Traversals, less steps (e.g. dinner reservation) Devices with limited or no display surface/ typing is not an option or is cumbersome (e.g. Xbox, Invoke) Multitasking (e.g. control music while writing a doc) The Good Setting up language understanding to allow for conversational tangents, corrections, forward- slot filling Deciding the right conversation model for your scenario Environment (e.g. speech in a noisy environment) Adapting to context – device as well as user The Challenge © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Conversation Designer 5/20/2018 1:36 AM Conversation Designer © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Conversation Designer 5/20/2018 1:36 AM Conversation Designer One stop shop development experience Seamlessly brings together several aspects of bot development—LU, LG, UX, Dialogue Visual authoring experience to build conversational bots Clear separation between conversation logic vs. business logic Conversation runtime orchestrate bot conversations What are we building? https://microsoft.sharepoint.com/teams/BrandCentral/Pages/Bundles/MSC16_slalom_056.aspx © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Conversation Designer 5/20/2018 1:36 AM Conversation Designer Building bots is a multi-role collaborative effort Learnings from Bot Framework community as well as first-party Bot development (Cortana) Visual tool to help author E2E Natural Language conversations that users can type, tap or talk to Modelling conversations in code behind can be challenging Why are we building it? https://microsoft.sharepoint.com/teams/BrandCentral/Pages/Bundles/MSC16_slalom_056.aspx © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Conversation Designer Covers all aspects of bot development 5/20/2018 1:36 AM Conversation Designer Covers all aspects of bot development Conversation Designer LUIS integration Script trigger Simple reply Script action Dialogue action Simple and conditional response template Speak vs. display Cards, designer and preview JavaScript code HTTP wrapper Azure Functions Language understanding: Utterance → [domain X intent X slots] LU Dialogue: Conversational flow between agent and user including logic that directs flow DIA Language generation: Spoken, display strings for the agent LG Cards on-screen or speech-out for given turn in a conversation UX Bot’s business logic/code behind <> © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Architecture overview Conversation Designer 5/20/2018 1:36 AM Architecture overview Conversation Designer LUIS.ai LU Author/train Bot connector Author Developer’s Azure subscription Website with bot assets + code Runtime deployed as website extension LUIS runtime deployed locally Bot.agent Bot.js Cards.json LU Bot activity Bot activity Bot app authored using Conversation Designer Save User © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Demo Conversation Designer 5/20/2018 1:36 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

How do the pieces fit together 5/20/2018 1:36 AM How do the pieces fit together Authoring Bot hosting Start with Conversation Designer to prototype, design your conversations Implement business logic in Conversation Designer for E2E bot development Azure LU SDK Implement the conversational model using Azure Bot Service (Bot Builder SDK) LUIS.ai LU Implement the conversational model using Bot Builder SDK Custom cloud © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Summary and call to action 5/20/2018 1:36 AM Summary and call to action Conversational experiences are everywhere – Custom app/ website, custom devices & 1st and 3rd party channels Incorporate Microsoft cognitive service APIs for your next bot Design & build for Type, Tap, Talk Adapt conversations based on context – Tailor experiences based on device capabilities Follow & deeply understand the user so conversations are natural and effective Model your conversational flows effectively single turn, contextual carry over .vs. structured flow Pick the right tooling + hosting model Azure – Bot Builder SDK, Azure Bot Service Code, Conversation Designer Custom cloud – Bot Builder SDK Check out http://dev.botframework.com https://github.com/Microsoft/BotBuilder https://azure.microsoft.com/en-us/services/bot-service/ © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Other relevant sessions - Ignite 5/20/2018 1:36 AM Other relevant sessions - Ignite THR3075 – Getting started with the Microsoft Bot Framework Robert Standefer Sep 26th 10:20AM – 10:40AM; OCCC South – Expo Theater #8 BRK4036 - Bot Framework patterns and practices straight from our customer Robert Standefer; Cindy Noteboom Sep 26th 2:15PM – 3:30PM; Hyatt Regency Windermere Z © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Please evaluate this session Tech Ready 15 5/20/2018 Please evaluate this session From your Please expand notes window at bottom of slide and read. Then Delete this text box. PC or tablet: visit MyIgnite https://myignite.microsoft.com/evaluations Phone: download and use the Microsoft Ignite mobile app https://aka.ms/ignite.mobileapp Your input is important! © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5/20/2018 1:36 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.