Build 2015 4/16/2017 © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Azure Media Services developer deep dive Build 2014 4/16/2017 2-766 Azure Media Services developer deep dive Mingfei Yan (@mingfeiy) yanmf@microsoft.com Sr. Program Manager Microsoft Azure Media Services © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Agenda What is Microsoft Azure Media Services Video-on-demand workflow Encoding features Dynamic packaging Media intelligence Azure Media Player Content Protection (AES and DRM) Dynamic Encryption Live encoding and streaming workflow How does it work Clear stream and encrypted live stream

Digital media landscape is always changing: The Challenge & The Opportunity Video is the new currency Audiences are changing and demanding premium content on their own devices. That isn't easy: Many different device profiles and different delivery technologies.   Huge capital investment required Expensive, time-consuming, need for high scale and availability, especially hard and costly as both audience size and content libraries grow.

The challenging future of video delivery Build 2015 4/16/2017 6:15 PM The challenging future of video delivery © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Introducing Azure Media Services H.264 HLS MP4 AVI DASH Azure Media Services Encoding Delivery Microsoft’s cloud platform now enables on demand and live streaming video solutions for consumer and enterprise scenarios. Introducing Azure Media Services

Live & On Demand Streaming Plus a growing ecosystem of value-add third party partner components What do we mean by Azure Media Services? Scalable components for building custom media workflows in the cloud Cloud Upload & Storage Encoding & Media Intelligence Content Protection Live & On Demand Streaming with integrated CDN Player Clients

On-Demand Workflow Ingest/Store Encode Encrypt Publish Stream/Deliver TechReady 16 4/16/2017 On-Demand Workflow Ingest/Store Encode Encrypt Publish Stream/Deliver © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Step 1: Ingest Content TechReady 16 4/16/2017 ASSET INGEST Azure Blob Different options of Ingesting a Mezzanine Asset Pre-encrypt files prior to uploading (AES 256) Secure HTTPS upload Network level peering for fast HTTP into Azure Fast upload using UDP with Aspera Multiple storage accounts enabled to manage your media asset © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Step 2: Encode, Package or Encrypt TechReady 16 4/16/2017 Queue Azure Blob Azure Blob Encode © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Step 2: Encode, Package or Encrypt TechReady 16 4/16/2017 Encoding Reserved Units Encode Azure Blob Azure Blob Encode Encode Broadcast/Studio quality video and audio formats Video - H.264, MXF, DVCPro, MPEG2 TS, WMV, De-interlacing Audio - AC3/Dolby Digital+, AAC,-LC, Multi Language Tracks SD, HD, or 4K AVC content (HEVC coming soon) Packages to MP4, Smooth Streaming, Http-Live-Streaming Encrypts with PlayReady, Common Encryption, AES Pay only for what you use, charged per Output GB Manage via Azure Portal, API, or Azure Explorer Desktop Tool © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Multiple options for encoding TechReady 16 Multiple options for encoding 4/16/2017 Choose Encoding capabilities (based on your input/output file formats) Encoder Premium Encoder Reference: comparison between Encoder and Premium encoder Starting from 1.99/GB Starting from 1.99/GB *preview Choose your encoding reserved unit (how fast encoder performances) 4-5x faster 2x faster $69/mo $139/mo $399/mo © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Step 3: Deliver Content Managed streaming service… it just works! Ingest Azure Blob Asset Encode Stream Origin Service Managed streaming service… it just works! Guaranteed bandwidth Auto recovery, redundancy and failover Multiple origins support and scale independently Azure and 3rd party CDN support IP Whitelisting

Using Azure Media Services Portal to encode a video DEMO Using Azure Media Services Portal to encode a video

Feature highlight- Dynamic packaging Allows you to re-use your encoded content and bring it to various streaming formats without repackaging the content. Traditional Encode and Package Package HLS Encode Package Smooth Streaming Video sources Multi-bitrates Mp4 Origin Service Dynamic Packaging Origin Service Dynamic Packaging HLS Encode Smooth Streaming Video sources Multi-bitrates Mp4 DASH Input format: Mp4 or Smooth Streaming Output format: Smooth Streaming , Http-Live-Streaming (v4 and v3), MPEG-DASH You need to have at least 1 reserved streaming unit to enable dynamic packaging!

Media Services APIs and SDKs REST API for all platforms Reference: http://msdn.microsoft.com/en-us/library/windowsazure/hh973617.aspx .NET library Nuget package: https://nuget.org/packages/windowsazure.mediaservices GitHub: https://github.com/Azure/azure-sdk-for-media-services Extensions for .NET SDK: https://github.com/sazure/azure-sdk-for-media-services-extensions PHP Library GitHub: https://github.com/windowsazure/azure-sdk-for-php Open Tech blog with demo: http://msopentech.com/blog/2014/01/23/ms-open-technologies-enhances-open-source-php-sdk-windows-azure/ JAVA library http://www.windowsazure.com/en-us/develop/java/java-home Windows / Mac / Linux GitHub: https://github.com/windowsazure/azure-sdk-for-java/ PowerShell cmdlets How to use: http://www.gtrifonov.com/2013/08/24/how-to-use-windows-azure-powershell-for-media-services/ Node.js library GitHub: https://github.com/fritzy/node-azure-media

Using .NET SDK to publish the content and get streaming URLs DEMO Using .NET SDK to publish the content and get streaming URLs

Formats Streaming Locator http{media services account name}.origin.mediaservices.net/{locator ID}/{filename}.ism/Manifest(format=mpd-time-csf) Format Syntax Smooth Streaming Smooth Streaming 2.0 manifest (legacy manifest) (format=fmp4-v20) MPEG DASH (format=mpd-time-csf) Apple HTTP Live Streaming (HLS) V4 (format=m3u8-aapl) Apple HTTP Live Streaming (HLS) V3 (format=m3u8-aapl-v3) HDS (for Adobe PrimeTime/Access licensees only) (format=f4m-f4f)

Introducing Azure Media Player A Free JavaScript based player, detecting platform, provides best experience Defaults to open standards where possible Will switch to different packaging depending on platform Knows how to request streams from Azure Media Services Cross platform “just works” experience Aka.ms/azuremediaplayer

Architecture: Azure Media Player Unified CSS UI Unified JS Interface Tech order Access Platform/device capability Choose player based on tech order Pick up right streaming URLs from AMS A DASH player (HTML5 EME/MSE) A flash player A Silverlight player Playback (VOD, live, protected content) Native HTML5 (Built in browser)

DEMO Building a Azure Media Player using HTML5 and JavaScript References: Azure Media Player announcement Player API documentation Player API version Player demo pages

The matrix of player technology Build 2015 4/16/2017 6:15 PM The matrix of player technology Azure Media Player © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Features: Azure Media Player Build 2015 4/16/2017 6:15 PM Features: Azure Media Player Implemented Features • Playback of Content from Azure Media Services Clear On Demand Clear Live AES-128 Encrypted content PlayReady Encrypted content • Playback across a wide range of devices • Simple setup with <video> or via JS • Unified JavaScript APIs • Basic Heuristics • Unified Player UI Coming Soon • Full Subtitles/Captions support • Discontinuities • Trick-Play • Audio Only • Ads support • Analytics • Audio Track Selection • Bitrate Selection • Heuristics APIs • Specific error messaging and across-tech error unification • Multi-period presentations • Multiple camera angles © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Media Intelligence and Content Enhancements 4/16/2017 Media Intelligence and Content Enhancements Introducing Azure Media Indexer Natural Language Processing technology Catalogue vast content libraries Generate transcripts from multimedia Will support OCR, multiple languages, Search, Deep linking Used by The Washington Post, NASA/JPL, and many others © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

DEMO Azure Media Indexer

Secure your media – Content Protection options with AMS

Azure Media services Content Protection Secure Upload and Secure Storage Options Dynamic Encryption Options for Content Streaming AES-128 Clear Key Microsoft PlayReady Hosted License for Key Delivery Token-based Authentication models and Integration with Active Directory Diverse playback options

How to choose the best content protection method TechReady 18 4/16/2017 How to choose the best content protection method Encrypt Smooth Streaming content with PlayReady protection via common encryption scheme (CENC), and the option of packaging it into HLS or DASH. PlayReady technology allows you to define restrictive licensing agreement to manage user access rights to your media. Source: IDC Successful Cloud Partners 2013 Microsoft PlayReady® Who should use this feature: Premium studio content or high business impact content: Key is encrypted and decryption happens in a secure DRM decoder environment Encrypt on-the-wire communication using the widely-known symmetric AES encryption algorithm. An authentication service for key is provided. Source: IDC Successful Cloud Partners 2013 AES Clear Key encryption Who should use this feature: Trusted audience or time-valued content: Key is stored in clear format so it can only be used with trusted users or content that has time value associated with it. Used to prevent “man-in-the-middle” attacks © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Dynamic Packaging and Dynamic Encryption Static encryption Origin Server Dynamic Packaging Encode Encryption Smooth Streaming + PlayReady Smooth Streaming Video sources Smooth Streaming + PlayReady DASH + CENC PlayReady Dynamic Encryption Origin Server Dynamic Packaging and Encryption HLS + AES or PlayReady Encode Smooth Streaming + AES or PlayReady Video sources Multi-bitrates Mp4 Or Smooth Asset DASH + CENC

Architecture – Dynamic Encryption with AES/PlayReady Define: Authorization policy (Token/IP/Open) Content Key asset Client SDK Customers Asset Delivery policy (HLS with AES) or (Smooth Streaming with PlayReady) Smooth Streaming + PlayReady(http) Storage Origin Service HLS + AES (http) DASH + PlayReady (http) MP4 PlayReady/ AES Key Services Token verification PlayReady License/ AES Key Request License with token (https) Return License if token verified(https) Login Customer’s Auth system Issue token

When and for how long is it valid? JWT Token Acquisition JWT JWT Tokens can be generated by anyone and require at minimum: HMAC SHA-256 (symmetric key) or RSA SHA-256 (asymmetric key, x509 certificate) Issuer Audience Not Before Expiration Who issued the token? Who is it intended for? When and for how long is it valid? (Unix time, secs since 1st Jan 1970) {"typ":"JWT","alg":"HS256"} { "aud":"https://contoso.com/relyingparty", "iss":"https://contoso.accesscontrol.windows.net/", "nbf":1336067338,"exp":1336070938,"nameid":"frankm", "identityprovider":"contoso.com",“role”: [ “admin”, “user” ]} Header.Claim[.Claim].Signature Signed with symmetric or assymetric key _3dZQ6cmmFgrZ_-VmOLrr7CHne3Xdko_WtE6-Je5Ihw

Check token from Auth header/parameters Player Your Backend Symmetric/Asymetric key, used to configure key auth policy with Token Workflow Authenticate User Give back signed JWT token Issuer Audience Validity + Signature JWT Token Configure Player to use Token AMS Key Service Check token from Auth header/parameters AES Key or PR License Player plays media & decrypts with key

Dynamic encryption for on-demand DEMO Dynamic encryption for on-demand

Azure Media Services Explorer Tool Build 2012 4/16/2017 Azure Media Services Explorer Tool A No-Code Easy UI way to use Media Services Release http://aka.ms/amse Source code https://github.com/Azure/Azure-Media-Services- Explorer/ Blog post http://azure.microsoft.com/blog/2014/10/08/managi ng-media-workflows-with-the-new-azure-media- services-explorer-tool/ © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Live Streaming Ingest Transform Archive Encrypt Deliver 4/16/2017 © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

RTMP (Highest Bitrate) Build 2015 4/16/2017 6:15 PM How does live encoding and streaming work? Preview URL Azure Media Services RTMP (Highest Bitrate) RTP Smooth Streaming Live Encoding Preview Ingest URL Input devices Live channel Ingest: Ingest endpoint to accept Live streams Convert ingest data to fMP4 (e.g. RTMP fMP4) Forwards the stream to live encoding or preview end-points Live encoding: Encode video into multi-bitrates © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

RTMP (Highest Bitrate) Build 2015 4/16/2017 6:15 PM How does live encoding and streaming work? Preview URL Azure Media Services RTMP (Highest Bitrate) RTP Smooth Streaming Live Encoding Preview Program Achieve Dynamic Encryption Dynamic Packaging Program Storage (fmp4) Ingest URL CDN Live stream (Program URLs) Input devices Live channel Streaming endpoints REST APIs Preview: Receives stream from Ingest Forwards to Program Exposes Preview URL (for monitoring) Program: Writes it to Blob Storage for Archive/DVR © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

PlayReady license/ AES Key Services Architecture: Live Streaming with dynamic encryption Preview- monitoring Client SDK Players Define: Content key, Authorization policy (license template), Delivery policy Storage FMP4 Streaming Endpoint HLS+ AES Channel Program Multi-bitrate RTMP/Smooth Smooth Streaming+ PlayReady MPEG-DASH + PlayReady PlayReady license/ AES Key Services Token Authentication PlayReady License/ AES Key Request License with token (https) Return license if token verified(https) Login Issue token Customer’s Auth system

Live encoding and live streaming through the cloud DEMO Live encoding and live streaming through the cloud

Live encoding Features: Live encoding of a single bitrate live feed into an adaptive bitrate stream Ability to ingest a live feed over RTP protocol (MPEG Transport Streams), RTMP and Smooth Streaming Ability to control insertion of slates Ability to get a thumbnail preview of the live feed

Key Takeaways Media Services are easy, flexible, and powerful TechReady 14 4/16/2017 Key Takeaways Media Services are easy, flexible, and powerful Customers can reach any device using any protocol Partner ecosystem: easily build-in or build-on Content protection across all clients Pay for what you use, easy to understand billing Any media, on any device, delivered from the cloud © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Resources www.azure.com/media Build 2012 4/16/2017 Resources www.azure.com/media Microsoft Azure Media Services accounts are free for 90 days Content Protection documentation http://msdn.microsoft.com/en-us/library/azure/dn282272.aspx Sample code https://github.com/AzureMediaServicesSamples Mingfei’s blog http://mingfeiy.com/ Email me at yanmf@Microsoft.com © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Resources Improve your skills by enrolling in our free cloud development courses at the Microsoft Virtual Academy. Try Microsoft Azure for free and deploy your first cloud solution in under 5 minutes! Easily build web and mobile apps for any platform with AzureAppService for free.