AI development using Data Science Virtual Machines (DSVM) in Azure 6/17/2018 3:49 AM BRK2370 AI development using Data Science Virtual Machines (DSVM) in Azure Gopi Kumar Principal Program Manager Lead AI & Research Barnam Bora Program Manager AI & Research © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Agenda Introduction to the Data Science Virtual Machines (DSVM) in Azure New Announcements AI Development Workflow & Why DSVM Introducing New Offerings Deepdive 1 Deepdive 2 Resources & Next Steps Q&A “500,000 Tweets relating to AI / ML collected processed in SQL Server & R Server using ScaleR functions.”
Data Science Virtual Machines (DSVM) Pre-Configured environments in the cloud for Data Science & AI Modeling, Development & Deployment.
Data Science Virtual Machines (DSVM) DSVM – Windows Server 2016 Editions DSVM – Linux – Ubuntu Deep Learning Virtual Machines
DSVM Announcements Azure Gov on AI for Earth Azure China New Samples Deep Learning VM Azure Gov on AI for Earth Azure China New Samples Batch AI Training Azure Machine Learning
End-to-End AI Development Workflow using Data Science Virtual Machines (DSVM)
Why Data Science VMs ? Examples & Templates to get started
The Deep Learning VM Windows Server 2016 and Ubuntu releases Physical Card = 2 x NVidia TESLA GPUs Use NC class Azure VMs with GPUs Great for Deep Learning workloads
Deepdive Gopi Kumar 6/17/2018 3:49 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Team Data Science Process (TDSP) Business Understanding Deployment Modeling (ML/AI) Data acquisition & understanding Agile, iterative data science process to improve collaboration, quality and productivity http://aka.ms/tdsp © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Iterative Development with DSVM Local tools Local Debug Faster experimentation Single VM Development Larger VMs GPU Scale Up Multi Node Remote Spark Batch Nodes VM Scale Sets Scale Out
Problem: Extract entities in Medical Documents Dataset: MEDLINE corpus 27 Millions abstracts 800+ XML Files Textual data
Architecture
Deepdive Barnam Bora 6/17/2018 3:49 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Problem: Product Detection from images Training Dataset: 60 Retail Product Images Metadata Labels Microsoft Cognitive Toolkit
Storage Resources Azure Blob Storage Azure Cosmos DB Images files for Training & Scoring Metadata about Images
Training Model on the DSVM + Publish Web-service Azure Blob Storage Azure Cosmos DB DSVM – Windows Server 2016 Trained Model Web Service
API in Azure Cosmos DB 6/17/2018 3:49 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Storage Resources DNN Training Workflow
6/17/2018 3:49 AM Next Steps Hands-on Lab – HOL3034 (Ignite only) https://aka.ms/dsvm/ignitehol Free Test Drive http://aka.ms/dsvm/testdrive © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Take a free test drive: http://aka.ms/dsvm/testdrive Reference DSVM Forum - send questions, feedback and feature requests on the forum - http://aka.ms/dsvm/forum DSVM Product Page – http://aka.ms/dsvm DSVM Introductory DIY workshop – http://aka.ms/dsvm/workshop Video Recorded Session– http://aka.ms/dsvm/webinar Learn Analytics @ Microsoft – http://learnanalytics.microsoft.com GitHub Link – https://github.com/Azure/DataScienceVM Take a free test drive: http://aka.ms/dsvm/testdrive
6/17/2018 3:49 AM Q & A © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Please evaluate this session Tech Ready 15 6/17/2018 Please evaluate this session From your Please expand notes window at bottom of slide and read. Then Delete this text box. PC or tablet: visit MyIgnite https://myignite.microsoft.com/evaluations Phone: download and use the Microsoft Ignite mobile app https://aka.ms/ignite.mobileapp Your input is important! © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.