Azure Machine Learning on Databricks 1/8/2019 7:01 PM Azure Machine Learning on Databricks Seth Mottaghinejad sethmott@microsoft.com Wolfgang Pauli, PhD wolfgang.pauli@microsoft.com © 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Agenda Azure Databricks Azure Machine Learning 1/10/2019 10:04 PM Agenda Azure Databricks Azure Machine Learning AML Integration with Databricks AutoML © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Azure Databricks

What is Azure Databricks? Microsoft Ignite 2015 11/19/2018 1:07 AM What is Azure Databricks? A fast, easy and collaborative Apache® Spark™ based analytics platform optimized for Azure Designed in collaboration with the founders of Apache Spark One-click set up; streamlined workflows Interactive workspace that enables collaboration between data scientists, data engineers, and business analysts. Native integration with Azure services (Power BI, SQL DW, Cosmos DB, Blob Storage) Enterprise-grade Azure security (Active Directory integration, compliance, enterprise -grade SLAs) Best of Databricks Best of Microsoft © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Azure Databricks Microsoft Ignite 2015 11/19/2018 1:07 AM Enhance Productivity Build on secure & trusted cloud Scale without limits © 2015 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

AML Integration with Databricks

AML SDK + Databricks End-to-end custom Machine Learning Easily install the SDK in Azure Databricks clusters Use the SDK for: Logging training run metrics Containerize Spark ML models Deploy them into ACI or AKS, just like any other models. Automated ML (public preview) of Azure ML SDK with Azure Databricks

AutoML

Machine Learning Process SQL DB Cosmos DB Datawarehouse Data lake Blob storage … Prepare Data Build & Train Deploy

Machine Learning Complexity Source: http://scikit-learn.org/stable/tutorial/machine_learning_map/index.html