Delivering enterprise BI with Azure Analysis Services 5/28/2018 4:27 PM BRK3098 Delivering enterprise BI with Azure Analysis Services Josh Caplan @Joshcaplan1984 Sr. Program Manager © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
What do all of these have in common? Microsoft Build 2017 5/28/2018 4:27 PM What do all of these have in common? © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
They can all use Azure Analysis Services Microsoft Build 2017 5/28/2018 4:27 PM They can all use Azure Analysis Services Azure Analysis Services © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Business logic & metrics Azure Analysis Services Azure Analysis Services is based on SQL Server technology Data sources BI semantic model Client tools Cloud Cloud SQL Database Security SQL Data Warehouse Data modeling Power BI Data Lake In-memory cache HDInsight/Spark Other data sources On-premises Azure Analysis Services On-premises Power BI Desktop SQL Server / Oracle / Teradata Excel Lifecycle management Business logic & metrics Other data sources Third party BI tools
Rich semantic modelling Source Data Complex raw data optimized for processing Semantic Model Rich, business user friendly semantic model Cloud Data Azure Analysis Services Product Id Product Name Product Description Category Category Id Category Name Category Description Sub Category Shelf qty Return qty Order qty Sale qty On-Premises Data locatioidentifier identifiertype fieldidentifier numberofunitssoldtodate remaningnumber Numberofuntissoldtoday receivedback productidentifier descriptionline1 descriptionline2 qtyafterqtysales familyidentifier
Connect and go Microsoft Build 2017 5/28/2018 4:27 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Lightning fast queries Source Data Complex raw data optimized for processing Semantic Model Rich, business user friendly semantic model Cloud Data Azure Analysis Services Cache Semantic model On-Premises Data Queries productidentifier descriptionline1 descriptionline2 qtyafterqtysales familyidentifier numberofunitssoldtodate remaningnumber Numberofuntissoldtoday receivedback Insights at the speed of thought locatioidentifier identifiertype fieldidentifier
Lightning fast queries Microsoft Build 2017 5/28/2018 4:27 PM Lightning fast queries 2 1 3 4 © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Demo: Azure Analysis Services Microsoft Build 2017 5/28/2018 4:27 PM Demo: Azure Analysis Services © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Demo: Getting started Microsoft Build 2017 5/28/2018 4:27 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
5/28/2018 4:27 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Considerations for using Azure AS Scenario: Large models with high concurrent usage Query latency: Low. All data in Memory Data freshness: On demand Data partitioning Model size: Up to 400 GB of data after compression. Programmability: ARM, PowerShell, TOM/AMO, TMSL, MSOLAP and ADOMD. Application life cycle: Visual studio and source control integration.
5/28/2018 4:27 PM Loading Data © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Tabular Object Model (TOM) 5/28/2018 4:27 PM Model Data Sources Tabular Object Model (TOM) Tables Relationships © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Tables Name: Table 1 Columns Measures Hierarchies Partitions Query 5/28/2018 4:27 PM Tables Name: Table 1 Columns Measures Hierarchies Partitions Query © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Query: Select * from dbo.factTable Partitions Name: Partition 1 Query: Select * from dbo.factTable
Partitions Name: 20170101 Query: Select * from dbo.factTable where date = “1/1/2017” Name: 20170102 Query: Select * from dbo.factTable where date = “1/2/2017” Name: 20170103 Query: Select * from dbo.factTable where date = “1/3/2017”
Demo: Creating partitions with TOM and AMO
Automated Partition Management whitepaper http://aka.ms/asprocessing
Management REST API (coming soon)
Management REST API (coming soon) Advantages: Doesn’t require .NET Asynchronous Automatic retry
Demo: Refresh with REST
Scaling queries
Scaling queries - before
Scale out Azure AS Cluster Frontend node Backend node asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver Frontend node Backend node
Scale out Azure AS Cluster Frontend node Backend node asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver Frontend node Backend node
Scale out Azure AS Cluster Frontend node Backend node asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver Frontend node Backend node
Scale out Number of query replicas: 0 Azure AS Cluster Frontend node asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver Frontend node Backend node
Scale out Number of query replicas: 3 Azure AS Cluster Frontend node asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver Frontend node Backend node
Scale out Number of query replicas: 0 Azure AS Cluster Frontend node asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver Frontend node Backend node
Demo: Scale out
Server alias
Connecting to a server
Link://linkfiletest.azurewebsites.net/ Connecting to a server Link://linkfiletest.azurewebsites.net/
Link endpoint example namespace linkfiletest { public class Startup // This method gets called by the runtime. Use this method to add services to the container. // For more information on how to configure your application, visit https://go.microsoft.com/fwlink/?LinkID=398940 public void ConfigureServices(IServiceCollection services) } // This method gets called by the runtime. Use this method to configure the HTTP request pipeline. public void Configure(IApplicationBuilder app, IHostingEnvironment env, ILoggerFactory loggerFactory) loggerFactory.AddConsole(); app.Run(async (context) => //context.Response.ContentType = "text/xml"; await context.Response.WriteAsync("asazure://southcentralus.asazure.windows.net/testux"); });
Other important features Azure Active directory and B2B On premise data gateway Firewall (now available)
Azure Analysis Services 5/28/2018 4:27 PM Azure Analysis Services A customer case study © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Azure Intelligence Team 5/28/2018 4:27 PM Azure Intelligence Team Mission Statement: Azure Intelligence Platform (AIP) builds a comprehensive data platform for C+E focused on managing metrics for demand (our customers), monetization (usage and billing), and market intelligence. Main Customers: Sales, Marketing, Finance, Compensation © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
By the numbers 5 TB of data per day 1 PB of data 900 pipelines 70 nodes 1200 cores
5/28/2018 4:27 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
5/28/2018 4:27 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
5/28/2018 4:27 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
5/28/2018 4:27 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
More information AS processing whitepaper: http://aka.ms/asprocessing Azure Analysis Services: https://aka.ms/AzureAS Azure BI Blog: https://aka.ms/azurebiblog
Please evaluate this session Tech Ready 15 5/28/2018 Please evaluate this session From your Please expand notes window at bottom of slide and read. Then Delete this text box. PC or tablet: visit MyIgnite https://myignite.microsoft.com/evaluations Phone: download and use the Microsoft Ignite mobile app https://aka.ms/ignite.mobileapp Your input is important! © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
5/28/2018 4:27 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.