Delivering enterprise BI with Azure Analysis Services

Slides:



Advertisements
Similar presentations
Success through People with LinkedIn and O365
Advertisements

4/18/2018 6:56 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN.
Microsoft Teams Behind the Scenes – Q&A
Successfully migrate existing databases to Azure SQL Database
What’s new in Entity Framework Core 2.0
5/21/2018 9:40 PM BRK3021 Learn about modern infrastructure roles in RDS: Next generation Windows desktop & app virtualization Clark Nicholson - Principal.
5/22/2018 1:39 AM BRK2156 Power BI Report Server: Self-service BI and enterprise reporting on-premises Christopher Finlan Senior Program Manager © Microsoft.
Azure Machine Learning Deploying and Managing Models in production
Creating Enterprise Grade BI Models with Azure Analysis Services
Azure on Steroids: Full Automation with PowerShell
Azure File Sync Setup, configuration and management
6/12/2018 2:19 PM BRK3245 DirectQuery in Analysis Services: best practices, performance, and use cases Marco Russo SQLBI © Microsoft Corporation. All rights.
Azure Cloud Shell Magic of Modern Command-line Management
ASP.NET Core 2.0 Fundamentals
Developing Hybrid Apps on Microsoft Azure Stack
6/17/ :27 AM BRK3341 Unlock extensibility by connecting your service to PowerApps and Microsoft Flow Theresa (Tessa) Palmer–Sr. Program Manager Sunay.
Data Platform and Analytics Foundational Training
Azure SDKs and Tools for You
Decoding audit events in Microsoft Office 365
Optimizing Microsoft OneDrive for the enterprise
What a Real, Functioning DevOps Team Looks Like
7/22/2018 9:21 PM BRK3270 Building a Better Data Solution: Microsoft SQL Server and Azure Data Services Joey D’Antoni Principal Consultant Denny Cherry.
SQL Server on Linux on All-Flash Arrays
Microsoft Ignite /31/ :08 AM
Welcome! Power BI User Group (PUG)
8/6/ :17 AM THR2214 Hybrid Cloud Activated A customer case study optimizing on-premises & Azure performance and cost Mor Cohen-Tal Senior Product.
Excel and Power BI Better Together Democratization of data
Workflow Orchestration with Adobe I/O
Find, try and get line-of-business apps on Microsoft AppSource
Automate all things! Microsoft Azure continuous deployment
Modern Front-End Web Development with Visual Studio
Agile Planning with Visual Studio Team Services (VSTS)
Get a 360° view of your customers with Microsoft Dynamics 365
9/21/2018 3:41 AM BRK3180 Architect your big data solutions with SQL Data Warehouse & Azure Analysis Services Josh Caplan & Matt Usher Program Managers.
9/22/2018 3:49 AM BRK2247 Learn from MVPs: Panel discussion on all things SharePoint and OneDrive © Microsoft Corporation. All rights reserved. MICROSOFT.
Confidence at speed: Visual Studio 2017 and your CI pipeline
Azure PowerShell Aaron Roney Senior Program Manager Cormac McCarthy
Continuous Delivery for Microsoft Azure
11/22/2018 1:43 PM THR3005 How to provide business insight from your data using Azure Analysis Services Peter Myers Bitwise Solutions © Microsoft Corporation.
Continuous Delivery with Visual Studio Team Services
Azure Advisor: Optimization in the best way
Mobile Center and VSTS:​ Better together for your Mobile DevOps
Microsoft products for non-profits
Automating security for better, continuous compliance in the cloud
Introduction to ASP.NET Core 1.0
Five cool things you can do with Windows PowerShell on Office 365
Microsoft To-Do Preview
Securely pass passwords into your deployment
Microsoft Exchange: Through the eyes of MVPs (Panel discussion)
MDM Migration Analysis Tool (MMAT)
Overview: Dynamics 365 for Project Service Automation
Virtual Reality with Azure and Unity
Understand your Azure cloud assets dependencies with BMC Discovery
Surviving identity management in a hybrid world
Breaking Down the Value of A Yammer Post: 20 Things to Do
Cool Microsoft Edge Tips and Tricks
When Bad Things Happen to Good Applications
Getting the most out of Azure resources with Azure Advisor
Manage your App Service resources using Command line tools
“Hey Mom, I’ll Fix Your Computer”
4/21/2019 7:09 AM THR2098 Unlock New Opportunities with Nintex Hawkeye Process Intelligence and Workflow Analytics Sr. Product.
Business Continuity and the Microsoft Cloud
Consolidate, manage, backup, and secure your cloud content
Designing Bots that Fit Your Organization
Ask the Experts: Windows 10 deployment and servicing
Passwordless Service Accounts
Digital Transformation: Putting the Jigsaw Together
WCF and .NET Framework Microservices in Containers
Diagnostics and troubleshooting in Azure App Service Support Center
Optimizing your content for search and discovery
Presentation transcript:

Delivering enterprise BI with Azure Analysis Services 5/28/2018 4:27 PM BRK3098 Delivering enterprise BI with Azure Analysis Services Josh Caplan @Joshcaplan1984 Sr. Program Manager © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

What do all of these have in common? Microsoft Build 2017 5/28/2018 4:27 PM What do all of these have in common? © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

They can all use Azure Analysis Services Microsoft Build 2017 5/28/2018 4:27 PM They can all use Azure Analysis Services Azure Analysis Services © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Business logic & metrics Azure Analysis Services Azure Analysis Services is based on SQL Server technology Data sources BI semantic model Client tools Cloud Cloud SQL Database Security SQL Data Warehouse Data modeling Power BI Data Lake In-memory cache HDInsight/Spark Other data sources On-premises Azure Analysis Services On-premises Power BI Desktop SQL Server / Oracle / Teradata Excel Lifecycle management Business logic & metrics Other data sources Third party BI tools

Rich semantic modelling Source Data Complex raw data optimized for processing Semantic Model Rich, business user friendly semantic model Cloud Data Azure Analysis Services Product Id Product Name Product Description Category Category Id Category Name Category Description Sub Category Shelf qty Return qty Order qty Sale qty On-Premises Data locatioidentifier identifiertype fieldidentifier numberofunitssoldtodate remaningnumber Numberofuntissoldtoday receivedback productidentifier descriptionline1 descriptionline2 qtyafterqtysales familyidentifier

Connect and go Microsoft Build 2017 5/28/2018 4:27 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Lightning fast queries Source Data Complex raw data optimized for processing Semantic Model Rich, business user friendly semantic model Cloud Data Azure Analysis Services Cache Semantic model On-Premises Data Queries productidentifier descriptionline1 descriptionline2 qtyafterqtysales familyidentifier numberofunitssoldtodate remaningnumber Numberofuntissoldtoday receivedback Insights at the speed of thought locatioidentifier identifiertype fieldidentifier

Lightning fast queries Microsoft Build 2017 5/28/2018 4:27 PM Lightning fast queries 2 1 3 4 © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Demo: Azure Analysis Services Microsoft Build 2017 5/28/2018 4:27 PM Demo: Azure Analysis Services © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Demo: Getting started Microsoft Build 2017 5/28/2018 4:27 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5/28/2018 4:27 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Considerations for using Azure AS Scenario: Large models with high concurrent usage Query latency: Low. All data in Memory Data freshness: On demand Data partitioning Model size: Up to 400 GB of data after compression. Programmability: ARM, PowerShell, TOM/AMO, TMSL, MSOLAP and ADOMD. Application life cycle: Visual studio and source control integration.

5/28/2018 4:27 PM Loading Data © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Tabular Object Model (TOM) 5/28/2018 4:27 PM Model Data Sources Tabular Object Model (TOM) Tables Relationships © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Tables Name: Table 1 Columns Measures Hierarchies Partitions Query 5/28/2018 4:27 PM Tables Name: Table 1 Columns Measures Hierarchies Partitions Query © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Query: Select * from dbo.factTable Partitions Name: Partition 1 Query: Select * from dbo.factTable

Partitions Name: 20170101 Query: Select * from dbo.factTable where date = “1/1/2017” Name: 20170102 Query: Select * from dbo.factTable where date = “1/2/2017” Name: 20170103 Query: Select * from dbo.factTable where date = “1/3/2017”

Demo: Creating partitions with TOM and AMO

Automated Partition Management whitepaper http://aka.ms/asprocessing

Management REST API (coming soon)

Management REST API (coming soon) Advantages: Doesn’t require .NET Asynchronous Automatic retry

Demo: Refresh with REST

Scaling queries

Scaling queries - before

Scale out Azure AS Cluster Frontend node Backend node asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver Frontend node Backend node

Scale out Azure AS Cluster Frontend node Backend node asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver Frontend node Backend node

Scale out Azure AS Cluster Frontend node Backend node asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver Frontend node Backend node

Scale out Number of query replicas: 0 Azure AS Cluster Frontend node asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver Frontend node Backend node

Scale out Number of query replicas: 3 Azure AS Cluster Frontend node asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver Frontend node Backend node

Scale out Number of query replicas: 0 Azure AS Cluster Frontend node asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver asazure://aspaaseastus2.asazure.windows.net/someserver Frontend node Backend node

Demo: Scale out

Server alias

Connecting to a server

Link://linkfiletest.azurewebsites.net/ Connecting to a server Link://linkfiletest.azurewebsites.net/

Link endpoint example namespace linkfiletest { public class Startup // This method gets called by the runtime. Use this method to add services to the container. // For more information on how to configure your application, visit https://go.microsoft.com/fwlink/?LinkID=398940 public void ConfigureServices(IServiceCollection services) } // This method gets called by the runtime. Use this method to configure the HTTP request pipeline. public void Configure(IApplicationBuilder app, IHostingEnvironment env, ILoggerFactory loggerFactory) loggerFactory.AddConsole(); app.Run(async (context) => //context.Response.ContentType = "text/xml"; await context.Response.WriteAsync("asazure://southcentralus.asazure.windows.net/testux"); });

Other important features Azure Active directory and B2B On premise data gateway Firewall (now available)

Azure Analysis Services 5/28/2018 4:27 PM Azure Analysis Services A customer case study © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Azure Intelligence Team 5/28/2018 4:27 PM Azure Intelligence Team Mission Statement: Azure Intelligence Platform (AIP) builds a comprehensive data platform for C+E focused on managing metrics for demand (our customers), monetization (usage and billing), and market intelligence. Main Customers: Sales, Marketing, Finance, Compensation © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

By the numbers 5 TB of data per day 1 PB of data 900 pipelines 70 nodes 1200 cores

5/28/2018 4:27 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5/28/2018 4:27 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5/28/2018 4:27 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5/28/2018 4:27 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

More information AS processing whitepaper: http://aka.ms/asprocessing Azure Analysis Services: https://aka.ms/AzureAS Azure BI Blog: https://aka.ms/azurebiblog

Please evaluate this session Tech Ready 15 5/28/2018 Please evaluate this session From your Please expand notes window at bottom of slide and read. Then Delete this text box. PC or tablet: visit MyIgnite https://myignite.microsoft.com/evaluations Phone: download and use the Microsoft Ignite mobile app https://aka.ms/ignite.mobileapp Your input is important! © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5/28/2018 4:27 PM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.