BI in the cloud, is it possible? Sure is with Azure! Rob Hawthorne M352
Planning for the Cloud Considerations for loading data Overview and demo Azure Data Factory What, why and how Overview and demo Visualisation and Reporting Power BI Overview and demo
… data warehousing has reached the most significant tipping point since its inception. The biggest, possibly most elaborate data management system in IT is changing. – Gartner, “The State of Data Warehousing in 2012” Data sources
5 Increasing data volumes 1 Real- time data 2 Non-Relational Data New data sources & types 3 Cloud-born data 4
New-AzureDataFactory -Name “HaloTelemetry“ -Location “West-US“ New-AzureDataFactory -Name “GameTelemetry“ -Location “West-US“
New-AzureDataFactoryLinkedService -Name "MyHDInsightCluster“ -DataFactory“GameTelemetry" -File HDIResource.json New-AzureDataFactoryLinkedService -Name "MyStorageAccount" -DataFactory“GameTelemetry" -File BlobResource.json
“GeoCoded Game Usage” Table:
Pipeline Definition:
// Deploy Table New-AzureDataFactoryTable -DataFactory“GameTelemetry“ -File NewUserActivityPerRegion.json // Deploy Pipeline New-AzureDataFactoryPipeline -DataFactory “GameTelemetry“ -File NewUserTelemetryPipeline.json // Start Pipeline Set-AzureDataFactoryPipelineActivePeriod -Name “NewUserTelemetryPipeline“ -DataFactory “GameTelemetry“ -StartTime 10/29/ :00:00
"availability": { "frequency": "Day", interval": 1 } Hourly GameUsage Activity: (e.g. Hive) :
Power BI Desktop A freely downloadable 32/64bit desktop companion optimized for use with the Power BI Service. Visual data exploration and reporting tool complementary to Excel. Combines the power of Power Query, Power Pivot & Power View. Effortlessly publish and share interactive visual reports to users of Power BI Power BI Desktop is a visual data exploration and reporting tool
Automation & Management Data Transformation & Movement Execution Layer (Data Storage & Processing) Automation/Coordination Layer (Coordination, Scheduling, Management) Low Frequency $0.60$0.48$1.50$1.20 High Frequency $1.00$0.80$2.50$ activities100+ activities0-100 activities100+ activities CloudOn Premises HDInsight (hrs) Compute/VM (hrs) Data Transfer (GB) ADF Pricing Per Month Resources Used to Execute Activities in a Pipeline: Note: public preview = 50% discount on the rates shown above
Elastic for SQL NZ3 Fri 11:55am Telling Stories with Data Marlborough Fri 9:00am Architecting the Internet of Things NZ1 Fri 1:55pm Introduction to Microsoft Hololens SKYCITY Theatre Thurs 4:30pm Azure Machine Learning Marlborough Fri 10:40am Find me later at… Hub Happy Hour Thu 5:30-6:30pm Closing drinks Fri 3:00-4:30pm And maybe the pub!
Subscribe to our fortnightly newsletter Free Online Learning Sessions on Demand