WWW.PRAGMATICWORKS.C OM. Platinum Level Sponsors Gold Level Sponsors Pre Conference Sponsor Venue Sponsor Key Note Sponsor.

Slides:



Advertisements
Similar presentations
Adam Jorgensen Pragmatic Works Performance Optimization in SQL Server Analysis Services 2008.
Advertisements

SQL SERVER 2012 XVELOCITY COLUMNSTORE INDEX Conor Cunningham Principal Architect SQL Server Engine.
Big Data Working with Terabytes in SQL Server Andrew Novick
Arjun Krishnamoorthi  Power View enables self-service BI by providing simple to use ad-hoc reporting for business users and decision.
Presented by Brad Gall Using BI Techniques for Database Statistics.
Dos and don’ts of Columnstore indexes The basis of xVelocity in-memory technology What’s it all about The compression methods (RLE / Dictionary encoding)
Data Analysis Nirvana: Excel 2013 Business Intelligence Features Tom Jones – President, Iridium Technology LLC.
Realizing Business Insights with PowerPivot
SPONSORS. Microsoft PowerPivot for SQL Server, Excel 2010, and SharePoint 2010 Michael Herman Syntergy, Inc.
IST722 Data Warehousing Business Intelligence Development with SQL Server Analysis Services and Excel 2013 Michael A. Fudge, Jr.
Developing an Optimized Analysis Services Tabular Project BI Semantic Model Peter Myers StrataDB DBI315.
PowerPivot Hope Foley Perpetual Technologies. Who Am I?  Microsoft Team Lead  SQL Server DBA  (MCITP: Database Administration in 2005 and 2008)  In.
David Dye.  Introduction  Introduction to PowerPivot  Working With PowerPivot.
Highline Class, BI 348 Basic Business Analytics using Excel Import, Clean, Transform, Data 1.
Highline Class, BI 348 Basic Business Analytics using Excel Introduction to PowerPivot 1.
SQL Server Analysis Services 2012 BI Semantic Model BISM.
Last Updated : 27 th April 2004 Center of Excellence Data Warehousing Group Teradata Performance Optimization.
Database Systems, 8 th Edition SQL Performance Tuning Evaluated from client perspective –Most current relational DBMSs perform automatic query optimization.
Intro to Power BI Azhagappan Arunachalam.  Senior Database Architect   PowerBICentral.com  (blog on getting started.
BISM Introduction Marco Russo
Azure SQL DW – Elastic Data Analytics in the cloud Josh Sivey | Microsoft TSP #492 | Phoenix.
Power View Overview April 25, POWER VIEW Presentation ready visualizations for the masses.
SQL for Super Users Presented by: Adam Jacobson Red Three Consulting, Inc.
Write DAX Queries using DAX Studio Alex Barbeau
A highway through the mountains of data with the SQL Server Tabular Model This presentation is a walk through in-memory database and reporting features.
Scott Fallen Sales Engineer, SQL Sentry Blog: scottfallen.blogspot.com.
UBAX09 Exploring the Possibilites with PowerPivot and Microsoft Dynamics AX Cristian Nicola, Yvonne Haarloev,
Taking Analysis Services Tabular to Enterprise Levels Stacia Varga Data Inspirations
Microsoft PowerBI – Advanced Solutions with Microsoft Excel and PowerBI Presented by: Phillip Guglielmi, CPA | Senior BI Consultant and Solutions Architect.
Performance Monitoring for SQL Server Analysis Services Stan Geiger #506 | Baltimore BI 2016.
Review DirectQuery in SSAS 2016, best practices and use cases
45 Minutes to Your First Tabular Model
Building Tabular Models
45 Minutes to Your First Tabular Model
Introduction to Tabular Data Models
Frontline Analytics | Brett Powell
Power BI Performance Tips & Tricks
6/12/2018 2:19 PM BRK3245 DirectQuery in Analysis Services: best practices, performance, and use cases Marco Russo SQLBI © Microsoft Corporation. All rights.
<Enter course name here>
6/19/2018 © 2014 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks.
Your friends / colleagues can watch this session Live on !
ABC! Always Be…. Coding (calculated measures)
Less known component in SSIS and cool features of Power BI
Exam Braindumps
Toolkit for DAX Optimization
Power BI Performance …Tips and Techniques.
Introduction to tabular models
The Ins and Outs of Indexes
Introduction to tabular models
The Key to the Database Engine
Enriching your BI Semantic Models with Data Analysis Expressions (DAX)
Best practice using Power pivot. Henk Vlootman, Excel MVP
Query Optimization Techniques
Creating HIGH PERFORMANCE TABULAR MODELS
TechEd /24/2018 6:19 AM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered.
Welcome to SQL Saturday Denmark
Power BI for large databases
Processing Analysis Services Tabular Models
Data Modeling and Prototyping
Power BI with Analysis Services
If you are expecting … Power BI Data Modeling This session explains why data modeling is so important even if Power BI utilizes the in-memory columnar.
Let’s Build a Tabular Model in Azure
Power BI at Enterprise-Scale
Enriching your BI Semantic Models with Data Analysis Expressions (DAX)
Dashboard in an Hour Using Power BI
Role Playing Dimensions in Tabular Data Models
Processing Tabular Models
Annoyed with a stubborn pivot table? PowerPivot is your answer.
Data Modeling and Prototyping
Presentation transcript:

OM

Platinum Level Sponsors Gold Level Sponsors Pre Conference Sponsor Venue Sponsor Key Note Sponsor

OM Silver Level Sponsors Bronze Level Sponsors

Rachael Martino Principal

OM 5 SQL Server and Oracle developer and IT Manager since SQL Server 2000 Focus on BI and building a data culture of excellence Boston area resident Ravelry fan and avid knitter About Me

OM 6 Agenda Impact of poor performance Performance Tips and Techniques Demonstration

OM Power BI is fast Or, why worry about performance?

OM 8 Power BI

OM 9 Power BI Power BI leverages Power Pivot and Power View (and Power Query) In-memory, columnar database and formula engine are fast “Now is 3 seconds” three-seconds-of-now/

OM 10 Architecture xVelocity in-memory analytics engine Columnar storage Compression In-memory cache “Microsoft’s family of in-memory and memory-optimized data management technologies”

OM 11 xVelocity (Vertipaq) *Ashvini Sharma and Allan Folting at TechEd North America 2012, courtesy of Mark Schneeberger tabular-model-resources/

OM 12 Performance impacts Slow Processing on data loads Long waits during Design, especially: Calculated columns Relationships Visualization: Slow slicers

OM 13 Large file size of pbix file: Not necessarily indicator of bad performance Sudden changes File size and memory indicators Screenshot of my local drive, showing improvements in file size as I resolved data issues. Memory usage Direct impact on performance

OM Performance impact demo Behaviors affect: 1)Data Load 2)Design 3)Visualizations

OM Tips and Techniques Let’s solve this…

OM 16 Tip #1: Tall, narrow tables are faster* Corollary Tip #1a: remove any unused fields Tables must efficiently compress columns for speed Remove relationship ID’s not in use – these may have high cardinality and are unnecessary Remove all fields not used for analysis *The exception: In the case of tables with 10’s of millions of rows, the 1M-row partitions or “Chunking” may interfere with efficient compression rates

OM 17 Strings, stored in hash table, require two queries to get a single value. Hash table uses less memory unless there is high cardinality, then the hash table becomes overhead compress-data/ compress-data/ Strings used as ID’s can use unreasonable amounts of memory and slow performance. Tip #2: Integers are faster than strings

OM 18 Tip #3: Slicers use multiple queries Slicers issue two queries each: The first to get the list The second query to check which rows of the pivot tables are related Cross-filtering slicers cause those same two queries to be executed for multiple sets of slicers. High cardinality slicers from large tables make poor user experience (too many options) and are slow power-view-reports-with-a-power-pivot-data-source/ power-view-reports-with-a-power-pivot-data-source/

OM 19 Tip #4: Understand DAX functions and Calculations Understand formula engine interaction with the xVelocity engine for your DAX The FILTER statement must check every row individually (no bulk scans) MIN will have to scan the entire table to find the answer replace-sumx-if-possible/ replace-sumx-if-possible/ Caution: In design every change to the data model requires a recalc of all calculated columns a-power-pivot-data-source/ a-power-pivot-data-source/

OM 20 Tips #5 & 6: 5. Remove unnecessary precision or split granularity values to reduce cardinality For example: split datetime into Date and Time 6. Remove unnecessary rows in Calendars: Extra rows in reference tables cause unnecessary attempts at computation; rows not shown on tables or slicers have been computed against the fact data

OM 21 Sometime Tip #7: Caution with calculations The formula engine is I/O intensive and runs on one thread only, if processing performance is problematic, move simple calculations to the database Once processed calculated columns are static values in the data store Measures are calculated during query execution Caution: In design every change to the data model requires a recalc of all calculated columns power-view-reports-with-a-power-pivot-data-source/ power-view-reports-with-a-power-pivot-data-source/

OM 22 Technique #1: Check your memory usage File size is a rough estimate of performance, but not 100% accurate. speed/ speed/ Measure relative memory usage of each table and field using Kasper de Jonge’s Power Pivot Memory Usage tool by loading you data into Excel edition/ edition/

OM 23 Technique #2: Check your DAX Slow measures and calculations can cause big problems at design time and in visualizations Lookup DAX You may want to test and evaluate DAX using DAX Studio – I have not used this tool.

OM So, is this better? ….Let’s see

OM Performance improvement demo Using our tips and techniques

OM Conclusions

OM 27 Power BI is fast and will perform Performance is very good in Power BI and PowerPivot models Large is relative depending on efficiency of data Think about your data model and calculations

OM 28 References (not on slides) Power Pivot and Power BI by Rob Collie and Avichal Singh Pragmatic Works’ Tabular and Power Pivot On Demand Training course Power Pivot Pro Brad Gall’s Power BI v2 and Beyond, January 19, detailedflat-pivot-is-slow-and-doesnt-sort-properly-try-text- measures/ detailedflat-pivot-is-slow-and-doesnt-sort-properly-try-text- measures/ us/library/gg413463(v=sql.110).aspxhttps://msdn.microsoft.com/en- us/library/gg413463(v=sql.110).aspx

Rachael Martino Principal