- for the SSASMD Developer

Slides:



Advertisements
Similar presentations
Adam Jorgensen Pragmatic Works Performance Optimization in SQL Server Analysis Services 2008.
Advertisements

1 Migrating from Access to SQL Server Simon Kingston, CSU / NPS NRGIS.
new database engine component fully integrated into SQL Server 2014 optimized for OLTP workloads accessing memory resident data achive improvements.
Jeremy Boyd Director – Mindscape MSDN Regional Director
Building Ad-Hoc Reports using the SQL Server 2005 Reporting Services (SSRS) Report Builder (SQL307) Adrian Rupp Business Intelligence Solutions Specialist.
VMware vCenter Server Module 4.
Manage & Configure SQL Database on the Cloud Haishi Bai Technical Evangelist Microsoft.
Object Oriented Databases by Adam Stevenson. Object Databases Became commercially popular in mid 1990’s Became commercially popular in mid 1990’s You.
SPONSORS. Microsoft PowerPivot for SQL Server, Excel 2010, and SharePoint 2010 Michael Herman Syntergy, Inc.

1 SQL Server 2000 Administration Kashef Mughal MSB.
1 Chapter Overview Performing Configuration Tasks Setting Up Additional Features Performing Maintenance Tasks.
Visual Studio 2012: A Complete IDE (Debugging & Source Control) Kevin Howell.
Log Shipping, Mirroring, Replication and Clustering Which should I use? That depends on a few questions we must ask the user. We will go over these questions.
Introduction to MySQL  Working with MySQL and MySQL Workbench.
Honest Bob’s Cube Processing Bob Duffy Database Architect Prodata SQL Centre of Excellence 18 th July, 2014.
#SQLSAT454 Using Power BI in Enterprise Andrea
Configuring SQL Server for a successful SharePoint Server Deployment Haaron Gonzalez Solution Architect & Consultant Microsoft MVP SharePoint Server
Honest Bob’s Cube Processing Bob Duffy Database Architect.
FUN WITH AVAILABILITY GROUPS Christopher Wolff SQL Server Database Engineer, Xero.
Microsoft BI Online Training AcuteSoft: India: , Land Line: +91 (0) USA: , UK.
Doing fast! Optimizing Query performance with ColumnStore Indexes in SQL Server 2012 Margarita Naumova | SQL Master Academy.
SQL IMPLEMENTATION & ADMINISTRATION Indexing & Views.
Architecting Enterprise Workloads on AWS Mike Pfeiffer.
SQL Server Analysis Services Fundamentals
SQL Server on Linux CTP 1.1 Florian
IT06 – HAVE YOUR OWN DYNAMICS NAV TEST ENVIRONMENT IN 90 MINUTES
Module 1: SQL Server Overview
Cloud BI with Azure Analysis Services
How to tune your applications before moving your database to Microsoft Azure SQL Database (MASD) OK, you've jumped into your Azure journey by creating.
Building Tabular Models
Welcome to SharePoint Saturday Houston
Visual Studio Database Tools (aka SQL Server Data Tools)
Best Practices for Dynamics NAV Administration and Security
Temporal Databases Microsoft SQL Server 2016
Agile Analytics: Automated Builds and Deployments
What’s new in SQL Server 2017 for BI?
Power BI Performance Tips & Tricks
Power BI after more than 1 year in production
Title Here, 40pt, Arial, 1 line
Lead SQL BankofAmerica Blog: SQLHarry.com
Cloud BI with Azure Analysis Services
Antonio Abalos Castillo
Beyond the BDC\BCS Model
6/12/2018 2:19 PM BRK3245 DirectQuery in Analysis Services: best practices, performance, and use cases Marco Russo SQLBI © Microsoft Corporation. All rights.
SQL Server Integration Services
ROLAP partitioning in MS SQL Server 2016
SQL Server Analysis Services Fundamentals
SQL Server Analysis Services Fundamentals
SQL 2014 In-Memory OLTP What, Why, and How
What’s new in SQL Server 2016 Availability Groups
TechEd /23/ :44 AM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered.
TechEd /24/2018 6:19 AM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered.
Welcome to SQL Saturday Denmark
Cloud BI with Azure Analysis Services
Visual Studio Database Tools (aka SQL Server Data Tools)
Understanding Azure SQL DB Service Tiers
Entity Framework from a database perspective
DAT381 Team Development with SQL Server 2005
AlwaysOn Availability Groups
Welcome to SQLSaturday #767! Hosted by Lincoln SQL Server User Group
Introducing Scenario Network Data Editing and Enterprise GIS
Let’s Build a Tabular Model in Azure
Power BI at Enterprise-Scale
Data modelling for Power BI using brand new Analysis Services Features
Using Columnstore indexes in Azure DevOps Services. Lessons learned
Michelle Haarhues Keeping up with SSMS.
Using Columnstore indexes in Azure DevOps Services. Lessons learned
Processing Tabular Models
Working with Very Large Tables Like a Pro in SQL Server 2017
Presentation transcript:

- for the SSASMD Developer Pro Techniques - for the SSASMD Developer 03/12/2016 | SQL Saturday #569 - Prague 2016

Thanks to our sponsors! 03/12/2016 | SQL Saturday #569 - Prague 2016

Agenda Me Show of Hands! Partitions Synchronization Integration Testing Custom Assemblies PowerShell Deployment – Pointers (if time permits)

ABOUT.ME/JENSVESTERGAARD CatMan Solution A/S - BI @vestergaardj http://www.t-sql.dk jv@t-sql.dk

Show of Hands SSASMD? Uppers n’ Downers Tabular (on-premises)? Azure Analysis Services? Uppers n’ Downers Greatest struggles? Greatest wins!

PARTITIONING 03/12/2016 | SQL Saturday #569 - Prague 2016

Partitioning Symptoms? Processing Query Data Management

Partitioning - Processing What to do? Read -> Process -> Write Processing Speed INT or DECIMAL, Yes! Floating Points, No! Increase the amount of memory available for Analysis Services during processing of partitions. Process fewer partitions in parallel. Define smaller partitions. Recommendation: a partition size containing between 5 and 20 million records. Design fewer aggregations for your partition. 03/12/2016 | SQL Saturday #569 - Prague 2016

Partitioning - Processing ProcessFull; ProcessData; ProcessIndex; ProcessClearIndexes; ProcessAdd; ProcessClear; ProcessFull => ProcessClear, ProcessData, and ProcessIndex. Full: deletes existing partition data, indexes, and aggregations and fully reprocesses a partition. Data: deletes existing partition data, indexes, and aggregations and loads only data in a partition. Index: builds indexes and aggregations for a partition. ClearIndexes: deletes partition indexes and aggregations. Add: incrementally updates a partition by adding new data to it. Clear: deletes partition data, indexes, and aggregations.

Partitioning - Processing Partition Processing Load Speed (Rows Read/Sec) 2008: 50K OK, 100K Optimized 2016: 100 OK, 150K Optimized OLE DB for SQL Server over Native Client Increase the network Packet Size from 4096 bytes  to 32 Kbyte (32767). JumboFrames – Network setting Enter the Bios Power options menu and see if you can disable settings like ‘Processor Power Idle state’.  In the Windows Control Panel, set the Server Power Plan to max. throughput

Partitioning - Query Improve IO Sub System Cube Size > 5 GB Aggregation Design per Partition Sweet spot vs No of Partitions to Manage Test your partition schema

Partitioning – Manage Data Storage Mode per Partition 03/12/2016 | SQL Saturday #569 - Prague 2016

DEMO 1 of 4 PARTITIONING

Partitioning – Wrap up Analysis Services Store Procedure (ASSP) http://asstoredprocedures.codeplex.com/ John Tunnicliffe https://ssaspartitionmanager.codeplex.com/ PowerShell Manual 03/12/2016 | SQL Saturday #569 - Prague 2016

SYNCHRONIZATION 03/12/2016 | SQL Saturday #569 - Prague 2016

Synchronization Why? How? Restore Robocopy Cowboy development Built-in feature

Synchronization What User must be a member of the Analysis Services server administrator role on the Target server. User must have Full Control permissions on the Source database. TCP port 2383 must be open on both servers to allow remote connections between default instances. Both the Source and Target server must be the same version. Edition needs to be either Enterprise, Developer, or Business Intelligence. Server mode must be identical on the two, either Tabular/Tabular or Multidimensional/Multidimensional. 03/12/2016 | SQL Saturday #569 - Prague 2016

DEMO 2 of 4 Synchronization

Integration TESTING 03/12/2016 | SQL Saturday #569 - Prague 2016

Integration Testing Benefits How? Keep from seeing the same bug over and over again Make sure you don’t break anything else Check for performance degradation How? C#/VB.Net code in Visual Studio (Unit Test Project)

DEMO 3 of 4 Integration Testing

CUSTOM ASSEMBLIES 03/12/2016 | SQL Saturday #569 - Prague 2016

Custom Assemblies When? How? What? Noteable: Security High Cardinality Text Search in several attributes Some NonEmpty scenarios (think T-SQL INNER JOIN) How? C#/VB.NET Assembly integrated with Analysis Services DebugView (SysInternals) https://technet.microsoft.com/en-us/sysinternals/debugview.aspx What? Show me the Money! 1.2M Products and we already see a significant difference Noteable: Security

DEMO 4 of 4 Custom Assembly

Questions

RESOURCES Jens Vestergaard – Custom Assemblies: http://t-sql.dk/?p=1383 Henk van der Valk – Processing Optimization: http://henkvandervalk.com/how-to-process-a-ssas-molap-cube-as-fast-as-possible-part-1 Jens Vestergaard – Cube Synchronization http://t-sql.dk/?p=1403 Microsoft – Unit Testing https://blogs.msdn.microsoft.com/visualstudioalm/tag/unit-testing/ Jens Vestergaard – Integration Testing http://t-sql.dk/?p=1567

We care about your opinion! Please don't forget to rate this session http://bit.ly/2fXGJNQ We look forward to see you at the next event! http://czechpass.org #CZBISQLPASS 03/12/2016 | SQL Saturday #569 - Prague 2016