Cloud, On-Premise, or Hybrid - Where are you making BI investment decisions and why? John P White jpw@unlimitedviz.com @diverdown1964 http://whitepages.unlimitedviz.com

Welcome to SharePoint Saturday Houston Thank you for being a part of the 5th Annual SharePoint Saturday for the greater Houston area! Please turn off all electronic devices or set them to vibrate If you must take a phone call, please do so in the hall so as not to disturb others Special thanks to our Title Sponsor, ProSymmetry

Thanks to all our Sponsors!

Information Speaker presentation slides should be available from the SPSHOU website within a week or so The Houston SharePoint User Group will be having it’s next meeting Wednesday April 15th. Please join us at www.h-spug.org

John White CTO/Co-Founder of UnlimitedViz SharePoint Server MVP, SQL Server v-TS jpw@unlimitedviz.com http://whitepages.unlimitedviz.com @diverdown1964

Agenda BI Architecture On Premise Options Cloud Options Migration Options

tyGraph Demo Demo tyGraph Connect to the tyGraph Client, and show the base Excel file, and what it’s connected to. Show the embedded file and how it’s built Open either file in a browser Go to Office 365 and open the embedded only! Model. Interact with it. Open it up in the Power BI App Open up the power BI dashboard app Build a quick dashboard.

BI Architecture

ONE DOES NOT SIMPLY RETURN HIS RAW DATA FROM THE DATABASE Business Intelligence is all about the data, but that doesn’t mean that you just wire up Excel to source data and start Extracting (although far too many people do). This is bad for a number of reason - Security – data level access to production data - Usability – difficult to understand constructs (Great Plains anyone?) - Performance – reporting against the production data concentrates the load. - Organization – data optimized for transactions, not reporting RETURN HIS RAW DATA FROM THE DATABASE

BI Architecture 101 Extract, Transform, and Load (ETL) Storage Design and Visualization Source data Data Marts E Reporting Server(s) T L Middleware Server(s) Data Warehouse Instead of querying our source systems directly, we want to take our data and move it into Data Warehouses and data marts, which are optimized for the sorts of analysis that we want to perform. This is done through an ETL operation. CLICK The data is extracted from the source system, CLICK transformed into the shape we need it, CLICK then loaded into the data warehouse. CLICK Other ETL processes or cube process will load the data into any necessary marts, cubes or models. From here various servers and client will access the data, usually from the data marts of cubes, but occasionally from the warehouse directly. So how does this translate to the Microsoft stack? There are two ways. The Enterprise, or “classic” BI method, or the Power (personal) method. BI and Designer Clients Data Cubes and Tabular Models

On Premises Options

Microsoft enterprise (classic) BI ETL Storage Design and Visualization E Source data SQL Server DB SQL Server Integration Services (SSIS) SQL Server Reporting Services (SSRS) E E SharePoint (with) Excel Services PowerPivot for SharePoint SSRS SharePoint Mode PerformancePoint L SQL Server DB Starting with the classic method, SQL Server Integration Services is the tool that performs our ETL. SQL Server Database Engine is used for the storage of the data warehouses and data marts SQL Server Analysis Services is the multidimensional engine (traditional OLAP cubes) and now is the engine for enterprise tabular models (xVelocity). SSRS is the traditional server engine for serving reports, and can be deployed either standalone, or through SharePoint. These tools all ship on SQL server media, but some (SSRS and PowerPivot for SharePoint) may be deployed to SharePoint Clients of this infrastructure may be servers themselves, or designers and Power Users. Consuming tools include Excel, SQL Server Data Tools, Excel Services, PowerPivot for SharePoint, or a host of other tools. Recently, there has been a lot of work in the Personal BI space – so how does that compare to this approach? Fundamental BI concepts still apply. T Excel SQL Data Tools Report Builder 3rd party tools SQL Server Analysis Services Multidimensional and Tabular modes

Enterprise BI Good curation Relatively expensive Slow to rollout Large Capacity Frequent updates Fine grained permissions

Microsoft personal BI (All in Excel) Power Query (ETL) Worksheets Pivot Charts and Tables Power View (Analytic reports) Power Map (Geospatial and time series data) Power Pivot (Model design) Power Pivot Import (EL) To start with, we have an Excel Workbook. Excel is the personal BI client from Microsoft. As of the 2010 version (through an add-in), or Excel 2013 directly we have access to an embedded xVelocity data model. CLICK Using the PowerPivot add-in (needs to be enabled) we can import data directly from the source data systems, and then manipulate the structure, but the data is read only. It can be refreshed, but not edited. Really, we have the E and the L of an ETL system. More recently, Power Query has been introduced. It’s a part of Power BI, but in this context it’s just a free Excel add-in that brings more elegance to the import. It puts the T back into ETL on the personal side. It has a host of other features, and different data source options, but that’s fundamentally what it is. Power Query can also load data directly into the workbook, into the model, or both. Once the data has been loaded it can be consumed through a number of Excel tools. The traditional multi dimensional tools are the Pivot chart and Pivot table, but we now also have Power View for analytical reporting, and Power Map for geospatial analysis. PowerPivot is the model editor. Be careful with Power Query. It cant be automatically refreshed. Yet. All of these approaches, both enterprise and personal converge through SharePoint and dashboards. Tabular Data Model (xVelocity)

Personal BI Highly accessible Little data reliability No curation Capacity limits Difficult to share Manual updates

Team BI Worksheets SSAS SharePoint Mode Power Pivot Refresh To start with, we have an Excel Workbook. Excel is the personal BI client from Microsoft. As of the 2010 version (through an add-in), or Excel 2013 directly we have access to an embedded xVelocity data model. CLICK Using the PowerPivot add-in (needs to be enabled) we can import data directly from the source data systems, and then manipulate the structure, but the data is read only. It can be refreshed, but not edited. Really, we have the E and the L of an ETL system. More recently, Power Query has been introduced. It’s a part of Power BI, but in this context it’s just a free Excel add-in that brings more elegance to the import. It puts the T back into ETL on the personal side. It has a host of other features, and different data source options, but that’s fundamentally what it is. Power Query can also load data directly into the workbook, into the model, or both. Once the data has been loaded it can be consumed through a number of Excel tools. The traditional multi dimensional tools are the Pivot chart and Pivot table, but we now also have Power View for analytical reporting, and Power Map for geospatial analysis. PowerPivot is the model editor. Be careful with Power Query. It cant be automatically refreshed. Yet. All of these approaches, both enterprise and personal converge through SharePoint and dashboards. SSAS SharePoint Mode

Excel/PowerPivot/SharePoint Excel Client SharePoint Farm Power Pivot Power Pivot Service Application Excel Services XLSX File Workbook Analysis Services SharePoint Mode xVelocity Data Model Data Sources Data Sources

Team BI and SharePoint Dashboards Power Pivot Worksheets Pivot Tables and Charts Power View Data Marts and other Standard Worksheets Pivot Tables and Charts PerformancePoint Scorecards and KPIs Within SharePoint, we can publish reports and data models, and establish connections to the relevant back end systems. These components can then be used to construct dashboards, or used on their own as dashboards. Dashboards can contain, but are not necessarily limited to Worksheets and worksheet components through Excel Services, either directly connected or via PowerPivot SSRS Reports PerformancePoint scorecards and KPIs PerformancePoint reports PerformancePoint Reports Analytic Charts and Grids Decomposition trees SQL Server Reporting Services Reports Standard Power View Data Cubes and Tabular Models

Team BI Some curation Accessible Good Sharing story Capacity Limits Automatic periodic data refresh

Personal to Enterprise with xVelocity Team Enterprise Excel Power Pivot Power View Power Query Power Map SharePoint Excel Services PowerPivot for SharePoint Reporting Services Integrated Analysis Services Integration Services

On Prem Deployment Demo Demo tyGraph Start with empty Excel, point at the raw data warehouse and pull into the model. Show a real full workbook Show the files uploaded Show the data refresh schedule Show how the model can be imported into SSAS Connect to SSAS and upload

Cloud Options

IAAS vs SAAS The one difference – where the data lives Identity is an issue

Office 365 Features Limits Access through a browser Data model interactivity Excel web part Anonymous sharing 10 MB file size limit No refresh

Power BI Data refresh with Data Management Gateway Increased file size limits (250 MB/model) Mobile client Natural language query (Power Q&A) Add-on to Office 365

Power BI Enterprise Issues Refresh rate Capacity Data sensitivity/sovereignty Fine-grained permissions Cost

Power BI Dashboard Preview AKA “the new Power BI” Freemium model ($10/user/month for full) No reliance on Excel or Office 365 SSAS Connector with fine grained permissions Enterprise grade at last

tyGraph Services Architecture tyGraph Domain AD tyGraph Harvester SQL Server DW SSAS Tabular SSAS Gateway SharePoint PowerPivot for SharePoint Excel Services Data Management Gateway This is precisely the architecture required for Power BI dashboards Power BI Dashboards

Demo Cloud Deployment Take the embedded model workbook, upload to Power BI and enable it Show the refresh options Show it running in the Power BI app Next, open the Power BI dashboarding preview, connect to the data and breate a basic visualization. Pin it to the dashboard.

Migration Options

Tool Availability On Prem Cloud (SAAS) SQL Server SQL Server Analysis Services SQL Server Integration Services SQL Server Reporting Services SharePoint BCS Excel Services PowerPivot for SharePoint Power View PerformancePoint SQL Azure SharePoint Online BCS Excel Services Power BI Data Management Gateway SSAS Connector SQL Server Reporting Services?

SSRS in Power BI “SSRS will be a native component of Power BI. All the functionality of SSRS will be available in Power BI by this summer. SSRS connectivity will be real-time connectivity to the on-prem data source. No refresh required.” Amir Netz Chief Architect, Microsoft Business Intelligence SQL PASS Summit, May 7, 2014

Cloud Options Investment Cloud Option Excel Files Connected to data Connected to SSAS With small embedded models With large embedded models With refreshed models SQL Server Reporting Services BCS PerformancePoint SharePoint Online Connected to SQL Azure (hybrid – on prem SSIS) Using the SSAS Connector (hybrid – on prem SSAS) Nothing extra With Power BI With Power BI (hybrid – connected to on-prem data) Coming soon (likely hybrid) BCS (hybrid – connected to SQL Azure) No current migration path

Fine Grained Permissions The “double hop” Problem Solutions Kerberos – A double edged sword Claims – future solution (?) Impersonation SetUser() – (SQL Server) EFFECTIVEUSERNAME - (Analysis Services, Excel Services, PerformancePoint) Explain Double hop problem Kerberos constrained delegation allows token passing, but hard to set up Reporting Services has supported this for a long time via SetUser() – nobody understood it BISM implicitly supports EFFECTIVEUSERNAME PerformancePoint and Excel Services now support EFFECTIVEUSERNAME against multidimensional sources

Get Prepared Build on the tabular model whenever possible Familiarize yourself with SSAS, SSIS, SSRS Federate Identity Understand EffectiveUserName and SetUser Minimize PerformancePoint investments

Q&A/Cheap advice @diverdown1964 whitepages.unlimitedviz.com

Please Leave Feedback Please fill out the session survey with your feedback. You can scan the QR Code to launch the survey. Submitting the survey makes you eligible for a Giveaway at the end of the session. Survey Link: WhatsYourAnswer.com?S201547151159