Agile BI with SQL Server 2012 & TFS 2012 Mohamed Kabiruddin Microsost BI Consultant, Oakton Consulting Twitter: @mdkabir Blog: www.nobrainerlab.com
Agenda The Agile Manifesto Traditional BI vs. Agile BI Agile BI Tools in SQL Server 2012 Team Foundation Server Demo Case Studies & Questions
The Agile Manifesto – Top Picks Customer satisfaction – continuous delivery Changing requirements – early or late Frequent delivery – shorter timescale Process Sustainable development Business and IT co-ordination Motivated and trustworthy individuals People Face-to-face conversations Attention to technical excellence & good design Learn and reflect from every iteration Other
Kimball & Agile BI They seem to naturally fit with the front-end business intelligence layer Designing and developing the analytic reports involves unpredictable, rapidly changing requirements The developers often have strong business acumen and curiosity, allowing them to communicate effectively with the business users It’s reasonable to deliver functionality in a matter of weeks Margy Ross, President The Kimball Group
Traditional Approach Jan 2013 Feb 2013 Mar 2013 Apr 2013 May 2013 Data Architecture & Modelling Business Requirements Definition Data consolidation & cleansing BI Reporting Solution Development Project Initiation, Planning & Resourcing Infrastructure Design ETL Development BI Reporting Solution Design
High level estimation and planning Agile approach to BI Deploy - Self Service BI reports, dashboards Feedback (for next iteration) Incorporate the model into Enterprise DW Business Requirements for the Iteration Build - Prototype BI Model, In-Memory Data Model Product Backlog Iteration Backlog High level estimation and planning
You are doing Agile BI if… Project and solution design is incrementally driven by data source loads Data access is provided to business users immediately for decision making Incrementally adding new measures and new reports as and when the business requires
‘BI’-Fold Process Agile Project Methodologies Product Backlog – Tasks / Activities Self Service BI Ad-hoc Reporting
SQL Server 2012 BI Stack
Long Live the King - SSIS SSIS Templates – Master Child packages Simplified ETL Framework – Logging within Catalog Handy Transformations: PIVOT, UNPIVOT, SCRIPT COMPONENT Think about Performance (Avoid asynchronous transformations) Use Balanced Data Distributor for large data volumes and data flow bottlenecks (Free download from Microsoft) Take advantage of Project Deployment model for project-wide parameters and configurations Build packages with high re-usability in mind
Visualisation Tools Excel SharePoint Performance Point Power Pivot Power View Performance Point Dashboards SSRS Excel SharePoint
Data Modelling / Storage Image Courtesy: Melissa Coates – SQLChick Blogger
Team Foundation Server 2012 Core Capabilities Process Guidance & Automation Agile Project Planning Work Item Tracking Build Management & Automation Version Control
TFS – On Premise Vs. Cloud Service Federated Identity Management Team Foundation Server SCM and Version Control Team Foundation Service Agile Planning & Collaboration Tools Feedback Requests & Issue Tracking Continuous Integration Builds Lab Management Detailed Reporting & Analytics On-Premises Server Integration
Version Control
TFS – Web UI Burndown Charts Task Tracking Team Notices
Demo TFS feature set and walkthrough Tabular Modelling walkthrough Data Analysis with Excel (including GeoFlow) SSIS 2012 features (optional)
Agile BI is an approach that combines processes, methodologies, tools and technologies, while incorporating organizational structure, in order to help strategic, tactical and operational decision-makers be more flexible and more responsive to ever-changing business and regulatory requirements -Forrester Research
References Delivering Data Warehousing and BI Projects using Agile - http://smartdatacollective.com/bharden/33590/delivering-data-warehousing-and-bi-projects-using-agile Agile BI – Wikipedia -http://en.wikipedia.org/wiki/Agile_Business_Intelligence Agile BI Best Practices - http://www.agiledata.org TFS MSDN - http://msdn.microsoft.com/en-us/vstudio/ff637362.aspx Dataset used for demo (Department of Foreign Affairs and Trade: Country and Commodity Trade 2006-2012) - http://data.gov.au/dataset/country-and-commodity-trade-data-spreadsheet-2/
Questions? Please complete an evaluation form for this session …and thanks again to our awesome sponsors! Please include this as the final slide in your deck, and remind attendees to complete an evaluation form for your session. Thanks!