Douglas Barrett (WhereScape) Data Warehouse Architect VOC202

Current Life Technical Presales Consultant Data Warehouse Architect Projects: Previous lives Microsoft Consulting ASB Bank DWH Team ADHB ASB MRP Telecom Vero Insurance AirNZ Metrowater Sky City Fonterra etc

Data Warehouse 101 Talk the same language SQL Server 2005 and Data Warehousing The Good and the Bad DWH Projects Secrets for success Customers ADHB – Mr Paul McGrath (DWH Manager) ASB - Mr Steve Letford (BI Manager) Questions and Answers

Organisations use functional systems to run their business Data is locked away Financials Sales HR

BI Solution Data Warehouse Financials Sales Financials Other Inventory CRM Reformat Data SQL Server 2005 AS, RS and Excel or PP

BI Solution Data Warehouse Financials Sales Financials Other Inventory CRM Reformat Data

Extract Transform Load

Relational Database Partitioning DMVs Analysis Services Unified Data Model KPIs Integration Services Pipeline Processing Reporting Services Cube support Report Model / Report Builder

Relational Database Partitioning DMVs Analysis Services Unified Data Model KPIs Integration Services Pipeline Processing Reporting Services Cube support Report Model / Report Builder

Relational Database Partitioning DMVs Analysis Services Development Environment KPIs UDM Integration Services Pipeline processing Reporting Services Cube support Model / Report Builder Excel Services BI Portal Performance Point Forecasting / Planning Dashboarding

Metadata missing Logging control Integration Services Consistency of Implementation Auditing / logging Metadata

Disk layout Data Logs Tempdb Exclusivity Processor – 64 bit Server Memory Stats and Indices

1. Find a sponsor 2. Prototype 3. User driven design 4. Maintain momentum 5. Remove Mysteries 6. The DWH is a process not a project 7. Small team of smart people

Find the sponsor As high up as possible (Executive) In the business Find out their pain They will determine success / failure Clears the way – makes life easy

Prototype – users don’t know what they want Build what is possible – then show users 1 – 2 weeks using real data Requirements are generally a waste of time Find out KPIs and core reports Provides a picture / estimate of the full project

User driven design Show them what is possible Let them decide how to handle issues / rules “Socialise the design” No surprises at the end of a project

Maintain momentum Shorter focused projects – single business area 3 months max Short intense projects retain business involvement

Remove Mysteries Data Warehouse processing will always have problems Processing should make it easy to find out “what happened” Documentation is pretty handy

The DWH is a process not a project Needs BAU resource The data warehouse is never static Always new data problems / enhancements / tuning

Small Team of Smart People Teams don’t scale well Able to talk to the business Able to develop complex transforms Able to model the data based on implied requirements

Mr Paul McGrath Data Warehouse Manager

Team of 5 SQL Server 2000 and DTS Bogged down by BAU Unable to manage change quickly Unable to deliver new data No consistency or standards Change control was a mess Business getting frustrated with slow delivery.

WhereScape RED Single Product Speed of Development Standards Built in Change Control Self Documenting Methodology - Prototype and iterate Manages database Generates SQL Stored procedures and Analysis Services Cubes

WhereScape RED 3 month project to redevelop Inpatient and some Outpatient systems for Analysis Prototype and iterate Full ownership by ADHB Development Team Involve analysts Ongoing support and enhancements

Upgraded to SQL Server 2005 and AS 2005 Upgraded to 64bit Servers WhereScape RED already SQL Server 2005 compliant including Analysis Services 2005 Benefits Make use of the latest features, fully supported by RED Partitioning Ranking New Analysis Services features including KPI’s Pain – minimal

EDW with multiple data sources Approx 150Gb and growing Expanding to other areas Radiology Haematology/Oncology Mental Health Finance, HR etc Catch up on a back log of work Start being proactive to users Management Information Portal MOSS and Excel Services Interactive Reporting Excel 2007 Customizable ADHB – Current Situation

ADHB – Information Portal

Extend to other areas: Outpatients Haematology Mental Catch up on a back log of work Start being proactive to users Delivery via Reporting Services

Mr Paul McGrath Data Warehouse Manager

Mr Steve Letford BI Solution Manager

New Data mart project support regulatory requirements Relatively large team of developers and designers SQL Server 2005 and SSIS Project got stuck with design, implementation issues, unable to engage with the business. Unable to deliver the project Business getting frustrated with IT for slow delivery.

WhereScape RED Project to redevelop key data mart Prototype and iterate Involve Business representatives Ongoing support and enhancements Successfully delivered Utilising SQL Server partitioning, Analysis Services 2005 and Reporting Services

Create a group wide governance committee Extend data mart into a set of federated data marts Rollout reports Group wide Create a services model Move to 64bit

Mr Steve Letford BI Solution Manager

© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.