James Serra – Data Warehouse/BI/MDM Architect

Slides:



Advertisements
Similar presentations
System Center Reporting Through the BI Stack
Advertisements

Supervisor : Prof . Abbdolahzadeh
Business Intelligence Simon Pease. Experience with BI Developing end-to-end BI prototype for Plan International Developing end-to-end BI prototype for.
Jose Chinchilla MCITP: Database Administrator, SQL Server 2008 MCITP: Business Intelligence Design and Implementation, SQL Server 2008 President & CEO,
Copyright © Starsoft Inc, Data Warehouse Architecture By Slavko Stemberger.
Presented by Brad Gall Using BI Techniques for Database Statistics.
Technical BI Project Lifecycle
Data Warehousing M R BRAHMAM.
Cloud, On-Premise, or Hybrid - Where are you making BI investment decisions and why? John P
Database Systems: Design, Implementation, and Management Tenth Edition
Data Warehousing - 3 ISYS 650. Snowflake Schema one or more dimension tables do not join directly to the fact table but must join through other dimension.
Chapter 13 The Data Warehouse
1 © Prentice Hall, 2002 Chapter 11: Data Warehousing.
UNCLASSIFIED Business Intelligence and SharePoint 2010 Steve McDonnell.
DATA WAREHOUSE (Muscat, Oman).
Building a Data Warehouse with SQL Server Presented by John Sterrett.
Business Intelligence Overview Marc Schöni Technical Solution Professional | Business Intelligence Microsoft Switzerland.
Agenda Common terms used in the software of data warehousing and what they mean. Difference between a database and a data warehouse - the difference in.
Week 6 Lecture The Data Warehouse Samuel Conn, Asst. Professor
Data Warehouse to BI 1. Agenda  Review  Preparing the DW for Analysis  Microsoft BI Platform Overview  Building a Cube in SSAS 2.
SPONSORS. Microsoft PowerPivot for SQL Server, Excel 2010, and SharePoint 2010 Michael Herman Syntergy, Inc.
DATA WAREHOUSING IN SQL SERVER 2005/2008 BUSINESS INTELLIGENCE.
Sayed Ahmed Logical Design of a Data Warehouse.  Free Training and Educational Services  Training and Education in Bangla: Training and Education in.
IST722 Data Warehousing Business Intelligence Development with SQL Server Analysis Services and Excel 2013 Michael A. Fudge, Jr.
Activity Running Time DurationIntro0 2 min Setup scenario 2 2 min SQL BI components & concepts 4 5 min Data input (Let’s go shopping) 9 7 min Whiteboard.
DW-1: Introduction to Data Warehousing. Overview What is Database What Is Data Warehousing Data Marts and Data Warehouses The Data Warehousing Process.
Vidas Matelis, Toronto SQL Server User Group November 13, 2008.
Business Intelligence Zamaneh Jahed. What is Business Intelligence? Business Intelligence (BI) is a broad category of applications and technologies for.
The 20-Minute Tabular Model Bill Anton Prime Data Intelligence.
1 Data Warehouses BUAD/American University Data Warehouses.
13 Chapter 13 The Data Warehouse Database Systems: Design, Implementation, and Management 4th Edition Peter Rob & Carlos Coronel.
OLAP & DSS SUPPORT IN DATA WAREHOUSE By - Pooja Sinha Kaushalya Bakde.
Data Warehousing.
David Dye.  Introduction  Introduction to PowerPivot  Working With PowerPivot.
Data Warehousing and OLAP. Warehousing ► Growing industry: $8 billion in 1998 ► Range from desktop to huge:  Walmart: 900-CPU, 2,700 disk, 23TB Teradata.
13 1 Chapter 13 The Data Warehouse Database Systems: Design, Implementation, and Management, Seventh Edition, Rob and Coronel.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 13 Business Intelligence and Data Warehouses.
CMPE 226 Database Systems October 21 Class Meeting Department of Computer Engineering San Jose State University Fall 2015 Instructor: Ron Mak
Chapter 11: Data Warehousing Modern Database Management 6 th Edition Jeffrey A. Hoffer, Mary B. Prescott, Fred R. McFadden.
June 08, 2011 How to design a DATA WAREHOUSE Linh Nguyen (Elly)
The Data Warehouse Chapter Operational Databases = transactional database  designed to process individual transaction quickly and efficiently.
Dr. Chen, Data Mining  A/W & Dr. Chen, Data Mining Chapter 6 The Data Warehouse Jason C. H. Chen, Ph.D. Professor of MIS School of Business Administration.
CS 157B: Database Management Systems II April 10 Class Meeting Department of Computer Science San Jose State University Spring 2013 Instructor: Ron Mak.
MIS 451 Building Business Intelligence Systems Data Staging.
SQL Server Analysis Services Understanding Unified Dimension Model (UDM)
The Need for Data Analysis 2 Managers track daily transactions to evaluate how the business is performing Strategies should be developed to meet organizational.
BISM Introduction Marco Russo
A highway through the mountains of data with the SQL Server Tabular Model This presentation is a walk through in-memory database and reporting features.
To SSAS or not to SSAS, that is the question Ayman Senior PFE - Microsoft.
Or How I Learned to Love the Cube…. Alexander P. Nykolaiszyn BLOG:
Data Warehousing and OLAP Outline u Models & operations u Implementing a warehouse u Future directions.
Microsoft BI Online Training AcuteSoft: India: , Land Line: +91 (0) USA: , UK.
Develop Business Intelligence Application with Microsoft SharePoint 2013 Author: Vo Duy Anh.
DATA WAREHOUSING TECHNIQUES ROUNDTABLE Kathy Bronson Trevyn Bowden Clackamas Communtiy College 7/2016 Information Technology Forest Grove, Oregon NWEUG.
Supervisor : Prof . Abbdolahzadeh
Serve as Director Funded by the Louisiana Department of Transportation and Development Developed LaCrash application to electronically capture crash.
Building Tabular Models
Chapter 13 Business Intelligence and Data Warehouses
Chapter 13 The Data Warehouse
Summarized from various resources Modern Database Management
IBM DATASTAGE online Training at GoLogica
Data Warehouse.
Designing Business Intelligence Solutions with Microsoft SQL Server
Data Warehouse and OLAP
Data Warehousing and OLAP
Warehouse Architecture
Applying Data Warehouse Techniques
Data Warehouse and OLAP
Resources.
Data Warehousing.
Presentation transcript:

James Serra – Data Warehouse/BI/MDM Architect

Agenda  Why use a data warehouse?  Fast Track Data Warehouse (FTDW)  Appliances  Data Warehouse vs Data Mart  Kimball vs Inmon (Normalized vs Dimensional)  Populating a Data Warehouse  ETL vs ELT  Normalizing and Surrogate Keys  SSAS Cubes  SQL Server 2012 Tabular Model  End-User Microsoft BI Tools

Software: SQL Server 2008 R2 Enterprise Windows Server 2008 Hardware: Tight specifications for servers, storage and networking ‘Per core’ building block Configuration guidelines: Physical table structures Indexes Compression SQL Server settings Windows Server settings Loading

Data Warehouse vs Data Mart

 Normalized (Inmon) vs Dimensional (Kimball)  Normalized:  Normalization rules  Many tables using joins  Dimensional:  Facts and dimensions  Less tables having duplicate data (de-normalized)  Easier for user to understand Kimball vs Inmon

 Frequency of data pull  Full Extraction – All data  Incremental Extraction – Only data changed from last run  Determine data that has changed  Timestamp - Last Updated  CDC  Partitioning  Triggers  MERGE  Online Extraction – Data from source  Replication  Database Snapshot  Availability Groups  Offline Extraction – Data from flat file Populating a Data Warehouse

ETL vs ELT

Normalizing and Surrogate Keys

Reasons to use instead of data warehouse:  Aggregating (Summarizing) the data for performance  Multidimensional analysis – slice, dice, drilldown  Hierarchies  Advanced time-calculations – i.e. 12-month rolling average  Easily use Excel to view data  Slowly Changing Dimensions (SCD) SSAS Cubes

Data Warehouse Architecture

 New xVelocity in-memory database in SSAS  Build model in Power Pivot or SSDT  Uses existing relational model  No star schema, no extra SSIS  Uses DAX  Faster and easier to use than multidimensional model SQL Server 2012 Tabular Model

 Excel PivotTables  SQL Server Reporting Services (SSRS)  Report Builder  PowerPivot  PerformancePoint Services (PPS)  Power View End-User Microsoft BI Tools