Data Warehouses, Dimensional Modeling, and the Laundromat

Slides:



Advertisements
Similar presentations
Bus Matrix… the foundation of your Data Warehouse
Advertisements

Data Warehousing Design Transparencies
Dimensional Modeling.
Cognos 8 Training Session
1 Use or disclosure of data contained on this sheet is subject to the restriction on the title page of this proposal or quotation. An Introduction to Data.
BY LECTURER/ AISHA DAWOOD DW Lab # 2. LAB EXERCISE #1 Oracle Data Warehousing Goal: Develop an application to implement defining subject area, design.
© Genesee Academy, /1/ The.
James Serra – Data Warehouse/BI/MDM Architect
Enterprise Data Warehousing (EDW) By: Jordan Olp.
Data Warehouse IMS5024 – presented by Eder Tsang.
Business Intelligence. On-Line Analytical Processing (OLAP) Tools The use of a set of graphical tools that provides users with multidimensional views.
MIS 451 Building Business Intelligence Systems Logical Design (3) – Design Multiple-fact Dimensional Model.
Chapter 2: Data Warehousing
IST722 Data Warehousing An Introduction to Data Warehousing Michael A. Fudge, Jr.
IST722 Data Warehousing Technical Architecture Michael A. Fudge, Jr. * Figures taken from Kimball Ch. 4.
July 6, 2011 Martha Newton. Objectives Data Group staff Data storage concepts What is a Data Warehouse What’s in the Data Warehouse (Vanderbilt’s Enterprise.
Data Warehousing DSCI 4103 Dr. Mennecke Introduction and Chapter 1.
Data Warehouse Toolkit Introduction. Data Warehouse Bill Inmon's paradigm: Data warehouse is one part of the overall business intelligence system. An.
Data Warehousing A QUICK SUMMARY Sushanthan Premanath & Indrajith Premanath CSCI 4707.
Class Agenda: 02/13/2014 Review Goals of assignments.
Agenda Common terms used in the software of data warehousing and what they mean. Difference between a database and a data warehouse - the difference in.
Business Intelligence
1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.
Best Practices for Data Warehousing. 2 Agenda – Best Practices for DW-BI Best Practices in Data Modeling Best Practices in ETL Best Practices in Reporting.
1 Business Intelligence De-Mystified Ben Bor NZ Ministry of Health Ben Bor NZ Ministry of Health.
Business Intelligence Process Grain of the Fact Table Dr. Chang Liu
Data Warehouse Architecture. Inmon’s Corporate Information Factory The enterprise data warehouse is not intended to be queried directly by analytic applications,
ETL Overview February 24, DS User Group - ETL - February ETL Overview “ETL is the heart and soul of business intelligence (BI).” -- TDWI ETL.
Data Warehouse and Business Intelligence Dr. Minder Chen Fall 2009.
Datawarehouse A sneak preview. 2 Data Warehouse Approach An old idea with a new interest: Cheap Computing Power Special Purpose Hardware New Data Structures.
Dimensional Modeling Primer Chapter 1 Kimball & Ross.
UNIT-II Principles of dimensional modeling
Building Dashboards SharePoint and Business Intelligence.
Competitive (Business) Intelligence Systems The Road to Denormalization (starring Charlie Sheen & other Random Celebrities)
CMPE 226 Database Systems October 21 Class Meeting Department of Computer Engineering San Jose State University Fall 2015 Instructor: Ron Mak
June 08, 2011 How to design a DATA WAREHOUSE Linh Nguyen (Elly)
INFS 6220 Systems Analysis & Design Transactional DBs vs. Data Warehouses.
Introduction Data Vault. Historical development Business Intelligence 1950 Turing : First computers 1960Codd : 3NF 1970Management Information Systems.
To SSAS or not to SSAS, that is the question Ayman Senior PFE - Microsoft.
Or How I Learned to Love the Cube…. Alexander P. Nykolaiszyn BLOG:
Building the Corporate Data Warehouse Pindaro Demertzoglou Data Resource Management.
Copyright © 2016 Pearson Education, Inc. Modern Database Management 12 th Edition Jeff Hoffer, Ramesh Venkataraman, Heikki Topi CHAPTER 9: DATA WAREHOUSING.
Data Warehouse/Data Mart It’s all about the data.
CMPE 226 Database Systems April 12 Class Meeting Department of Computer Engineering San Jose State University Spring 2016 Instructor: Ron Mak
DATA WAREHOUSING TECHNIQUES ROUNDTABLE Kathy Bronson Trevyn Bowden Clackamas Communtiy College 7/2016 Information Technology Forest Grove, Oregon NWEUG.
Overview of Data Warehousing (DW) and OLAP
Business Intelligence Overview
CMPE Database Systems Workshop June 12 Class Meeting
Power BI for Your Business Session 2: Data Modeling Making your data work for you with Power BI Jeremy Kingry eBECS LTD. Data Analytics Practice Lead.
Advanced Applied IT for Business 2
Data Warehousing Business Intelligence
Applying Data Warehouse Techniques
Overview and Fundamentals
Competing on Analytics II
MIS2502: Data Analytics Dimensional Data Modeling
CMPE 226 Database Systems April 11 Class Meeting
Applying Data Warehouse Techniques
INFS 3220 Systems Analysis & Design
An Introduction to Data Warehousing
Data Warehouses, Dimensional Modeling, and the Laundromat
Applying Data Warehouse Techniques
Warehouse Architecture
Analytics in the Cloud using Microsoft Azure
The Road to Denormalization
Role Playing Dimensions (p )
Chapter 3 DATA WAREHOUSING.
Building a Microsoft BI solution step-by-step
Technical Architecture
Data Warehouses, Dimensional Modeling, and the Laundromat
Data Warehousing.
Presentation transcript:

Data Warehouses, Dimensional Modeling, and the Laundromat

The washers and dryers are like an organization’s operational / transaction systems . . .

Sorting by color is best for washing, but not for retrieval and wearing! Reorganize

ETL is like bringing clothes home and putting them away for easy retrieval!

Denormalized Star Schema – Common Approach Fact (core or transaction) Tables in middle of star Dimensional (structural or “lookup”) Tables around “points” of star Cust # CustName 100 Moe 101 Larry 102 Curly Loc # LocName 1000 NY 2000 LA 3000 PGH LOC DIMENSION CUSTOMER DIMENSION Order # Date Cust# Prod# Loc# 1 06/15/XX 100 QR22 1000 2 07/19/XX 100 QR22 1000 3 08/30/XX 101 SR56 2000 SALES ORDER (FACT) TABLE Date Quarter 06/29/XX 2 Bob 06/30/XX 2 Sue 07/01/XX 3 Prod # ProdName QR22 Rake SR56 Spade TW43 Mulch PRODUCT DIMENSION DATE DIMENSION The DW structure reflects Dimensional Modeling

Common (Conformed) Dimensions Denormalized Star Schema (continued) Stars are linked via common (i.e., Conformed) Dimensions to form Data Warehouse Cust # CustName 100 Moe 101 Larry 102 Curly Loc # LocName 1000 NY 2000 LA 3000 PGH LOC DIMENSION CUSTOMER DIMENSION Order # Date Cust# Prod# Loc# 1 06/15/XX 100 QR22 1000 2 07/19/XX 100 QR22 1000 3 08/30/XX 101 SR56 2000 ORDER TABLE SALES ORDER (FACT) TABLE Common (Conformed) Dimensions Date Quarter 06/29/XX 2 06/30/XX 2 S 07/01/XX 3 Juan CUSTOMER TABLE Prod # ProdName QR22 Rake SR56 Spade TW43 Mulch PRODUCT DIMENSION DATE DIMENSION TIME Prod# ProdName Stock Date Units QR22 Rake 03/23/XX 150 TW43 Mulch 04/15/XX 1452 SR56 Spade 05/01/XX 997 INVENTORY (FACT) TABLE

DW Development Approaches Inmon Model: EDW approach (top-down) Kimball Model: Data mart approach  (bottom-up) Which model is best? Depends

Bill Inmon (Top-Down) Build an all-encompassing Enterprise Data Warehouse (EDW) When EDW is finished, use it to create subject-oriented Data Marts “Cargo-Ship” approach

Ralph Kimball (Bottom-Up) Build subject-oriented Data Marts first Connect the individual Data Marts to create a Data Warehouse Start small and add to Data Warehouse over time “Freight Train” approach

Best Approach depends on the organization’s resources and needs!

In-Memory Visualization Tools Newest End-User Data Analytic Tools Very visual dashboards displays and gauges Stores data in local PC’s RAM (more flexible & faster performance) Can utilize Dimensional Modeling of a Data Warehouse, or model data on local PC Main competitors: Tableau, Qlikview, MS-Power BI

MS Power BI Demo