1 ACCTG 6910 Building Enterprise & Business Intelligence Systems (e.bis) The Data Warehouse Lifecycle Olivia R. Liu Sheng, Ph.D. Emma Eccles Jones Presidential.

Slides:



Advertisements
Similar presentations
Data Warehousing – An Introductory Perspective
Advertisements

Copyright © Starsoft Inc, Data Warehouse Architecture By Slavko Stemberger.
ITEC 423 Data Warehousing and Data Mining Lecture 3.
Data Warehousing M R BRAHMAM.
Data Warehouse Architecture Sakthi Angappamudali Data Architect, The Oregon State University, Corvallis 16 th May, 2005.
Introduction to data warehouses
1 ACCTG 6910 Building Enterprise & Business Intelligence Systems (e.bis) Introduction to Data Mining Olivia R. Liu Sheng, Ph.D. Emma Eccles Jones Presidential.
Defining Data Warehouse Concepts and Terminology
1 ACCTG 6910 Building Enterprise & Business Intelligence Systems (e.bis) Data Staging Olivia R. Liu Sheng, Ph.D. Emma Eccles Jones Presidential Chair of.
Components and Architecture CS 543 – Data Warehousing.
1 ACCTG 6910 Building Enterprise & Business Intelligence Systems (e.bis) Dimensional Modeling I Olivia R. Liu Sheng, Ph.D. Emma Eccles Jones Presidential.
1 ACCTG 6910 Building Enterprise & Business Intelligence Systems (e.bis) Dimensional Modeling II Olivia R. Liu Sheng, Ph.D. Emma Eccles Jones Presidential.
1 ACCTG 6910 Building Enterprise & Business Intelligence Systems (e.bis) Introduction to Data Warehouse Olivia R. Liu Sheng, Ph.D. Emma Eccles Jones Presidential.
Chapter 13 The Data Warehouse
Data Warehouse Components
Data Warehousing DSCI 4103 Dr. Mennecke Introduction and Chapter 1.
Data Warehouse Toolkit Introduction. Data Warehouse Bill Inmon's paradigm: Data warehouse is one part of the overall business intelligence system. An.
Designing a Data Warehouse
Data Warehousing: Defined and Its Applications Pete Johnson April 2002.
Architecture and Infrastructure Module 2 G.Anuradha.
MIS 451 Building Business Intelligence Systems
Data Conversion to a Data warehouse Presented By Sanjay Gunasekaran.
Agenda Common terms used in the software of data warehousing and what they mean. Difference between a database and a data warehouse - the difference in.
An Introduction to Infrastructure Ch 11. Issues Performance drain on the operating environment Technical skills of the data warehouse implementers Operational.
Intro to MIS – MGS351 Databases and Data Warehouses Chapter 3.
Database Systems – Data Warehousing
Data Warehouse Overview September 28, 2012 presented by Terry Bilskie.
Business Intelligence Zamaneh Jahed. What is Business Intelligence? Business Intelligence (BI) is a broad category of applications and technologies for.
Datawarehouse Objectives
1 Data Warehouses BUAD/American University Data Warehouses.
OLAP & DSS SUPPORT IN DATA WAREHOUSE By - Pooja Sinha Kaushalya Bakde.
1 Reviewing Data Warehouse Basics. Lessons 1.Reviewing Data Warehouse Basics 2.Defining the Business and Logical Models 3.Creating the Dimensional Model.
Designing Aggregations. Performance Fundamentals - Aggregations Pre-calculated summaries of data Intersections of levels from each dimension Tradeoff.
Best Practices in Higher Education Student Data Warehousing Forum Northwestern University October 21-22, 2003 FIRST QUESTIONS Emily Thomas Stony Brook.
Datawarehouse A sneak preview. 2 Data Warehouse Approach An old idea with a new interest: Cheap Computing Power Special Purpose Hardware New Data Structures.
6.1 © 2010 by Prentice Hall 6 Chapter Foundations of Business Intelligence: Databases and Information Management.
13 1 Chapter 13 The Data Warehouse Database Systems: Design, Implementation, and Management, Seventh Edition, Rob and Coronel.
CHAPTER 7: ARCHITECTURAL COMPONENTS. CHAPTER OBJECTIVES  Understand data warehouse architecture  Examine how the architectural framework supports the.
Dimensional Modeling Primer Chapter 1 Kimball & Ross.
Enterprise Data Warehousing— Planning for the Long Haul Vicky Shaffer and Marti Graham April 18, 2005.
Ayyat IT Group Murad Faridi Roll NO#2492 Muhammad Waqas Roll NO#2803 Salman Raza Roll NO#2473 Junaid Pervaiz Roll NO#2468 Instructor :- “ Madam Sana Saeed”
Creating a Data Warehouse Data Acquisition: Extract, Transform, Load Extraction Process of identifying and retrieving a set of data from the operational.
Foundations of Business Intelligence: Databases and Information Management.
By N.Gopinath AP/CSE.  The data warehouse architecture is based on a relational database management system server that functions as the central repository.
MIS 451 Building Business Intelligence Systems Data Staging.
1 Copyright © Oracle Corporation, All rights reserved. Business Intelligence and Data Warehousing.
An Overview of Data Warehousing and OLAP Technology
Copyright © 2006, Oracle. All rights reserved. Czinkóczki László oktató Using the Oracle Warehouse Builder.
C Copyright © 2007, Oracle. All rights reserved. Introduction to Data Warehousing Fundamentals.
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
Supervisor : Prof . Abbdolahzadeh
Intro to MIS – MGS351 Databases and Data Warehouses
Defining Data Warehouse Concepts and Terminology
Building Data ware House
Lecture-34 DWH Implementation: Goal Driven Approach (2)
Chapter 13 The Data Warehouse
Data Warehouse.
Databases and Data Warehouses Chapter 3
Defining Data Warehouse Concepts and Terminology
المحاضرة 4 : مستودعات البيانات (Data warehouse)
Data Warehouse and OLAP
Data Warehouse Overview September 28, 2012 presented by Terry Bilskie
An Introduction to Data Warehousing
Data Warehouse Architecture
Data Warehouse Architecture
THE ARCHITECTURAL COMPONENTS
Data Warehouse Overview September 28, 2012 presented by Terry Bilskie
Data Warehousing Concepts
Technical Architecture
Data Warehouse and OLAP
Presentation transcript:

1 ACCTG 6910 Building Enterprise & Business Intelligence Systems (e.bis) The Data Warehouse Lifecycle Olivia R. Liu Sheng, Ph.D. Emma Eccles Jones Presidential Chair of Business

2 Source System (Legacy) extract Storage: Flat files (fastest); RDBMS; Other Processing: Clean; Prune; Combine; Remove duplicates; households; standardize; conform dimensions; store awaiting replications; archive; export to data marts No user query services Populate, replicate, recover Data Mart #1: OLAP ( ROLAP and/or MOLAP) query services; dimensional! Subject oriented; locally implemented; user group driven; may store atomic data; may be frequently refreshed; conform to DW Bus Data Mart #2 Data Mart #3 Populate, replicate, recover Ad Hoc Query Tools Report Writers End User Applications feed Models: forecasting; scoring; allocating; data mining; other downstream Systems; other parameters; special UI Data Staging Area The Data Warehouse Presentation Servers End User Data Access Uploaded cleaned dimensions Uploaded model results Basic Elements of a Data Warehouse System DW BUS Conformed dimensions and facts Relational Flat files Spreadsheets ERP Legacy

3 Technical Architecture Design Product Selection & Installation End-User Application Specification End-User Application Development The Business Dimensional Lifecycle Project Planning Business Requirement Definition Business Requirement Definition Deployment Maintenance, Monitoring, Evaluation & Growth Maintenance, Monitoring, Evaluation & Growth Project Management Dimensional Modeling Physical Design Data Staging Design & Development

4 Dimensional Modeling Logical Design (Design appropriate table structures and relationships) Tool: Oracle Data Mart Designer

5 Physical Design Storage Structure Performance Tuning Indexes and aggregation Tool: Data Mart Designer

6 Data Staging Extraction (Cleansing and ) Transformation Loading (Transportation) Tool: Oracle Data Mart Builder

7 Data Staging TransformationExtractionTransportation

8 End User Application Specification and Development On-Line Analytic Processing (OLAP) –Reporting –Ad-hoc query –Graphical Analysis Tool: Oracle Data Mart Discoverer

9 OLAP Reporting

10 OLAP Drill-up&Drill-down Query

11 OLAP Graphical Analysis