Building Data ware House

Slides:



Advertisements
Similar presentations
Supervisor : Prof . Abbdolahzadeh
Advertisements

1 Use or disclosure of data contained on this sheet is subject to the restriction on the title page of this proposal or quotation. An Introduction to Data.
Business Intelligence Simon Pease. Experience with BI Developing end-to-end BI prototype for Plan International Developing end-to-end BI prototype for.
Copyright © Starsoft Inc, Data Warehouse Architecture By Slavko Stemberger.
Data Warehouse Architecture Sakthi Angappamudali Data Architect, The Oregon State University, Corvallis 16 th May, 2005.
Introduction to data warehouses
Introduction to Data Warehouse and Data Mining MIS 2502 Data Analytics
Information Integration. Modes of Information Integration Applications involved more than one database source Three different modes –Federated Databases.
An Introduction to Dimensional Data Warehouse Design Presented by Joseph J. Sarna Jr. JJS Systems, LLC.
Exploiting the DW data DW is a platform for creating a wide array of reports It solves data feed problems, but does not lead to specific decision support.
1 ACCTG 6910 Building Enterprise & Business Intelligence Systems (e.bis) Data Staging Olivia R. Liu Sheng, Ph.D. Emma Eccles Jones Presidential Chair of.
Components and Architecture CS 543 – Data Warehousing.
Data Warehousing -Kalyani. Topics Definition Types Components Architecture Database Design OLAP Metadata repository.
1 ACCTG 6910 Building Enterprise & Business Intelligence Systems (e.bis) The Data Warehouse Lifecycle Olivia R. Liu Sheng, Ph.D. Emma Eccles Jones Presidential.
MIS 451 Building Business Intelligence Systems Logical Design (3) – Design Multiple-fact Dimensional Model.
IST722 Data Warehousing Technical Architecture Michael A. Fudge, Jr. * Figures taken from Kimball Ch. 4.
By N.Gopinath AP/CSE. Two common multi-dimensional schemas are 1. Star schema: Consists of a fact table with a single table for each dimension 2. Snowflake.
Chapter 13 The Data Warehouse
Data Warehouse Toolkit Introduction. Data Warehouse Bill Inmon's paradigm: Data warehouse is one part of the overall business intelligence system. An.
Designing a Data Warehouse
1 Components of A Successful Data Warehouse Chris Wheaton, Co-Founder, Client Advocate.
Business Intelligence Instructor: Bajuna Salehe Web:
Data warehousing theory and modelling techniques Building Dimensional Models.
Data Conversion to a Data warehouse Presented By Sanjay Gunasekaran.
Agenda Common terms used in the software of data warehousing and what they mean. Difference between a database and a data warehouse - the difference in.
Designing a Data Warehouse Issues in DW design. Three Fundamental Processes Data Acquisition Data Storage Data a Access.
Activity Running Time DurationIntro0 2 min Setup scenario 2 2 min SQL BI components & concepts 4 5 min Data input (Let’s go shopping) 9 7 min Whiteboard.
The Business Intelligence Side of Blue Mountain RAM Bill Lucas, IT Systems Architect and Senior Software Engineer.
Database A database is a collection of data organized to meet users’ needs. In this section: Database Structure Database Tools Industrial Databases Concepts.
Decision Support and Date Warehouse Jingyi Lu. Outline Decision Support System OLAP vs. OLTP What is Date Warehouse? Dimensional Modeling Extract, Transform,
13 1 Chapter 13 The Data Warehouse Database Systems: Design, Implementation, and Management, Seventh Edition, Rob and Coronel.
Prepared By Aakanksha Agrawal & Richa Pandey Mtech CSE 3 rd SEM.
Dimensional Modeling Primer Chapter 1 Kimball & Ross.
Data Staging Data Loading and Cleaning Marakas pg. 25 BCIS 4660 Spring 2012.
Creating a Data Warehouse Data Acquisition: Extract, Transform, Load Extraction Process of identifying and retrieving a set of data from the operational.
Two-Tier DW Architecture. Three-Tier DW Architecture.
CS 157B: Database Management Systems II April 10 Class Meeting Department of Computer Science San Jose State University Spring 2013 Instructor: Ron Mak.
MIS 451 Building Business Intelligence Systems Data Staging.
Data Warehousing -Kalyani.
Business Intelligence Overview
Supervisor : Prof . Abbdolahzadeh
CHAPTER 9 - Data Warehouse Implementation and Use
Advanced Applied IT for Business 2
Lecture-32 DWH Lifecycle: Methodologies
Lecture-34 DWH Implementation: Goal Driven Approach (2)
Data warehouse and OLAP
Chapter 13 The Data Warehouse
Components of A Successful Data Warehouse
Software Development Life Cycle
Data storage is growing Future Prediction through historical data
IBM DATASTAGE online Training at GoLogica
Data Warehouse.
Competing on Analytics II
Dimensional Model January 14, 2003
SSIS Demo Michael A. Fudge, Jr.
المحاضرة 4 : مستودعات البيانات (Data warehouse)
Data Warehouse and OLAP
An Introduction to Data Warehousing
Data Warehouse Architecture
Data warehouse.
Warehouse Architecture
Data Warehouse Architecture
THE ARCHITECTURAL COMPONENTS
The Road to Denormalization
OLAP in DWH Ján Genči PDT.
Data Warehousing Concepts
Chapter 13 The Data Warehouse
Technical Architecture
Data Warehouse and OLAP
Best Practices in Higher Education Student Data Warehousing Forum
Presentation transcript:

Building Data ware House

Building a Data Warehouse Data Warehouse Lifecycle Analysis Design Import data Install front-end tools Test and deploy

Stage 1: Analysis Identify: Create an enterprise-level data dictionary Design Import data Install front-end tools Test and deploy Identify: Target Questions Data needs Timeliness of data Granularity Create an enterprise-level data dictionary Dimensional analysis Identify facts and dimensions

Stage 2: Design Star schema Data Transformation Aggregates Analysis Design Import data Install front-end tools Test and deploy Star schema Data Transformation Aggregates Pre-calculated Values HW/SW Architecture Dimensional Modeling

Dimensional Modeling Fact Table – The primary table in a dimensional model that is meant to contain measurements of the business. Dimension Table – One of a set of companion tables to a fact table. Most dimension tables contain many textual attributes that are the basis for constraining and grouping within data warehouse queries.

Stage 3: Import Data Identify data sources Analysis Design Import data Install front-end tools Test and deploy Identify data sources Extract the needed data from existing systems to a data staging area Transform and Clean the data Resolve data type conflicts Resolve naming and key conflicts Remove, correct, or flag bad data Conform Dimensions Load the data into the warehouse

Importing Data Into the Warehouse Operational Systems (source systems)

Stage 4: Install Front-end Tools Analysis Design Import data Install front-end tools Test and deploy Reporting tools Data mining tools GIS Etc.

Stage 5: Test and Deploy Usability tests Software installation Analysis Design Import data Install front-end tools Test and deploy Usability tests Software installation User training Performance tweaking based on usage

Waterfall Model

Spiral Model

Rapid Application Development (RAD)

DWH Life Cycle Model DESIGN ENHANCE PROTOTYPE OPERATE DEPLOY 58