Data Warehouse—Subject‐Oriented

Slides:



Advertisements
Similar presentations
An overview of Data Warehousing and OLAP Technology Presented By Manish Desai.
Advertisements

Chapter 13 The Data Warehouse
April 30, Data Warehousing and OLAP Technology: An Overview  What is a data warehouse?  Data warehouse architecture  From data warehousing to.
 Data Warehouse Architecture By: Harrison Reid. Outline  What is a Data Warehouse Architecture  Five Main Data Warehouse Architectures  Factors That.
Data Warehouse Architecture Sakthi Angappamudali Data Architect, The Oregon State University, Corvallis 16 th May, 2005.
ICS 421 Spring 2010 Data Warehousing (1) Asst. Prof. Lipyeow Lim Information & Computer Science Department University of Hawaii at Manoa 3/18/20101Lipyeow.
Ch1: File Systems and Databases Hachim Haddouti
Chapter 13 The Data Warehouse
1 © Prentice Hall, 2002 Chapter 11: Data Warehousing.
1 Data Warehousing and OLAP. 2 Data Warehousing & OLAP Defined in many different ways, but not rigorously.  A decision support database that is maintained.
An Overview of Data Warehousing and OLTP Technology Presenter: Parminder Jeet Kaur Discussion Lead: Kailang.
Chapter 4 Database Management Systems. Chapter 4Slide 2 What is a Database Management System (DBMS)?  Database An organized collection of related data.
Data Warehousing: Defined and Its Applications Pete Johnson April 2002.
Ch3 Data Warehouse Dr. Bernard Chen Ph.D. University of Central Arkansas Fall 2010.
8/20/ Data Warehousing and OLAP. 2 Data Warehousing & OLAP Defined in many different ways, but not rigorously. Defined in many different ways, but.
Data Warehouse Architecture. Inmon’s Corporate Information Factory The enterprise data warehouse is not intended to be queried directly by analytic applications,
Data Warehouse Overview September 28, 2012 presented by Terry Bilskie.
Program Pelatihan Tenaga Infromasi dan Informatika Sistem Informasi Kesehatan Ari Cahyono.
I Information Systems Technology Ross Malaga 4 "Part I Understanding Information Systems Technology" Copyright © 2005 Prentice Hall, Inc. 4-1 DATABASE.
Data warehousing and online analytical processing- Ref Chap 4) By Asst Prof. Muhammad Amir Alam.
Data Warehouse Fundamentals Rabie A. Ramadan, PhD 2.
1 Data Warehouses BUAD/American University Data Warehouses.
2 Copyright © Oracle Corporation, All rights reserved. Defining Data Warehouse Concepts and Terminology.
The Data Warehouse “A data warehouse is a subject-oriented, integrated, time-variant, and nonvolatile collection of “all” an organisation’s data in support.
1 Reviewing Data Warehouse Basics. Lessons 1.Reviewing Data Warehouse Basics 2.Defining the Business and Logical Models 3.Creating the Dimensional Model.
5 - 1 Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved.
CISB594 – Business Intelligence
October 28, Data Warehouse Architecture Data Sources Operational DBs other sources Analysis Query Reports Data mining Front-End Tools OLAP Engine.
6.1 © 2010 by Prentice Hall 6 Chapter Foundations of Business Intelligence: Databases and Information Management.
Ch3 Data Warehouse Dr. Bernard Chen Ph.D. University of Central Arkansas Fall 2009.
CISB594 – Business Intelligence Data Warehousing Part I.
UNIT-II Principles of dimensional modeling
Management Information Systems, 4 th Edition 1 Chapter 8 Data and Knowledge Management.
CISB594 – Business Intelligence Data Warehousing Part I.
The Data Warehouse “A data warehouse is a subject-oriented, integrated, time-variant, and nonvolatile collection of “all” an organisation’s data in support.
Data Mining Data Warehouses.
CISB594 – Business Intelligence Data Warehousing Part I.
The Need for Data Analysis 2 Managers track daily transactions to evaluate how the business is performing Strategies should be developed to meet organizational.
2 Copyright © 2006, Oracle. All rights reserved. Defining Data Warehouse Concepts and Terminology.
What is a database? (a supplement, not a substitute for Chapter 1…) some slides copied/modified from text Collection of Data? Data vs. information Example:
Management Information Systems by Prof. Park Kyung-Hye Chapter 7 (8th Week) Databases and Data Warehouses 07.
Data Mining and Data Warehousing: Concepts and Techniques What is a Data Warehouse? Data Warehouse vs. other systems, OLTP vs. OLAP Conceptual Modeling.
1 HCMC UT, 2008 Data Warehousing 1.Basic Concepts of data warehousing 2.Data warehouse architectures 3.Some characteristics of data warehouse data 4.The.
Introduction To DBMS.
Advanced Applied IT for Business 2
Chapter 1: Introduction
Chapter 1: Introduction
Defining Data Warehouse Concepts and Terminology
Data warehouse and OLAP
Chapter 13 The Data Warehouse
Data storage is growing Future Prediction through historical data
OLAP Concepts and Techniques
Data Warehouse.
Data Warehouse Architecture
Defining Data Warehouse Concepts and Terminology
Basic Concepts in Data Management
Data Warehouse Overview September 28, 2012 presented by Terry Bilskie
An Introduction to Data Warehousing
Data Warehousing Data Model
Dr. Bernard Chen Ph.D. University of Central Arkansas Fall 2009
Warehouse Architecture
Data and Interoperability:
Data Warehousing Data Model –Part 1
Data Warehouse.
Data Warehouse Overview September 28, 2012 presented by Terry Bilskie
Chapter 1 Database Systems
Data Warehousing Concepts
DATABASE TECHNOLOGIES
Technical Architecture
Data Warehouse and OLAP Technology
Presentation transcript:

Data Warehouse—Subject‐Oriented •Organized  around  major  subjects,  such  as  customer,  product,  sales. •Focusing  on  the  modeling  and  analysis  of  data  for  decision  makers,  not  on  daily  operations  or  transaction  processing. •Provide  a  simple  and  concise  view  around  particular  subject  issues  by  excluding  data  that  are  not  useful  in  the  decision  suppor  process.(EP-44)

Data Warehouse ‐Integrated •Constructed  by  integrating  multiple,  heterogeneous  data  sourcesrelational  databases,  flat  files,  on‐line  transaction  records •Data  cleaning  and  data  integration  techniques  are  applied. Ensure  consistency  in  naming  conventions,  encoding  structures,  attribute  measures,  etc.  among  different  data  sourcesE.g.,  Hotel  price:  currency,  tax,  breakfast  covered,  etc. When  data  is  moved  to  the  warehouse,  it  is  converted

Data Warehouse ‐Time Variant •The  time  horizon  for  the  data  warehouse  is  significantly  longer  than  that  of  operational  systems. Operational  database:  current  value  data. Data  warehouse  data:  provide  information  from  a  historical  perspective  (e.g.,  past  5‐10  years) •Every  key  structure  in  the  data  warehouse Contains  an  element  of  time,  explicitly  or  implicitly But  the  key  of  operational  data  may  or  may  not  contain  “time  element”.

Data Warehouse ‐Non Updatable •A  physically  separate  store  of  data  transformed  from  the  operational  environment. •Operational  update  of  data  does  not  occur  in  the  data  warehouse  environment. Does  not  require  transaction  processing,  recovery,  and  concurrency  control  mechanisms. Requires  only  two  operations  in  data  accessing:  initial  loading  of  dataand  access  of  data.

Data mart: A data mart contains a subset of corporate-wide data that is of value to a specific group of users. The scope is confined to specific, selected subjects. For example, a marketing data mart may confine its subjects to customer, item, and sales. Data marts are usually implemented on low cost departmental servers that are UNIX- or Windows/NT-based. The implementation cycle of a data mart is more likely to be measured in weeks rather than months or years.

Accident, not architecture Sourced directly from operational systems Independent data marts – generally developed by individual organisational departments, which operate in isolation. Organisations with a number of data marts will find data definitions across the data marts inconsistent and lacking in conformity. Accident, not architecture Sourced directly from operational systems Redundant data Redundant processing Not scalable “Doesn’t require that a business come to terms with their data and business procedures” Data mart bus architecture - this architecture is rooted in specific business processes but the use of conformed dimensions and facts enables the incremental integration of additional data marts to form an organisation wide view of the organisation. Data is modelled dimensionally in a star schema. Start at the ground level rather than the enterprise level – “Bottoms up” approach Pick business processes and model them Dimensional modeling (star schema) rather than ERD Data marts uses “standardized, conformed dimensions” Warehouse is “conceptual” created by the “bus” of conformed dimensions

Addresses need for dependent data marts Hub and spoke architectures – the aim of this architecture is to iteratively develop, subject by subject, an enterprise wide view of data where atomic level data is maintained in the warehouse in 3rd normal form i.e. the hub. The vast majority of users will access the data from dependant dimensionally modelled data marts (spokes). Addresses need for dependent data marts Marts receive data from central source ‐ the warehouse Medium and large contexts Scalable, often enterprise‐wide Sometimes called the Corporate Information Factory Centralised data warehouse – this architecture is similar to the hub and spoke architecture but has no dependant data marts. No dependent data marts Consolidates data marts into data warehouse Warehouse contains both atomic (detail) data and summary

Useful in mergers and acquisitions Federated – the federated architecture draws upon existing decision support structures where the “data is either logically of physically integrated using shared keys, global metadata, distributed queries, and other methods”. Low overhead Do not rearchitect existing data structures (such as marts,warehouses, or transactional systems) Logically or physically integrate data Distributed queries and metadata associate the data Access data simultaneously across multiple systems Useful in mergers and acquisitions

DATA WAREHOUSE Corporate/Enterprise-wide Union of all data marts Data received from staging area Queries on presentation resource Structure for corporate view of data Organized on E-R model DATA MART Departmental A single business process Star-join (facts & dimensions) Technology optimal for data access and analysis Structure to suit the departmental view of data Figure 2-5 Data warehouse versus data mart