Nov 8 2002DOLAP 2002 McLean USA A Multidimensional and Multiversion Structure for OLAP Applications Mathurin Body 1,2, Maryvonne Miquel 2, Yvan Bédard.

Slides:



Advertisements
Similar presentations
An overview of Data Warehousing and OLAP Technology Presented By Manish Desai.
Advertisements

Business Intelligence Simon Pease. Experience with BI Developing end-to-end BI prototype for Plan International Developing end-to-end BI prototype for.
VIEWS / TSS Overview. End-to-end Air Quality Data and Decision Support VIEWS / TSS Vision Acquisition Import Unification Management Manipulation Retrieval.
Department of Software and Computing Systems Physical Modeling of Data Warehouses using UML Sergio Luján-Mora Juan Trujillo DOLAP 2004.
Introduction to Databases
Data Warehousing M R BRAHMAM.
Dimensional Modeling Business Intelligence Solutions.
Database Systems: Design, Implementation, and Management Tenth Edition
Data Warehouse IMS5024 – presented by Eder Tsang.
Spatial data warehouses and SOLAP: a new GIS technology Geosciences, mapping day Jean-Paul KASPRZYK, phd student.
COMP 578 Data Warehousing And OLAP Technology Keith C.C. Chan Department of Computing The Hong Kong Polytechnic University.
CSE6011 Warehouse Models & Operators  Data Models  relations  stars & snowflakes  cubes  Operators  slice & dice  roll-up, drill down  pivoting.
Chapter 13 The Data Warehouse
Online Analytical Processing (OLAP) Hweichao Lu CS157B-02 Spring 2007.
M ODULE 5 Metadata, Tools, and Data Warehousing Section 4 Data Warehouse Administration 1 ITEC 450.
ETL By Dr. Gabriel.
MDC Open Information Model West Virginia University CS486 Presentation Feb 18, 2000 Lijian Liu (OIM:
XCube XML For Data Warehouses By Sven Groot. Data warehouses Contains data drawn from several databases and external sources Contains data drawn from.
Week 6 Lecture The Data Warehouse Samuel Conn, Asst. Professor
©Silberschatz, Korth and Sudarshan18.1Database System Concepts - 5 th Edition, Aug 26, 2005 Buzzword List OLTP – OnLine Transaction Processing (normalized,
Data Warehouse & Data Mining
Best Practices for Data Warehousing. 2 Agenda – Best Practices for DW-BI Best Practices in Data Modeling Best Practices in ETL Best Practices in Reporting.
IMS 6217: Data Warehousing / Business Intelligence Part 3 1 Dr. Lawrence West, Management Dept., University of Central Florida Analysis.
Web-Enabled Decision Support Systems
DW-1: Introduction to Data Warehousing. Overview What is Database What Is Data Warehousing Data Marts and Data Warehouses The Data Warehousing Process.
OnLine Analytical Processing (OLAP)
Chapter 6 SAS ® OLAP Cube Studio. Section 6.1 SAS OLAP Cube Studio Architecture.
1 Data Warehouses BUAD/American University Data Warehouses.
13 Chapter 13 The Data Warehouse Database Systems: Design, Implementation, and Management 4th Edition Peter Rob & Carlos Coronel.
Data Warehousing.
1 INTEROP WP1: Knowledge Map Michaël Petit (U. of Namur) January 19 th 2004 Updated description of tasks after INTEROP Kickoff Meeting, Bordeaux.
5 - 1 Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved.
Data Staging Data Loading and Cleaning Marakas pg. 25 BCIS 4660 Spring 2012.
Ayyat IT Group Murad Faridi Roll NO#2492 Muhammad Waqas Roll NO#2803 Salman Raza Roll NO#2473 Junaid Pervaiz Roll NO#2468 Instructor :- “ Madam Sana Saeed”
Chapter 5 DATA WAREHOUSING Study Sections 5.2, 5.3, 5.5, Pages: & Snowflake schema.
On Querying Versions of Multiversion Data Warehouse Tadeusz Morzy Robert Wrembel Poznań University of Technology Institute of Computing Science Poznań,
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
13 1 Chapter 13 The Data Warehouse Database Systems: Design, Implementation, and Management, Seventh Edition, Rob and Coronel.
CSE 5331/7331 F'071 CSE 5331/7331 Fall 2007 Dimensional Modeling Margaret H. Dunham Department of Computer Science and Engineering Southern Methodist University.
1 Database Systems, 8 th Edition 1 Chapter 13 Business Intelligence and Data Warehouses Objectives In this chapter, you will learn: –How business intelligence.
Query Optimization For OLAP-XML Federations Dennis Pedersen Karsten Riiis Torben Bach Pedersen Nykredit Center for Database Research Department of Computer.
A New OLAP Aggregation Based on the AHC Technique DOLAP 2004 R. Ben Messaoud, O. Boussaid, S. Rabaséda Laboratoire ERIC – Université de Lyon 2 5, avenue.
Database Management Systems, 2 nd Edition. R. Ramakrishnan and J. Gehrke1 Data Warehousing and Decision Support.
SQL Server Analysis Services Understanding Unified Dimension Model (UDM)
Database Management Systems 3ed, R. Ramakrishnan and J. Gehrke1 Data Warehousing and Decision Support Chapter 25.
1 Database Systems, 8 th Edition Star Schema Data modeling technique –Maps multidimensional decision support data into relational database Creates.
Introduction to OLAP and Data Warehouse Assoc. Professor Bela Stantic September 2014 Database Systems.
Data Warehousing and OLAP Outline u Models & operations u Implementing a warehouse u Future directions.
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
CSE6011 Implementing a Warehouse  Monitoring: Sending data from sources  Integrating: Loading, cleansing,...  Processing: Query processing, indexing,...
OLAP Theory-English version On-Line Analytical processing (Buisness Intelligence) Ing.Skorkovský,CSc Department of Corporate Economy Faculty of Economics.
Data Mining and Data Warehousing: Concepts and Techniques What is a Data Warehouse? Data Warehouse vs. other systems, OLTP vs. OLAP Conceptual Modeling.
Data Warehousing CIS 4301 Lecture Notes 4/20/2006.
Chapter 13 Business Intelligence and Data Warehouses
Chapter 13 The Data Warehouse
Data Warehouse.
Data Warehouse and OLAP
Chapter 1 Database Systems
File Systems and Databases
Conceptual, Logical, and Physical Design of Data Warehouses
VIEWS / TSS Overview.
Introduction of Week 9 Return assignment 5-2
Database Design Hacettepe University
Chapter 13 The Data Warehouse
Chapter 13 The Data Warehouse
Chapter 1 Database Systems
Data Warehousing Concepts
Analysis Services Analysis Services vs. the Data Warehouse vs. OLTP DB
Data Warehouse and OLAP
Presentation transcript:

Nov DOLAP 2002 McLean USA A Multidimensional and Multiversion Structure for OLAP Applications Mathurin Body 1,2, Maryvonne Miquel 2, Yvan Bédard 1,2, Anne Tchounikine 2 1 Centre de recherche en Géomatique, Univ Laval, Québec, Canada 2 Institut National des Sciences Appliquées, Lyon, France

Nov DOLAP 2002 McLean USA Purpose Handle evolutions in Multidimensional Structures Compare data into static structures Provide a new conceptual model Define evolution operators Give solutions and tools for implementation

Nov DOLAP 2002 McLean USA Multidimensional Models Date Gender CityCountry Static organization of data Fact Table Nb of Births Star or Snowflake representation Issues

Nov DOLAP 2002 McLean USA First Case Study Location dimension: D1100 D D Query: « Total number of births per year and city ? » Evo C  C  Evo C  C  Evo C1100  C2150  C1C2 D1D2D C1C2 D1D2D Exact view2. Mapped info into 2001 organization 3. Mapped info into 2002 organization Issues

Nov DOLAP 2002 McLean USA Second Case Study Location dimension: D100- D1-150 D2-50 Query: « Total number of births per year and district ? » Evo D100-? D1-150? D2-50? Evo D  Evo D140 * 150  D260 ** 50  C1 D Exact view2. First Structure3. Second Structure 2002 C1 D1D2 * D1 ~ 40 % of the births of D1 ** D2 ~ 60 % of the births of D1 Issues

Nov DOLAP 2002 McLean USA Existing Solutions (1/2) Related works Updating models (M. Blaschka, C. Hurtado, A.O. Mendelzon and A. Vaisman) +Pragmatic way +Allow temporal comparison –Corrupt data –lose data (e.g. deletion of a member) –Hiding evolutions

Nov DOLAP 2002 McLean USA Existing Solutions (2/2) Related works Tracking history models (R. Bliujute, P. Chamoni and S. Stock, J. Eder and C. Koncilia, R. Kimball, A.O. Mendelzon and A. Vaisman, T.B. Pedersen, C.S. Jensen and C.E. Dyreson ) +Temporally consistent representation +Evolutions kept –Only one representation of data (no comparison across time) –Limit of data analysis +Mapping functions (J. Eder and C. Koncilia) +Timestamps on the elements of multidimensional database (A.O. Mendelzon and A. Vaisman)

Nov DOLAP 2002 McLean USA Our Objectives For the administrators: –Integrate all kinds of evolution in a multidimensional structure –Take into account complex dimension structures For the users: –Choose between different modes of representation –End user tools for analyse Proposal

Nov DOLAP 2002 McLean USA Evolutions in multidimensional structures Proposal Dimension schema evolution Creation and deletion of a dimension Creation and deletion of a hierarchy Creation and deletion of a level Move of a level in the hierarchical schema structure Evolution members: simple operations Creation of a member Deletion of a member Transformation of a member (change of an attribute, its name or meaning…) Merging of n members into one member Splitting of one member into n members Reclassification of a member in the dimension structure Evolution on members : Exples of complex operations Decreasing: splitting and deletion Increasing: creation and merging Partial annexation: splitting and merging

Nov DOLAP 2002 McLean USA Conceptual Model: Temporal Multidimensional Schema ZaïreDem. Rep. of Congo [1990 ; 1997][1997 ; Now] Temporal Dimension: - Evolution of the hierarchical structure of the members Mapping Relationship: -keeping transition links between member versions D1 D D2 f : x  x f : x  0.4 x f : x  0.6 x f : x  x Confidence factor: -Evaluation of the confidence associated to a mapping (exact mapping) (approximated mapping) (exact mapping) (approximated mapping) - Evolution of the members of a dimension Member Version: V1 D1D2D3 [98 ; 02] [98 ; 00][01 ; 02] V2 P1 Proposal

Nov DOLAP 2002 McLean USA Conceptual Model: MultiVersion Fact Table Temporal Modes of Presentation: - Modes for the presentation of a multidimensional request MultiVersion Fact Table: -Fact Table with different temporal modes of Presentation - Automatically deduced from the temporally consistent fact table, the temporal dimensions and the mapping relationship - a valid, unchanged structure over its given valid time. Structure Version: VS.1VS.2VS.3 - Temporally consistent mode - version VS.1 - version VS.2 - version VS.3 Proposal

Nov DOLAP 2002 McLean USA Logical Model - Temporal Modes of Presentation integrated in a new dimension. Date Gender CityCountry Fact Table Nb of births Confidence factor - Confidence factors integrated as a new measure T.M.P. Implementation

Nov DOLAP 2002 McLean USA Architecture MultiVersion Data Warehouse OLAP MultiVersion CubeTemporal Data Warehouse -Extract the Structure Versions -Compute the transitive… of the Mapping relation -Mapping of data -Data Agregation -Multidimensional Indexation Implementation

Nov DOLAP 2002 McLean USA Prototype Sale numbers and production cost per product, district and month Star Schema of the temporal Data Warehouse Implementation

Nov DOLAP 2002 McLean USA Development Tools Visual Basic Interface and Proclarity Components OLAP MultiVersion Cube (SQL Server Analysis Service) Access to the data cube Data warehouse Repository (SQL Server) Access to meta data Implementation

Nov DOLAP 2002 McLean USA End User Tools for Analysis Implementation Example of Metadata: describes the evolutions of the element pointed in the grid. Grid: presents the values and their confidence factors Comparative study: Two temporal modes are represented Dimensions control: used to navigate trough the cube

Nov DOLAP 2002 McLean USA End User Tools for Navigation: find the « best version » Implementation Parameters for each type of confidence Rank of the temporal modes of presentation

Nov DOLAP 2002 McLean USA Conclusion A temporal multidimensional model for supporting evolutions on multidimensional structures USER Navigate through different modes of presentation Choose the interpretation he wants to give to his request Be guide to select its best representation Have access to metadata describing all evolutions of member versions DESIGNER AND ADMINISTRATOR Model different kinds of hierarchical dimensions Take into account all types of evolutions in the multidimensional structures Implement this model on commercial OLAP environment Extension choose a temporal mode of presentation for each dimension