Best Practices for Data Warehousing. 2 Agenda – Best Practices for DW-BI Best Practices in Data Modeling Best Practices in ETL Best Practices in Reporting.

Slides:



Advertisements
Similar presentations
Tips and Tricks for Dimensional Modeling
Advertisements

MIS 385/MBA 664 Systems Implementation with DBMS/ Database Management
BY LECTURER/ AISHA DAWOOD DW Lab # 2. LAB EXERCISE #1 Oracle Data Warehousing Goal: Develop an application to implement defining subject area, design.
Business Information Warehouse Business Information Warehouse.
Jaros Jaros Overview. Jaros Overview - History Founded 1999 as consulting company GE Medical Systems IT Sigma Aldrich Smurfit-Stone Container Transitioned.
SQL Server Accelerator for Business Intelligence (SSABI)
Technical BI Project Lifecycle
Data Warehousing M R BRAHMAM.
TURKISH INJURY DATABASE (UKAY) TURKISH PUBLIC HEALTH AGENCY Directorate of Strategy Development Aslı Sungur.
Organizing Data & Information
Data Warehousing - 3 ISYS 650. Snowflake Schema one or more dimension tables do not join directly to the fact table but must join through other dimension.
Chapter 13 The Data Warehouse
Business Intelligence & Analytics
Center of Excellence for IT at Bellevue College. IT-enabled business decision making based on simple to complex data analysis processes  Database development.
Components of the Data Warehouse Michael A. Fudge, Jr.
ETL Design and Development Michael A. Fudge, Jr.
ETL By Dr. Gabriel.
Agenda Common terms used in the software of data warehousing and what they mean. Difference between a database and a data warehouse - the difference in.
Burton upon Trent, 23rd October. Merit Intelligence Our offerings A complete offering – product, competence and services Competence based on many years.
BUSINESS INTELLIGENCE/DATA INTEGRATION/ETL/INTEGRATION AN INTRODUCTION Presented by: Gautam Sinha.
©Silberschatz, Korth and Sudarshan18.1Database System Concepts - 5 th Edition, Aug 26, 2005 Buzzword List OLTP – OnLine Transaction Processing (normalized,
Sayed Ahmed Logical Design of a Data Warehouse.  Free Training and Educational Services  Training and Education in Bangla: Training and Education in.
1 Brett Hanes 30 March 2007 Data Warehousing & Business Intelligence 30 March 2007 Brett Hanes.
Data Warehousing Seminar Chapter 5. Data Warehouse Design Methodology Data Warehousing Lab. HyeYoung Cho.
1 The following presentation is from the Oracle Webcast “What’s New in P6 EPPM Release 8.1.” As a partner, you may not use the Oracle Power Point template,
Activity Running Time DurationIntro0 2 min Setup scenario 2 2 min SQL BI components & concepts 4 5 min Data input (Let’s go shopping) 9 7 min Whiteboard.
DW-1: Introduction to Data Warehousing. Overview What is Database What Is Data Warehousing Data Marts and Data Warehouses The Data Warehousing Process.
Atlanta Microsoft Database Forum Introduction to Data Warehousing Concepts Brian Thomas Solution Builders, Inc. Presented by March 8, 2004
Business Intelligence Zamaneh Jahed. What is Business Intelligence? Business Intelligence (BI) is a broad category of applications and technologies for.
Business and IT Working Together to Streamline Corporate Reporting Stephen Hord, Director of Product Development – UBmatrix.
Data Warehouse. Design DataWarehouse Key Design Considerations it is important to consider the intended purpose of the data warehouse or business intelligence.
1 Data Warehouses BUAD/American University Data Warehouses.
2 Copyright © Oracle Corporation, All rights reserved. Defining Data Warehouse Concepts and Terminology.
Right In Time Presented By: Maria Baron Written By: Rajesh Gadodia
Soup-2-Nuts Alaska Department of Fish & Game Commercial Fisheries October, 2011.
December 5, Repository Metadata: Tips and Tricks Peggy Rodriguez, Kathy Kimball.
Building Data and Document-Driven Decision Support Systems How do managers access and use large databases of historical and external facts?
UNIT-II Principles of dimensional modeling
Chapter 5 DATA WAREHOUSING Study Sections 5.2, 5.3, 5.5, Pages: & Snowflake schema.
Building Dashboards SharePoint and Business Intelligence.
1 Extending Drill Through to Oracle Transaction Level Detail from Hyperion Essbase.
Creating a Data Warehouse Data Acquisition: Extract, Transform, Load Extraction Process of identifying and retrieving a set of data from the operational.
Using Oracle BI Suite EE Plus with Oracle E-Business Suite Joe Dahl Product Specialist Noetix Corporation.
Rajesh Bhat Director, PLM Analytics Applications
June 08, 2011 How to design a DATA WAREHOUSE Linh Nguyen (Elly)
Using Oracle BI Suite EE Plus with Oracle E-Business Suite Joe Dahl Product Specialist Noetix Corporation.
1 Copyright © 2009, Oracle. All rights reserved. Oracle Business Intelligence Enterprise Edition: Overview.
 Definition of terms  Reasons for need of data warehousing  Describe three levels of data warehouse architectures  Describe two components of star.
1 Copyright © Oracle Corporation, All rights reserved. Business Intelligence and Data Warehousing.
The Need for Data Analysis 2 Managers track daily transactions to evaluate how the business is performing Strategies should be developed to meet organizational.
(OBIA) Training & Placement Program By Keen IT To request free demo session please mail us at
Introduction to OLAP and Data Warehouse Assoc. Professor Bela Stantic September 2014 Database Systems.
Copyright © 2006, Oracle. All rights reserved. Czinkóczki László oktató Using the Oracle Warehouse Builder.
Building the Corporate Data Warehouse Pindaro Demertzoglou Data Resource Management.
Copyright © 2016 Pearson Education, Inc. Modern Database Management 12 th Edition Jeff Hoffer, Ramesh Venkataraman, Heikki Topi CHAPTER 9: DATA WAREHOUSING.
7 Copyright © 2006, Oracle. All rights reserved. Defining a Relational Dimensional Model.
2 Copyright © 2006, Oracle. All rights reserved. Defining Data Warehouse Concepts and Terminology.
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
Slide 1 © 2016, Lera Technologies. All Rights Reserved. Oracle Data Integrator By Lera Technologies.
ETL Design - Stage Philip Noakes May 9, 2015.
Oracle Business Intelligence Enterprise Edition
Chapter 13 The Data Warehouse
Summarized from various resources Modern Database Management
Data Warehouse.
Overview and Fundamentals
Competing on Analytics II
Data Warehouse.
Data Warehousing Concepts
Oracle BI Applications - Architecture
Presentation transcript:

Best Practices for Data Warehousing

2 Agenda – Best Practices for DW-BI Best Practices in Data Modeling Best Practices in ETL Best Practices in Reporting

3 Best Practices in Data Modeling

4 ProductsDimension TimeDimension Oracle Order Management & Fulfillment Analytics Q. How many of my top customers bought products from my worst suppliers? Sales Orders Fact Table Dim Table DimensionTables Support for Cross-Application Analysis Supply Chain Analytics Purchase Orders Fact Table Dim Table DimensionTables Fundamental requirement that dimensions be common (conformed)

5 Features: Conformed dimensions Transaction data stored in most granular fashion Tracks full history of changes Prebuilt and extensible Built for speed Integrated Enterprise Analytics Data Model Benefits: Enterprise-wide business analysis (across entire value chain) Access summary metrics or drill to lowest level of detail Accurate historical representations Service Customers Sales Marketing Distribution Finance HR / Workforce Operations Procurement Customers Suppliers

6 The Result From this : To this : -Fewer, larger database tables rather than many smaller ones -Same piece of data appearing in several locations -Reduces need for join paths -Structure is denormalized for performance

7 Best Practices in ETL

8 Administration Metadata Presentation Dashboards by Role Reports, Analysis / Analytic Workflows Metrics / KPIs Logical Model / Subject Areas Physical Map BI Server Direct Access to Source Data Data Warehouse / Data Model DAC Federated Data Sources SiebelOracleSAP R/3PSFTEDW Other ETL Load Process Staging Area Extraction Process DAC ETL Architecture – Best Practice Load Extract SAPPeopleSoft Source Independent Layer Staging Tables Source Dependent Extract OtherSiebelOLTPOracle Special Connect Special Connect SQL App Layer ABAP App Layer Data DataWarehouse Transform

9 Use of a ETL platform Limited programming – GUI interface Re-usable components Easy data lineage tracking (where did data come from?) Pseudo-documentation – fast ramp-up for new resources Can build, test & implement the data flows more quickly

10 ETL Framework – Best Practices Generates surrogate key Does lookups for descriptions of code fields Does data driven updates – inserts for new rows, updates for old rows Reject Capture Keep track of effective dates and maintain history as required Handles Deletes

11 Best Practices in Reporting

12 The Semantic Layer Administration Metadata BI Presentation Services Dashboards by Role Reports, Analysis / Analytic Workflows Direct Access to Source Data Data Warehouse / Data Model ETL Load Process Staging Area Extraction Process DAC Federated Data Sources SiebelOracleSAP R/3PSFTEDW Other Multi-layered Abstraction Separation of physical, logical and presentation layers Logical modeling builds upon complex physical data structures Logical model independent of physical data sources, i.e. same logical model can be remapped quickly to another data source Metrics / KPIs Aggregate navigation Prebuilt hierarchy drills and cross dimensional drills Metrics / KPIs Logical Model / Subject Areas Physical Map BI Server

Object Security What parts of the application can you see? Business Logic Object Security Object Security Presentation Layer Physical Layer Semantic Object Layer Controls access to Subject Areas, Tables and Columns in Presentation Layer Limits access to Dashboards, Reports and Web Folders Web Object Security

14 DW -BI Architecture – Best Practice Extension of DW Schema for extension columns, additional tables, external sources, aggregates, indices, etc. Extension of ETL for extension columns, descriptive flexfields, additional tables, external sources, etc. Additional derived metrics, custom drill paths, exposing extensions in physical, logical and presentation layer, etc. Additional dashboards and reports, guided and conditional navigations, iBots, etc. Level of Effort Degree of Customization Easy Moderate Intermediate Involved Dashboards & Reports Semantic Metadata Layer DW Schema ETL

15 For any sales queries, please contact