Care and Feeding of a Data Warehouse

Slides:

Advertisements

Similar presentations

WITHIN REACH – BEYOND IMAGINATION Selkirk College Management Information Systems.

Advertisements

1 Use or disclosure of data contained on this sheet is subject to the restriction on the title page of this proposal or quotation. An Introduction to Data.

Building a Better IT Support Model: Making Banner Work Presented by: Bill Balint, Indiana University of Pennsylvania.

Achieving Financial Integrity with Real Time GL & Project Inquiry.

Copyright Dickinson College This work is the intellectual property of the author. Permission is granted for this material to be shared for non-commercial,

1 Enterprise Information System Enhancement Major technology venture Replace university’s primary information systems Solution is Banner from SCT inc.

What is Management Reporting from a Data Warehouse and What Does It Have to Do with Institutional Research? Emily Thomas Stony Brook University AIRPO Winter.

Technology Steering Group January 31, 2007 Academic Affairs Technology Steering Group February 13, 2008.

Managing Data Resources

Multidimensional Database Structure

Seton Hall University Banner Project – June 2007 Update Banner Project Update to the Finance Committee of the Board of Regents June 6, 2007 Stephen Landry,

Mgt 240 Lecture Database Management Systems: Access and Corporate Databases February 22, 2005.

Components and Architecture CS 543 – Data Warehousing.

Data Warehousing Data Warehousing: A Definition “A data warehouse is a single integrated store of data which provides the infrastructural basis for informational.

Technology Steering Group January 31, 2007 Academic Affairs Technology Steering Group February 13, 2008.

Data Warehousing at Notre Dame October 7, 2004 Dale Carter, Manager, Decision Support Jared Barnard, Database Administrator.

UK’s Reporting Strategy SAP’s Business Warehouse (BW) is the long-term solution for reporting. Business Warehouse is a preferable over writing reports.

Oracle Database Administration. Rana Almurshed 2 course objective After completing this course you should be able to: install, create and administrate.

Data Warehousing: Defined and Its Applications Pete Johnson April 2002.

Data Management Capabilities and Past Performance Dr. Srinivas Kankanahalli.

SOA & BPM Business Architecture, SOA & BPM Learn about SOA and Business Process Management (BPM) Learn how to build process diagrams.

National Finance Center’s 2008 Customer Forum EmpowHR 9.0 Billy Dantagnan Teracore.

Data Conversion to a Data warehouse Presented By Sanjay Gunasekaran.

WELCOME good day Alexandru Doszlop

CHAPTER 1: THE DATABASE ENVIRONMENT AND DEVELOPMENT PROCESS Modern Database Management 11 th Edition Jeffrey A. Hoffer, V. Ramesh, Heikki Topi © 2013 Pearson.

McGraw-Hill/Irwin Copyright © 2011 The McGraw-Hill Companies, All Rights Reserved Chapter 14 Enterprise Resource Planning Systems.

Understanding Data Warehousing

Database Systems – Data Warehousing

1 Presenters: Lucretia Parham Janice Zeigler Armstrong Atlantic State University May 14 10:15 a.m. - 11:15 a.m. Presenters: Lucretia Parham Janice Zeigler.

Kris Biesinger Office of Information & Instructional Technology GUGM The Integrated Learning Environment.

Uniting Cultures, Technology & Applications A Case Study University of New Hampshire.

ETL Overview February 24, DS User Group - ETL - February ETL Overview “ETL is the heart and soul of business intelligence (BI).” -- TDWI ETL.

The Minnesota State Colleges and Universities system is an Equal Opportunity employer and educator. Information Technology Enterprise Strategic Investment.

Right In Time Presented By: Maria Baron Written By: Rajesh Gadodia

FORUM II Best Practices in Data Warehousing in Higher Education: A Framework for Higher Education Reporting April 18, 2005 Slide 1 Cornell University’s.

EIS Progress Report Executive Steering Committee Meeting February 4, 2009 (Revised) 10/22/20151.

1 Reviewing Data Warehouse Basics. Lessons 1.Reviewing Data Warehouse Basics 2.Defining the Business and Logical Models 3.Creating the Dimensional Model.

Data Administration Data Warehouse Implementation 9/25/01.

5 - 1 Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved.

Best Practices in Higher Education Student Data Warehousing Forum Northwestern University October 21-22, 2003 FIRST QUESTIONS Emily Thomas Stony Brook.

UI-Integrate Project Update UIC Faculty Senate Meeting March 17, 2005.

Datawarehouse A sneak preview. 2 Data Warehouse Approach An old idea with a new interest: Cheap Computing Power Special Purpose Hardware New Data Structures.

TCC's Next Generation Integration Challenges and Success Stories Dr. John Kontogianes – Executive VP and CAO Randy Dominguez – Dean of Distance Learning.

Data Staging Data Loading and Cleaning Marakas pg. 25 BCIS 4660 Spring 2012.

1 Presenters: Lucretia Parham Sara Connor Armstrong Atlantic State University October 30, :45 – 12:35 Copyright Sara Connor and Lucretia Parham,

Creating a Data Warehouse Data Acquisition: Extract, Transform, Load Extraction Process of identifying and retrieving a set of data from the operational.

7 Strategies for Extracting, Transforming, and Loading.

A Unified Digital Campus: Marshall University’s Solution Presented by: Terri L. Tomblin-Byrd Bradley Morgan.

Oracle’s EPM System and Strategy

1 Copyright © Oracle Corporation, All rights reserved. Business Intelligence and Data Warehousing.

MBA/1092/10 MBA/1093/10 MBA/1095/10 MBA/1114/10 MBA/1115/10.

Data Warehouse – Your Key to Success. Data Warehouse A data warehouse is a  subject-oriented  Integrated  Time-variant  Non-volatile  Restructure.

C Copyright © 2007, Oracle. All rights reserved. Introduction to Data Warehousing Fundamentals.

2 Copyright © 2006, Oracle. All rights reserved. Defining Data Warehouse Concepts and Terminology.

1 Copyright © 2007, Oracle. All rights reserved. Installing and Setting Up the Warehouse Builder Environment.

Data Mining and Data Warehousing: Concepts and Techniques What is a Data Warehouse? Data Warehouse vs. other systems, OLTP vs. OLAP Conceptual Modeling.

Data Management Capabilities and Past Performance

Once Upon a Time: The Story of a Successful BI Implementation

Oracle Database Administration

Manajemen Data (2) PTI Pertemuan 6.

Data Warehouse.

OLAP Systems versus Statistical Databases

An Introduction to Data Warehousing

Purge-it! USP's, pre-sales process & helping the customer to decide

DAT381 Team Development with SQL Server 2005

Data Warehousing Concepts

Best Practices in Higher Education Student Data Warehousing Forum

David Gilmore & Richard Blevins Senior Consultants April 17th, 2012

Presentation transcript:

Care and Feeding of a Data Warehouse Mary Louise Powers Lehigh University

SCT Banner® Technical Environment All SCT Banner modules installed All ‘Web for’ products installed AIX/Unix, Oracle 8i Maintained by Enterprise Systems (ESI)

Project Background Request for a data warehouse from Institutional Research (IR) Strategic decision support Trend analysis Efficiency and accuracy Single institutional data source

Project Background Warehouse definition Time slice, Pre-defined events Strategic, not transactional Not a Data Mart for operational reporting Direct / indirect customers Data, not reports

Project Scope Design and implementation from Spring 2001 to Fall 2002 Graduation back to 1992 Enrollment/Registration from Fall 2001 Primary reporting source for IR

Design Focused on enrolled students, courses, graduation Reporting needs Business processes Technical interest in Dimensional Model and Star Schema

Star Schema

Design High level technical design Translated internal processes into schema Allowed for implementation of flat tables Stop gap measure Supporting data from Admissions & Financial Aid

Software Requirements Extraction, translations, cleansing Loading and warehouse table builds Creation of summary tables and views SCT Banner Executive-Self Service (WFE) Data Warehouse Executive Briefing Center Administrative interface

Production Environment Three databases SCT Banner Production “Stage” (copy of SCT Banner Production) Built from Banner export Provides “snapshot” of Banner at critical point in time – data is frozen Limited access Data Warehouse

Production Operations Enrollment / Registration / Graduation extracts Enrollment/Registration Events: 10th day census Midterm census Last day of class Close of term

Production Operations Pre-export audit reporting – SCT Banner production Export of SCT Banner production database Create Stage database from export (can be refreshed at any point in time)

Production Operations Pre-extract audit reporting – Stage Clean up of Stage database Synchronize of Stage and Banner corrections Archive corrected copy of Stage Audit trail Run warehouse maintenance process

Customizations / Enhancements Challenges Data quality Time involvement Getting accurate specifications Post Refresh Process

Administering / Managing Production Operations Manage events processing SCT Luminis 3 Portal – Calendar and task list Operations Who runs the warehouse Support and troubleshooting Security Request Tracking System

Technical Infrastructure maintenance Source code housekeeping Archiving processes WFE upgrade Oracle upgrades Optimize Stage database creation

Documentation Metadata Preliminary stage Quest Software - Toad ® Common Lehigh definitions

Documentation

Work in Progress You are never done Data retention requirements - TBD Data integrity issues Potential for implementation of other areas Changing business perspectives (New VP’s, etc)

Conclusion On going challenges Benefits Complexity of the system Timing and synchronization Lehigh’s data quality requirements Benefits Primary data source for IR Ease of use for historical reporting Stability of data

References Adamson, C. & Venerable, M. (1998) Data Warehouse Design Solutions. John Wiley & Sons, Inc. Dodge, G. & Gorman, T. (1998) Oracle8 Data Warehousing, A Hands on Guide to Designing, Building, and Managing Oracle Data Warehouses. John Wiley & Sons, Inc. Kimball, R. (1996) The Data Warehouse Toolkit. John Wiley & Sons, Inc.

Questions?