Maintenance of data warehouse

Slides:



Advertisements
Similar presentations
CHAPTER OBJECTIVE: NORMALIZATION THE SNOWFLAKE SCHEMA.
Advertisements

1 of 27 DA1241 Archive Companies Last updated: March-2004 DA1241 Archive Companies.
OVERVIEW TEAM5 SOFTWARE The TEAM5 software manages personnel and test data for personal ESD grounding devices. Test and personnel data may be viewed/reported.
BLM Data Quality. Purpose - after this course you will be able to… Describe why Data Quality matters Describe why Data Quality matters Define what is.
File Management Chapter 12. File Management File management system is considered part of the operating system Input to applications is by means of a file.
Managing Data Resources
Maintenance Modifying the data –Add records –Delete records –Update records Modifying the design –Add fields into tables –Remove fields from a table –Change.
Client/Server Databases and the Oracle 10g Relational Database
Distributed DBMSs A distributed database is a single logical database that is physically distributed to computers on a network. Homogeneous DDBMS has the.
Organizing Data & Information
BUSINESS DRIVEN TECHNOLOGY
Database Features Lecture 2. Desirable features in an information system Integrity Referential integrity Data independence Controlled redundancy Security.
Chapter 1 An Overview of Database Management. 1-2 Topics in this Chapter What is a Database System? What is a Database? Why Database? Data Independence.
Managing Data Resources. File Organization Terms and Concepts Bit: Smallest unit of data; binary digit (0,1) Byte: Group of bits that represents a single.
Data Warehousing: Defined and Its Applications Pete Johnson April 2002.
Managing Multi-User Databases AIMS 3710 R. Nakatsu.
1 DATABASE TECHNOLOGIES BUS Abdou Illia, Fall 2007 (Week 3, Tuesday 9/4/2007)
Database Systems – Data Warehousing
1 DATABASE TECHNOLOGIES BUS Abdou Illia, Fall 2012 (September 5, 2012)
6-1 DATABASE FUNDAMENTALS Information is everywhere in an organization Information is stored in databases –Database – maintains information about various.
Integrating and managing your Engaging Networks data Top ten data features.
Physical Database Design Chapter 6. Physical Design and implementation 1.Translate global logical data model for target DBMS  1.1Design base relations.
© 2007 by Prentice Hall 1 Introduction to databases.
I Information Systems Technology Ross Malaga 4 "Part I Understanding Information Systems Technology" Copyright © 2005 Prentice Hall, Inc. 4-1 DATABASE.
Discovering Computers Fundamentals Fifth Edition Chapter 9 Database Management.
Professor Michael J. Losacco CIS 1110 – Using Computers Database Management Chapter 9.
More about Databases. Data Entry through Forms Table View (Data sheet view) is useful for data entry of new records But sometimes customization would.
Storing Organizational Information - Databases
McGraw-Hill/Irwin © 2008 The McGraw-Hill Companies, All Rights Reserved Chapter 7 Storing Organizational Information - Databases.
Databases Shortfalls of file management systems Structure of a database Database administration Database Management system Hierarchical Databases Network.
Building Data and Document-Driven Decision Support Systems How do managers access and use large databases of historical and external facts?
6.1 © 2010 by Prentice Hall 6 Chapter Foundations of Business Intelligence: Databases and Information Management.
Access 2007 ® Use Databases How can Microsoft Access 2007 help you structure your database?
Microsoft Access 2013 ®® Tutorial 9 Using Action Queries and Advanced Table Relationships.
Maintaining a Database Access Project 3. 2 What is Database Maintenance ?  Maintaining a database means modifying the data to keep it up-to-date. This.
Data Staging Data Loading and Cleaning Marakas pg. 25 BCIS 4660 Spring 2012.
Data resource management
Week 7 : Chapter 7 Agenda SQL 710 Maintenance Plan:
Chapter 5 DATA WAREHOUSING Study Sections 5.2, 5.3, 5.5, Pages: & Snowflake schema.
Managing Data Resources. File Organization Terms and Concepts Bit: Smallest unit of data; binary digit (0,1) Byte: Group of bits that represents a single.
7 Strategies for Extracting, Transforming, and Loading.
June 08, 2011 How to design a DATA WAREHOUSE Linh Nguyen (Elly)
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 1 Database Systems.
SQL Basics Review Reviewing what we’ve learned so far…….
Data Resource Management Chapter 5 McGraw-Hill/IrwinCopyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved.
Managing Data Resources File Organization and databases for business information systems.
Practical Database Design and Tuning
You Inherited a Database Now What?
Managing Multi-User Databases
Client/Server Databases and the Oracle 10g Relational Database
Indexing Structures for Files and Physical Database Design
CIS 155 Table Relationship
Chapter 4 Relational Databases
Database Management  .
Databases A brief introduction….
What is a Database and Why Use One?
Basic Concepts in Data Management
MANAGING DATA RESOURCES
Database Vs. Data Warehouse
More about Databases.
Practical Database Design and Tuning
An Introduction to Data Warehousing
MANAGING DATA RESOURCES
Data warehouse.
The Database Environment
You Inherited a Database Now What?
DATABASE TECHNOLOGIES
Information Systems Development MIS331
Tutorial 9 Using Action Queries and Advanced Table Relationships
Database management systems
Presentation transcript:

Maintenance of data warehouse

How to Maintain a Data Warehouse Both databases and data warehouses consist of tables, indexes and keys, but unlike the former, warehouses are designed primarily to respond to critical analysis queries. Thus, maintaining a data warehouse requires a bit more work, including keeping the data very well organized, updating the warehouse to fit constantly changing business requirements and reviewing all updates with your entire staff. Though you are primarily responsible for the warehouse, remember that you are not the only one who will be using it.

How to Maintain a Data Warehouse Step 1 Periodically update the warehouse by removing extraneous data and duplicate entries, cleaning up redundant data and inconsistent relationships and defragging tables that are 30 percent or more fragmented.

How to Maintain a Data Warehouse Step 2 Keep the Web log lean and regularly delete summarized data, as over-congested logs will cause a reduction in performance speed. Back the data into an archive if you must maintain a historical record.

How to Maintain a Data Warehouse Step 3 Evaluate whether you must expand your warehouse every time you add new profile properties, as every database object can only contain a certain number of properties. The number differs based on the database software being used.

How to Maintain a Data Warehouse Step 4 Transform data by combining multiple fields into one field; breaking down data fields into separate fields based on year, month and day; mapping related data sets into a single representation; and applying surrogate keys to dimension table records.

How to Maintain a Data Warehouse Step 5 Keep users of the warehouse well-trained on how to create queries, access database structures and handle unexpected contingencies. Also, review all warehouse changes with staff members before applying them, because the changes might negatively affect a user's ability to acquire the information he needs.

How to Maintain a Data Warehouse Step 6 Update statistic files after you load new data rebuild an index. Also, run periodic updates either weekly or monthly. Keeping your statistic files updated will optimize query transactions, which in turn will enhance overall performance speed.