The Visibility Information Exchange Web System is a database system and set of online tools originally designed to support the Regional Haze Rule enacted.

Slides:



Advertisements
Similar presentations
ICIS-NPDES Plugin Design Preview Webinar ICIS-NPDES Full Batch OpenNode2 Plugin Project Presented by Bill Rensmith Windsor Solutions, Inc. 3/15/2012.
Advertisements

Components of GIS.
WRAP Technical Support System for Air Quality Planning, Tracking, & Decision Support Tom Moore | Shawn McClure Western Regional Air Partnership | Cooperative.
VIEWS / TSS Overview. End-to-end Air Quality Data and Decision Support VIEWS / TSS Vision Acquisition Import Unification Management Manipulation Retrieval.
Visibility Information Exchange Web System. Source Data Import Source Data Validation Database Rules Program Logic Storage RetrievalPresentation AnalysisInterpretation.
High-level VIEWS Architecture. Data Acquisition & Import Data Acquisition System: Accepts submission of data in a variety of schemas and formats Can automatically.
Integrated Decision Support: A Tale of Two Systems “It was the best of times, it was the worst of times…” Charles Dickens, A Tale of Two Cities, 1859 “Actually,
The Visibility Information Exchange Web System is a database system and set of online tools originally designed to support the Regional Haze Rule enacted.
Chapter 3 Database Management
Your Interactive Guide to the Digital World Discovering Computers 2012 Chapter 10 Managing a Database.
An Introduction to Dimensional Data Warehouse Design Presented by Joseph J. Sarna Jr. JJS Systems, LLC.
WRAP Technical Support System for Air Quality Planning, Tracking, & Decision Support Tom Moore, Western Regional Air Partnership, Western Governor’s Association.
16 months…. The Visibility Information Exchange Web System is a database system and set of online tools originally designed to support the Regional Haze.
Components and Architecture CS 543 – Data Warehousing.
The Visibility Information Exchange Web System (VIEWS): An Approach to Air Quality Data Management and Presentation In a broader sense, VIEWS facilitates.
Living in a Digital World Discovering Computers 2010.
VIEWS/TSS: An Integrated Systems Solution for Air Quality and Regional Haze Planning The Visibility Information Exchange Web System (VIEWS) is an online.
Data Warehouse success depends on metadata
Shawn McClure Software Engineer CIRA, Colorado State University Projects: Visibility Information Exchange Web.
MIS DATABASE SYSTEMS, DATA WAREHOUSES, AND DATA MARTS CHAPTER 3
1 © Prentice Hall, 2002 Chapter 11: Data Warehousing.
Tutorial 11: Connecting to External Data
Distributed Data Analysis & Dissemination System (D-DADS) Prepared by Stefan Falke Rudolf Husar Bret Schichtel June 2000.
M ODULE 5 Metadata, Tools, and Data Warehousing Section 4 Data Warehouse Administration 1 ITEC 450.
Data Conversion to a Data warehouse Presented By Sanjay Gunasekaran.
Basic Concepts of Datawarehousing An Overview Prasanth Gurram.
L/O/G/O Metadata Business Intelligence Erwin Moeyaert.
DATA WAREHOUSING IN SQL SERVER 2005/2008 BUSINESS INTELLIGENCE.
©Silberschatz, Korth and Sudarshan18.1Database System Concepts - 5 th Edition, Aug 26, 2005 Buzzword List OLTP – OnLine Transaction Processing (normalized,
Discovering Computers Fundamentals, 2012 Edition Your Interactive Guide to the Digital World.
Objectives Overview Define the term, database, and explain how a database interacts with data and information Define the term, data integrity, and describe.
Chapter 7: Database Systems Succeeding with Technology: Second Edition.
What is VIEWS? The Visibility Information Exchange Web System is an online system designed to acquire, manage, and provide access to data and metadata.
AN OVERVIEW OF DATA WAREHOUSING
Business Intelligence Zamaneh Jahed. What is Business Intelligence? Business Intelligence (BI) is a broad category of applications and technologies for.
Discovering Computers Fundamentals Fifth Edition Chapter 9 Database Management.
MIS DATABASE SYSTEMS, DATA WAREHOUSES, AND DATA MARTS CHAPTER 3
5-1 McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved.
MIS2502: Data Analytics The Information Architecture of an Organization.
5 - 1 Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved.
MANAGING DATA RESOURCES ~ pertemuan 7 ~ Oleh: Ir. Abdul Hayat, MTI.
WRAP Technical Support System for Air Quality Planning, Tracking, & Decision Support Tom Moore | Western Governors’ Association Shawn McClure | Cooperative.
13 1 Chapter 13 The Data Warehouse Database Systems: Design, Implementation, and Management, Seventh Edition, Rob and Coronel.
Sachin Goel (68) Manav Mudgal (69) Piyush Samsukha (76) Rachit Singhal (82) Richa Somvanshi (85) Sahar ( )
Building Dashboards SharePoint and Business Intelligence.
Creating a Data Warehouse Data Acquisition: Extract, Transform, Load Extraction Process of identifying and retrieving a set of data from the operational.
MGA Duplica Replication Tool. 1. High Availability and Avoidance of Data Loss  Replicate to alternate databases 2. Split activities across databases.
7 Strategies for Extracting, Transforming, and Loading.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
U.S. Environmental Protection Agency Central Data Exchange Pilot Project Promoting Geospatial Data Exchange Between EPA and State Partners. April 25, 2007.
The Need for Data Analysis 2 Managers track daily transactions to evaluate how the business is performing Strategies should be developed to meet organizational.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
An Overview of Data Warehousing and OLAP Technology
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
What is a database? (a supplement, not a substitute for Chapter 1…) some slides copied/modified from text Collection of Data? Data vs. information Example:
Management Information Systems by Prof. Park Kyung-Hye Chapter 7 (8th Week) Databases and Data Warehouses 07.
Data Mining and Data Warehousing: Concepts and Techniques What is a Data Warehouse? Data Warehouse vs. other systems, OLTP vs. OLAP Conceptual Modeling.
Intermountain West Data Warehouse - Western Air Quality Study
Jaclyn Hansberry MIS2502: Data Analytics The Things You Can Do With Data The Information Architecture of an Organization Jaclyn.
Shawn McClure, Rodger Ames and Doug Fox - CIRA
Chapter 13 Business Intelligence and Data Warehouses
Current and Future State of the IMPROVE Website
Chapter 13 The Data Warehouse
Data Warehouse.
MIS2502: Data Analytics The Information Architecture of an Organization Acknowledgement: David Schuff.
MIS2502: Data Analytics The Information Architecture of an Organization Aaron Zhi Cheng Acknowledgement:
VIEWS / TSS Overview.
Chapter 13 The Data Warehouse
Best Practices in Higher Education Student Data Warehousing Forum
David Gilmore & Richard Blevins Senior Consultants April 17th, 2012
Presentation transcript:

The Visibility Information Exchange Web System is a database system and set of online tools originally designed to support the Regional Haze Rule enacted by the EPA to reduce regional haze in national parks and wilderness areas. Web Address: Sponsor: Guiding Body: Location: Staff: Affiliations: Five EPA Regional Planning Organizations (RPOs) VIEWS Steering Committee Cooperative Institute for Research in the Atmosphere (CIRA), Colorado State University, Fort Collins, CO Scientists, researchers, and IT professionals Interagency Monitoring of Protected Visual Environments (IMPROVE) What is VIEWS?Some facts:  Provide easy online access to a wide variety of air quality data.  Provide online tools for exploring and analyzing this data.  Maintain a catalog of relevant air quality-related resources.  Facilitate the research and understanding of global air quality issues. What are some of its other goals?  Over 600 registered users  Over 200 organizations represented  Almost 100 countries represented  300+ unique hits a day  Linked to by over four dozen sites  Over 40 million records of air data  Dozens of monitoring networks  CSU Research Initiative Award  Uses the new Manifold GIS  Monitoring site photographs  Class I Area webcams  Visibility photographs  Visibility Grey Literature  Periodic Newsletter  Contour Maps  Trends Analysis  Air Mass Composition Analysis

VIEWS Architecture Overview2 Source Data Import Source Data Validation Database Rules Program Logic Storage RetrievalPresentation AnalysisInterpretation Transformation Back End Front End Import: Getting data into the system Validation: Ensuring data accuracy Storage: Managing data, backup, and archival Transformation: Sorting, joining, aggregating Retrieval: Getting the data out Presentation: Displaying the data Analysis: Making the data understandable Interpretation: Making the data usable

VIEWS Architecture Detail: Data Acquisition & Import Data Acquisition System: Accepts submission of data in a variety of schemas and formats Can automatically extract data from known online sources Uses database replication where possible Initially imports data and metadata “as-is” into the source database Data Import System: Extracts data from the source database Scrubs data and performs conversions Maps source metadata to integrated metadata Transforms the data into an integrated schema Verifies and validates imported data Loads data into the back-end OLTP system Metadata Import System: Facilitates the entry of new metadata Validates new metadata entries Detects overlap with existing metadata

VIEWS Architecture Detail (cont’d): Data Management OLTP: Functions as the “back-end” database Fully relational and in 3 rd normal form Used for data import, validation, and management Technologies: Microsoft SQL Server Data Warehouse Generation System: Extracts data from the OLTP De-normalizes and transforms data Loads data into the Data Warehouse Builds table indexes Archives “snapshots” of the database Technologies: VB, stored procedures Data Warehouse: Functions as the “front-end” database Uses a de-normalized “star schema” Used for querying and archiving data Automatically generated from the OLTP Technologies: Microsoft SQL Server

VIEWS Architecture Detail (cont’d): Data Backup, Restore, and Archival Backup and Restore System: Automatically and periodically backs-up critical VIEWS databases Restores database backups on demand Replication and Archival System: Vertically partitions the Data Warehouse by time period Takes a full “snapshot” of the data warehouse at regular intervals Creates a historical audit trail for verifying archive integrity

VIEWS Architecture Detail (cont’d): Data Presentation and Analysis

Author: Shawn McClure