09/12/2003CCAQS Data Management System1 Central California Air Quality Studies Data Management System Status Report to the Study Agency Policy Committee.

Slides:



Advertisements
Similar presentations
Logical and Physical Design of an Information System
Advertisements

HES Data Management Ari Haukijärvi. Planning of HES Data Management Purpose of the data management The data will be available for analysis The available.
Illinois Justice Network Portal Implementation Board Meeting February 11, 2004.
Space Missions Can Your Library Automation Software Do This? David Hook MDA
Fedora Users’ Conference Rutgers University May 14, 2005 Researching Fedora's Ability to Serve as a Preservation System for Electronic University Records.
1 Improving Customer Service Through Electronic Data Management & Paperless Data Delivery ~~~~~ The USEPA Region 2 Experience Linda M. Mauel Chief, Hazardous.
Lifecycle Quality Management With the QDM System.
Data Dictionary What does “Backordered item” mean? What does “New Customer info.” contain? How does the “account receivable report” look like?
SYSTEM ANALYSIS & DESIGN (DCT 2013)
U.S. IOOS ® Requirements Marketplace? March 8, 2013 Carl Gouldman, Debra Hernandez 1.
Local Area Networks Outline –Basic Components of a LAN –Network Architectures –Topologies and LAN Technologies –Selecting a LAN –Improving LAN Performance.
INREM. Purpose “ To provide a central point from which information, in a standard format, relating to incidents at inland water locations can be obtained.
Standardization of Data A Pragmatic View for a Complex Process Forum on e-Business Interoperability and Standardization May 14, 2004 C.K. Wong iASPEC Technologies.
Library Link Victoria Cathy Quinn Mildura Rural City Council Library Service Michael Graf Port Phillip Library Service.
Evaluation of Reference Services Dr. Dania Bilal IS 530 Fall 2005.
CGI Programming: Part 1. What is CGI? CGI = Common Gateway Interface Provides a standardized way for web browsers to: –Call programs on a server. –Pass.
Software Development Unit 2 Databases What is a database? A collection of data organised in a manner that allows access, retrieval and use of that data.
PCARSS: Transfers of Accountability
Information and Data What’s the difference between two? Information systems = hardware and software working together… It will take DATA that has been put.
Case Studies: Statistics Canada (WP 11) Alice Born Statistics UNECE Workshop on Statistical Metadata.
Development of a Comprehensive Agricultural - Air Pollution Issues Research Program A discussion item for the Policy Committee Recommended by the San Joaquin.
MAHI Research Database Data Validation System Software Prototype Demonstration September 18, 2001
SAINT ‘01 Proactive DNS Caching: Addressing a Performance Bottleneck Edith Cohen AT&T Labs-Research Haim Kaplan Tel-Aviv University.
November 27, 2007Pebble Project Agency Meetings Pebble Project Data Management Data Management Responsibilities Ensure complete and accurate field and.
GDT V5 Web Services. GDT V5 Web Services Doug Evans and Detlef Lexut GDT 2008 International User Conference August 10 – 13  Lake Las Vegas, Nevada GDT.
Statistics Canada’s Real Time Remote Access Solution 2011 MSIS Meeting – Karen Doherty May 2011.
Documenting the Participation of Fishing Vessel Crew Members in Alaska’s Commercial Fisheries Documenting the Participation of Fishing Vessel Crew Members.
2/6/01D-1 © 2001 T. Horton CS 494 Object-Oriented Analysis & Design Using PARTS to Illustrate Requirements Concepts.
Digital Filing A Simple Way to Digitally Centralize and Distribute Documents.
GCSE Computing#BristolMet Session Objectives# 20 MUST describe a database and discuss the legal implications of storing personal information SHOULD explain.
HIGH INTENSITY DRUG TRAFFICKING AREA FINANCIAL MANAGEMENT DATABASE PROJECT.
Indexed content Migrate content Create links Content for future indexing.
National Database System The Australian Experience.
1 AARP Tax-Aide Activity Reporting In 2011 Prepared by AARP Foundation Edited for NY3 DC 2010.
Copyright © 2011 Pearson Education, Inc. Publishing as Prentice Hall Analyzing Systems Using Data Dictionaries Systems Analysis and Design, 8e Kendall.
1 Neil Wheeler, Kenneth Craig, and Clinton MacDonald Sonoma Technology, Inc. Petaluma, California Presented at the Sixth Annual Community Modeling and.
Evaluation of Reference Services Dr. Dania Bilal IS 530 Spring 2006.
Agenda  Records Retention Content Management Trends  Demonstration of Technology  Question and Answer Mark Weintraub Business Development Manager Image.
Using the Right Method to Collect Information IW233 Amanda Murphy.
Presented by Chris Allen Unified Program Technology Services Manager October 12, 2010
Quality Assurance Procedures for CCAQS Data Part 1 - QA of Field Measurement Data Part 2 - QA of Emissions Data.
LEADS/EMS DATA VALIDATION IPS MeteoStar December 11, 2006 WHAT IS VALIDATION? From The Dictionary: 1a. To Make Legally Valid 1b. To Grant Official.
Supplier Information Service Presented By: Cynthia Reichardt, Functional Sponsor, SIS Quality Leadership Forum July
Information Retrieval Transfer Cycle Dania Bilal IS 530 Fall 2007.
Central Data Repository introduction What does it do? Session I.
November 17, 2008Pebble Project Agency Meetings Pebble Project Data Management Data Management Responsibilities Ensure complete and accurate field and.
Air Resources Board California Environmental Protection Agency OZONE SIP MODELING and DATA ANALYSIS Policy Committee Meeting John DaMassa Saffet Tanrikulu.
U.S. Environmental Protection Agency Central Data Exchange Pilot Project Promoting Geospatial Data Exchange Between EPA and State Partners. April 25, 2007.
RiM Systems Inc. Recording Application Management.
Using the Exchange Network A User’s Perspective Deb Soule Watershed Management Bureau New Hampshire Department of Environmental Services.
The basics of knowing the difference CLIENT VS. SERVER.
CSC 2720 Building Web Applications Basic Frameworks for Building Dynamic Web Sites / Web Applications.
Towards Zero Copies Brian Alconcel, P.E. Chief, Office of Highway System Information & Performance CALIFORNIA DEPARTMENT OF TRANSPORTATION - CALTRANS.
Public Libraries Survey Data File Overview. What We’ll Talk About PLS: Public Libraries Survey State level data Public library data (Administrative Entities)
Public Libraries Survey Data File Overview. 2 What We’ll Talk About PLS: Public Library Survey State level data Public library data (Administrative Entities)
1 1. Systems and Software Development 1.1 The Systems Life Cycle.
Designing a Comprehensive Laserfiche System PP104 Steve Tivedt, The Insco Dico Group.
Air Resources Board California Environmental Protection Agency CCOS STATUS REPORT Policy Committee Meeting Saffet Tanrikulu, Ph.D. October 25, 2002.
IT Audit for non-IT auditors Cornell Dover Assistant Auditor General 31 March 2013.
BP/ARCO GeoTracker User Experiences California CUPA Form February 2002.
Database System Concepts and Architecture
The Transportation Information Gateway An Open Source Web Platform for Collaboration in the Planning Process AMPO 2017 Annual Meeting Brian ten Siethoff,
“What do I do ?”, “How do I do it ?”, What do I do it with ?
Chapter 12: Automated data collection methods
Systems Design, Implementation, and Operation
JavaScript Form Validation
To access bill pay site go to biller specific URL
Data Groupings: File File: a group of related records
Chapter 22, Part
Lecture 23 CS 507.
Presentation transcript:

09/12/2003CCAQS Data Management System1 Central California Air Quality Studies Data Management System Status Report to the Study Agency Policy Committee Sept. 12, 2003

09/12/2003CCAQS Data Management System 2 Database Contents CCOS Records CRPAQS Records CCOS 97 % of data available SIP Support CRPAQS 90 % of data available Data Analysis Support Outstanding Issues Current Status

09/12/2003CCAQS Data Management System 3 Remote Data Access Very Important Most Frequently Missing Data… e.g. Documentation & “Supporting Information” Consequences: Supporting data become unavailable Results in questionable data points Post Field Study Documentation Difficult Value Associated Loss of Value $ / Record Design Based on Past Experience

09/12/2003CCAQS Data Management System 4 System to Store All Valuable Info: “Place” for Everything Collected e.g. Instruments & Methods (Field or Lab) Rigid Data Submittal Standards Collect Info Up Front in Field Data Submittals Screen Incoming Files Automate Quality Assurance Automate Data Validation from Analysts Address User Needs Up Front Bring User Input Into Design Phase Limit Standard Output Formats Allow Ad-Hoc Requests via Web Interface “Value-Based Design”

09/12/2003CCAQS Data Management System 5 “Methods & Instruments” Example of Relational Database

09/12/2003CCAQS Data Management System 6 File Structures & Internal Processing File Structures & Internal Processing Data Input Data Output Data Processing

09/12/2003CCAQS Data Management System 7 CCAQS vs. SARMAP CCAQSSARMAP Data Sources1611 # Records130 Million4-5 Million # Days43060 Challenges

09/12/2003CCAQS Data Management System 8 Standards Standards Development Required Iterative Process Input – Data Submittal From Contractors Data Processing Output – Data Delivery to Clients More Time and Effort Than Anticipated BenefitSponsors Will Realize Maximum Value for Data Analysis and Modeling Purposes Benefit - Sponsors Will Realize Maximum Value for Data Analysis and Modeling Purposes Challenges

09/12/2003CCAQS Data Management System 9