3SAQS Technical Workshop April 30 th, 2015 Data Warehouse Current and Future Development Intermountain West Data Warehouse.

Slides:



Advertisements
Similar presentations
ASIAES Project Overview Satellite Image Network for Natural Hazard Management in ASEAN+3 region Pakorn Apaphant Geo-Informatics and Space Technology Development.
Advertisements

Three-State Air Quality Study (3SAQS) Three-State Data Warehouse (3SDW) 3SAQS Response-to-Comments on 2011 Modeling Protocol University of North Carolina.
WRAP Technical Support System for Air Quality Planning, Tracking, & Decision Support Tom Moore | Shawn McClure Western Regional Air Partnership | Cooperative.
Three-State Air Quality Study (3SAQS) Three-State Data Warehouse (3SDW) 3SAQS Revised 2011 Modeling Protocol Reflecting Reviewer Comments University of.
An Update on the Activities of the Western Regional Air Partnership ‘WRAP v2.0’ Robert Kotchenruther, Ph.D. NW-AIRQUEST June, 2011.
Attribution of Haze Phase 2 and Technical Support System Project Update AoH Meeting – San Francisco, CA September 14/15, 2005 Joe Adlhoch - Air Resource.
Three-State Air Quality Study (3SAQS) Three-State Data Warehouse (3SDW) 3SAQS Technical Scope of Work: Tom Moore, WESTAR/WRAP on behalf of University.
Technical Support System Review / / RPO Monitoring/Data Analysis Workgroup Conference.
TSS Project Update WRAP Technical Analysis Forum San Francisco, CA October 11, 2007.
WRAP Technical Support System for Air Quality Planning, Tracking, & Decision Support Tom Moore, Western Regional Air Partnership, Western Governor’s Association.
16 months…. The Visibility Information Exchange Web System is a database system and set of online tools originally designed to support the Regional Haze.
Technical Support System Review Board Meeting March 8, 2007.
Proposal Outline: Extensions to the VIEWS: General CATT Analysis Tool R. Husar, CAPITA Revised, June 26, 2003 Proposed Sub-Projects CATT for VIEWS$20k.
Stefan Falke Center for Air Pollution Impact and Trend Analysis Washington University in St. Louis Networked Data and Tools for Environmental Management.
Western Air Quality Data Warehouse Website Development, Documents, Projects 3SAQS Technical Workshop, CIRA, Fort Collins, CO Feb 25, 2015.
3SAQS Data Warehouse Update October 10, 2014 CIRA - Fort Collins, CO.
WRAP Technical Support System Project Update AoH Call October 19, 2005.
1 Alternate Title Slide: Presentation Name Goes Here Presenter’s Name Infrastructure Solutions Division Date GIS Perfct Ltd. Autodesk Value Added Reseller.
ArcGIS Workflow Manager An Introduction
Three State Data Warehouse Tom Moore Shawn McClure, Rodger Ames, Dustin Schmidt
AIRNow-International The future of the United States real-time air quality reporting and forecasting program and GEOSS participation John E. White U.S.
WRAP Decision and Data Support Systems Tom Moore | Western Governors’ Association Shawn McClure | Cooperative Institute for Research in the Atmosphere.
U.S. Environmental Protection Agency WATERS Status Update
Western Air Quality Study (WAQS) Intermountain Data Warehouse (IWDW) WAQS-IWDW Tool Development Workgroup Webinar - Sept. 2, 2015.
Modeling Studies of Air Quality in the Four Corners Region National Park Service U.S. Department of the Interior Cooperative Institute for Research in.
3SAQS Technical Committee Workshop Overview of updated schedule / deliverables related to ongoing 3SAQS technical work October 31, 2013 Tom Moore.
Enterprise GIS Planning and Framework Jennifer Reek GIS Coordinator City of Brookfield, WI.
Three State Data Warehouse 1 Cassie Archuleta Shawn McClure Tom Moore June 20,
2004 Workplan WRAP Regional Modeling Center Prepared by: Gail Tonnesen, University of California Riverside Ralph Morris, ENVIRON Corporation Zac Adelman,
TSS Project Update WRAP Technical Analysis Forum San Francisco, CA October 11, 2007.
November 7, 2013 WRAP Membership Meeting Denver, CO Tom Moore WRAP Air Quality Program Manager WESTAR Council.
Three State Data Warehouse 1 Cassie Archuleta Tom Moore May 6, 2014 Progress Update for 3SDW Development.
Western Air Quality Study (WAQS) Intermountain West Data Warehouse (IWDW) Revisions to WAQS Phase 2 SoW: September 2015 – March 2016 University of North.
Ideas on a Network Evaluation and Design System Prepared for EPA OAQPS Richard Scheffe by Rudolf B. Husar and Stefan R. Falke Center for Air Pollution.
AoH/MF Meeting, San Diego, CA, Jan 25, 2006 Source Apportionment Modeling Results and RMC Status report Gail Tonnesen, Zion Wang, Mohammad Omary, Chao-Jung.
3SAQS Technical Workshop February 25 th, 2015 Data Warehouse Current and Future Development Intermountain West Data Warehouse.
WRAP Update WESTAR Meeting San Francisco April 25, 2011.
IMPROVE Newsletter and Calendar Gloria Mercer Air Resource Specialists, Inc Sharp Point Drive, Suite E Fort Collins, Colorado /
An Integrated Systems Solution to Air Quality Data and Decision Support on the Web GEO Architecture Implementation Pilot – Phase 2 (AIP-2) Kickoff Workshop.
WRAP Technical Support System for Air Quality Planning, Tracking, & Decision Support Tom Moore | Western Governors’ Association Shawn McClure | Cooperative.
Three-State Air Quality Study (3SAQS) Three-State Data Warehouse (3SDW) Status of 3SAQS Air Quality and Emissions Modeling University of North Carolina.
Impacts of MOVES2014 On-Road Mobile Emissions on Air Quality Simulations of the Western U.S. Z. Adelman, M. Omary, D. Yang UNC – Institute for the Environment.
User Working Group 2013 Data Access Mechanisms – Status 12 March 2013
WRAP Workshop July 29-30, 2008 Potential Future Regional Modeling Center Cumulative Analysis Ralph Morris ENVIRON International Corporation Novato, California.
Three-State Air Quality Study (3SAQS) Three-State Data Warehouse (3SDW) 3SAQS Phase II -- Task Source Apportionment Modeling Study Design University.
TSS Database Inventory. CIRA has… Received and imported the 2002 and 2018 modeling data Decided to initially store only IMPROVE site-specific data Decided.
Three-State Air Quality Study (3SAQS) Three-State Data Warehouse (3SDW) 3SAQS/3SDW Progress Review to the 3SAQS Technical Committee University of North.
IWDW-WAQS Technical Committee Status Call, December IWDW Update IWDW-WAQS Technical Committee Status Call.
May 23, 2013 Don Arkell WESTAR Staff WESTAR Council Meeting Tom Moore Air Quality Program Manager Western Governors’ Association.
TSS Project Update WRAP Technical Analysis Forum Boise, ID May 22, 2007.
Western Regional Technical Air Quality Studies: support for Ozone and other Air Quality Planning in the West Tom Moore Air Quality Program Manager Western.
WRAP Activities Overview §308 Technical Work Outline June 3, 2003.
Intermountain West Data Warehouse Update WAQS Technical Committee WAQS Technical Committee Call, July 23, 2015.
Application of NASA ESE Data and Tools to Particulate Air Quality Management A proposal to NASA Earth Science REASoN Solicitation CAN-02-OES-01 REASoN:
Technical Support System Review Board Meeting March 8, 2007.
Key Findings from May & July 2008 WRAP Technical Workshops September 30, 2008 Steve Arnold, Colorado DPHE & Bob Kotchenruther, EPA R10 (Co-Chairs, WRAP.
Reaching New Heights Tools and Data for air quality planning in the Intermountain West Intermountain West Data Warehouse Presenter: Agency: Contact Information:
The Bear River Watershed Information System Jeffery S. Horsburgh Utah Water Research Laboratory Utah State University David.
3SAQS Data Warehouse Update September 30, 2014 CIRA - Fort Collins, CO.
TSS Scoping Study Results AoH Meeting – Tempe, AZ November 16/17, 2005.
Intermountain West Data Warehouse
Intermountain West Data Warehouse - Western Air Quality Study
Western Regional Technical Projects 2011 through 2013
Current and Future State of the IMPROVE Website
IWDW-WAQS Technical Committee Status Call
Intermountain West Data Warehouse
Regional Haze Planning Work Group
3SDW Non-NEPA Request Form
WRAP Modeling Forum, San Diego
WSAQDW planning documents
Presentation transcript:

3SAQS Technical Workshop April 30 th, 2015 Data Warehouse Current and Future Development Intermountain West Data Warehouse

Outline Update - DW Overview & Development Data Request Status Visualization tools – Image browser linklink – Model-to-obs tooltool – Emissions review tooltool – Dynamic Geospatial Model visualization tooltool – ENVIRON Source Apportionment tool ENVIRON site ENVIRON site Functionality Data Request Form Prototype data selection form Category Management Inventory Management Forum & notifications Forum Wrap-up and action items 3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015

Outline Update - DW Overview & Development Data Request Status Visualization tools – Image browser linklink – Model-to-obs tooltool – Emissions review tooltool – Dynamic Geospatial Model visualization tooltool – ENVIRON Source Apportionment tool ENVIRON site ENVIRON site Functionality Data Request Form Prototype data selection form Category Management Inventory Management Forum & notifications Forum Wrap-up and action items 3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015

IWDW Overview

3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015 IWDW Overview

DW Development Update Project Management – Q Data Requests; Inventory Management; Data Delivery Documentation Data & Information Management – Q through 2016 Visualization tool development (modeling I/O & analysis) Modeling platform review Expanded documentation and “easy-to-reference” information 3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015

Outline Update - DW Overview & Development Data Request Status Visualization tools – Image browser linklink – Model-to-obs tooltool – Emissions review tooltool – Dynamic Geospatial Model visualization tooltool – ENVIRON Source Apportionment tool ENVIRON site ENVIRON site Functionality Data Request Form Prototype data selection form Category Management Inventory Management Forum & notifications Forum Wrap-up and action items 3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015

Data Request Summary – pg. 1 RequestRequestorData Supporting Docs Request Submitted 3-State Steward Action Direct Interest Studies for WSAQS Cooperators Methane/VOC Control Sensitivity Study Tammy Thompson CIRA 2008 EmissionsScope of WorkYes Emissions Inventory Data Summary for 2008 Tammy Thompson CIRA 2008 EmissionsNoneYesMike Barna Filled 4/24/2015 Source Apportionment Modeling for Nitrogen in Greater Yellowstone Area (GYA) Tammy Thompson CIRA 2011 Emissions (unreleased) Project PlanYesMike Barna National Park AQRV Todd McDonnell E&S Environmental Chemistry 2011 Emissions (unreleased) NoneYes Routes to Sustainability for Natural Gas Development and Water and Air Resources in the Rocky Mountain Region - Sensitivity Analysis Shannon Capps University of Colorado, Boulder 2008b Base year Platform (partial) Modeling Protocol and Timeline Yes Kevin Briggs Filled 4/24/2015 Comparison of source contributions to nitrogen deposition at Class 1&2 areas in the Western U.S. Tammy Thompson CIRA 2008b Emissions and CAMx inputs NoneNo WRAP TSS Emission Tool Updates – 2011a emissions displays Cassie Archuleta Air Resource Specialists 2011a Emissions (unreleased) NoneNoTom Moore Inventory--categories and methodology consistent with previous WRAP inventories for regional haze from 2004 and 2008 (reasonable progress) Daniel Bon CDPHE 2008b Base year Platform None (may be taken care under Archuleta request above) YesTom Moore Will fulfill via TSS after update w/2011 emissions

Data Request Summary – pg. 2 RequestRequestorData Supporting Docs Request Submitted 3-State Steward Action NEPA Studies Hiawatha Regional Energy Development Project (HREDP) Environmental Impact Statement Ralph Morris ENVIRON 2008b NEPA Platform NoneNoCharis Tuers Converse County Development Environmental Impact Statement (EIS) Chao-Jung Chien AECOM 2008b NEPA Platform NoneYes Ryan McCammon Fulfilled 3/18/2015 Outside Requests (applicability to WSAQS Cooperators not clear) Colorado Oil and Gas Sensitivity Analyses James Wilkinson Golder Associates Inc. 2008b NEPA Platform NoneYes Update of a USFS Fire handbook Suresh Ratnam University of Southern California Base2020_08aNoneNo Improving Ozone modeling in Uintah Basin Huy Tran Utah State University 2008b Emissions and utilities None Yes incomplete Analysis of FRAPPÉ and DISCOVER- AQ 2014 campaigns Gabriele Pfister NCAR 2011a Emissions and utilities (unreleased) NoneYes

Responding to Data Requests Process needs for operating the Data Warehouse noted so far: – the identities, roles, and responsibilities of cooperating agency “stewards” need to be clarified – the necessary level of documentation and applicability to the overall goals of the cooperators; and – the form of a “release” of a platform and its component data, including the associated use recommendation.

Pending Project Proposals with no data requests Information or Data Request Proposal RequestorStart DateData Request Submitted Fulfillment ApproachAction Emissions QA 2011 Base A Gail Tonnesen EPA Region 8 10/1/2014NoneNoInternal project report completed Ozone spatial plots for 2011 MPE Gail Tonnesen EPA Region 8 10/16/2014NoneNo Display capability on DW in development PEM integration with SMOKE/CMAQ Private consultant11/11/2014NoneNoCancelled 2011a Modeling SensitivitiesZac Adelman UNC-IE9/1/2014NoneNo Conducted as internal DW modeling study analysis PMDETAILRalph Morris ENVIRON12/1/2014NoneNo Pending, will utilize files from DW and PMDETAIL project 2020 Future Case Sensitivity Mike Barna National Park Service, Air Resource Division 1/23/2015NoneNoPending

Outline Update - DW Overview & Development Data Request Status Visualization tools – Image browser linklink – Model-to-obs tooltool – Emissions review tooltool – Dynamic Geospatial Model visualization tooltool – ENVIRON Source Apportionment tool ENVIRON site ENVIRON site Functionality Data Request Form Prototype data selection form Category Management Inventory Management Forum & notifications Forum Wrap-up and action items 3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015

Image Browser Displays large image sets delivered by data provider Possible Next Steps – Improve navigation (fewer mouse clicks) – Display meta data – Browse multiple image sets side by side

Model-To-Obs Tool Compare model values to observed values by network Possible Next Steps – Platform selection – Additional filtering capabilities

Emissions Review Tool View modeled emissions by source category, state, county, and SCC Possible Next steps – Refactor data base to correctly label and aggregate parameters and source categories – Expand SCC visualization capabilities

Dynamic Geospatial Model Visualization Displays model output data with overlaid monitor data

Dynamic Geospatial Model Visualization ArcSDE (Spatial Database Engine) with SQL Server – Stores/Serves rasters of model data – Stores/Serves raster attributes – Data can be accessed remotely by ArcGIS users ArcServer – Provides web services which render data stored in SDE – Web Services consumed by web applications such as the data warehouse

Dynamic Geospatial Model Visualization Advantages – Map Projection – Uniform color scale – Monitor data overlay – Ease of combining multiple features – Sharing data with other GIS users

Dynamic Geospatial Model Visualization Disadvantages – More Pre-processing – Data duplication – Infrastructure heavy (ArcServer, ArcSDE)

Dynamic Geospatial Model Visualization Possible Next steps – Parameterize, platform, species, layer, time window – Additional Monitor data – Additional features Cities Roads – Automate preprocessing, execute on demand

Source Apportionment Tool Developments/Status Received prototype from Environ Database up and running Possible Next steps Deploy prototype user interface on CIRA systems Integrate user interface with main warehouse system Integrate database with main warehouse DB Automate data ingestion

Outline Update - DW Overview & Development Data Request Status Visualization tools – Image browser linklink – Model-to-obs tooltool – Emissions review tooltool – Dynamic Geospatial Model visualization tooltool – ENVIRON Source Apportionment tool ENVIRON site ENVIRON site Functionality Data Request Form Prototype data selection form Category Management Inventory Management Forum & notifications Forum Wrap-up and action items 3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015

Data Request Form Automated FTP fulfillment – One click FTP user creation and data access – Create/Update FTP user account – Enable FTP access to requested data without duplication of data – Two Successful deliveries via FTP – Image Browser uses FTP fulfillment to serve images

Data Request Form Component Selection – Flattened tree – More descriptive information – Alternative to category tree

Data Request Form Possible Next Steps – Integrate component selection with request form – Possibly separate project proposal from data request – Continue to evolve approval and stewardship policies and procedures – Integrate data release status and/or evaluation level – Notification clean-up

Category Management Create/Remove/Edit – Data Categories – File Items in category – Meta Data Browse file system Data Management Reports – Missing data Possible Next steps – Additional reporting as needed – Better display of category/file meta data parameters – File/Category history

Inventory Management MD5 checksums stored in relational database History of file meta data – file size – mod time – checksum Data Recovery tool Next Steps – Incorporate detailed meta data scraper – Automation of Checksum computation – Reporting Report changes to data requestors File level data status

Forum & Notifications

Outline Update - DW Overview & Development Data Request Status Visualization tools – Image browser linklink – Model-to-obs tooltool – Emissions review tooltool – Dynamic Geospatial Model visualization tooltool – ENVIRON Source Apportionment tool ENVIRON site ENVIRON site Functionality Data Request Form Prototype data selection form Category Management Inventory Management Forum & notifications Forum Wrap-up and action items 3SAQS Technical Workshop, CIRA, Fort Collins, CO April 30, 2015