Intermountain West Data Warehouse

Slides:



Advertisements
Similar presentations
WRAP Technical Support System for Air Quality Planning, Tracking, & Decision Support Tom Moore | Shawn McClure Western Regional Air Partnership | Cooperative.
Advertisements

Uinta Basin Air Quality Study Kathleen Sgamma. Topics Covered  Background  Purpose  Timelines  Project Details  WRAP Phase III Oil & Gas Emissions.
An Update on the Activities of the Western Regional Air Partnership ‘WRAP v2.0’ Robert Kotchenruther, Ph.D. NW-AIRQUEST June, 2011.
Three-State Air Quality Study (3SAQS) Three-State Data Warehouse (3SDW) 3SAQS Technical Scope of Work: Tom Moore, WESTAR/WRAP on behalf of University.
Three-State Air Quality Study (3SAQS) Three-State Data Warehouse (3SDW) 2008 CAMx Modeling Model Performance Evaluation Summary University of North Carolina.
Integrated Decision Support: A Tale of Two Systems “It was the best of times, it was the worst of times…” Charles Dickens, A Tale of Two Cities, 1859 “Actually,
Technical Support System Review / / RPO Monitoring/Data Analysis Workgroup Conference.
WRAP Technical Support System for Air Quality Planning, Tracking, & Decision Support Tom Moore, Western Regional Air Partnership, Western Governor’s Association.
Technical Support System Review Board Meeting March 8, 2007.
Improving an Air Quality Decision Support System through the Integration of Satellite Data with Ground-based, Modeled, and Emissions Data NASA ROSES 2007:
Western Air Quality Data Warehouse Website Development, Documents, Projects 3SAQS Technical Workshop, CIRA, Fort Collins, CO Feb 25, 2015.
3SAQS Data Warehouse Update October 10, 2014 CIRA - Fort Collins, CO.
Issues on Ozone Planning in the Western United States Prepared by the WESTAR Planning Committee for the Fall Business Meeting, Tempe, AZ October 31, 2011.
West-wide Jumpstart Air Quality Modeling Study Modeling Results November 7, 2013 Technical Project Team ENVIRON, Alpine Geophysics, Univ. of North Carolina.
Three State Data Warehouse Tom Moore Shawn McClure, Rodger Ames, Dustin Schmidt
Three-State Air Quality Study (3SAQS) Three-State Data Warehouse (3SDW) 3SAQS 2015 Scope of Work University of North Carolina (UNC-IE) ENVIRON International.
Western Air Quality Study (WAQS) Intermountain Data Warehouse (IWDW) WAQS-IWDW Tool Development Workgroup Webinar - Sept. 2, 2015.
3SAQS Technical Committee Workshop Overview of updated schedule / deliverables related to ongoing 3SAQS technical work October 31, 2013 Tom Moore.
Deterministic and Empirical Assessment of Smoke’s Contribution to Ozone (DEASCO 3 ) Project WESTAR-EPA Wildfire and Ozone Exceptional Events Meeting Tom.
November 7, 2013 WRAP Membership Meeting Denver, CO Tom Moore WRAP Air Quality Program Manager WESTAR Council.
Western Air Quality Study (WAQS) Intermountain West Data Warehouse (IWDW) Revisions to WAQS Phase 2 SoW: September 2015 – March 2016 University of North.
October 29, 2012 Tom Moore Air Quality Program Manager Western Governors’ Association WESTAR Council Meeting.
3SAQS Technical Workshop February 25 th, 2015 Data Warehouse Current and Future Development Intermountain West Data Warehouse.
WRAP Update WESTAR Meeting San Francisco April 25, 2011.
Response to WRAP Air Managers Committee Memo “Request for Cost Estimates” April 6, 2009 WESTAR Council.
October 8, 2014 Tom Moore WRAP Air Quality Program Manager WESTAR Council California Desert Air Working Group Pala, CA 1.
An Integrated Systems Solution to Air Quality Data and Decision Support on the Web GEO Architecture Implementation Pilot – Phase 2 (AIP-2) Kickoff Workshop.
Impacts of MOVES2014 On-Road Mobile Emissions on Air Quality Simulations of the Western U.S. Z. Adelman, M. Omary, D. Yang UNC – Institute for the Environment.
Western States Air Quality Study Background Air Quality Modeling University of North Carolina (UNC-IE) ENVIRON International Corporation (ENVIRON) May.
Utah Department of Environmental Quality Division of Air Quality Utah Department of Environmental Quality Division of Air Quality WRAP Technical Analysis.
WRAP Workshop July 29-30, 2008 Potential Future Regional Modeling Center Cumulative Analysis Ralph Morris ENVIRON International Corporation Novato, California.
Three-State Air Quality Study (3SAQS) Three-State Data Warehouse (3SDW) 3SAQS Phase II -- Task Source Apportionment Modeling Study Design University.
Three-State Air Quality Study (3SAQS) Three-State Data Warehouse (3SDW) 3SAQS/3SDW Progress Review to the 3SAQS Technical Committee University of North.
Three-State Air Quality Study (3SAQS) Three-State Data Warehouse (3SDW) 3SAQS Pilot Project Modeling Overview University of North Carolina (UNC-IE) ENVIRON.
IWDW-WAQS Technical Committee Status Call, December IWDW Update IWDW-WAQS Technical Committee Status Call.
May 23, 2013 Don Arkell WESTAR Staff WESTAR Council Meeting Tom Moore Air Quality Program Manager Western Governors’ Association.
Western Regional Technical Air Quality Studies: support for Ozone and other Air Quality Planning in the West Tom Moore Air Quality Program Manager Western.
Intermountain West Data Warehouse Update WAQS Technical Committee WAQS Technical Committee Call, July 23, 2015.
Technical Support System Review Board Meeting March 8, 2007.
April 17, 2012 Tom Moore Air Quality Program Manager Western Governors’ Association WESTAR Council Meeting.
Key Findings from May & July 2008 WRAP Technical Workshops September 30, 2008 Steve Arnold, Colorado DPHE & Bob Kotchenruther, EPA R10 (Co-Chairs, WRAP.
Federal Land Manager Environmental Database (FED) Overview and Update June 6, 2011 Shawn McClure.
Reaching New Heights Tools and Data for air quality planning in the Intermountain West Intermountain West Data Warehouse Presenter: Agency: Contact Information:
3SAQS Data Warehouse Update September 30, 2014 CIRA - Fort Collins, CO.
Tom Moore – WESTAR-WRAP
Intermountain West Data Warehouse - Western Air Quality Study
Shawn McClure, Rodger Ames and Doug Fox - CIRA
Western Regional Technical Projects 2011 through 2013
IWDW-WAQS Technical Committee
Aerosol & Atmospheric Optics: Visual Air Quality and Radiation
Alternative title slide
Intermountain West Data Warehouse – Western Air Quality Study (IWDW-WAQS) A Web System Application Framework for use of Remote Sensing Obs in Air Quality.
Current and Future State of the IMPROVE Website
Dissemination of Haze Data, Data Products and Information
Federal Land Manager Environmental Database (FED)
IWDW-WAQS Technical Committee Status Call
WRAP Regional Haze Planning Workgroup (RHPWG)
Western Air Quality Study (WAQS) Intermountain Data Warehouse (IWDW)
WAQS Monitoring Network Assessment
Regional Haze Planning Work Group
Tom Moore (WESTAR and WRAP) and Pat Brewer (NPS ARD)
Upcoming projects* to support Regional Haze SIP/TIP planning
Issues on Ozone Planning in the Western United States
Overview of WRAP 2014 Platform develop and Shake-Out project update
Tribal Data WG Fire and Smoke WG Oil and Gas WG
timeframe in to be determined
Tribal Data WG Fire and Smoke WG Oil and Gas WG
Tribal Data WG Fire and Smoke WG Oil and Gas WG
Tribal Data WG Fire and Smoke WG Oil and Gas WG
WSAQDW planning documents
Presentation transcript:

Intermountain West Data Warehouse http://views.cira.colostate.edu/tsdw Introduction and Overview for WRAP Tribal Data Work Group and Regional Technical Operations Work Group July 20, 2017 today’s presenters: Shawn McClure Rodger Ames Tom Moore Zac Adelman

Presentation Outline IWDW Introduction - Concept, Motivations, and Objectives (Tom) IWDW Overview (Shawn) The “System of Systems” approach Warehouse ecosystem and architecture Data, tools, and resources Ongoing tasks and activities WAQS Introduction – Background and Objectives (Tom) Modeling Platforms (Zac) What are they and how are they used by the IWDW WAQS simulations IWDW external modeling platforms Research (Zac) Boundary conditions, winter meteorology and winter O3, source apportionment Support for outside research Data & Modeling Platform Use and Applications (Rodger) Oversight and data request What is a modeling platform’s intended use (NEPA, etc.) TDWG and RTOWG tasks Monitoring Network Assessment IWDW future research and tasks

An Integrated System of Systems Intermountain West Data Warehouse (IWDW) Partners: NPS, BLM, USFS, EPA, States FLM Environmental Database (FED) Partners: NPS, USFS Databases Websites Software Hardware WRAP TSS Partners: WRAP NASA ROSES Partners: NASA / NPS VIEWS Partners: EPA / States NASA NAAPS Partners: NASA / NPS NPS Conditions & Trends Tools (nps.gov) Partners: NPS/ARD Southeastern Modeling, Analysis, and Planning (SEMAP) Partners: EPA, Southeastern States

Hardware and Software Infrastructure Hardware Resources File Server #1: $11,000; 127 TB used out of ~220 TB File Server #2: $11,000; 91 TB used out of ~220 TB Database Server: (leveraged from FED project – i.e. no cost to IWDW) Web Server: (leveraged from FED project) GIS Server: (leveraged from FED project) Wiki Server: (leveraged from FED project) Development Server #1: (leveraged from FED project) Development Server #2: $4,000 Development Server #3: $4,000 Software Resources MSDN (Microsoft) Subscription (leveraged from FED project – i.e. no cost to IWDW) Windows Server, Windows 7, Windows 10 (servers and development machines) SQL Server (database servers) Internet Information Server (web server) Visual Studio (software development suite for development machines) Outlook, Word, Excel, PowerPoint, etc. (development machines) ESRI GIS Server (3 “seats” at $35 dollars per seat, through CSU discount) GLOBUS High Speed File Transfer Software (no cost, through CSU) Software libraries and framework (leveraged from FED project) User management system (leveraged from FED project) IWDW website – content, wiki, data requests, modeling, emissions, and SA tools IWDW website – monitoring data and tools (leveraged from FED project)

Data Warehouse Ecosystem Overview

Data Warehouse Data Flow Diagram

Data, Tools, and Resources

Data Selection and Access Consoles

Data Products and Exploration Tools Monitored Modeled Emissions

Ongoing Tasks and Activities Fulfill approved cooperator requests for data Maintain, repair, and configure servers and machines Install, update, and configure server software Obtain, organize, and manage new datasets Process and transform data for use with the online tools Backup and archive dataset inventory Operate, update, and refine the IWDW website Respond to collaborator and user feedback Document the system, tools, and datasets Provide help with using the warehouse resources Facilitate collaboration with other relevant projects

Western Air Quality Study (WAQS) Introduction The Western Air Quality Study, with assistance from WESTAR and WRAP, develops state-of-the-art air quality data and photochemical grid modeling products to support studies assessing the air quality in the intermountain west region.

Modeling Platforms Overview Modeling Platform: All data and software tools associated with a photochemical grid modeling (PGM) project Scripts and software PGM Input Data Meteorology Unprocessed and Model-ready Emissions Initial/boundary conditions Ancillary data PGM Output Data Concentrations Deposition Visibility metrics Model-obs pairs Special Study Data Initial Conditions Restart Meteorology PGM Special Study Data = source apportionment, attainment test, unmonitored area analysis, MPE plots Emissions Nesting Boundary Conditions

Modeling Platforms Overview Modeling platforms are the core modeling products of the IWDW Extend IWDW beyond providing only observations Unique feature of the IWDW is to provide complete modeling systems, in addition to observations Modeling platforms provide a shortcut to a vetted modeling and data system Data and software packaged together Platform model performance evaluation (MPE) Documentation Supported Projects: NEPA SIP/planning Research IWDW Data Request Form - Access modeling platform components - Documentation - Recommended uses of the platform

Modeling Platforms Overview Current/Available IWDW -WAQS Modeling Platforms WRF meteorology data SMOKE-processed emissions: NEI + regional oil and gas + regional natural (fires, biogenic, lightning) WAQS Photochemical Grid Modeling 2008: 36/12km CAMx simulation with a 2020 future year 2011: 36/12/4km CMAQ and CAMx simulations with a 2025 future year 2011b emissions v2 CAMx output using consistent meteorology Sensitivity study data by request WAQS Modeling Platforms What are they and how are they used by the IWDW What is a modeling platform’s intended use WAQS simulations (2008, 2011a, 2011b, future years, CMAQ+CAMx, WRF, SMOKE) 2011b updates

Modeling Platforms Overview IWDW External Modeling Platforms WestJumpAQMS (2008, archive) CARMMS (v1.0, 2011 Base Case, 2021 Planning) SNMOS (2011 Base Case, 2025 Planning with SA Tools) Denver/NFR O3 SIP (2011 Base Case, 2017 Planning w/ SA Tools) EPA national air quality transport analysis 2011v3 base case 2023 ozone transport 2028 Regional Haze contribution analysis (pending) EPA national WRF/MMIF for AERMOD (2013, 2014, 2015) WAQS Modeling Platforms What are they and how are they used by the IWDW What is a modeling platform’s intended use WAQS simulations (2008, 2011a, 2011b, future years, CMAQ+CAMx, WRF, SMOKE) 2011b updates SNMOS 12/4-km Modeling Domains

IWDW – WAQS In-House Research Studies Background ozone International transport Winter ozone Modeled boundary conditions MOVES onroad mobile emissions Source apportionment Methane and regional ozone Model performance Urban vs rural Baseline O3 Winter O3 O3 Precursors Speciated PM and visibility Deposition WAQS Modeling Platforms What are they and how are they used by the IWDW What is a modeling platform’s intended use WAQS simulations (2008, 2011a, 2011b, future years, CMAQ+CAMx, WRF, SMOKE) 2011b updates

IWDW – WAQS Derivative Projects Over 35 external data requests to IWDW for modeling platforms IWDW is actively supporting SIP/planning, NEPA, and research in the western U.S. Customized projects range from complete platforms for modeling to individual components for targeted research Free and open access to thousands of MPE plots and tabulated data

Modeling Platform Management Oversight Data stewards Secured space for Project Governing Board and Oversight Committee Documentation Public face Study level documents page Project level documentation Applications MPE process with Project Cooperators Clearinghouse for external modeling studies IWDW Data Request Form Cooperators’ recommendations Data Use Agreement Requestor’s project information & intended use Modeling platform file level information Links to modeling protocol, model performance evaluation reports

Monitoring Data - Use and Applications Data availability Openly available for query, charting, download Provides access to and common format for numerous datasets AQS IMPROVE CSN CASTNet NADP, etc. Applications Monitoring Network Assessment Regional inter-jurisdictional process; Assess status of current monitoring network (preceded by 3SAQS MNA); Analysis: monitor-to-monitor correlations, airsheds, spatial extents, gap analysis, monitor rankings by proximity to emissions by source sector; Examine potential NAAQS impact from O&G emissions, particularly in rural locations; Assess AQRVs in Class I & II Areas related to PM2.5 and deposition; Leverage WAQS emissions and AQ modeling in analysis; Provide recommendations to stakeholders; Cost analysis for continued monitoring at Elk Springs and Paradox; Analysis products available on the IWDW Seven state and five federal agencies

Monitoring Data - Use and Applications Gap Analysis O3 monitors spatial extents Active O&G well locations

Monitoring Data - Use and Applications Gap Analysis NO2 monitors spatial extents Active O&G well locations

Existing IWDW Products: Tribal Data Workgroup Tasks Activity Type / Source of Effort Milestone Initial assessment of the status of WRAP region Tribal air quality monitoring, AQS reporting, and emissions inventories In-Kind - TDWG, WRAP Staff and IWDW In 2017 Existing IWDW Products: Monitoring Network Assessment analysis and data products Current list of Tribal monitors Use of Tribal emissions inventories in regional modeling

Regional Technical Operations Work Group Tasks Activity Type / Source of Effort Milestone New western U.S. base year modeling platform and future years’ projections for planning milestones Next IWDW-WAQS modeling platform and ancillary studies   Regional Haze modeling analyses Pending direction from RHPWG, leverage IWDW Background Ozone modeling analyses Background Ozone Scientific Assessment journal paper, leverage IWDW Other western air quality modeling analyses Pending direction from other Work Groups, leverage IWDW Exceptional Event regional data support Regional Exceptional Event Analysis Existing IWDW Products: WAQS sensitivity studies WAQS modeling platforms used for air quality planning Source apportionment modeling studies Baseline O3 monitoring data evaluations for rural locations Monitoring data from special studies “External” modeling studies Exceptional Event Survey results presented at April 28th WRAP Board meeting

Future Research Topics and Tasks Modeling & Monitoring Data New WAQS modeling platform Sensitivity studies (e.g. international contributions, background O3, natural vs. anthropogenic emissions, etc.) Tribal non-point sources in regional modeling Modeled impacts on Tribal lands Exceptional event analysis support data RHR foundational data from IMPROVE Ongoing assimilation of monitoring data IWDW Tools Refine system for automating the MPE process and the generation of MPE products Expand infrastructure for automatically producing summary and derivative data sets from raw, gridded modeling results Broaden capabilities for performing GIS-based processing and analysis

Important Data Warehouse Links IWDW Website: http://views.cira.colostate.edu/tsdw/ IWDW Description and Background: http://views.cira.colostate.edu/tsdw/About IWDW Data and Tools: http://views.cira.colostate.edu/tsdw/Data IWDW Resources: http://views.cira.colostate.edu/tsdw/Resources IWDW Wiki: http://vibe.cira.colostate.edu/wiki IWDW Forums: http://views.cira.colostate.edu/tsdw/Forum