Download presentation
Presentation is loading. Please wait.
1
Federal Leadership Forum Three-State Air Quality Study and Data Warehouse Project Cooperative Institute for Research in the Atmosphere Colorado State University Shawn McClure
2
Groups at CSU Foothills Campus Operates under a 5-year renewable Cooperative Agreement (CA) with NOAA Complementary CAs with DoI/NPS and DoD/ARL 146 scientists, staff and students Including 6 Federal NESDIS scientists/4 Federal NPS Scientists Including 7 post docs, 21 graduate students, 16 undergraduates Including 14 academic faculty (part time) ------------------------------------------------------------------------ $13M/year in research and outreach funding $8M/year from NOAA CIRA at a glance
3
CIRA Sponsors
4
Groups at CSU Foothills Campus Cooperative Institute for Research in the Atmosphere (CIRA/CSU) Colorado State University Atmospheric Sciences Department (Richard Johnson) CSU Atmospheric Chemistry Department (Jeffrey Collett) National Park Service (NPS) Air Quality Research Group (Bret Schichtel, Bill Malm) NOAA/NESDIS Regional and Mesoscale Meteorology Branch (RAMMB, Mark DeMaria) Center for Multiscale Modeling of Atmospheric Processes (CMMAP – NSF, Dave Randall) Western Governor’s Association (WGA, Tom Moore) Western Regional Air Partnership (WRAP, Tom Moore) Other CIRA Partnerships and Collaborations National Aeronautics and Space Administration (NASA) Institute for the Environment at the University of North Carolina, Chapel Hill Sonoma Technologies, Inc. Air Resource Specialists, Inc. (ARS) ENVIRON Multiple Universities Groups, Partnerships, and Collaborations
5
Architects, Developers, and Operational Managers for: The Visibility Information Exchange Web System (VIEWS): http://views.cira.colostate.eduhttp://views.cira.colostate.edu The WRAP Technical Support System (TSS): http://vista.cira.colostate.edu/tsshttp://vista.cira.colostate.edu/tss The Federal Environmental Database (FED): http://views.cira.colostate.edu/fedhttp://views.cira.colostate.edu/fed The EPA Air Toxics Data Archive (ATDA): http://vista.cira.colostate.edu/atdahttp://vista.cira.colostate.edu/atda Principal Investigators for: The NASA Satellite Data Extension to VIEWS/TSS (beta): http://views.cira.colostate.edu/nasahttp://views.cira.colostate.edu/nasa The NAAPS Data Extension to VIEWS/TSS: http://views.cira.colostate.edu/web/projects/naaps.aspxhttp://views.cira.colostate.edu/web/projects/naaps.aspx The EPA Ozone Data Pilot Project: http://views.cira.colostate.edu/web/projects/epaozone.aspxhttp://views.cira.colostate.edu/web/projects/epaozone.aspx Other Active Projects and Collaborations: The Emissions and Air Quality Modeling Data Management System for the Southeastern States Air Resource Managers (SESARM): (URL pending) Operational exemplar (VIEWS/TSS) for the Group on Earth Observations’ (GEO) Global Earth Observation System of Systems (GEOSS): (URL pending) EPA’s Cyber-Infrastructure (CyAir) project: http://www.cyair.net/http://www.cyair.net/ Development Consultation and Operational Hosting for: The WRAP Emissions Data Management System: http://www.wrapedms.orghttp://www.wrapedms.org The WRAP Fire Emissions Tracking System: http://wrapfets.orghttp://wrapfets.org Systems, Projects, and Collaborations
6
VIEWS/TSS Data and Processing Flowchart
7
Modeling Data and Processing Flowchart
8
High-level Architecture of our System of Systems
9
Database and Data Warehouse Management
10
Data Import and Integration
11
VIEWS/TSS Decision Support Tools
12
VIEWS Website Traffic and Usage
13
Data Management: Extracting and Filtering
14
Data Management: Transforming and Reformatting
15
Data Management: Structuring and Reconciling
16
Data Management: Derived and Intermediate Products Uniformly formatted netCDF files – Optimized for long term storage – More easily consumed by end users – Facilitates interoperability and standardization – Better enables derived product generation Static graphical images – Can be used by a wide variety of visualization tools – Transparency of *.PNG images is ideal for Google and Bing Maps – Enables quick browsing and identification of air quality events – Enables smooth client-side animations and searching KML and KMZ files – Makes it possible to store feature and topology data – Can be used by current and popular visualization tools – Enables direct data and metadata query – Facilitates sharing and interoperability
17
“Interoperability”: The ability of diverse systems and organizations to work together to exchange and utilize information. To facilitate this, VIEWS has been designed with the following services and features: Discovery, retrieval, and exchange of data and metadata On-the-fly transformation and formatting of data and metadata Upload and management of user-supplied data and metadata Generation of visualization and analysis products Availability of “embeddable” components and tools Support of OGC web standards for spatial data exchange Data Management: Standards and Interoperability
18
Interoperability: Enabling Systems of Systems
19
VIEWS/TSS Decision Support Tools
20
Metadata Exploration: Dataset Inventory
21
Metadata Exploration: Monitoring Site Information
22
Exceptional event metadata (such as fires) can be stored and dynamically associated with data, photos, and imagery at run time in order to provide quick cross-referencing and discovery of related data. Thus, satellite and modeled data can be quickly associated with aerosol events once these linkages are complete. “Bisquit” fire impacting Crater Lake in 2002 Metadata Exploration: Air Quality Events
23
Data Exploration: File Explorer tool
24
Data Exploration: Aerosol Composition Analysis
25
Data Exploration: Image Browser and Animation Tool
26
Data Exploration: Dataset Timeline and Parameter Inventory
27
Mapping: CAMx Ozone from CIRA – April 20, 2006
28
Mapping: CMAQ Ozone from UNC – April 20, 2006
29
Mapping: Aura/OMI Ozone Column – 4/20/2006
30
Mapping: Aura/OMI Radiative Cloud Fraction
31
Mapping: IMPROVE Ammonium Sulfate
32
Mapping: Three layers combined
33
Mapping: Google Earth
34
Comments and Recommendations Expect greater complexity (than you do right now) Ensure that software engineers lead the Data Warehouse development (not scientists) Leverage existing work (e.g. WestJump AQMS, WRAP work, etc.) Modularize functional areas –Modeling –Data Warehouse –Configuration Management (versioning, lineage, pedigree, and change tracking) –End User Tools Create a “data broker” position to manage data flows between functional areas Buffer modelers and system developers from decisions about data Organize an approach to disagreements Don’t let the perfect become the enemy of the good Plan for delays
35
Thanks. VIEWS website: http://views.cira.colostate.edu TSS website: http://vista.cira.colostate.edu/tss Shawn McClure: mcclure@cira.colostate.edu
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.