Presentation is loading. Please wait.

Presentation is loading. Please wait.

Federal Leadership Forum Three-State Air Quality Study and Data Warehouse Project Cooperative Institute for Research in the Atmosphere Colorado State University.

Similar presentations


Presentation on theme: "Federal Leadership Forum Three-State Air Quality Study and Data Warehouse Project Cooperative Institute for Research in the Atmosphere Colorado State University."— Presentation transcript:

1 Federal Leadership Forum Three-State Air Quality Study and Data Warehouse Project Cooperative Institute for Research in the Atmosphere Colorado State University Shawn McClure

2 Groups at CSU Foothills Campus Operates under a 5-year renewable Cooperative Agreement (CA) with NOAA Complementary CAs with DoI/NPS and DoD/ARL 146 scientists, staff and students Including 6 Federal NESDIS scientists/4 Federal NPS Scientists Including 7 post docs, 21 graduate students, 16 undergraduates Including 14 academic faculty (part time) ------------------------------------------------------------------------ $13M/year in research and outreach funding $8M/year from NOAA CIRA at a glance

3 CIRA Sponsors

4 Groups at CSU Foothills Campus Cooperative Institute for Research in the Atmosphere (CIRA/CSU) Colorado State University Atmospheric Sciences Department (Richard Johnson) CSU Atmospheric Chemistry Department (Jeffrey Collett) National Park Service (NPS) Air Quality Research Group (Bret Schichtel, Bill Malm) NOAA/NESDIS Regional and Mesoscale Meteorology Branch (RAMMB, Mark DeMaria) Center for Multiscale Modeling of Atmospheric Processes (CMMAP – NSF, Dave Randall) Western Governor’s Association (WGA, Tom Moore) Western Regional Air Partnership (WRAP, Tom Moore) Other CIRA Partnerships and Collaborations National Aeronautics and Space Administration (NASA) Institute for the Environment at the University of North Carolina, Chapel Hill Sonoma Technologies, Inc. Air Resource Specialists, Inc. (ARS) ENVIRON Multiple Universities Groups, Partnerships, and Collaborations

5 Architects, Developers, and Operational Managers for: The Visibility Information Exchange Web System (VIEWS): http://views.cira.colostate.eduhttp://views.cira.colostate.edu The WRAP Technical Support System (TSS): http://vista.cira.colostate.edu/tsshttp://vista.cira.colostate.edu/tss The Federal Environmental Database (FED): http://views.cira.colostate.edu/fedhttp://views.cira.colostate.edu/fed The EPA Air Toxics Data Archive (ATDA): http://vista.cira.colostate.edu/atdahttp://vista.cira.colostate.edu/atda Principal Investigators for: The NASA Satellite Data Extension to VIEWS/TSS (beta): http://views.cira.colostate.edu/nasahttp://views.cira.colostate.edu/nasa The NAAPS Data Extension to VIEWS/TSS: http://views.cira.colostate.edu/web/projects/naaps.aspxhttp://views.cira.colostate.edu/web/projects/naaps.aspx The EPA Ozone Data Pilot Project: http://views.cira.colostate.edu/web/projects/epaozone.aspxhttp://views.cira.colostate.edu/web/projects/epaozone.aspx Other Active Projects and Collaborations: The Emissions and Air Quality Modeling Data Management System for the Southeastern States Air Resource Managers (SESARM): (URL pending) Operational exemplar (VIEWS/TSS) for the Group on Earth Observations’ (GEO) Global Earth Observation System of Systems (GEOSS): (URL pending) EPA’s Cyber-Infrastructure (CyAir) project: http://www.cyair.net/http://www.cyair.net/ Development Consultation and Operational Hosting for: The WRAP Emissions Data Management System: http://www.wrapedms.orghttp://www.wrapedms.org The WRAP Fire Emissions Tracking System: http://wrapfets.orghttp://wrapfets.org Systems, Projects, and Collaborations

6 VIEWS/TSS Data and Processing Flowchart

7 Modeling Data and Processing Flowchart

8 High-level Architecture of our System of Systems

9 Database and Data Warehouse Management

10 Data Import and Integration

11 VIEWS/TSS Decision Support Tools

12 VIEWS Website Traffic and Usage

13 Data Management: Extracting and Filtering

14 Data Management: Transforming and Reformatting

15 Data Management: Structuring and Reconciling

16 Data Management: Derived and Intermediate Products Uniformly formatted netCDF files – Optimized for long term storage – More easily consumed by end users – Facilitates interoperability and standardization – Better enables derived product generation Static graphical images – Can be used by a wide variety of visualization tools – Transparency of *.PNG images is ideal for Google and Bing Maps – Enables quick browsing and identification of air quality events – Enables smooth client-side animations and searching KML and KMZ files – Makes it possible to store feature and topology data – Can be used by current and popular visualization tools – Enables direct data and metadata query – Facilitates sharing and interoperability

17 “Interoperability”: The ability of diverse systems and organizations to work together to exchange and utilize information. To facilitate this, VIEWS has been designed with the following services and features: Discovery, retrieval, and exchange of data and metadata On-the-fly transformation and formatting of data and metadata Upload and management of user-supplied data and metadata Generation of visualization and analysis products Availability of “embeddable” components and tools Support of OGC web standards for spatial data exchange Data Management: Standards and Interoperability

18 Interoperability: Enabling Systems of Systems

19 VIEWS/TSS Decision Support Tools

20 Metadata Exploration: Dataset Inventory

21 Metadata Exploration: Monitoring Site Information

22 Exceptional event metadata (such as fires) can be stored and dynamically associated with data, photos, and imagery at run time in order to provide quick cross-referencing and discovery of related data. Thus, satellite and modeled data can be quickly associated with aerosol events once these linkages are complete. “Bisquit” fire impacting Crater Lake in 2002 Metadata Exploration: Air Quality Events

23 Data Exploration: File Explorer tool

24 Data Exploration: Aerosol Composition Analysis

25 Data Exploration: Image Browser and Animation Tool

26 Data Exploration: Dataset Timeline and Parameter Inventory

27 Mapping: CAMx Ozone from CIRA – April 20, 2006

28 Mapping: CMAQ Ozone from UNC – April 20, 2006

29 Mapping: Aura/OMI Ozone Column – 4/20/2006

30 Mapping: Aura/OMI Radiative Cloud Fraction

31 Mapping: IMPROVE Ammonium Sulfate

32 Mapping: Three layers combined

33 Mapping: Google Earth

34 Comments and Recommendations Expect greater complexity (than you do right now) Ensure that software engineers lead the Data Warehouse development (not scientists) Leverage existing work (e.g. WestJump AQMS, WRAP work, etc.) Modularize functional areas –Modeling –Data Warehouse –Configuration Management (versioning, lineage, pedigree, and change tracking) –End User Tools Create a “data broker” position to manage data flows between functional areas Buffer modelers and system developers from decisions about data Organize an approach to disagreements Don’t let the perfect become the enemy of the good Plan for delays

35 Thanks. VIEWS website: http://views.cira.colostate.edu TSS website: http://vista.cira.colostate.edu/tss Shawn McClure: mcclure@cira.colostate.edu


Download ppt "Federal Leadership Forum Three-State Air Quality Study and Data Warehouse Project Cooperative Institute for Research in the Atmosphere Colorado State University."

Similar presentations


Ads by Google