Air Quality Community Experiences and Perspectives on International Interoperability Standards IGARSS, 30 July 2010 Honolulu,HI Presented by Erin Robinson Erin Robinson, Stefan Falke, Rudolf Husar, David McCabe, Frank Lindsay, Chris Lynnes, Greg Leptoukh, Beate Hildenbrand, Oleg Goussev, Peter Sommer

Air quality community spans efforts Monitor the atmosphere (surface, satellite and aerial systems), Model future atmospheric behavior and air quality conditions, Measure and estimate emissions of pollution and pollution forming gases and particles, Combine those information with socio-economic data for decision making analyses. Informing the Public Enforcing Standards Hemispheric Transport Real-time Service Regulatory Analysis Policy Assessment Atmospheric Composition Science & Education

Interoperability Efforts GALEON ESIP GEOSS AIP CyAir HTAP/AMEN Network Portals / Catalogs NASA Programs/Projects EPA Programs/Projects NOAA Programs/Projects Air Quality Forecasting NESDIS NGDC Hazard Mapping System IDEA and IDEA-I WRAP EDAC LAITS Giovanni 3D-AQS RS for BlueskyRAINS Aura in AQ Forecasting VIEWS/TSS SAMITS Sensor Web Architecture & Demo (Mandl) DAACS AMI AirNOW AQS OAQPS HTAP Remote Sensing Gateway Environmental Science Connector DataFed Unidata Giovanni LAITS RSG CIERA/NEISGEI VIEWS RSIG Forest Service Programs/Projects Bluesky The Air Quality Web Landscape (not comprehensive – from a US perspective) Mediators GEO Portals Earth Observation Portal (GEO) Geospatial One Stop Environmental Science Connector (EPA) Global Change Master Directory (GCMD) ECHO (NASA) LEAD (NSF) AC Portal (CEOS/WGISS) International GMES MACC CEOS ACC State Aura in AQ Forecasting RPOs Vermont

Traditional Project Approach Data Do something with the data (add value) Generate Product Deliver Product to Customer Closed System

Interoperability Challenges Standalone-project-oriented approaches Multiple interoperability standard implementations Required tailored implementation of standards “The user cannot find the data; If he can find it, cannot access it; If he can access it, ; he doesn't know how good they are; if he finds them good, he can not merge them with other data” The Users View of IT, NAS 1989

Air Quality & Health Applications

Making Project Contributions Reusable Data Do something with the data (add value) Generate Product Deliver Product to Customer Provide Website Access (manual) Provide web service access Provide access to processing/analysis/value-adding services 7

Project A combines multiple data sources to generate near-real time information for the public Project A provides web service interfaces to some of its data and information Project A

Project B analyzes surface and satellite data in support of regulatory analysis and provides web services to their analysis output and analysis tools Project B

New Project A new project uses services from projects A, B and C to meet its objectives

SOA Actions User Provider Broker The data reuse is possible through the service oriented architecture of GEOSS. Publish– ISO 19115,19119 Find – OpenSearch Bind OGC W*S

Community/Provider Catalogs Metadata ISO 19115/19119 subset for Geospatial Data Data Providers Data Access Service Data Protocol WMS, WCS (netDCF CF) + conventions

GEOSS CSR Registration Specifies: Where the records are located Metadata standard Harvest periodicity Data Access Service

GEOSS Clearinghouse harvests metadata from distributed catalogs OGC CSW Queryable ISO CSW Profile OGC CSW Returnable Metadata Description Data Binding Air Quality Community Record

Com Client Data User OGC CSW Queryable Air Quality Specific ISO CSW Profile OGC CSW Returnable Metadata Description Data Binding Air Quality Community Record

Com Client Data User OGC CSW Queryable Air Quality Specific ISO CSW Profile OGC CSW Returnable Metadata Description Data Binding Air Quality Community Record

GetCapabilities GetData Capabilities, ‘Profile’ Data Where? When? What? Which Format? Server Back End Std. Interface Client Front End Std. Interface

Clients can access any HTAP model ‘datasets’ for browsing, comparison, statistical…processing YOUR client software can also access any HTAP model ‘datasets’ Perform your types of analyses The data the tools and the methods are shared to the Community through the AQ CoP So, participants of this project automatically become members of AQ CoP HTAP Data Network FZ Juelich server offers HTAP model ‘datasets’ WCS–netCDF–CF Standard Protocol FZ Juelich & WashU Co-develop connectivity software DataFed Giovanni

Objectives Provide access, tools, and contextual guidance to scientists and value-adding organizations in using remotely sensed atmospheric composition data, information, and services Help foster interoperability and application of atmospheric composition data, information and services worldwide Start with DLR and NASA, work with partners in CEOS and the broader AC community in advancing the AC Portal CEOS Atmospheric Composition Portal 19 GEO Task AR-09-02b DLR Giovanni Datafed Other s OGC WMS OGC WCS Beta version of the ACP by September 2010 OPeNDAP DLR Giovanni Datafed Other s DLR Giovanni Datafed Other s Data Access Gateways Visualization Tools Processing/Analysis Tools Initial focus on air quality but plan is to server broader community (climate, strat. O3) GEOSS User Contributed Content Users Contextual metadata Put in back-up

CEOS Atmospheric Composition Portal 20 Analyze difference

GEO AQ-CoP Main interaction through the open, participatory website:

Summary and Issues The air quality interoperability efforts have found some success in using existing web standards to achieve a base level of interoperability Many challenges remain spanning technical issues in making standards work for air quality uses to organization issues in achieving agreement among air quality-specific conventions to standards As the community gains experience in how to implement and tailor the standards they will develop best practices The interoperability efforts described in this abstract have focused on OGC standards. However, there is a desire to evaluate the applicability of other web standards for air quality systems, in particular OPeNDAP.

Acknowledgements This work is not done alone, acknowledge all of the people that contribute to this effort: CEOS and Atmospheric Composition Portal HTAP Network CyAir ESIP Air Quality Workgroup GEOSS Architecture Implementation Pilots GEO AQ Community of Practice

Backup Slides

Users Data Providers GEOSS Common Infrastructure Air Quality Community Catalog General search and use of GEOSS data and services AQ-specific search and use of GEOSS data and services Air Quality Community Infrastructure SEDAC DataFed Giovanni EDAC NGC ESA Data web service metadata registrations AIP-2 Workspace:

Next Steps: Continue to work with AQ community to improve the AQ-specific sections needed for sharper discovery Work with AQ data providers to register their services in AQ Community Catalogs Extend metadata with unstructured user-contributed content through DataSpaces Use the GEOSS AQ CoP to help coordinate activities

Air Quality Community Interoperability Efforts (not comprehensive) GEO AQ CoP: Working to connect various AQ networking activitiesGEO AQ CoP GEOSS AIP-3: The GEOSS Architecture Implementation Pilot (AIP) develops and deploys new process and infrastructure components for the GCI and the broader GEOSS architectureGEOSS AIP-3 HTAP: The HTAP network aims to facilitate seamless access to distributed HTAP model data, easy connectivity of data processing components through standard interfaces, and provide a set of basic tools for data processing, integration, and comparisons.HTAP CEOS AC Portal: The AC Portal is being developed to provide access, tools, and contextual guidance to scientists and value-adding organizations in using remotely sensed atmospheric composition dataCEOS AC Portal CyAir: Contributions to the planning, development, maintenance and coordination of systems to help the air quality community better utilize air quality related informationCyAir

A joint NASA-NOAA-EPA initiative: Objective - Prototype a near-real-time MODIS trajectory forecast product using MODIS direct broadcast aerosol optical depth over CONUS. Goal - Improve accuracy of next day PM 2.5 Air Quality Index (AQI) by providing pseudo-synoptic aerosol observations and trajectory forecast during large aerosol events. Provides forecast guidance for surface air quality (PM2.5) Dust storms Smoke from forest fires Urban/industrial haze System requirements Direct broadcast receiving station for satellite data Trajectory model Regional meteorological forecast model output Algorithms to derive aerosol optical depth or related parameters Surface mass aerosol monitors System flexibility Easily adaptable to other regions of the globe Easy to modify to input other satellite data Benefit - Enable improved mitigation of health effects caused by episodes of poor air quality Infusing satellite Data into Environmental Applications (IDEA) Al-Saadi et. al., September 2005, Bulletin of American Meteorological Society / 28

Juelich Client Clent

Giovanni Client

31 Giovanni Instances Giovanni A B D E C F C DE B A C F Area Plot Time SeriesModel Output Profile Cross-Section CorrelationsColumn Densities CALIOP CALIPSO CloudSat MODIS Terra SeaWiFS TRMM HALOE UARS TOMS EP, N7 Data Inputs MLS Aura OMI Aura AMSR-E Aqua MISR Terra MODIS Aqua AIRS Aqua MERRA Models vanni Slide provided by G. Leptoukh

SOA for Data Access & Processing Mediator for 100+ AQ Datasets Includes Tools for Analysis Applied to EPA EE Analysis Supported by NSF, NASA, RPOs, EPA Design Concept IEEE Systems Journal, Slide provided by R. Husar

DataFed Client Server

Atmospheric Composition Portal Objectives Provide access, tools, and contextual guidance to scientists and value-adding organizations in using remotely sensed atmospheric composition data, information, and services Help foster interoperability and application of atmospheric composition data, information and services worldwide Start with DLR and NASA, work with partners in CEOS and the broader AC community in advancing the AC Portal 34 GEO Task AR-09-02b DLR Giovanni Datafed Other s OGC WMS OGC WCS Plan is to have a beta version of the ACP by September 2010 OPeNDAP DLR Giovanni Datafed Other s DLR Giovanni Datafed Other s Data Access Gateways Visualization Tools Processing/Analysis Tools Initial focus on air quality but plan is to server broader community (climate, strat. O3) GEOSS User Contributed Content Users Contextual metadata Put in back-up

CEOS Atmospheric Composition Portal 35 Analyze difference

Hurdles “The user cannot find the data; If he can find it, cannot access it; If he can access it, ; he doesn't know how good they are; if he finds them good, he can not merge them with other data” The Users View of IT, NAS 1989

Remote Sensing Information Gateway EPA CMAQConcentrations, Met, Emissions, Deposition EPA Statically Fused Air and Deposition Surfaces O3, PM2.5 NOAA GOES Biomass Burning Emissions; PM2.5, NOx, CO, … - Subsetting -Regridding -Comparison -Export in common formats -Fast! -Atmospheric Science Researchers -Air Quality Modelers and Analyst NASA MODIS L2AOD NASA CALIPSO L1b TAB NOAA GOES AOD (GASP) (Future data) NASA CALIPSO L2Bext, AOD NASA MOPITT L2CO NASA OMI L2NO2 NOAA/NASA GOME-2NO2 Satellite: EPA AIRNow; O3, PM2.5 EPA AQS; O3, PM2.5 EPA UVNet; Irradiance Site Obs/Point Data: Modeled: RSIG System Primary Users -Air Quality Regulators and Managers -(RSIG is publicly- accessible.) Secondary Users Atmospheric Chemistry Earth Observations and Models Data Services AQ Data and Image Information Products RSIG WCS/WM S Servers Available for Other Systems 37 Slide provided by J. Syzkman Put in back-up

Source: G. Leptoukh, NASA Goddard

HTAP Data Network Juelich – M. Schultz DataFed – R. Husar Giovanni – G. Leptoukh To Support Hemispheric AP Transport Program To Make a contribution to GEOS

Other AQ CoP Ativities AQ CoP Participation in GEO Tasks US-09-01b: Development of Communities of Practice US-09-01a: Identifying User Requirements for Earth Obs. AR-09-01b: GEO Architecture Implementation Pilot (AIP) DA-09-02d: Atmospheric Model Evaluation Network ….. Meeting & Coordination Activities, May 2009: Session on AQ and GEOSS, ISRSE, Stresa, Italy (Husar) Jul 2009: AQ Community Infrastructure, ESIP, Santa Barbara, CA, US (McCabe) Nov 2009: AQ Side Meeting at GEO-VI Plenary, Wash. DC, US (McCabe, Keating) May 2010: GEO Decision Support Concept Proposal (Falke) June 2010: AQ Participation in the GEOSS AIP 2,3. (Falke, Robinson) Monthly: Telecons, Wiki workspace (Falke, Robinson)

AR-09-01b: GEO Architecture Implementation Pilot (AIP) Testing and Using the GEOSS Common Infrastructure (GCI) Data Search Facets DatasetParameterInstr.Platfor m Space Time Sharing is facilitated by the GEOSS Common Infrastructure Catalog of AQ Data though the GEOSS Clearinghouse

GEO AQ-CoP Main interaction through the open, participatory website: CoP People Member Projects DataSpaces

GEO AQ CoP Active Participants Technologists: Michael Decker, FZ Julich; Oleg Goussev (DLR); Kari Hoijarvi, WUSTL; Erin Robinson, WUSTL.. and others. Facilitators: Stefan Falke, NGC; Dave McCabe, EPA/CAC); Frank Lindsey, NASA; Rudy Husar, WUSTL; Martin Shulz, FZ Juelich.. and others. Agency Executives: Gary Foley, EPA; Terry Keating, EPA; Lawrence Friedl, NASA.. and others. Point of Contact: Rudolf Husar

Emerging HTAP Data Network

Outline Define the infrastructure that is emerging in order to allow data sharing and reuse to occur Identify the standards and conventions we are creating and the issues we’ve encountered Describe a few of the AQ projects/programs and their international scope

HTAP Data Network Stakeholders are autonomous organizations, scientists Participation is largely voluntary Information integration is key to success HTAP & GEOSS Symbiosis GEOSS is a good (system of systems) model for HTAP HTAP is a suitable use case for the emerging GEOSS HTAP Model Data Server Project: Connecting FZ Juelich server to WashU DataFed client