REASoN REASoN Project to link NASA's data, modeling and systems to users in research, applications and education Application of NASA ESE Data and Tools to Particulate Air Quality Management Stefan Falke and Rudolf Husar (Co-PIs) Washington University in St. Louis Project Period: NASA Applied Sciences Program Air Quality Team Meeting June 18-20, 2007, The Bolger Center, Potomac, MD

The Federated Data System, DataFed in a NutshellDataFed in a Nutshell DataFed Goals Facilitate flow of AQ data from providers to users Support user-driven data processing value chains Participate in specific application projects Approach: Data User-Provider Mediation Federates autonomous data providers Non-intrusively wraps data as web services Mediates, homogenizes data access/views Applications Air Quality RPO FASTNET Project (Fast Aerosol Sensing…) EPA Exceptional Event Regulation Tech Support EPA, NOAA, NASA Fire Emission Analysis Applications to Data Systems NASA Web Services Roadmap, WS Chaining GEOSS Architecture : Interoperability demos, pilots

Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataF ed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Control Data Acquisition Provider NASA DAACs EPA Model EPA AIRNow other s Data Standard Data Query Language: Where? When? What? (Space-time query - WMS, WCS) GetCapabilities GetData Capabilities, ‘Profile’ Data Where? When? What? Which Format? Server Back End Std. Interface Client Front End Std. Interface QueryGetData Standards Where?BBOXOGC, ISO When?TimeOGC, ISO What?TemperatureCF FormatnetCDF, HDF..CF, EOS, OGC T2T1 Loosely Coupled Data Access through Standard Protocols Standard Messaging What data you have? Give me this data

Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataF ed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Control Data Acquisition Provider NASA DAACs EPA Model EPA AIRNow other s Data Web Services and Workflow for Loose Coupling Service Chaining & Workflow Workflow Software: Dynamic Linking Software Mashups Software Mashup: Coarse-grain Linking

Web Coverage Service (WCS) All numeric Datasets are accessible through WCS WCS Server WCS Client GetCoverage GeoTiff,HDF, netCDF, CSV… netCDF

Over 50 Federated Datasets Data are accessed from autonomous, distributed providers DataFed ‘wrappers’ provide uniform geo-time referencing Tools allow space/time overlay, comparisons and fusion Near Real Time Data Integration Delayed Data Integration Surface Air Quality AIRNOWO3, PM25 ASOS_STIVisibility, 300 sites METARVisibility, 1200 sites VIEWS_OL40+ Aerosol Parameters Satellite MODIS_AOTAOT, Idea Project OMIAI, NO2, O3, Refl. TOMSAbsorption Indx, Refl. SEAW_USReflectance, AOT Model Output NAAPSDust, Smoke, Sulfate, AOT WRFSulfate Fire Data HMS_FireFire Pixels MODIS_FireFire Pixels Surface Meteorology RADARNEXTRAD SURF_METTemp, Dewp, Humidity… SURF_WINDWind vectors

Analysis Services takes two grids as input, conducts a mathematical operation using their values, and creates a single grid output Time Aggregate Service: Aggregates Map by Day-of-Week Grid Operator Service OMI NO2 - Friday OMI NO2 - Sunday

Data Services WCS WMS* Analysis Services Service Flow Engine DataFed Server 3 rd -party Server request data request / control map images DataFed Server Web Application Web Application Framework Web services are modular components that gain value when connected to form a chain of services, thereby creating a web application. The services can be geographically distributed among servers. The services come together by way of a workflow, which constructs and manages a set of services chained together. * The WMS request from the web application is extended to include non-standard WMS elements that control the service flow. Emissions Data Services WCS NEISGEI Server request data Data Services WCS Other AQ Projects request data

Data Access Services Standards for finding, accessing, portraying, and processing geospatial data are defined by the Open Geospatial Consortium (OGC). Web Map Server (WMS) for exchanging map images Web Feature Service (WFS) retrieves discrete feature data Web Coverage Service (WCS) allows access to multidimensional data that represent coverages, such as grids. Sensor Observation Service (SOS) multidimensional access to measurement data While these standards are based on the geospatial domain, many are designed to be extended to support non-geographic data “dimensions,” such as time and the many other dimension tables found in emissions inventories. Geospatial One-Stop

Interoperable Data and Analysis Services for Multiple Web Applications Data Comparison Application using OpenLayers Visualization Application using GoogleMaps Visualization Application using GoogleEarth Visualization and Analysis Application using DataFed Browser

AQ Research/Management Example Satellite evidence for Exceptional Event (smoke, dust) is now permissible by the EE Rule! Quebec Smoke, July 2002

Slide with standard NASA project stuff: Period of performance Objectives NASA Relevance AQ Research & Management Relvance …

Web service frameworks User interaction with web has expanded from one-way information download to include user-driven information content – “Web 2.0” Within the science and engineering domains, this next phase of the web is referred to as cyberinfrastructure, e-science, and service oriented science. new capabilities for sharing information, conducting research in a distributed environment, and achieving new insights that would have taken longer, or not occurred at all, in independent organizations. Web services approach uses standards-based interfaces for accessing and working with data. Our objective is to go beyond searching and visualizing data to include data processing and analysis services. Mashups - applications constructed by combining services from disparate sources. Top Mashup APIs

Analysis Services takes two grids as input, conducts a mathematical operation using their values, and creates a single grid output takes a set of latitude, longitude points and sums the associated values for all points that fall within each grid cell of an output grid Point-to-Grid Service Grid Operator Service