Current Air Quality Information ‘Ecosystem’ (Draft for Feedback) AQ information includes emissions, ambient & satellite data and model outputs The distributed.

Slides:

Advertisements

Similar presentations

Web Services Implementation Case Study: DataFed Air Quality Data & Services Project Coordinators: Software Architecture: R. Husar Software Implementation:

Advertisements

OGC Demo at IGARSS06 July 30 - Denver, CO Telecon 11 July 2006 Liping Di, George Mason University Rudolf Husar, Washington University.

Virtual Product of Air Quality Demo Scripts Liping Di, Peisheng Zhao Center for Spatial Information Science and Systems (CSISS) George Mason University.

DataFed and FASTNET Tools for Agile Air Quality Analysis Husar & Poirot.

Talk Outline Air Quality Information System Challenges (5min) –Real-time monitoring and data delivery (1 slide) –Characterization of pollutant in.

ESIP Vision: “Achieve a sustainable world” by Serving as facilitator and advisor for the Earth science information community Promoting efficient flow of.

1 The FASTNET Project Presented by: Sean Raffuse 1 Rudy Husar 2 Rich Poirot and Gary Kleiman 3 1 Sonoma Technology, Inc. 2 Center for Air Pollution Impact.

Stefan Falke Center for Air Pollution Impact and Trend Analysis Washington University in St. Louis Networked Data and Tools for Environmental Management.

Infusing satellite Data into Environmental Applications (IDEA): PM2.5 forecasting tool hosted at NOAA NESDIS using NASA MODIS (Moderate Resolution Imaging.

Dissemination of Haze Data, Data Products and Information Bret Schichtel, Rodger Ames, Shawn McClure and Doug Fox.

Select, Overlay, Explore; Multidimensional data Maintain Distributed Data; Heterogeneous coding, access Connect providers to users; Homogenize data access.

AIRNow-International The future of the United States real-time air quality reporting and forecasting program and GEOSS participation John E. White U.S.

CAPITA Projects NSF ToolsCollaboration Tools for Virtual Workgroups EPA WebVis Internet Visibility System NOAAASOS Data Evaluation EPAICAP Intercontinental.

Distributed Voyager (DVoy) Web Services

DRAFT June 6, 2005 ESIP AQ Cluster, Air Quality Cluster Air Quality Cluster TechTrack Earth Science Information Partners Partners NASA.

DRAFT April 28, 2005 ESIP AQ Cluster, The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.

REASoN REASoN Project to link NASA's data, modeling and systems to users in research, applications and education Application of NASA ESE Data and Tools.

Air Quality Focus Group Discussion Summary ESIP Winter Meeting January 2005 Air Quality is one of 12 Applications of National Priority as defined by NASA.

Federated Network for Sharing Air Quality Data and Processing Services Center for Air Pollution Impact and Trend Analysis (CAPITA) Washington University,

Work Group Meeting on HTAP-Relevant IT Techniques, Tools and Philosophies: DataFed Experience and Perspectives Rudolf B. Husar CAPITA, Washington University,

DRAFT April 28, 2005 ESIP AQ Cluster, Current Air Quality Information ‘Ecosystem’ (Draft for Feedback) AQ information includes emissions,

1 The FASTNET Project Presented by: Sean Raffuse 1 Rudy Husar 2 Rich Poirot and Gary Kleiman 3 1 Sonoma Technology, Inc. 2 Center for Air Pollution Impact.

REASoN REASoN Project to link NASA's data, modeling and systems to users in research, education and applications Application of NASA ESE Data and Tools.

An Integrated Systems Solution to Air Quality Data and Decision Support on the Web GEO Architecture Implementation Pilot – Phase 2 (AIP-2) Kickoff Workshop.

Integration of Multi-Sensory Earth Observations for Characterization of Air Quality Events E. M. Robinson Advisor, R. B. Husar 2010 Masters of Science.

Spatio-Temporal Data Sharing using XML Web Services Presented at the Workgroup Meeting on Web-based Environmental Information System for Global Emission.

Federated Data System DataFed Rudolf Husar, Washington University, St. Louis With may who participated and supported DataFed since National Ambient.

REASoN REASoN Project to link NASA's data, modeling and systems to users in research, education and applications Application of NASA ESE Data and Tools.

Stefan Falke Center for Air Pollution Impact and Trend Analysis Washington University in St. Louis Brooke Hemming US EPA – Office of Research and Development.

Application of ESE Data and Tools to Particulate Air Quality Management The CAPITA REASoN Project August 15, 2003 Stefan Falke and Rudolf Husar Center.

Air Quality Cluster Air Quality Cluster TechTrack Earth Science Information Partners Partners(?) NASA NOAA EPA USGS DOE NSF Industry… Data Flow Technologies.

Accessing and Using Fire-Related Data with the CAPITA DataFed.net* Services Framework Stefan Falke Rudolf Husar Kari Hoijarvi Washington University in.

1 Application Scenario: Smoke Impact REASoN Project: Application of NASA ESE Data and Tools to Particulate Air Quality Management (PPT/PDF)Application.

NASA Air Quality Applications Program and the ESIP Air Quality Cluster The goal of the NASA Air Quality Management program is to: Enable partners’ beneficial.

Why so many data systems? Dickerson – ppt. Information as a Resource Shared not exchanged …

Current Project Objectives The project’s focus is on criteria pollutants and toxics because of their availability and accessibility. Recommend and demonstrate.

OGC Demo at IGARSS06 July 30 - Denver, CO Telecon 11 July 2006 Liping Di, George Mason University Rudolf Husar, Washington University.

Select, Overlay, Explore; Integration of diverse data Distributed Data Heterogeneous coding, access Connects providers to users; Homogenize data access.

Stefan Falke and Rudolf Husar Center for Air Pollution Impact and Trend Analysis Washington University in St. Louis A NSF Digital Government Pilot Project.

REASoN REASoN Project to link NASA's data, modeling and systems to users in research, education and applications Application of NASA ESE Data and Tools.

ESIP Federation – Strategic PlanStrategic Plan MISSION –Establish and continuously improve science-based end-to-end processes that increase the quality.

Federated Network for Sharing Air Quality Data and Processing Services Center for Air Pollution Impact and Trend Analysis (CAPITA) Washington University,

Architectures and Technologies Enabling the Diffusion of Atmospheric Science Information Rudolf B. Husar and Erin Robinson Washington University, St. Louis.

Air Quality Demonstration Prepared for the 18 th ESIP Federation Meeting January 3, Air Quality Community Support through New Information Technologies.

Interoperability of Data and Processing Services: Experience Using the DataFed System Rudolf B. Husar, Stefan R. Falke and Kari Hoijarvi Washington University,

Part I DataFed An Agile Distributed Air Quality Data System Rudolf B. Husar Washington University, St. Louis Seminar Presented at University of Alabama,

COMMUNITY. Data Acquisition and Usage Value Chain.

NASA REASoN Project SHAirED: S ervices for H elping the Air -quality Community use E SE D ata Stefan Falke, Kari Höijärvi and Rudolf Husar, Washington.

NASA REASoN Project SHAirED: S ervices for H elping the Air -quality Community use E SE D ata Stefan Falke, Kari Höijärvi and Rudolf Husar, Washington.

Processes of the Information Value Chain Informing Knowledge ActionProductive Knowledge Information Organizing Grouping Classifying Formatting Geo-referencing.

Part I DataFed An Agile Distributed Air Quality Data System Rudolf B. Husar Washington University, St. Louis Seminar Presented at University of Alabama,

Architecture and Technologies for an Agile, User-Oriented Air Quality Data System Rudolf B. Husar Washington University, St. Louis Presented at the workshop.

Architecture and Technologies for an Agile, User-Oriented Air Quality Data System Rudolf B. Husar Washington University, St. Louis Presented at the workshop.

Web Services-Based Mediator of Distributed Data Flow and Processing Project Coordinators: Software Architecture: R. Husar Software Implementation: K. Höijärvi.

Integration of Multi-Sensory Earth Observations for Characterization of Air Quality Events using Service Oriented Architecture E. M. Robinson Advisor,

ESIP Air Quality Jan Air Quality Cluster Air Quality Cluster Technology Track Earth Science Information Partners Partners NASA NOAA EPA (?) USGS.

: Data Sharing/Processing Infrastructure Data Catalog and Access Dozens of datasets on aerosols, emissions, fire, meteorology,

1 SEEDS IT Vision Scenario: Smoke Impact REASoN Project: Application of NASA ESE Data and Tools to Particulate Air Quality Management (PPT/PDF)Application.

DRAFT June 6, 2005 ESIP AQ Cluster, Contact R. Husar Air Quality Cluster Air Quality Cluster TechTrack Earth Science Information Partners.

The Federated Data System DataFed R. Husar, K. Hoijarvi, S. Falke, DaFed Community EPA Data Summit, Feb. 12, 2008, RTP Non-intrusive data integration infrastructure.

Standards-based Access to Air Quality Data: Application of OGC WMS and WCS Protocols Client Server Std. Interface GetCapabilities GetData Capabilities,

Topic Suggestions Scheffe GEOSS Support to Regional Air Quality (see next slide) –Data. Services –Sharing/Harvesting Infrastructure –Intellectual Resources.

Federated Network for Sharing Air Quality Data and Processing Services Center for Air Pollution Impact and Trend Analysis (CAPITA) Washington University,

Fire, Smoke & Air Quality: Tools for Data Exploration & Analysis : Data Sharing/Processing Infrastructure This project integrates.

NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Reuse Working Group Earth Science Data Systems Reuse Working Group Case Study: SHAirED Services for.

DATAFED Application Programs. Dvoy Data Flow and Processes DataView 1 View Data Abstract Portrayal Device Portrayal Render Device View Portrayal Device.

ESIP Vision: “Achieve a sustainable world” by Serving as facilitator and advisor for the Earth science information community Promoting efficient flow of.

ESIP Air Quality Jan Air Quality Cluster Air Quality Cluster Technology Track Earth Science Information Partners Partners NASA NOAA EPA (?) USGS.

GEOSS Air Quality Community Infrastructure

4/5 May 2009 The Palazzo dei Congressi di Stresa Stresa, Italy

Presentation transcript:

Current Air Quality Information ‘Ecosystem’ (Draft for Feedback) AQ information includes emissions, ambient & satellite data and model outputs The distributed data are produced and provided by agencies, mostly through portals Providers have different access protocols, formats, and information usage conditions This lack of interoperability causes the under-utilization of the rich data resources

Future Integrated AQ information System (Draft for Feedback) DataMart VIEWS NEISGEI AIRNow AQMod DAACs ASOS NEI Emission IDEA GASP Missions WeaMod Forecast GloMod FireInv Data Federation Distributed, Virtual, Uniform AQ Forecasting AQ Compliance Status and Trends Network Assess. Data Processing Filtering, Aggregation, Fusion Info Products Reports, Websites Data are maintained by custodians and exposed through ‘portals’ Mediators uniformly ‘wrap’ data and provide processing services Analysts program the services to create application-specific products Responsibility is shared among data providers and mediator/ integrators ESIPFed can provide the infrastructure and tools for the AQ info system Mediators

Federated Air Quality Data System - Draft Text 1 Text 2 Wrappers Where? What? When? Federate Data StructuringSlice & Dice Explore Data Viewers Programs Integrate Understand Inform Public AQ Compliance Forecast AQ Status & Trends Satellite Devel. Network Asses. Manage Hazards ……… Info Needs Reports Emission Surface Satellite Model Single Datasets Providers Networking Reuse ESIP AQ Cluster Draft Run and click PPT Slideshow to see chart animations Non-intrusive Linking & MediationData UsersData Providers

DataFed Description DataFed Vision Better air quality management and science through by effective use of relevant data DataFed Goals Facilitate the access and flow of atmospheric data from provider to users Support the development of user-driven data processing value chains P articipate in specific application projects Approach: Mediation Between Users and Data Providers DataFed assumes spontaneous, autonomous emergence of AQ data (a la Internet) Non-intrusively wraps datasets for access by web services WS-based mediators provide homogeneous data views e.g. geo-spatial, time... End-user programming of data access and processing through WS composition (limited) Applications Building browsers and analysis tools for distributed monitoring data Serve as data gateway for user programs; web pages, GIS, science tools DataFed is currently focused on the mediation of air quality data

Anatomy of a Wrapper Service: TOMS Satellite Image Data Given the URL template and the image description, the wrapper service can access the image for any day, any spatial subset using a HTTP URL or SOAP protocol: Wrapper classes are available for geo-spatial (incl. satellite) images, SQL servers, text files,etc. The mediator classes are implemented as web services for uniform data access, transformation and portrayal. src_img_width src_img_height src_margin_rightsrc_margin_left src_margin_top src_margin_bottom src_lon_min src_lat_max src_lat_min src_lon_max Image Description for Data Access: src_image_width=502 src_image_height=329 src_margin_bottom=105 src_margin_left=69 src_margin_right=69 src_margin_top=46 src_lat_min=-70 src_lat_max=70 src_lon_min=-180 src_lon_max=180 The daily TOMS images reside on the FTP archive, e.g. ftp://toms.gsfc.nasa.gov/pub/eptoms/images/aerosol/y2000/ea gif ftp://toms.gsfc.nasa.gov/pub/eptoms/images/aerosol/y2000/ea gif URL template: ftp://toms.gsfc.nasa.gov/pub/eptoms/images/aerosol/y[yyyy]/ea[yy][mm][dd].gif Transparent colors for overlays RGB(89,140,255) RGB(41,117,41) RGB(23,23,23) RGB(0,0,0)

SeaWiFS Satellite Aerosol Chemical Air Trajectory Map Boarder VIEW by Web Service Composition

Datasets Used in FASTNET Data are accessed from autonomous, distributed providers DataFed ‘wrappers’ provide uniform geo-time referencing Tools allow space/time overlay, comparisons and fusion Near Real Time Data Integration Delayed Data Integration Surface Air Quality AIRNOWO3, PM25 ASOS_STIVisibility, 300 sites METARVisibility, 1200 sites VIEWS_OL40+ Aerosol Parameters Satellite MODIS_AOTAOT, Idea Project GASPReflectance, AOT TOMSAbsorption Indx, Refl. SEAW_USReflectance, AOT Model Output NAAPSDust, Smoke, Sulfate, AOT WRFSulfate Fire Data HMS_FireFire Pixels MODIS_FireFire Pixels Surface Meteorology RADARNEXTRAD SURF_METTemp, Dewp, Humidity… SURF_WINDWind vectors ATADTrajectory, VIEWS locs.

A Sample of Datasets Accessible through ESIP Mediation Near Real Time (~ day) It has been demonstrated (project FASTNET) that these and other datasets can be accessed, repackaged and delivered by AIRNow through ‘Consoles’ MODIS Reflectance MODIS AOT TOMS Index GOES AOT GOES 1km Reflec NEXTRAD Radar MODIS Fire Pix NRL MODEL NWS Surf Wind, Bext

FASTNET: Inter-RPO pilot project, through NESCAUM, 2004 Web-based data, tools for community use Built on DataFed infrastructure, NSF, NASA Project fate depends on sponsor, user evaluationFASTNET:

Some of the Tools Used in FASTNET –Data Catalog –Data Browser –PlumeSim, Animator –Combined Aerosol Trajectory Tool (CATT) Consoles: Data from diverse sources are displayed to create a rich context for exploration and analysis CATT: Combined Aerosol Trajectory Tool for the browsing backtrajectories for specified chemical conditions Viewer: General purpose spatio-temporal data browser and view editor applicable for all DataFed datasets

Midwest HazeCam Image Console Image Archive and Browser Image Archive and Browser Hourly Midwest HazeCam Images are archived by DataFed data access system Archived images for all cameras can be browsed through this console HazeCam URL for a day: URL for a site and day: URLs can be embedded as links into s, bookmarks, web pages, PPT and PDF files. Midwest HazeCam Image Browser Select date and timeSet image size and time MW HazeCam Console Other FASTNET Consoles

Aerosol Event Catalog: Web pages Catalog of generic ‘web objects’ – pages, images, animations that relate to aerosol events Each ‘web object’ is cataloged by location, time and aerosol type.

Distribution of Responsibility Distributed Responsibility in OpenDAP Responsibility The data lies with the data providers The data access protocol lies with OPeNDAP Application programs with the developers (Matlab,.. Excel…) Data discovery with the GCMD and NVODS Distributed Responsibility DataFed(??) The data lies with the data providers The wrappers and mediators with DataFed community Application programs with end user Data discovery with data & service registries

HMS + GOES