The Federated Data System DataFed R. Husar, K. Hoijarvi, S. Falke, DaFed Community EPA Data Summit, Feb. 12, 2008, RTP Non-intrusive data integration infrastructure.

Slides:

Advertisements

Similar presentations

Air Quality and Health Scenario Stefan Falke, Rudy Husar, Frank Lindsay, David McCabe.

Advertisements

1 GEOSS Architecture Implementation Pilot (AIP) Phase 2 Air Quality and Health Working Group Stefan Falke, Rudy Husar, Frank Lindsay, David McCabe, Erin.

REASoN REASoN Project to link NASA's data, modeling and systems to users in research, education and applications Application of NASA ESE Data and Tools.

Enabling Tools and Methods for International, Inter- disciplinary and Educational Collaboration E. M. Robinson, K. Hoijarvi, S. Falke, E. Fialowski, M.

Web 2.0 in Air Quality Analysis and Management Rudolf B. Husar and Erin M. Robinson Washington University, St. Louis, MO 2007 National Environmental Information.

Enhancing Data Discovery, Understanding and Usage through an Air Quality Metadata System ISRSE, 6 May 2009 The Palazzo dei Congressi di Stresa Stresa,

GEOSS Architecture Describes how components fit together for providing data and information that will be better …than the individual components or systems.

ESIP Winter Meeting, Jan.9-10, 2008 EIE Vision The Earth Information Exchange is an integrated system of distributed components that work together to expedite.

ESIP Vision: “Achieve a sustainable world” by Serving as facilitator and advisor for the Earth science information community Promoting efficient flow of.

ESIP Air Quality Workgroup and the GEO Air Quality Community of Practice collaboratively building an air quality community network for finding, accessing,

Emissions Information Infrastructures NEISGEI and GEOSS Stefan Falke Northrop Grumman and Washington University in St. Louis

Global Earth Observation System of Systems (GEOSS) Architecture Implementation Pilot (AIP) Air Quality and Health Working Group Stefan Falke, Rudy Husar,

Air Quality Cluster Earth Science Information Partners Goals 1. Serve as facilitator and advisor.

AIRNow-International The future of the United States real-time air quality reporting and forecasting program and GEOSS participation John E. White U.S.

DRAFT June 6, 2005 ESIP AQ Cluster, Air Quality Cluster Air Quality Cluster TechTrack Earth Science Information Partners Partners NASA.

2009 Progress Report to UIC: GEOSS Air Quality Community of Practice (AQ CoP link to cop site ) Rudolf Husar (Point of Contact, Washington.

Air Quality Workgroup Earth Science Information Partners The ESIP Air Quality Workgroup and its role in a Community Information Infrastructure

REASoN REASoN Project to link NASA's data, modeling and systems to users in research, applications and education Application of NASA ESE Data and Tools.

ESIP Air Quality Cluster. ESIP Federation A Network of Diverse Organizations Working Together to Bring Earth Observation Information to Bear on Environmental.

ESIP Air Quality Cluster 2006 ESIP Summer Meeting: “ Exchanging and Connecting Ideas & Resources ” 17th Federation Assembly Meeting Lamont-Doherty Earth.

ESIP Federation Air Quality Cluster Partner Agencies.

ESIP Federation 101 Federation of Earth Science Information Partners.

GEOSS AIP-2 Overview AIP-2 Societal Benefit Area Working Groups: Air Quality & Health Disaster Response Biodiversity and Climate Renewable Energy Air Quality.

Air Quality Cluster Stefan R. Falke 1,2 and Rudolf B. Husar 2 (1) Northrop Grumman Corp, (2) Washington University, St. Louis, MO Partners NASA NOAA EPA.

REASoN REASoN Project to link NASA's data, modeling and systems to users in research, education and applications Application of NASA ESE Data and Tools.

REASoN REASoN Project to link NASA's data, modeling and systems to users in research, education and applications Application of NASA ESE Data and Tools.

GEOSS Air Quality Community Infrastructure ESIP, 23 July 2010 Knoxville, TN E.M. Robinson, R.B. Husar, S.R. Falke, E.T. Habermann, A. Warnock, M. Hogeweg,

NASA Air Quality Applications Program and the ESIP Air Quality Cluster The goal of the NASA Air Quality Management program is to: Enable partners’ beneficial.

An Atmospheric Composition Constellation Portal Overview ACC Workshop – Air Quality ESRIN Frascati, Italy 15 June 2009.

Current Project Objectives The project’s focus is on criteria pollutants and toxics because of their availability and accessibility. Recommend and demonstrate.

1 Using the GEOSS Common Infrastructure in the Air Quality & Health SBA: Wildfire & Smoke Assessment Prepared by the GEOSS AIP-2 Air Quality & Health Working.

ESIP Vision: “Achieve a sustainable world” by Serving as facilitator and advisor for the Earth science information community Promoting efficient flow of.

REASoN REASoN Project to link NASA's data, modeling and systems to users in research, education and applications Application of NASA ESE Data and Tools.

Enabling Tools and Methods for International, Inter- disciplinary and Educational Collaboration E. M. Robinson, K. Hoijarvi, S. Falke, E. Fialowski, M.

AQ Science Problems Complex Needs: –Multiple datasets –Multiple Tools –DIVERSE Community of People Underlying data infrastructure is being developed to.

R.Husar From Dedicated to Federated Data Systems Data ProvidersDecisionsDSS CIRA VIEWS Reg. Haze EPA AQS NAAQS EPA AirNow.

International Collaboration, Interoperable Data Flows, Architecture of GEOSS R.B. Husar, E. M. Robinson, J. D. Husar and M. Kieffer, Wash. Univ. G. Percivall,

2010 Progress Report to UIC: GEOSS Air Quality Community of Practice (AQ CoP) Rudolf Husar (Point of Contact, Washington University in.

Brooke L. Hemming, Ph.D. US EPA/National Center for Environmental Assessment Stefan Falke, Ph.D. Washington University in St. Louis Terry Keating, Ph.D.

ESIP AQ Cluster Community Components for the Air Quality SBA in AIP-2.

Fire Emissions Network Sept. 4, 2002 A white paper for the development of a NSF Digital Government Program proposal Stefan Falke Washington University.

NASA REASoN Project SHAirED: S ervices for H elping the Air -quality Community use E SE D ata Stefan Falke, Kari Höijärvi and Rudolf Husar, Washington.

NASA REASoN Project SHAirED: S ervices for H elping the Air -quality Community use E SE D ata Stefan Falke, Kari Höijärvi and Rudolf Husar, Washington.

2009 Progress Report to UIC: GEOSS Air Quality Community of Practice (AQ CoP link to cop site ) Rudolf Husar (Point of Contact, Washington.

Perspectives on GEOSS & Air Quality Collated, Jan 2008, rbh Air Quality Application Perspective Keating, EPA: Global Air Quality Assessment and Forecasting.

Introduction to GEO Air Quality Community of Practice GEO AQ CoP - Wiki Workspace GEO AQ CoP - Wiki Workspace Rudolf Husar, Washington University, MO Stefan.

GEOSS A single dataset will serve many communities Any single problem requires many datasets Register Discover.

Application of NASA ESE Data and Tools to Air Quality Management Stefan Falke and Rudolf Husar (Co-PIs) Washington University in St. Louis Project Period:

1 Using the GEOSS Common Infrastructure in the Air Quality & Health SBA: Wildfire & Smoke Assessment Prepared by the GEOSS AIP-2 Air Quality & Health Working.

: Data Sharing/Processing Infrastructure Data Catalog and Access Dozens of datasets on aerosols, emissions, fire, meteorology,

The Federated Data System DataFed: Experiences in Data Homogenization and Networking R.B. Husar, K. Hoijarvi, S. R. Falke, E. M. Robinson, Washington University,

DRAFT June 6, 2005 ESIP AQ Cluster, Contact R. Husar Air Quality Cluster Air Quality Cluster TechTrack Earth Science Information Partners.

Application of NASA ESE Data and Tools to Particulate Air Quality Management A proposal to NASA Earth Science REASoN Solicitation CAN-02-OES-01 REASoN:

Harmonization and Integration of Semi- Structured Data Through Wikis and Controlled Tagging E. M. Robinson, R. B. Husar Washington University, St. Louis,

Topic Suggestions Scheffe GEOSS Support to Regional Air Quality (see next slide) –Data. Services –Sharing/Harvesting Infrastructure –Intellectual Resources.

HTAP Data Network GEO Task DA-09-02d: Atm. Model Evaluation Network Project Officer: Terry Keating, EPA ESIP Meeting, Air Quality Workgroup January 5,

Fire, Smoke & Air Quality: Tools for Data Exploration & Analysis : Data Sharing/Processing Infrastructure This project integrates.

NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Reuse Working Group Earth Science Data Systems Reuse Working Group Case Study: SHAirED Services for.

Federation of Earth Science Information Partners EGIDA Workshop May 9-11, 2011, Bonn, Germany.

ESIP Vision: “Achieve a sustainable world” by Serving as facilitator and advisor for the Earth science information community Promoting efficient flow of.

AIP-3 Kickoff Workshop Summary Health SBA: Air Quality and Infectious Diseases Kick-off Session Leads: Stefan Falke, François MARQUES GEOSS AIP-3 Kickoff.

Global Earth Observation System of Systems (GEOSS) Architecture Implementation Pilot (AIP) Air Quality and Health Working Group Stefan Falke, Rudy Husar,

Earth Science Information Partners

ESIP Air Quality Custer Initiative Workspaces: Connecting Data Producers, Analysts Decision Makers Winter ESIP Meeting, January 8, 2008, Washington.

The GEO Air Quality Community of Practice AQ CoP

GEOSS Air Quality Community Infrastructure

WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe

The GEO Air Quality Community of Practice

4/5 May 2009 The Palazzo dei Congressi di Stresa Stresa, Italy

Air Quality Data Systems and the GEOSS Architecture

Presentation transcript:

The Federated Data System DataFed R. Husar, K. Hoijarvi, S. Falke, DaFed Community EPA Data Summit, Feb. 12, 2008, RTP Non-intrusive data integration infrastructure Standard web services for data access, processing Tools from shared-reusable service components For more details see extended DataFed presentationextended DataFed presentation

Selected DataFed Tools Consoles, CATTViewers, Browsers:

100+ Distributed Federated Datasets for use by people and other Data Systems

Data-Centric Workspace: DataSpaces Catalog - Find Dataset Describe Dataset Discuss Dataset Earth Science Information Partners (ESIP) Semantic Wiki: Structured (RDF) and Unstructured Content Open, Standard Matadata Ready for Export/Harvesting by Registries, Catalogs, Portals, Mashups, … Metadata Aggregation

DataFed Applications ( ) Science Data Integration, Fusion Mystery (Nitrate?) Events AQ Event Detection AQ Management Exceptional Event Analysis (EPA – N. Frank) Network Assessment (EPA – R. Scheffe) Global, Regional Emissions (EPA – T. Keating) FASTNET, CATT Tools, S/R Analysis (RPO – R. Poirot) IS Networking Infrastructure GEOSS Interoperability Demos NASA/ESIP Web Services, (NASA) HTAP Network, Integration (EPA – Keating) Collaboration in Virtual Workgroups (NSF) GEOSS

Objectives: standards-based access to distributed emission inventory data tools for data processing and analysis means for sharing data & tools contribute to community-based, collaborative environments (cyberinfrastructure) Approach: Create OGC services for emissions related data Use DataFed to register datasets, provide OGC interfaces for datasets, develop analysis services, and create service workflows Develop emission analysis tools to compare emissions inventories Create “mashup” applications for analysis and visualization Develop information exchange connections within service oriented frameworks and with Web 2.0 technologies Mashups Flows Analyses Stefan Falke – Northrop Grumman, Washington U., ESIP

Component Connections RSS NEISGEI Portal RSS Smog Blog NEISGEI Mashup Saved Analyses RSS del.icio.us DataFed analyses ESIP DataSpaces Analysis Services NEISGEI WCSDataFed WCS FGDC SERF Giovanni WCS “drive” analysis workflow results DataFed Catalog Global Change Master Directory Geospatial One Stop DataFed Service Workflow Engine Wiki Workspace

Air Quality Cluster Earth Science Information Partners Goals 1. Serve as facilitator and advisor for the Earth science information community. 2. Promote flow of Earth science data from collection to end-use. 3. Improve usability of Earth science data and information systems. 4. Expand the use of Earth science information – get it to the decision-makers. 5. Educate the public about Earth science and science information systems. datatools,methods,services AQ Cluster builds links among groups in order to achieve an effective use of data in decision- making that could not be achieved by any organization acting on its own. Connect air quality data consumers and data producers:  bringing people and ideas together for delivering earth science data to AQ researchers, managers and other users/consumers  facilitate and demonstrate information flow from data providers to AQ consumers datatools,methods,services a) b) c) AQ Cluster aids in reuse of data, processing tools and other services across projects, programs and agencies. users

Recent Cluster Interaction Provided a coordination/collaboration forum for following activities Community ActivityCluster Interaction AQ Data Summit wiki workspace, ESIP profile GEOSS Architecture Implementation Pilot scenario input, wiki workspace, telecon discussions NOX Data Synthesis Workshop workshop development and coordination, group preparations, wiki, suggestions for standards-based interoperability between OMI providers and AQ users S.Cal Smoke Wiki wiki, contributed smoke data/analysis web content DataSpaces host on wiki, metadata aggregation, provide content, discussions on design; coordination with educational DataSheets Other interaction: NSF proposal coordination, NASA proposal submissions, data lineage design discussions

DataFed Websites DataFed.net Portal Wiki Data Catalog Presentations