Emerging Approaches to the Integration of Autonomous Heterogeneous Air Quality Information Systems Invited Paper IN13E-01 American Geophysical Union, San Francisco December 11, 2006 Richard Scheffe US Environmental Protection Agency Rudolf B. Husar Washington University, St. Louis

GEOSS Eco-informatics Accountability/ indicators SIPs, nat.rules designations PHASE PM research Risk/exposure assessments AQ forecasting Programs NAAQS setting EPA NOAA NASA NPS USDA DOE Private Sector States/Tribes RPO’s/Interstate Academia NARSTO NAS, CAAAC CASAC, OMB Enviros Organizations CDC Supersites IMPROVE, NCore PM monit, PAMS CASTNET Lidar systems NADPSatellite data Intensive studies PM centers Other networks: SEARCH, IADN.. Data sources CMAQ GEOS-CHEM Emissions Meteorology Health/mort. records Entities participating in AQ information exchannge Unfortunately, the inner working of the IS that links these entities is not yet understood. The challenge posed by R. Scheffe : Please e xplain this Informatics Mess

2. Is data sharing a viable approach to achieve the convergence & optimization? Common data Client Data Overlaps Monitoring Satellite Modeling 1. Can we integrate air quality information through partnerships? Specific AQ Informatics Questions:

Infromatics Challenges Science: Understand and explain how IS work Dependencies, driving forces (co-opetition) and processes of IS Engineering: Design of Info Systems Information Flow, SAO, System of Systems Technology: Harnessing and harvesting IT & the web. Web Services, Workflow, Social Software, Google *.* Web2.0, RSS

Data are distributed geographically by autonomous providers Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form Data includes emissions Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form Information Providers: Geography, Content, Agency, Form Data includes emissions, ambient data, Ambient Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form Data includes emissions, ambient data, satellite data Satellite Ambient Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form Data includes emissions, ambient data, satellite data and model output Model Satellite Ambient Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form Data are provided by multiple agencies: EPA, NOAA, NASA and others NASA Mission NOAA GASP NASA IDEA NASA DAACs NOAA ASOS EPA-AQS DataMart EPA AIRNow RPO VIEWS FS FireInv State/Local Emission EPA NEISGEI EPA NEI NOAA WeaMod EPA AQModel NOAA Forecast Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form NASA DAACs NOAA GASP NASA IDEA NASA Missions EPA NEI EPA NEISGEI FS FireInv State/Local Emission NOAA ASOS RPO VIEWS EPA AIRNow EPA-AQS AIRS NOAA WeaMod EPA AQModel NASA GloModel NOAA Forecast Furthermore, data are provided in varied formats and access protocols Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form Data on Internet are geography-independent and can be ‘linearized’ Internet Remote Sensing Surface Obs Emission SciForec ast Model

Users are distributed geographically EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist Policy Users includes policy makers EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist Users includes policy makers, the public Policy Public EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist Users includes policy makers, the public, AQ managers Policy Public Manager EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist and scientist Policy Public Manager Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist Users are affiliated with multiple agencies: EPA, NOAA, NASA, as well as others Policy Public Manager Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist Users: By Types, Agency, Info Needs Furthermore, users need various types of information provided in multiple formats Policy Manager Policy Scientist ManagerScientist Policy Public EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist Since the users are also on the Internet, their geographic location is irrelevant Public Manager Scientist Internet other

Information System Challenge Refining and delivering information Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow other s Data Knowledge

Agile Information System: Data Access, Processing and Products Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow other s Data Organizing Document Structure/Format Interfacing Value Adding Processes

Agile Information System: Data Access, Processing and Products Uniform Access Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow other s Data Organizing Document Structure/Format Interfacing Value Adding Processes Homogenizing Format profile Standard access Data as Service

Agile Information System: Data Access, Processing and Products Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataF ed Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow other s Data Organizing Document Structure/Format Interfacing Characterizing Display/Browse Compare/Fuse Characterize Value Adding Processes Homogenizing Format profile Standard access Data as Service

Agile Information System: Data Access, Processing and Products Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataF ed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow other s Data Analyzing Filter/Integrate Aggregate/Fuse Custom Analysis Organizing Document Structure/Format Interfacing Characterizing Display/Browse Compare/Fuse Characterize Value Adding Processes Homogenizing Format profile Standard access Data as Service

Value-Adding Processes Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataF ed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow other s Data Analyzing Filter/Integrate Aggregate/Fuse Custom Analysis Organizing Document Structure/Format Interfacing Characterizing Display/Browse Compare/Fuse Characterize Reporting Inclusiveness Iterative/Agile Dynamic Report Value Adding Processes Homogenizing Format profile Standard access Data as Service

Agile Information System: Data Access, Processing and Products Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataF ed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Control Provider NASA DAACs EPA Model EPA AIRNow other s Data Control Seeking Information Providing Information Negotiating & Market Space

Infromatics Challenges Science: Understand and explain how IS work Dependencies, driving forces (co-opetition), information processes Engineering: Design of Info Systems Information Flow, SAO, System of Systems Technology: Harnessing and harvesting IT & the web. Web Services, Workflow, Social Software, Google *.* Web2.0, RSS

Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataF ed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Control Data Acquisition Provider NASA DAACs EPA Model EPA AIRNow other s Data Standard Data Query Language: Where? When? What? (Space-time query by OGC WMS, WCS) GetCapabilities GetData Capabilities, ‘Profile’ Data Where? When? What? Which Format? Server Back End Std. Interface Client Front End Std. Interface QueryGetData Standards Where?BBOXOGC, ISO When?TimeOGC, ISO What?TemperatureCF FormatnetCDF, HDF..CF, EOS, OGC T2T1 Loosely Coupled Data Access through Standard Protocols

Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataF ed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Control Data Acquisition Provider NASA DAACs EPA Model EPA AIRNow other s Data Web Services and Workflow for Loose Coupling Service Broker Service Provider Publish Find Bind Service User Web Service Interaction Service Chaining & Workflow Web Services Triad: Publish – Find – Bind Workflow Software: Dynamic Linking Software Mashups Software Mashup: Coarse-grain Linking

Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataF ed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Control Data Acquisition Provider NASA DAACs EPA Model EPA AIRNow other s Data Collaborative Reporting and Dynamic Delivery Co Writing - Wiki ScreenCast Collaborative Analysis and Writing Wiki, Blogs, Group Annotations Dynamic Content Delivery: GoogleEarth, Screencasting…

Summary There IS an ‘alignment of stars’ for integrating AQ data systems Third-party mediation can homogenize the distributed data Agile SOA-based IS can deliver info products to diverse users Since 2005, one such IS, DataFed is used by EPA and in research

Some major AQ Information System Challenges (Same as the DoD, ES Challenges?) WCS/W MS Ap p Are WCS/WMS Convergence Protocols? Connecting Humans! Right Level of Networking?

DataFed assumes autonomous data providers Non-intrusively wraps data into web services Provides processing and analysis tools

Apparent divergences? Organizations have different missions NPS Protect ecosystems, AQ WQ NASA Explore fundamental Earth System Properties USDA Protect/optimize Ag and forest resources EPA ( Protect human health & envi. Improve air, water, ecosystem CDC To promote health and quality of life …. NOAA To understand and predict changes in the Earth’s environment and …

Collaboration (culture) empire building? Observation technologies {e.g., satellites} Computational power Science, talent {embodied in AQ models and young geniuses } Budgets, agency collaboration resource/program accountability Accountability, ↓ regulatory assessments {e.g., NAS, CASAC} Information technologies {e.g., data sharing protocols} Alignment Stars aligned?