COMMUNITY. Data Acquisition and Usage Value Chain.

Slides:



Advertisements
Similar presentations
Web Services Implementation Case Study: DataFed Air Quality Data & Services Project Coordinators: Software Architecture: R. Husar Software Implementation:
Advertisements

Components of GIS.
Input Data Warehousing Canada’s Experience with Establishment Level Information Presentation to the Third International Conference on Establishment Statistics.
VIEWS / TSS Overview. End-to-end Air Quality Data and Decision Support VIEWS / TSS Vision Acquisition Import Unification Management Manipulation Retrieval.
Information Resources Management January 16, 2001.
Visibility Information Exchange Web System. Source Data Import Source Data Validation Database Rules Program Logic Storage RetrievalPresentation AnalysisInterpretation.
Federated PM and Haze Data Warehouse Project a sub- project of (enter your sticker & logo here ) Nov 20, 2001, RBH St. Louis Midwest Supersite Project.
Managing Data Resources
Integrated Decision Support: A Tale of Two Systems “It was the best of times, it was the worst of times…” Charles Dickens, A Tale of Two Cities, 1859 “Actually,
The Visibility Information Exchange Web System is a database system and set of online tools originally designed to support the Regional Haze Rule enacted.
WRAP Technical Support System for Air Quality Planning, Tracking, & Decision Support Tom Moore, Western Regional Air Partnership, Western Governor’s Association.
16 months…. The Visibility Information Exchange Web System is a database system and set of online tools originally designed to support the Regional Haze.
WRAP Technical Support System Project Update AoH Call October 19, 2005.
 MODERN DATABASE MANAGEMENT SYSTEMS OVERVIEW BY ENGINEER BILAL AHMAD
Chapter 1: The Database Environment
MIS 710 Module 0 Database fundamentals Arijit Sengupta.
Database Systems: Design, Implementation, and Management Ninth Edition
Chapter 1 Database Systems. Good decisions require good information derived from raw facts Data is managed most efficiently when stored in a database.
Web Self Service Take Home Message Web Self Service gives CRM information access to assigned non-CRM users.
Database Architecture Introduction to Databases. The Nature of Data Un-structured Semi-structured Structured.
DRAFT June 6, 2005 ESIP AQ Cluster, Air Quality Cluster Air Quality Cluster TechTrack Earth Science Information Partners Partners NASA.
DRAFT April 28, 2005 ESIP AQ Cluster, The data life cycle consists of the acquisition and the usage parts Usage ActivitiesData Acquisition.
Instrument Builders Information Specialists (ESIP) Scientists Curriculum Developers Teachers Decision Analysts Decision Makers Reports From Kim Kastens.
Case 2: Emerson and Sanofi Data stewards seek data conformity
© 2008 IBM Corporation ® IBM Cognos Business Viewpoint Miguel Garcia - Solutions Architect.
© 2009 Pearson Education, Inc. Publishing as Prentice Hall 1 Chapter 1: The Database Environment Modern Database Management 9 th Edition Jeffrey A. Hoffer,
Supersite Relational Database Project: ‘Federated PM Data Warehouse’ ‘Federated PM Data Warehouse Rudolf Husar, PI Center for Air Pollution Impact and.
Air Quality Focus Group Discussion Summary ESIP Winter Meeting January 2005 Air Quality is one of 12 Applications of National Priority as defined by NASA.
Universal Data Access and OLE DB. Customer Requirements for Data Access Technologies High-Performance access to data Reliability Vendor Commitment Broad.
Data Management Console Synonym Editor
Supersite Relational Database Project: (Data Portal?) a sub- project of St. Louis Midwest Supersite Project Draft of the November 16, 2001 Presentation.
5 - 1 Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved.
An Integrated Systems Solution to Air Quality Data and Decision Support on the Web GEO Architecture Implementation Pilot – Phase 2 (AIP-2) Kickoff Workshop.
Building Data and Document-Driven Decision Support Systems How do managers access and use large databases of historical and external facts?
Spatio-Temporal Data Sharing using XML Web Services Presented at the Workgroup Meeting on Web-based Environmental Information System for Global Emission.
6.1 © 2010 by Prentice Hall 6 Chapter Foundations of Business Intelligence: Databases and Information Management.
DataFed Challenge. Value-Adding Processes Integrated DataDatasets Std. Interface Data Views Std. Interface Data Control Reports Obs. & ModelsDecision.
Current Air Quality Information ‘Ecosystem’ (Draft for Feedback) AQ information includes emissions, ambient & satellite data and model outputs The distributed.
Stefan Falke Center for Air Pollution Impact and Trend Analysis Washington University in St. Louis Brooke Hemming US EPA – Office of Research and Development.
Air Quality Cluster Air Quality Cluster TechTrack Earth Science Information Partners Partners(?) NASA NOAA EPA USGS DOE NSF Industry… Data Flow Technologies.
Supersite Relational Database Project: (Data Portal?) a sub- project of St. Louis Midwest Supersite Project Draft of the November 16, 2001 Presentation.
WS Roadmap. The pathway to a service-oriented architecture The pathway to a service-oriented architecture Bob Sutor, IBM IBM identified four steppingstones.
Building Dashboards SharePoint and Business Intelligence.
Smoke Event Public EPA NAAQS Exc. Events States: AQ Warning NOAA Travel Advisories AQ Forecasting FAA Flight Advisories NASA Earth Obs: Public.
Mercury – A Service Oriented Web-based system for finding and retrieving Biogeochemical, Ecological and other land- based data National Aeronautics and.
CS562 Advanced Java and Internet Application Introduction to the Computer Warehouse Web Application. Java Server Pages (JSP) Technology. By Team Alpha.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
Dvoy Related Ideas. Data Acquisition and Usage Value Chain.
Air and Waste Management Association Professional Development Course AIR-257: Satellite Detection of Aerosols Issues and Opportunities Fraction.
NASA REASoN Project SHAirED: S ervices for H elping the Air -quality Community use E SE D ata Stefan Falke, Kari Höijärvi and Rudolf Husar, Washington.
NASA REASoN Project SHAirED: S ervices for H elping the Air -quality Community use E SE D ata Stefan Falke, Kari Höijärvi and Rudolf Husar, Washington.
Dvoy Networking Ideas. OpenGIS Web Services Mission: Definition and specification of geospatial web services. A Web service is an application that can.
Processes of the Information Value Chain Informing Knowledge ActionProductive Knowledge Information Organizing Grouping Classifying Formatting Geo-referencing.
Web Services-Based Mediator of Distributed Data Flow and Processing Project Coordinators: Software Architecture: R. Husar Software Implementation: K. Höijärvi.
GEOSS A single dataset will serve many communities Any single problem requires many datasets Register Discover.
An Integrated Fire, Smoke and Air Quality Data & Tools Network Stefan Falke and Rudolf Husar Center for Air Pollution Impact and Trend Analysis Washington.
DRAFT June 6, 2005 ESIP AQ Cluster, Contact R. Husar Air Quality Cluster Air Quality Cluster TechTrack Earth Science Information Partners.
Application of NASA ESE Data and Tools to Particulate Air Quality Management A proposal to NASA Earth Science REASoN Solicitation CAN-02-OES-01 REASoN:
Topic Suggestions Scheffe GEOSS Support to Regional Air Quality (see next slide) –Data. Services –Sharing/Harvesting Infrastructure –Intellectual Resources.
Voyager Data Services Services for Finding, Exploring and Presenting Distributed Environmental Data Outline Prepared by Voyager Interest Group on Environmental.
Building Systems for Today’s Dynamic Networked Environments A Methodology for Building Sustainable Enterprises in Dynamic Environments through knowledge.
The ECOST Web-based platform for data providers and for data users.
Federal Land Manager Environmental Database (FED) Overview and Update June 6, 2011 Shawn McClure.
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
There is increasing evidence that intercontinental transport of air pollutants is substantial Currently, chemical transport models are the main tools for.
Popular Database Management Systems
Federal Land Manager Environmental Database (FED)
Enterprise Program Management Office
Chapter 17: Client/Server Computing
VIEWS / TSS Overview.
Presentation transcript:

COMMUNITY

Data Acquisition and Usage Value Chain

Data Processing Value Chain Monitor Store Data 1 Monitor Store Data 2 Monitor Store Data n Monitor Store Data m IntData1 IntDatan IntData2 Virtual Int. Data

Information Processing Value Chain (Taylor, 1975) Informing Knowledge ActionProductive Knowledge InformationData Organizing Grouping Classifying Formatting Displaying Analyzing Separating Evaluating Interpreting Synthesizing Judging Options Quality Advantages Disadvantages Deciding Matching goals, Compromising Bargaining Deciding Forces to Move Data one-shot to reusable form External force – contracts Internal – humanitarian, benefits Resistances to Move Data Mechanical Personal Institutional

Assigning maintenance responsibility (Wiederhold) a. Source data quality – supplier database, files, or web pages b. Interface to the source– wrapper, supplier or vendor for supplier c. Source selection – expert specialist in mediator d. Source quality assess. – customer input to mediator e. Semantic interoperation – specialist group input to the mediator f. Consistency & metadata – mediator service operation or warehouse g. Informal, integration – client services with customer input h. User presentation– client services with customer input Services Sources Customers

Standard Data Support System Data management systems, DBMS Data processing end exploration tools Presentation tools

PM/Haze Data Flow in Support of AQ Management There are numerous organizations in need of data relevant to PM/Haze Most interested parties (stakeholders) are both producers and consumers of PM and haze data There is a general willingness to share data but there are many physical and organizational resistances to data flow and processing RPO Regional Planning Orgs FLM Federal Land Managers EPA EPA Regul. & Research Industry Academic NARSTO Other: Private, Academic SuperSite Shared PM/Haze Data PM and haze data are used for may parts of AQ management, mostly in form of Reports The variety of pertinent (ambient, emission) data come from many different sources To produce relevant reports, the data need to be ‘processed’ (integrated, filtered aggregated)

PM/Haze Data Flow in Support of AQ Management PM and haze data are used for may parts of AQ management, mostly in form of Reports The variety of pertinent (ambient, emission) data come from many different sources To produce relevant reports, the data need to be ‘processed’ (integrated, filtered aggregated) Data from multiple measurements are shared by their providers or custodians Data are integrated, filtered, aggregated and fused in the process of analysis Reports use processed data for Status and Trends; Exposure Assessment; Compliance

Data Re-Use and Synergy Data producers maintain their own workspace and resources (data, reports, comments). Part of the resources are shared by creating a common virtual resources. Web-based integration of the resources can be across several dimensions: Spatial scale:Local – global data sharing Data content:Combination of data generated internally and externally The main benefits of sharing are data re-use, data complementing and synergy. The goal of the system is to have the benefits of sharing outweigh the costs. Content User Local Global Virtual Shared Resources Data, Knowledge Tools, Methods User Shared part of resources

Integration for Global-Local Activities Global Activity Local Benefit Global data, toolsImproved local productivity Global data analysisSpatial context; initial analysis Analysis guidance Standardized analysis, reporting Local Activity Global Benefit Local data, tools Improved global productivity Local data analysisElucidate, expand initial analysis Identify relevant issuesResponsive, relevant global analysis Global and local activities are both needed – e.g. ‘think global, act local’ ‘Global’ and ‘Local’ here refers to relative, not absolute spatial scale

Content Integration for Multiple Uses (Reports) Data from multiple measurements are shared by their providers or custodians Data are integrated, filtered, aggregated and fused in the process of analysis Reports use processed data for Status and Trends; Exposure Assessment; Compliance The creation of the needed reports requires data sharing and integration from multiple sources.

DATAFED Rationale As much as possible, data should reside in their respective home environment. ‘Uprooted’ data in centralized databases need updated and maintained. Data Providers would need to ‘open up’ their SQL data servers for limited data subsets and queries, in accordance with a ‘contract’. However, the data structures of the Providers will not need to be changed. Retrieval of uniform data from the data warehouse facilitates integration and comparison along the key dimensions (space, time, parameter, method) The open architecture of DATAFED and the use of web-standards promotes the building tools by and for the community: Data Viewers, Data Transformers and Integrators, Report Generators, Renderers etc..