1. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION Technology Infusion Working Group Karen Moe, NASA/ESTO Rob Raskin, NASA/JPL Earth Science Data Systems Working Group Meeting College Park, MD November 14 - 16, 2006

2. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 2 Agenda Mission & Scope Activities & Accomplishments –Process & Strategies –Web Services –Semantic Web –Capability Vision Breakout Session Agenda Technology Showcase –Web Services and Semantic Web Demonstrations

3. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 3 Tech Infusion Working Group Mission –Enable NASA’s Earth Science community to reach its research, application, and education goals more quickly and cost effectively through widespread adoption of key emerging information technologies Scope –Information technologies that... Provide capabilities critical to the ESD mission & vision Have been substantially developed (TRL6-9) but have not been widely deployed Cannot be obtained simply through reuse of mature subsystems or software May be slow to be adopted because of the unique characteristics of Earth science (e.g., high data volumes) Approach –Improve community understanding of the technology infusion process –Identify barriers and solutions to technology adoption –Use case studies to evaluate effectiveness of infusion processes –Identify and evaluate new and emerging technologies –Develop roadmaps for adoption of key technologies

4. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 4 TIWG 2006 Activities Maintained 3 active subgroups –Infusion Process and Strategies Subgroup lead: Steve Olding –Web Services Subgroup lead: Ken Keiser (UAH) –Semantic Web Subgroup leads: Rob Raskin (JPL) and Peter Fox (NCAR) Conducted weekly telecons –1st Thursday: Full working group –2nd Thursday: Process and Strategies –3rd Thursday: Web Services –4 th Thursday: Semantic Web Presented posters at January and July ESIP Federation meetings, Geoinformatics 2006, AGU Joint Assembly, and ESTC 2006 Held TIWG breakout session at July ESIP Federation meeting

5. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 5 Subgroup Activities Process and Strategies –Completed infusion process document –Conducted infusion readiness case study (REACT) –Developed infusion readiness assessment Web Services –Reviewed OGC Web Coverage Service –Developed web services demonstrations in collaboration with ESIP Federation Web Services Cluster –Presented web services demos at the July ESIP Federation meeting Semantic Web –Reviewed current maturity of semantic web technologies –Developed semantic web roadmap Capability Vision –Continued dissemination of the capability vision –Presented the vision at Geoinformatics 2006, AGU Joint Assembly, ESTC 2006, and July ESIP Federation meetings

6. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION Technology Infusion Process and Strategies Sub-Group

7. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 7 Technology Infusion Process Overview Summarizes 2005 findings 3 perspectives on technology infusion –The innovation development process –The innovation-decision process –TIWG infusion process Conclusion and Recommendations –Infusion Education –New Technology Awareness –Technical Support –Funding for Infusion –Technology Assessment Process

8. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 8 Innovation Decision Process Model Socioeconomic characteristics Personality variables Communication behavior Adoption Characteristics of the 'Decision-Making Unit' Prior Conditions Perceived Characteristics of the Innovation Decision Knowledge Persuasion Confirmation Implementation Communication Channels Relative advantage Compatibility Complexity Trialability Observability Previous practice Felt needs / problems Innovativeness Norms of the social systems Rejection Continued Adoption Continued Rejection Later Adoption Discontinuance Adapted from: Rogers (1995),”Diffusion of Innovations” - the means by which a message gets from the source to the receiver -different channels may play different roles in creating awareness and persuading individuals to change their attitude towards the innovation

9. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 9 REACT Technology Infusion Case Study Rapid Environmental Assessment Composition Tools (REACT) –Client application - part of the decision support tools being implemented by ACT under a cooperative agreement with NASA –Provides network centric services (client-to-server and peer-to-peer) for reading, reprojecting, and subsetting geo-spatial satellite imagery Infusion case study –Conducted infusion readiness case study using REACT as an example of a new technology preparing for infusion –Evaluated infusion readiness using the infusion decision process model Developed a self-assessment questionnaire –Questions designed to elicit preparedness of the technology for infusion –Based on infusion decision process model REACT Schedule and Key Deliverables Year 1: Application Component – a) Req. Gathering, b) Install high end HW/SW to ingest/process/serve data, c) enhance current Fusion server & Decision Support Tool Technology. Year 2: Application Component – a) Demonstrate widely available internet access to all data levels, b) develop initial Hazardous Algal Bloom product based on satellite/model data in GIS and other compatible formats, c) add new data streams (e.g. NPP VIIRS) Year 3-5: Application Component – a) Expand to other application areas, geographic areas, and data sources, b) identify and customize architecture to provide additional decision support tools, assist in transition of application to operation.

10. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 10 Technology Infusion Readiness Assessment Questions –Target users and target user characteristics Identifying the prospective users. –Innovation characteristics Factors affecting prospective users’ perceptions of the technology. –Financial What are the financial implications of adopting the technology for the prospective user? –Productization How much effort is required to take a technology that is proven in the lab and turn it into a 'product' –Communication channels How will we communicate with the different prospective users? –Characteristics of the innovation decision How will the decision to adopt the innovation be made?

11. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION Technology Infusion Web Services Sub-Group

12. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 12 Web Service Chaining Demo Goal: –Demonstrate collaborative service “chains” by connecting together services from many ESIP Federation members Example Scenario: –Analyze an Air Quality event Demo Participants –GENESIS SciFlo Workflows – Brian Wilson –DataFed – Rudy Husar –BPELPower Workflows – Liping Di, Peisheng Zhao –WIPE/REACT engine – Eric Malaret –OpenDAP / ECHO – Peter Cornillion & Michael Burnett

13. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 13 Carbon Cycle Web Service Chaining Demo Success Story –Developed as a collaboration between TIWG and ESIP Federation Web Services Cluster Activity organized using the Federation Wiki, WS Cluster telecons, and TIWG telecons (participants are geographically dispersed) Nine groups published callable services on the Wiki Six groups participated in service choreography demos –Demonstrated service chains for data query & access, visualization, image overlay, and simple data fusion –Demonstrated interoperability between different types of services: OGC WMS/WCS, SOAP, OpenDAP A service chain can combine all three –Identical Air Quality analysis chains executed by both BPELPower & SciFlo workflow engines Two different environments for authoring XML workflow documents]

14. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 14 Carbon Cycle Geographically Distributed Participants & Services GENESIS SciFlo GeoRegionQuery services SciFlo workflow engine DataFed WCS, Render, Aggregate services GMU LAITS WMS/WCS, Reprojection, Reformatting services BPELPower workflow WIPE from ACT Query, coverage, mosaics MSHELL analysis pipelines UAH WMS, HDFEOS Subsetting ADaM Data Mining SURA SCOOP SOAP Catalog & Inventory services for ocean data Join us at: http://wiki.esipfed.org/index.php/Available_Services

15. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 15 Carbon Cycle Air Quality Scenario AIRNOW.pmfine WCS SURF_MET.temp WCS Render SOAP Image MODIS Image via WMS Overlay Images SOAP Fused Image Dataflow Combines 5 remote services: - OGC WCS calls (2) - OGC WMS call - SOAP services to render & overlay images Executable by BPELPower or SciFlo workflow engines

16. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 16 Carbon Cycle Lessons Learned Challenges / Lessons Learned –Daunting semantic variation in service interfaces Many ways to describe a lat/lon bounding box, etc. We leveraged OGC WMS/WCS popularity by creating SOAP services with similar semantics Ultimately need standards, taxonomies, & semantic mediation –Simple, modular XML standards (Microformats) are best GML is too large & complex for easy use –Simple, flat service interfaces are more reusable Complex, deeply hierarchical XML input/output docs. are difficult to generate correctly & extract information from Should hide complexity whenever possible –Demonstrated service chains were simple, but a good start More complex analysis & data fusion scenarios will be challenging

17. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 17 Carbon Cycle Web Service Chaining On-Going Work –Add domain scenarios from all Federation Application Clusters Science Analysis Real-Time Decision Support –Publish & call more kinds of services Subsetting, Aggregation, Geo-Transformations, Re-projection, Data Fusion, Custom Analysis, Data Mining, Decision Support –Develop & exploit standard XML Microformats De facto geo-location standards from Google Earth, Microsoft Virtual Earth, & GIS world; and science domain standards Simple microformats agreed upon on-the-fly during collaborations –Join the growing “Chain Gang”, please... Publish your services on the Wiki (we will call them) Develop or participate collaboration scenarios

18. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 18 Web Services Roadmap On-Going Work –Update Web Services Roadmap to reflect experience with the demonstrations Technology  Geospatial services established  Open geospatial services proliferate  Production quality geospatial services  Geospatial service catalog established (WSDL, UDDI)  Common geospatial schema adopted (GML, ESML)  Standard workflow language infused (BPEL)  Open geospatial ontology converges (OWL)  Local processing + data exchange  Basic data tailoring services (data as service)  Interoperable geospatial services (analysis as service)  Parameter-based product searches and access Interoperable Information Infrastructure Assisted Discovery & Mediation  Metadata-driven data fusion (semantic service chaining)  Automatic service mediation  Semantic geospatial search & access  Common service protocol, description adopted (SOAP, WSDL) Capability Results  Improved Information Sharing  Accelerated Research & System Cost Savings  Increased Collaboration & Interdisciplinary Science  Increased PI Participation in Information Production  Increased Data Utilization  Open service protocols established (HTTP, REST) Current Near Term Mid Term Long Term  Intelligent Services  Unified security & identity management (WS-Security, SAML)  Full geospatial logical searches and access  Open data access established (OpenDAP, OGC) Data Messaging Output Outcome

19. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION Technology Infusion Semantic Web Sub-Group

20. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 20 Semantic Web Activities Reviewed current maturity of tools for the Semantic Web –Ontology languages: RDF, OWL (OWL-Lite, OWL-DL, OWL-Full) –Ontology editing and visualization: Protege, SWOOP, Medius, Cerebra Construct, SweDE –Reasoners: Pellet, Racer, Cerebra Server, Medius Knowledge Brokering Suite. –Knowledge Inference: Thetus –Web Services: OWL-S –Ontology storage: KOWARI, Sesame –Search Tools: SWOOGLE –Ontologies: SWEET. Upper level ontology for Earth system science. Updated Capability Vision to reflect semantic technologies Developed Semantic Web Roadmap –Technologies –Capabilities –Results

21. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 21 Technology  Geospatial semantic services established  Geospatial semantic services proliferate  Scientific semantic assisted services  SWEET 3.0 with semantic callable interfaces via standard programming languages  SWEET core 2.0 based on best practices decided from community  Scientific reasoning  Reasoners able to utilize SWEET 4.0  Local processing + data exchange  Basic data tailoring services (data as service), verification/ validation  Interoperable geospatial services (analysis as service), explanation  Common vocabulary based product search and access Interoperable Information Infrastructure Assisted Discovery & Mediation  Metadata-driven data fusion (semantic service chaining), trust  Semantic agent-based integration  Semantic agent- based searches  Geospatial reasoning, OWL- Time Capability Results  Improved Information Sharing  Increased Collaboration & Interdisciplinary Science  Acceleration of Knowledge Production  Revolutionizing how science is done  RDF, OWL, OWL- S Current Near Term Mid Term Long Term  Autonomous scientific inference  Numerical reasoning  Semantic geospatial search & inference, access  SWEET core 1.0 based on GCMD/CF Vocabulary Languages/ Reasoning Output Outcome Semantic Web Roadmap

22. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 22 Semantic Web: Roadmap Details SWEET Core 1.0 VSTO, MMI, others Semantics Proof/Trust Built into code logic and in the head of the user Basic semantics (DL, FOL) SyntaxExplanation/Rules High degree of semantic understanding Intelligent message routing (SOL) Current Near Term Mid Term Long Term SWEET core 2.0 + domain and math plug-in Standard workflow language (BPEL) Intelligent algorithm programming chaining Competing catalog schemas Common semantic service catalog established Inference Earth Science Standards Workflow Discovery SWEET 3.0 + science applications plug-in Semantic service chaining, SWSL XML, RDFOWL-DL, OWL-Full WSML Languages OWL-S, SWRL Enhanced semantic search into search engines Automatic knowledge discovery and mining GCMD, CF, ESML, GML, etc. Semantic framework for Web Services, WSMO PML

23. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION Technology Infusion Capability Vision

24. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 24 Capability Vision Outreach Continue to raise awareness of the Capability Vision Improve online availability –PowerPoint and PDF versions –New Flash version created Rudy Husar and Erin Robinson –NASA web sites DSWG, ESTO, Tech Infusion

25. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 25 Capab Capability Vision Posters Geoinformatics 2006 AGU Joint Assembly ESTC 2006 ESIP Federation summer meeting

26. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 26 Extending the Vision Leverage the Capability Vision to stimulate interest within the Earth science community in new and emerging technologies Provide assessment of current state of technologies to support the top 10 capabilities –Identify current research and available technologies –Assess technology maturity –Identify gaps and opportunities Verify alignment with similar technology vision activities (e.g. EOSDIS Evolution) TIWG Capability Vision EOSDIS Evolution

27. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION Technology Infusion Breakout Sessions

28. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 28 Breakout Session Agenda Review web services demo – lesson learned, recommendations etc. Updating the roadmap Review of the Semantic Web roadmap. Extending the capability vision. Assessment of technology maturity. What are the hot new and emerging technologies? How do we identify and monitor them?

29. NATIONAL AERONAUTICS AND SPACE ADMINISTRATION ESDS Tech Infusion Working Group 29 Technology Showcase Technology demonstrations on Wednesday afternoon –2:30 – 3:30 Web services chaining choreography update Brian Wilson, Rudy Husar, Liping Di, Eric Malaret –3:30 – 3:15 Web service based data mining Deployment & orchestration of automated workflows at DAAC. Ken Keiser & Chris Lynnes –4:00 – 5:00 Semantic Web Ontology-supported knowledge discovery in geospatial semantic web. Liping Di. NOESIS an ontology-based semantic search tool & resource aggregator. Rahul Ramachandran & Ken Keiser. Ontology collaboration web site. Peter Fox & Rob Raskin.