1. Copyright 2010, Open Geospatial Consortium Making Location Count Fusion of Remote Sensed Data and Geographic Information Using International Standards for Geoinformatics David Arctur Director, OGC Interoperability Programs George Percivall OGC Chief Architect SPIE Remote Sensing 2010 Toulouse, 21 September 2010

2. 2 Why Fusion Standards? Fusion is already pervasive in NGA –Manual multi-source analysis is a significant part of the NGA’s analytical paradigm –Manual and semi-automated multi-INT visualization and analysis is emerging as a preferred practice among analysts Multiple fusion R&D projects with diverse technical approaches Requirement to leverage fusion standards to enhance R&D prototypes to improve operational capability –Provide improved access to data –Interface and integrate diverse inputs –Provide stable framework and focus on value-added applications –Leverage commercial innovation; streamline business practices –Deliver relevant operational impact better, faster, cheaper

3. OGC Copyright 2010, Open Geospatial Consortium Making Location Count Elements of Fusion are Pervasive Now Standards-based Technologies and Implementations Abound

4. OGC Copyright 2010, Open Geospatial Consortium Making Location Count Why Further Focus on Fusion Standards? Need for rapidly deployable and interoperable tools to analyze, process and exploit two or more different types of data or products from the same or multiple sensors Develop new or further exploiting current capabilities for fusing information from –multiple sensors –multiple sources –multiple INTs (signals, human, etc) in ways that dramatically improve the ability to detect, identify, locate, and track objects. Copyright © 2010, Open Geospatial Consortium

5. OGC Copyright 2010, Open Geospatial Consortium Making Location Count OGC Fusion Standards Study Fusion defined: –“Process of combining data and information to improve detection, identification, and characterization of entities” Categories of Fusion –Sensor/Observation Fusion –Object/Feature Fusion –Decision Fusion 5

6. OGC Copyright 2010, Open Geospatial Consortium Making Location Count Categories of Fusion 6

7. OGC ® Helping the World to Communicate Geographically What do we mean by “Open” Standard? Freely and publicly available –Not free as in “free beer” but in “freedom of choice” Non discriminatory –Available to any one, any organization, any time, any where with no restrictions No license fees Vendor neutral in terms of content and implementation concept Data neutral –Independent of any data storage model or format Agreed to by a formal consensus process

8. OGC Copyright 2010, Open Geospatial Consortium Making Location Count Why Open Standards? Rapidly mobilize new capabilities – plug and play Lower systems costs –Reduced development over long-term –Reduced learning curve; greater availability of knowledgeable talent Encourage market competition –Choose based on functionality desired –Avoid “lock in” to a proprietary architecture Decisions to share information and services become policy decisions

9. OGC Copyright 2010, Open Geospatial Consortium Making Location Count Fusion Standards Study and OWS Testbeds Fusion Study, Phase 1 –Public Engineering Report OWS-7 Testbed –Sensor and Feature Fusion Fusion Study, Phase 2 –Decision Fusion –Workshop, August 10&11 OWS-8 Testbed 9 http://portal.opengeospatial.org/files/?artifact_id=36177

10. OGC Copyright 2010, Open Geospatial Consortium Making Location Count OGC Fusion Standards Study Participating Organizations Aston University Envitia Evolution Technology FortiusOne Fraunhofer IITB Galdos Intelligent Automation Intergraph Jacobs University Lockheed Martin Luciad MISB Northrop Grumman NGA NR Canada PYXIS Raytheon

11. OGC Copyright 2010, Open Geospatial Consortium Making Location Count OGC Fusion Standards Study 11

12. OGC ® Helping the World to Communicate Geographically © 2010 Open Geospatial Consortium, Inc.. OGC Sensor Web Enablement SWE is a suite of standards from OGC (Open Geospatial Consortium) 3 standard XML encodings (SensorML, O&M, TML) 4 standard web service interfaces (SOS, SAS, SPS, WNS) SWE is a Service Oriented Architecture (SOA) approach SWE is an open, consensus- based set of standards Enables discovery and tasking of sensor assets, and application of sensor observations for enhanced situational awareness, much like HTML, and HTTP enabled WWW

13. Making Location Count… Copyright © 2009, Open Geospatial Consortium, Inc. Catalog Service SOSSASSPS Clients SWE Web Services Access Sensor Description and Data Command and Task Sensor Systems Dispatch Sensor Alerts to registered Users Discover Services, Sensors, Providers, Data Accessible from various types of clients from PDAs and Cell Phones to high end Workstations 13

14. Making Location Count… On-demand Geolocation using SensorML AMSR-E SSM/I CloudsatLIS TMI TMI & MODIS footprints MAS Geolocation of satellite and airborne sensors using SensorML

15. Making Location Count… Copyright © 2009, Open Geospatial Consortium, Inc., All Rights Reserved. Copyright © 2007, Open Geospatial Consortium, Inc., All Rights Reserved. 15 Empire Challenge 2007/2008 ISR Support to C2 and Engagement Operations in a Coalition Environment OV-1 High-Level Operational Concept Graphic 15

16. Making Location Count… Empire Challenge: SWE Task, Access, and Fuse Ortho Processor 1Hz with existing down link (goal is 12 Hz min) 1920 x 1080 HD Color Up to 25 Hertz MPEG2 / KLV and NITF Flight Control UAV Footprints End User Analyst Console Mapping and Motion Imagery Merge NAWC, China Lake, CA, from Tigershark platform © 2010, Open Geospatial Consortium, Inc.16

17. Making Location Count… Application: NASA Sensor Web

18. OGC ® Helping the World to Communicate Geographically Change terms to Sensor/Observation Fusion Harmonized process for precise geolocation Increasing use of geometric and electromagnetic signatures Community-sanctioned/registered definitions for sensor terms Characterizing and propagating uncertainty of measurements Discovery and access of dynamic sensors Fusion of video from airborne and ground based platforms Sensor Fusion Recommendations Copyright © 2010, Open Geospatial Consortium 18

19. OGC ® Helping the World to Communicate Geographically Motion Video Change Detection WPS Event: Ground vehicle enters risk zone. Action: begin change detection of motion imagery from vehicle and previous imagery using WPS Vehicle crew repeats WPS with modified parameters Crew changes route based on detected changes

20. OGC ® Helping the World to Communicate Geographically Change Detection

21. OGC ® Helping the World to Communicate Geographically OWS-7 SFE Mobile Motion Imagery Change Detection SOS-(T) Compusult, 52 North Catalog Compusult SFE Client BIRI/Compusult Event Service Compusult, IfGI Sim. CCSI Sensors NGIS SOS NGIS WPS GMU Mobile Sensor SOS Client NGIS CCSI – Common CBRN Sensor Interface SFE – Sensor Fusion Enablement SOS – Sensor Observation Service SOS-(T) – Sensor Observatin Service (Transactional) WPS –Web Processing Service

22. OGC ® Helping the World to Communicate Geographically Sensor/Observation Fusion after OWS-7 Motion Imagery –MISB coordination –Motion imagery metadata –Video Search and Annotation –WPS for near real-time quality improvement of MISB video feeds: Further Security Architecture development (mission- and role-based) –Multi-level authentication and control over imagery data collection –Licensing commercial imagery SWE in fusion scenario: Flight path generation –Intergraph example of SIGINT for hot spots

23. GeoCode Points representing SIGINT In an area of interest Use primary hot spot (vector contour) as automated pan constraint in integrated image sweep Generate Graphical Density Representation of “high- confidence” results Resulting Area feature Provides flight Pattern For UAV Fusion via Multi-INT integration

24. OGC ® Helping the World to Communicate Geographically OGC Fusion Standards Study 24

25. OGC ® Helping the World to Communicate Geographically Feature/Object Fusion Feature & statistical analysis (follow-on to OWS-7 results) –Link semi-spatial data (tables and unstructured text) to geospatial data –Incorporate above into geoprocessing workflows –GML profile for geoprocessing light on information content, heavy on links to original data –Geoprocessing Markup Language GeoConversations –imagery markup and text with OWS Context, social APIs Coverage harmonization based on WCS 2.0 –Support for non-gridded coverages –Flexible coverage processing language Discrete global grids

26. Discrete Global Grid System Discrete – division into regular pieces or cells Quantized – method of setting values in each cell Indexed – unique and hierarchy for fast access Algebra – for relationships like neighbours and operations like addition

27. OGC Copyright 2010, Open Geospatial Consortium Making Location Count Decision Fusion Workshop Discrete Global Grids How might OGC use Discrete Global Grids? –For data encoding and processing –For visualization: WMTS and GeoBrowsers Define as a Coordinate Reference System ISEA3H: A specific discrete global grid –Icosahedral Snyder Equal Area aperture 3 Hexagon Grid Index for ISEA3H – coordination with PYXIS

28. OGC ® Helping the World to Communicate Geographically OGC Fusion Standards Study 28

29. OGC ® Helping the World to Communicate Geographically Decision Fusion “Support human decisions with interoperable services for situation assessment, impact assessment and decision support, using multiple sensors and processed information” Work with the broader IT standards community –Focus on open standards

30. OGC ® Helping the World to Communicate Geographically Decision Fusion Recommendations Information model with decisions as a first class object Define a decision fusion engine component “See and Talk” collaboration with common view Coordination through social networks Political geography as a step to all information types Dynamic routing based on location Conduct Fusion Standards Study, Part 2 focused on decision fusion Copyright © 2009, Open Geospatial Consortium, Inc.

31. OGC Copyright 2010, Open Geospatial Consortium Making Location Count Sensor and Feature Fusion Node conducting Decision Fusion Command Node Public Information Networks Dispatch and Operations Federated Decision Node InformationTaskMessagesCommands Open Source Messages Messages, Federated Search Structured Data MessagesCommands OGC Fusion Standards Study - Phase 2: Decision Fusion Context

32. OGC ® Helping the World to Communicate Geographically Decision Fusion Example: Afghanistan Election Attack Scenario Go beyond current Web Mapping Tools to associate trends and causes from multiple sources A likely target for an attack against the Pashtun during the 2009 election would be in Jalalabad, a largely Pashtun area with strong ties to Karzai, and a target of recent IED. The largest polling station in the area is at Compano Mosq, with an estimated 13,700 voters. An attack here on Election day could impact the outcome. Source: FortiusOne 32

33. OGC Copyright 2010, Open Geospatial Consortium Making Location Count Decisions as Structured Information Decision as first class object in an information model –The Situation –Courses of Action –Decision trees and Uncertainty representation –Risk Models –Workflows for decision making. –Use existing standards Decisions are Context specific –Views of system for different roles (role specific context document) –OWS Context (Need OWS Context SWG) Events relate to Decision templates –Occurrence of an event causes consideration of decision template –Event Architecture

34. OGC Copyright 2010, Open Geospatial Consortium Making Location Count Decision Fusion: Scenarios beyond OWS-7 Scenario: Connecting the Dots –Connecting information held by several “Decision Fusion Nodes” in the determination of a plan of attack by an individual or small group. –Decision: Does probable threat warrant dispatch to thwart threat? Scenario: Human presence detection –Determine current danger of a site before deploying resources –Fusing information from sensors with cultural and human information, and recent intelligence reports from human observers. [ODNI, 2010] –Decision: Is risk low enough to warrant committing personnel to ops? Scenario: Disaster/Emergency Management (flood) –EMS professional on site coordinating with local command center –Decision: Which resources to send and what routes are taken.

35. OGC ® Helping the World to Communicate Geographically OWS-7 Demonstrations www.opengeospatial.org select ”demos” in lower left www.opengeospatial.org

36. OGC ® Helping the World to Communicate Geographically OWS-8 Timeline Timeline - Draft –RFQ/CFP to be released mid October 2010 –RFQ/CFP responses due by late November 2010 –Kickoff in Washington DC area, February 2011 –Completion by end of July 2011 Contact: –David Arctur, darctur at opengeospatial.orgdarctur at opengeospatial.org –George Percivall, gpercivall at opengeospatial.orggpercivall at opengeospatial.org © 2010 Open Geospatial Consortium, Inc.

37. OGC ® Helping the World to Communicate Geographically For Details on OGC Standards… OGC Standards –Freely available – www.opengeospatial.org/standards www.opengeospatial.org/standards OGC Reference Model (ORM) –Overview of OGC Standards Baseline –Resource for defining architectures for specific applications – www.opengeospatial.org/standards/orm www.opengeospatial.org/standards/orm David Arctur, darctur at opengeospatial.org George Percivall, gpercivall at opengeospatial.orggpercivall at opengeospatial.org Copyright © 2010, Open Geospatial Consortium, Inc.