1. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance Imagery Over An Agent-Based Platform Dr. Willie Thompson, II Dr. Damian Watkins

2. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Agenda Overview of Problem Space Project Motivation & Significance Project Methodology Ongoing Work Future work

3. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Environment Challenges Limited Resources –Limited energy, processing, & storage –Very limited bandwidth Wireless Communications –Open communication medium –Hidden Terminal Effect, Channel contention, noisy channel –Monitoring may be difficult w/ security infrastructure Tactical Environment –Difficult to characterize normal behavior –Nodes prone to enemy capture –Limited analyst intervention Dynamic Environment –Mobile nodes and mobile infrastructure –No single concentration points for traffic analysis

4. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Role within BORG Research

5. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Contributions Real-time data management and processing of data streams Situational aware and intelligent presentation Autonomous and secure agent interaction

6. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Project Methodology Data Source Server Camera Archive

7. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Real Time Video Transmission Real Time Transport Protocol Java Media Framework Low power, low CPU power, small form factor devices

8. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Real Time Transport Protocol (RTP) Enables steaming media End-to-end network delivery services Transport independent( usually UDP) Creates sessions between application Connectionless protocol

9. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Java Media Framework Acquisition, Processing, and Delivery of Time- based media Time-> nanosecond precision Create and manage players w/ multiple RTP sessions Compatible w/AIFF, AU, AVI, GSM, MIDI, MPEG, QuickTime, RMF, and WAV formats

10. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Intelligent Agents Software Program Agency and intelligence are the fundamental underlying capabilities Autonomy – separate process/thread Intelligence – hard-coded logic, complex reasoning, learning. Implemented w/ JAVA

11. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Why use Intelligent Agents? Soldier (Node) Level Detection Analysis Command Level Detection Analysis Need an answer quickly Few data sources Limited Bandwidth Solution: Autonomous & Intelligent process to gather and display relevant info Intelligent Agents are autonomous and intelligent Have the luxury of time Abundant Data sources Bandwidth Solution: Autonomous processes may be used but not necessary

12. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Test Methodology Invoke JMF methods within Agent based platform. Agent Creates RTP session with data source and/or other agents. Analyze Performance of RTP and agent communication over wireless network.

13. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Test Scenario Peer-to-Peer network RTP Session1/UDPRTP Session2/UDP Streaming Source node

14. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Test Platform Streaming RTP Video Session flyovervideo150m Video Source

15. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE DATA traffic Rendering streaming tends to be slow Packet Errors and congestion over wireless network –High broadcast, network management traffic Approx. 82% of total traffic –Large packet sizes for video frames 1 Mega Byte packet size

16. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Agent Broadcast Traffic

17. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE RTP Broadcast Traffic

18. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Shortcomings Connectionless RTP –Frames are not guaranteed to arrive –Frames arrive out of order Inconsistent multiple RTP sessions High broadcast overhead –Network management traffic –Agent Communication overhead

19. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Future Work Agent Cooperation –Create and Manage RTP session –Authenticate and secure hosts Run RTP over reliable UDP Construct Representative Environment –Real MANET environment TEALAB CTA04 D. Watkins, C. Scott, “Methodology for Evaluating the Effectiveness of Intrusion Detection in Tactical Mobile Ad-hoc Networks”, IEEE Wireless Communications and Networking Conference 2004. –Virtual Environment (VMware)

20. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE References V.S. Subrahmanian, et al, Heterogeneous Agent Systems, MIT Press, 2000 Java Media Framework, 2.0. Guide: http://java.sun.com/products/java- media/jmf/reference/docs/index.html http://java.sun.com/products/java- media/jmf/reference/docs/index.html RTP Specification: http://www.faqs.org/rfcs/rfc1889.html http://www.faqs.org/rfcs/rfc1889.html

21. Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Questions? Comments?