1. VIDEO SURVEILLANCE AND MONITORING
FOR ADVANCED SITUATION AWARENESS
VSAM SYSTEM
SITE MODELING
VIDEO UNDERSTANDING TECHNOLOGIES
TARGET GEOLOCATION
SENSOR COORDINATION
HUMAN COMPUTER INTERFACE
RAW VIDEO INPUT
SITUATIONAL AWARENESS

2. VSAM SYSTEM Multiple Video Modalities Sensor Platforms
System Architecture

3. VIDEO UNDERSTANDING TECHNOLOGIES
Moving Target Analysis
Moving Target Detection
Human
Polar bear
Vehicle
Ground-based Target Detection
Target Recognition
Airborne Target Detection

4. Autonomous Helicopter
SITE MODELING
Custom DEM
generation by CMU
Autonomous Helicopter
Panoramic Mosaics
Spherical Mosaics
VRML models
3D Visualization

5. TARGET GEOLOCATION Target Geolocation by Viewing Ray Intersection
VSAM-Based Distributed Simulation
Moving Target Detected in Video Stream
Site Model
Imagery
User View
Real-time Insertion into Distributed Simulation

6. Airborne Sensor Multitasking to Disparate Geodetic Coordinates
SENSOR COORDINATION
SPU A
SPU B
Airborne Sensor Multitasking to
Disparate Geodetic Coordinates
Target Handoff
Ground Sensor Multitasking

7. ACTIVITY ANALYSIS Extended Target Trajectories
Running
Walking
Examples
Human leaves vehicle
Human enters vehicle
Occlusion
Negative-Examples
Extended Target Trajectories
Individual Target Activity Models
Human Vehicle Interactions
Parking Monitoring, Loitering, Rendezvous, Riot Detection

8. HUMAN COMPUTER INTERFACE
User Interface
System control
Data dissemination
Target point coordinates
Live video feed
Site model
Target
Sensors/FOV
Air sensor footprint