1. VSAM Demo Planning Workshop
June 12, 1998
Carnegie Mellon University

2. IFD Testbed System Infrastructure
Camera platforms
Five fixed base pan/tilt cameras (SPU 1-4, 6) (SPU are currently installed)
One Omnicam camera (SPU 5)
One relocatable (van based) camera (SPU 7)
One airborne camera (SPU 8)
Tied into the campus fiber optic network

3. CMU Campus Map Showing SPU/OCU Placement2 TI
VSAM OCU 1 3 4 5
VSAM SPU 6
Rapid deployment SPU
FRE SPU

4. IFD Active Sensors Sony EVI-330 in a weatherized enclosure
Directed Perception
pan-tilt unit
Sony EVI-330 in a
weatherized enclosure
RS232 control of
pan-tilt and camera
NTSC video out

5. Sony EVI-330
48.8
4.4
1023
Horz FOV
Zoom Settings
12X

6. IFD Testbed System Infrastructure

7. IFD Testbed System Infrastructure
Rack One
Eight SPU computers
Dual SPU monitor/keyboard/mouse switches
Rack Two
Eight VCR’s
Eight - ten VGA to NTSC converters
Three power strips

8. IFD Testbed System Infrastructure
Rack Three
4:1 video multiplexer
Two 6:2 video switches
Three video patch panels
Twelve 1:3 video distribution amplifiers
Power strip
Rack Four
Fiber Ethernet interface to Demo Center
Camera fiber optic converters
Eight video modulators and a video frequency combiner for Demo Center NTSC Signals

9. Overall Testbed System Layout

10. Typical Remote SPU Interfaces

11. SPU 7 Relocatable Van Interfaces

12. Airborne SPU 8 Interfaces

13. Demo Center OCU GUI projected display (NTSC minimum)
Projected display of four prominent SPU’s (Multiplexed)
Airborne NTSC monitor
SEEDS computer (BDM supplied or CMU supplied O2) and associated monitor
Additional FRE NTSC monitors
Visualization Client Kontron computer and display
Visualization Client connections for personal laptops

14. Visualization Clients
VSAM IFD
3rd party
VIS
SPU
SPU
VIS
OCU
SPU
VIS
SPU
GUI
VIS
SEEDS

15. VSAM 98 Demo Scenario Demo Premise
A group of international terrorists attempt to sabotage the highly successful VSAM IFD demonstration 1998.
A terrorist vehicle is detected in Schenley Park outside CMU’s Pittsburgh campus, and enters the campus. Meanwhile a single terrorist on foot attempts to gain access to the VSAM lab. When this fails, the pedestrian joins the vehicle and they attempt to escape. When they discover that they have been detected and the “police” are waiting for them, they try to flee on foot. The “police” capture two of them, but a third escapes in a stolen car. Fortunately, surveillance continues and the last terrorist is finally brought to justice outside campus on Boundary Rd.

16. Airborne area of interest
Demo Domain
Ground coverage
Airborne area of interest

17. CMU Campus Map Showing SPU/OCU Placement2 TI
VSAM OCU 1 3 4 5
VSAM SPU 6
Rapid deployment SPU
FRE SPU

18. 1. Suspicious Vehicle Enters CMU
Activity: Suspicious vehicle detected by airborne sensor. Vehicle enters CMU - VSAM system is put on alert.
Visualization: Site model overview, live video from aircraft, airborne sensor footprint, live video from rapid deployment SPU
Technology: airborne moving target detection and tracking, airborne camera pointing.

19. 2. Rogue Vehicle Parks, Terrorist Activity Occurs
Activity: Rogue vehicle enters CMU campus and parks. Terrorist enters CMU and moves to PRB.
Visualization: CMU campus overview with target vehicle trajectory, live video from ground sensors, SEEDS campus model, mosaic visualization
Technology: long-term target tracking, motion salience, handoff

20. 2b. Airborne Activity Monitoring
Activity: airborne sensor continues to monitor Schenley Park vehicular activity. Redeployment of mobile SPU
Visualization: Live airborne video showing targets of interest and airborne sensor footprint.
Seeds visualization showing airborne sensor asset and geolocated ground targets. Location of mobile SPU shown on site model.
Technology: airborne MTD in presence of parallax. Rapid sensor calibration.

21. 3. Attempted Break-in and Escape
Activity: Terrorist attempts to enter PRB - fails and runs to suspect vehicle, which flees past Smith Hall. Fortunately - “Police” (using a visualization client) are waiting.
Visualization: Output from building monitoring system, live video and trajectory of fleeing terrorists, GPS-based trajectory of “police”, SEEDS campus model.
Technology: Indoor surveillance, human-vehicle interaction (HVI), VSAM visualization node. 2 1 3

22. 4. “Police” Chase
Activity: 3 Terrorists flee “police” on foot to PRB car park where they are caught. One escapes to steal a car.
Visualization: CMU site model showing trajectories of all three terrorists and police, live video of terrorist flight, automatic detection of car theft, SEEDS campus model, synopsis mosaic.
Technology: Multiple simultaneous target tracking. Human-vehicle interaction. 2 1 3

23. 4b. Parking Lot Monitoring
Activity: As a random event, a car theft is attempted at the Scaife Hall car park.
Visualization: CMU site model showing location of attempted theft. Also, a textual alert of activity is presented, synopsis mosaic.
Technology: parking lot monitoring 5 6

24. 5. Escaped Terrorist Caught
Activity: Stolen vehicle tracked out of CMU to Boundary Rd where it is caught by waiting “police”
Visualization: Site model showing trajectory of target vehicle, live video from airborne sensor, airborne sensor footprint, BDM area model.
Technology: airborne pointing, fixation, MTD and tracking. Tracking and geolocation from redeployable SPU.

25. 5b. Detection of Loitering around PRB
Activity: A person is detected loitering around the entrance to PRB
Visualization: CMU site model showing location of loiterer. Also, a textual alert of activity is presented
Technology: Loitering detection using activity model. TI 1 3

26. Sensor Schedule 3. Attempted burglary and escape PRIMARY ACTIVITY
1. Intruder
detection
2. Rogue vehicle
tracking
4. Police chase
5. Capture
Indoor ALERT
SPU - TI
Indoor activity detection
Long-term tracking
“Police” car tracking
Multi-target tracking
SPU - EDSH(2)
Long-term tracking
HVI
Multi-target tracking
SPU - PRB(1)
Long-term tracking
HVI
Multi-target tracking
Loitering ALERT
SPU - WH(3)
Loiterer monitoring
Long-term tracking
Long-term tracking
SPU - RH(4)
Long-term tracking
Car park ALERT
SPU - RH(5)
Car park monitoring
Long-term tracking
Car park ALERT
SPU - SH(6)
Car park monitoring
Long-term tracking
Long-term tracking
Redeployment to gorge site
SPU - RDU
Target detection
Target tracking
SPU - AIR
Area monitoring
SECONDARY ACTIVITY
2b. Airborne area monitoring
4b. Parking lot monitoring alert
5b. Loitering alert

27. Sarnoff progress MTI on video over CMU & surroundings
Progress on drift-free fixation
Gantry for quantitative “airborne” experiments
Spherical mosaics of Ft. Benning

28. FRE Participation in IFD Demo
Type/Data
Function
IFD provides...
FRE provides...
Lehigh/
Columbia
Integrated
SPU
SPU 5:
detection,
tracking,
handoff
Computer
Video feed to DC
Monitor at DC
Location
Roberts
Sensor
Software
SRI
Parallel
Detection &
tracking by
stereo vision
PRB TI
Indoor
activity
detection
MIT AI
IFD
Normalcy
Wean
Video data
Everyone
Else
system/
Tech demo
Live video taps
Canned data
Limited video feed
to DC
Limited Monitors
Everything else

29. Technology Bazaar (Bizarre?)
FRE Technology Bazaar
Technology Bazaar (Bizarre?)
IFD provides (as last year):
Space (Smith Hall)
Power

30. FRE Participation Schedule