MACHINE-MEDIATED COMMUNICATION 3D environments, (sensors, projectors: sight, sound, touch, other sensory modes) information capture, display personal agents multimodal fusion storage media conversion, multilingual translation information representation computation management architectures, protocols agents dB’s libraries storage Web pages grid-based computation Other Sites Human Interface Global Network Communication Mediator security

Multimodal Human-Machine Interface

Force Feedback Glove Gaze Tracker Microphone Array Multimodal Human-Machine Interface Real-world trial with NJ National Guard

Portable Interactive Command Console (PICC) Steerable microphone array element Stereo face tracking cameras Gaze tracker Source locator microphone Loudspeakers Light pen Flatpanel display Sensors HQ/VEHICLE Robotic Vehicles Emergency Responder in the Field Internet

User interface for interaction and collaboration with robots and humans NSF Equipment Grant EIA# Center for Advanced Information Processing, Rutgers University, Piscataway, NJ PI: J.L. Flanagan, co-PIs: J. Wilder, I. Marsic, M. Krane

“Move this to there.”