Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca V&L Net workshop on Vision and Language Brighton, September 15 th, 2011 Exploiting Natural-Language Interaction in Video Surveillance Systems
2 UNDERSTAND videos with humans … (or actions in images) …to EXPLAIN them in their context (or classify, search…) ISE Lab: Research Lab on Image Sequence Evaluation
3 Detection Segmentation Agent/body/face tracking Activity recognition Scene understanding Behavior recognition Video annotation/ retrieval Augmented reality NL descriptions human horse ISE Lab: some research we do...
An example: the MIPRCV project 156 : … 203 : Lo vianant surt per la part inferior dreta :... 4
5 Control Terminal 3 Dedicated Servers Giga Ethernet cam Servolens with integrated Zoom Pan & Tilt Network Infrastructure An example: the MIPRCV demonstrator
6 PTZ control
7 Terminal for Active Video Surveillance
8 Natural Language Understanding
What happened today? 9
Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca Exploiting Natural-Language Interaction in Video Surveillance Systems