1. Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca V&L Net workshop on Vision and Language Brighton, September 15 th, 2011 Exploiting Natural-Language Interaction in Video Surveillance Systems

2. 2  UNDERSTAND videos with humans … (or actions in images)  …to EXPLAIN them in their context (or classify, search…) ISE Lab: Research Lab on Image Sequence Evaluation

3. 3 Detection Segmentation Agent/body/face tracking Activity recognition Scene understanding Behavior recognition Video annotation/ retrieval Augmented reality NL descriptions human horse ISE Lab: some research we do...

4. An example: the MIPRCV project 156 : … 203 : Lo vianant surt per la part inferior dreta... 252 :... 4

5. 5 Control Terminal 3 Dedicated Servers Giga Ethernet cam Servolens with integrated Zoom Pan & Tilt Network Infrastructure An example: the MIPRCV demonstrator

6. 6 PTZ control

7. 7 Terminal for Active Video Surveillance

8. 8 Natural Language Understanding

9. What happened today? 9

10. Jordi Gonzàlez, Josep Mª Gonfaus, Carles Fernández, F.Xavier Roca http://iselab.cvc.uab.es/ Exploiting Natural-Language Interaction in Video Surveillance Systems