Scene Understanding Francois BREMOND

Slides:



Advertisements
Similar presentations
INRETS, Villeneuve dAscq, December 15 th -16 th 2005 Project Overview Video Understanding Evaluation David CHER R&D department R&D department SILOGIC S.A.,
Advertisements

2.3.3 MAD SAMBA (Multicamera and distributed Surveillance and multisensor-based surveillance) Contact: Alessandro ZANASI zanasi-alessandro.eu.
AVITRACK Project FP INRIA Brussels, January 17th 2006.
HealthCare Monitoring: GERHOME Project Monique Thonnat, Francois Bremond & Nadia Zouba PULSAR, INRIA Date.
1 Early Pest Detection in Greenhouses Vincent Martin, Sabine Moisan INRIA Sophia Antipolis Méditerranée, Pulsar project-team, France.
Lima, Peru, 5 December 2013 Video Application: how to make the Smart Sustainable Cities safer Ziqin Sang Technical Director, Fiberhome Technologies Group.
ETISEO Project Corpus data - Video sequences contents - Silogic provider.
ETISEO Benoît GEORIS and François BREMOND ORION Team, INRIA Sophia Antipolis, France Lille, December th 2005.
By: Ryan Wendel.  It is an ongoing analysis in which videos are analyzed frame by frame  Most of the video recognition is pulled from 3-D graphic engines.
PETS’05, Beijing, October 16 th 2005 ETISEO Project Ground Truth & Video annotation.
Towards a Video Camera Network for Early Pest Detection in Greenhouses
Visual Event Detection & Recognition Filiz Bunyak Ersoy, Ph.D. student Smart Engineering Systems Lab.
Perception and Communications for Vulnerable Road Users safety Pierre Merdrignac Supervisors: Fawzi Nashashibi, Evangeline Pollard, Oyunchimeg Shagdar.
PULSAR Perception Understanding Learning Systems for Activity Recognition Theme: Cognitive Systems Cog C Multimedia data: interpretation and man-machine.
Event prediction CS 590v. Applications Video search Surveillance – Detecting suspicious activities – Illegally parked cars – Abandoned bags Intelligent.
1 Temporal Scenarios, learning and Video Understanding Francois BREMOND, Monique THONNAT, … INRIA Sophia Antipolis, PULSAR team, FRANCE
ORION Project-team Monique THONNAT INRIA Sophia Antipolis Creation: July 1995 Multidisciplinary team: artificial intelligence, software engineering, computer.
Abandoned Object Detection for Indoor Public Surveillance Video Dept. of Computer Science National Tsing Hua University.
Computer Vision. Computer vision is concerned with the theory and technology for building artificial Computer vision is concerned with the theory and.
Learning to classify the visual dynamics of a scene Nicoletta Noceti Università degli Studi di Genova Corso di Dottorato.
G52IIP, School of Computer Science, University of Nottingham What we will learn … Topics relate to the use of computer to Acquire/generate Process/manipulate/store.
Multimedia Information Retrieval and Multimedia Data Mining Chengcui Zhang Assistant Professor Dept. of Computer and Information Science University of.
Weilun Lao, Jungong Han, and Peter H.N. de With, Fellow, IEEE IEEE Transactions on Consumer Electronics, Vol. 55, No. 2, MAY 2009 Automatic Video-Based.
Orion Image Understanding for Object Recognition Monique Thonnat INRIA Sophia Antipolis.
Digital Image Processing & Analysis Spring Definitions Image Processing Image Analysis (Image Understanding) Computer Vision Low Level Processes:
Moving Object Detection and Tracking for Intelligent Outdoor Surveillance Assoc. Prof. Dr. Kanappan Palaniappan
January Smart Environments: Artificial Intelligence in the Home and Beyond Diane J. Cook
Automated Detection and Classification Models SAR Automatic Target Recognition Proposal J.Bell, Y. Petillot.
ETISEO Benoît GEORIS, François BREMOND and Monique THONNAT ORION Team, INRIA Sophia Antipolis, France Nice, May th 2005.
1 ETISEO: Video Understanding Performance Evaluation Francois BREMOND, A.T. Nghiem, M. Thonnat, V. Valentin, R. Ma Orion project-team, INRIA Sophia Antipolis,
ETISEO Evaluation Nice, May th 2005 Evaluation Cycles.
1 Scene Understanding perception, multi-sensor fusion, spatio-temporal reasoning and activity recognition. Francois BREMOND PULSAR project-team, INRIA.
Recognition of Human Behaviors with Video Understanding M. Thonnat, F. Bremond and B. Boulay Projet ORION INRIA Sophia Antipolis, France 08/07/2003 Inria/STMicroelectronics.
MACHINE VISION Machine Vision System Components ENT 273 Ms. HEMA C.R. Lecture 1.
Project on Visual Monitoring of Human Behavior and Recognition of Human Behavior in Metro Stations with Video Understanding M. Thonnat Projet ORION INRIA.
AVITRACK Project FP INRIA WP1 - Apron Activity Model WP3 - Scene Tracking WP4 - Scene Understanding Brussels, January 17th 2006.
ETISEO Benoît GEORIS and François BREMOND ORION Team, INRIA Sophia Antipolis, France Lille, December th 2005.
ETISEO Project Evaluation for video understanding Nice, May th 2005 Evaluation du Traitement et de l’Interprétation de Séquences vidEO.
Jack Pinches INFO410 & INFO350 S INFORMATION SCIENCE Computer Vision I.
Exploiting cross-modal rhythm for robot perception of objects Artur M. Arsenio Paul Fitzpatrick MIT Computer Science and Artificial Intelligence Laboratory.
VISION for Security Monique THONNAT ORION INRIA Sophia Antipolis.
Stochastic Grammars: Overview Representation: Stochastic grammar Representation: Stochastic grammar Terminals: object interactions Terminals: object interactions.
ETISEO François BREMOND ORION Team, INRIA Sophia Antipolis, France.
PETS’05, Beijing, October 16 th 2005 ETISEO Project Video Providers Corpus Data Video contents.
Copyright 2007 by Rombix. R CyClops is a computer vision solution which could integrate most of the Real World Computer Vision Application. Available.
ACTi IVS Server 2 (Intelligent Video Surveillance) Connecting Vision.
Bayesian Decision Theory Case Studies CS479/679 Pattern Recognition Dr. George Bebis.
Visual Information Processing. Human Perception V.S. Machine Perception  Human perception: pictorial information improvement for human interpretation.
Research and Future Perspectives on Intelligent Video Surveillance Systems Monique THONNAT Senior Scientist Head of Orion research team INRIA Sophia Antipolis.
REAL-TIME DETECTOR FOR UNUSUAL BEHAVIOR
SmartCatch Systems Putting Intelligence into Surveillance
Intelligent Face Recognition
TrueView People Counter
A Personal Tour of Machine Learning and Its Applications
Human Detection in Surveillance Applications
OFFICES AND APARTMENTS – Sheinovo 7
Tasks processing Strong participation . Large results comparison on
Utilizing AI & GPUs to Build Cloud-based Real-Time Video Event Detection Solutions Zvika Ashani CTO.
A Forest of Sensors: Tracking
Thrust IC: Action Selection in Joint-Human-Robot Teams
Proposal contents: Results achieved to date
New horizons in the artificial vision
Artificial Intelligence Changes the Security Landscape
SILOGIC S.A. , Toulouse, France
Creating Data Representations
Knowledge-based event recognition from salient regions of activity
Cognitive Dynamic System
Introduction to Artificial Intelligence Lecture 24: Computer Vision IV
Problem Image and Volume Segmentation:
Presentation transcript:

Scene Understanding Francois BREMOND perception, multi-sensor fusion, spatio-temporal reasoning and activity recognition. Francois BREMOND Orion project-team, INRIA Sophia Antipolis, FRANCE Francois.Bremond@sophia.inria.fr http://www-sop.inria.fr/orion/orion-eng.html Key words: Artificial intelligence, knowledge-based systems, cognitive vision, human behavior representation, scenario recognition

A scene understanding platform: real-time interpretation of videos from pixels to events Segmentation Classification Tracking Scenario Recognition Alarms access to forbidden area 3D scene model Scenario models A priori Knowledge

Video Understanding Applications metro station monitoring airport monitoring train monitoring building control access

ETISEO: performance evaluation depends on sensors (position, type) and scenes conditions strong perspective shadows tiny objects lighting conditions close view clutter

ETISEO: selection of 6 sites for ETISEO video acquisition.

Classification into more than 8 classes (e. g Classification into more than 8 classes (e.g. Person, Groupe, Train) based on 2D and 3D descriptors (position, 3D ratio height/width, …)

Vandalism in metro station

Fighting in metro station

Posture Recognition : silhouette comparison Real world Virtual world Generated silhouettes

Multi sensors information fusion: Lateral Shape Recognition

Bank agency monitoring

Parked aircraft monitoring in Toulouse: Toulouse-Blagnac Airport France Apron Video Sensors

Parked aircraft monitoring in Toulouse: “Unloading Front Operation”

Scenario recognition: “Disturbing people in a train”

HealthCare Monitoring : Détecteur de présence Contacts de portes Caméra Capteur de chute Capteur de pouls Microphones Pèse personne Surveillance respiratoire

HealthCare Monitoring

HealthCare Monitoring: Object detection and tracking (a) Segmentation (b) Classification (c) Tracking

HealthCare Monitoring: Object detection and tracking (a) Segmentation (b) Classification (c) Tracking

HealthCare Monitoring: Object detection and tracking (a) Segmentation (b) Classification (c) Tracking

HealthCare Monitoring: Object detection and tracking (a) Segmentation (b) Classification (c) Tracking

HealthCare Monitoring: Object detection and tracking (a) Segmentation (b) Classification (c) Tracking

HealthCare Monitoring: Object detection and tracking (a) Segmentation (b) Classification (c) Tracking

Trajectory clustering in Torino subway (45min), 2052 trajectories

People Classification (based on 3D parallelepiped) into 3 people classes : 1Person, 2Persons, 3Persons, Unknown

Posture Recognition : Set of Specific Postures Standing Sitting Bending Lying Hierarchical representation of postures