TRECVID IES Lab. Intelligent E-commerce Systems Lab. 1 Presented by: Thay Setha 05-Jul-2012

Outline Introduction TRECVID 2012 TRECVID 2012 Collaborative annotation TRECVID Data Availability 2

Introduction TRECVID – TREC Video Retrieval Evaluation ( ) The main goal of TRECVID – Promote the progress in content-based analysis, detection, retrieval in large amounts of digital video. Combine multiple sources of evidence Achieve greater effectiveness, speed, usability Modeling real usage scenarios More video data is getting available, which enables exploration of new tasks. 3

TRECVID 2012 TRECVID 2012 will continue 5 tasks from 2011 with variations and add one (multimedia event recounting). NIST will evaluate systems on the following tasks using the data indicated: – Semantic indexing [IACC.1] – Known-item search [IACC.1] – Interactive surveillance event detection [i-LIDS] – Instance search [Flickr Creative Commons] – Multimedia event detection [HAVIC] – Multimedia even recounting [HAVIC] 4

TRECVID 2012 Video data – IACC.1 Approximately 8,000 internet archive videos (50GB, 200 hours) Duration: 10 seconds and 3.5 minutes. Metadata provided by donor : title, keywords, and description – IACC.1.tv10.training Approximately 3,200 internet archive videos (50GB, 200 hours) Duration: 3.6 and 4.1 minutes Metadata provided by donor. – BBC rushes Rushes are the raw material from which programs are made in the editing room. videos have been segmented at arbitrary points to produce a collection of about 21,000 equal-length, short clips. – Flickr video for instance search Video available for research only from flickr.com will be available in webm format. – Gatwick and i-LIDS MCT airport surveillance video 150 hours of airport surveillance video data. – HAVIC is designed to be a large new collection of internet multimedia and is being constructed by the Linguistic Data Consortium and NIST. 5

TRECVID 2012 Ref: 6 The airport surveillance video used in TRECVID 2009 was used again in 2010 and 2011 as was some of the Sound and Vision (S&V) videos used in 2009

TRECVID 2012 Collaborative annotation Application to TRECVID 2012 Collaborative annotation – propose the approach to perform annotation of the TRECVID 2012 development set using a system similar to the one used for TRECVID – Web interface for the collaborative annotation : – 400,289 shots or keyframes in the TRECVID 2012 development set. 7

TRECVID 2012 Collaborative annotation 8 Sequential interface of the annotation system Parallel interface of the annotation system

TRECVID 2012 Collaborative annotation Annotation Page – Customized display screen Choose “Rows” and “Columns” values in the annotation page so that user can display a maximize number of images on the screen without having to scroll. each image comes with a set of three radio buttons labeled ‘N’, ‘S’, and ‘P’. ‘N’ = Negative ‘S’ = Skipped ‘P’ = Positive – Annotation Process Selecting one of radio buttons corresponds to annotate the image as "Negative", "Skipped" or "Positive" for the target feature. By default, all images are selected as Negative. 2 ways of changing the annotation of image. – check the corresponding radio button – click on the image, “Negative” to “Positive”, “Positive” to “Skipped”, and “Skipped” to “Negative” Corresponding color : Negative(red), Positive(green), and Skipped(yellow) 2 Action buttons: – Validate: Store the selected annotation for all the currently displayed images and go to next series of images. – Exit: terminates current annotation session. 9

TRECVID Data Availability Various types of data have been involved in the TRECVID workshops and the availability of these data sets varies by type and year as listed below: – TREC 2001 Video Track – TREC 2002 Video Track – TRECVID 2003 – TRECVID 2004 – TRECVID 2005 – TRECVID 2006 – TRECVID 2007 – TRECVID 2008 – TRECVID 2009 – TRECVID 2010 – TRECVID 2011 Ref: 10

TRECVID Data Availability TRECVID 2011 – Data: TRECVID 2009 Sound and Vision video files LIG key frames distributed in 2009 – Data for current TRECVID participants: Development dataset annotations for surveillance event detection Test dataset annotations for surveillance event detection HAVIC dataset for multimedia event detection – Data for not-TRECVID participants: London Gatwick surveillance video files – Data that publically available: Internet Archive videos (IACC.1) B.Collection.xml fileB.Collection.xml file Truth data created at/for NIST Truth data and baselines created by participants Ref: 11

Thank You! 12