Pascal Kelm Technische Universität Berlin Communication Systems Group Thursday, 2 April 2009 Video Key Frame Extraction for image-based Applications.

Slides:

Advertisements

Similar presentations

Data Mining and the Web Susan Dumais Microsoft Research KDD97 Panel - Aug 17, 1997.

Advertisements

A Human-Centered Computing Framework to Enable Personalized News Video Recommendation (Oh Jun-hyuk)

MASTERY OBJECTIVE: Learn parts of an html document Learn basic html tags HTML-An Introduction.

Automatic Video Shot Detection from MPEG Bit Stream Jianping Fan Department of Computer Science University of North Carolina at Charlotte Charlotte, NC.

Automated Shot Boundary Detection in VIRS DJ Park Computer Science Department The University of Iowa.

Taxonomic classification for web- based videos Author: Yang Song et al. (Google) Presenters: Phuc Bui & Rahul Dhamecha.

Using Multiple Synchronized Views Heymo Kou.  What is the two main technologies applied for efficient video browsing? (one for audio, one for visual.

What is PBS LearningMedia? An integrated service that includes the best of public broadcasting partners, drawing on:  WGBH Teachers’ Domain  PBS Digital.

Digital Video Archiving. ViArchive Overview ViArchive provides user friendly solutions for… – uploading video clips with metadata (searchable file info.

Personalized Abstraction of Broadcasted American Football Video by Highlight Selection Noboru Babaguchi (Professor at Osaka Univ.) Yoshihiko Kawai and.

1 Texmex – November 15 th, 2005 Strategy for the future Global goal “Understand” (= structure…) TV and other MM documents Prepare these documents for applications.

Discussion on Video Analysis and Extraction, MPEG-4 and MPEG-7 Encoding and Decoding in Java, Java 3D, or OpenGL Presented by: Emmanuel Velasco City College.

On the use of hierarchical prediction structures for efﬁcient summary generation of H.264/AVC bitstreams Luis Herranz, Jose´ M. Martı´nez Image Communication.

 Hamed Sadeghi Neshat.  With Internet delivery of video content surging to an unprecedented level, video advertising is becoming increasingly pervasive.

Chapter 11 Beyond Bag of Words. Question Answering n Providing answers instead of ranked lists of documents n Older QA systems generated answers n Current.

Semantic Web and Web Mining: Networking with Industry and Academia İsmail Hakkı Toroslu IST EVENT 2006.

ADVISE: Advanced Digital Video Information Segmentation Engine

Supervised by Prof. LYU, Rung Tsong Michael Department of Computer Science & Engineering The Chinese University of Hong Kong Prepared by: Chan Pik Wah,

Multimedia Search and Retrieval Presented by: Reza Aghaee For Multimedia Course(CMPT820) Simon Fraser University March.2005 Shih-Fu Chang, Qian Huang,

T.Sharon 1 Internet Resources Discovery (IRD) Video IR.

Presentation Outline  Project Aims  Introduction of Digital Video Library  Introduction of Our Work  Considerations and Approach  Design and Implementation.

LYU 0102 : XML for Interoperable Digital Video Library Recent years, rapid increase in the usage of multimedia information, Recent years, rapid increase.

Department of Computer Science and Engineering, CUHK 1 Final Year Project 2003/2004 LYU0302 PVCAIS – Personal Video Conference Archives Indexing System.

The Marketing Landscape. Partnering & Packaging Creates authentic experiences that provide a unique sense of place Keeps visitors in town longer Stretches.

Visual Information Retrieval Chapter 1 Introduction Alberto Del Bimbo Dipartimento di Sistemi e Informatica Universita di Firenze Firenze, Italy.

Video Search Engines and Content-Based Retrieval Steven C.H. Hoi CUHK, CSE 18-Sept, 2006.

1 Final Year Project 2003/2004 LYU0302 PVCAIS – Personal Video Conference Archives Indexing System Supervisor: Prof Michael Lyu Presented by: Lewis Ng,

A fuzzy video content representation for video summarization and content-based retrieval Anastasios D. Doulamis, Nikolaos D. Doulamis, Stefanos D. Kollias.

WP -6: Human Tracking and Modelling Year–I Objectives: Simple upper-body models and articulated tracks from test videos. Year-I Achievements: Tracking.

Discovering Computers Fundamentals, 2012 Edition Your Interactive Guide to the Digital World.

GD465 Digital Editing for Animation/ Overview Status Meeting January 2011.

김덕주 (Duck Ju Kim). Problems What is the objective of content-based video analysis? Why supervised identification has limitation? Why should use integrated.

CADAL Digital Library Wu Jiang-Qin,Zhuang Yue-Ting Pan Yun-he College of Computer Science, Zhejiang University,China November 18,2006 November 18,2006.

MUSCLE WP9 E-Team Integration of structural and semantic models for multimedia metadata management Aims: (Semi-)automatic MM metadata specification process.

DVMM Lab, Columbia UniversityVideo Event Recognition Video Event Recognition: Multilevel Pyramid Matching Dong Xu and Shih-Fu Chang Digital Video and Multimedia.

Enabling Access to Sound Archives through Integration, Enrichment and Retrieval WP3 – Retrieval systems.

Knowledge Science & Engineering Institute, Beijing Normal University, Analyzing Transcripts of Online Asynchronous.

Prof.dr. Inald Lagendijk, Coordinator Delft University of Technology Faculty of Electrical Engineering, Mathematics and Computer Science 1 Network of Excellence.

Using Multiple Synchronized Views Presenter: Teklu Urgessa Efficient Video Browsing.

MediaEval Workshop 2011 Pisa, Italy 1-2 September 2011.

Multimedia Databases (MMDB)

RIAO video retrieval systems. The Físchlár-News-Stories System: Personalised Access to an Archive of TV News Alan F. Smeaton, Cathal Gurrin, Howon.

Multimedia Information Retrieval

Web geo-visualization Data integration, amelioration, geo-referencing Advanced geo-spatial computing engine Tools: geospatial querying, data drill-down,

Information Systems & Semantic Web University of Koblenz ▪ Landau, Germany Semantic Web - Multimedia Annotation – Steffen Staab

Department of Computer Science and Engineering, CUHK 1 Final Year Project 2003/2004 LYU0302 PVCAIS – Personal Video Conference Archives Indexing System.

Real-Time Monitoring, Analysis, editing and publishing of Rich Media Hightower Explanation

Putting it all Together Editing and Encoding. Different Edits Cut Dissolve Fade out Fade in (to and from black or solid) Wipe.

Digital Broadcasting Research Division Broadcasting media Research Group TV-Anytime Metadata Authoring Tool Jung Won Kang Digital Broadcasting Research.

Markup and Validation Agents in Vijjana – A Pragmatic model for Self- Organizing, Collaborative, Domain- Centric Knowledge Networks S. Devalapalli, R.

Prof. Thomas Sikora Technische Universität Berlin Communication Systems Group Thursday, 2 April 2009 Integration Activities in “Tools for Tag Generation“

Networked Audio Visual Systems and Home Platforms ADMIRE-P at Med-e-Tel 2005 April 6-8, Application of Video Technologies and Pattern Recognition.

Facilitating Document Annotation using Content and Querying Value.

1 Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP Reporter: 林浩棟.

Automatic Video Tagging using Content Redundancy Stefan Siersdorfer 1, Jose San Pedro 2, Mark Sanderson 2 1 L3S Research Center, Germany 2 University of.

Data and Applications Security Developments and Directions Dr. Bhavani Thuraisingham The University of Texas at Dallas Lecture #15 Secure Multimedia Data.

TEMPLATE DESIGN © E-Eye : A Multi Media Based Unauthorized Object Identification and Tracking System Tolgahan Cakaloglu.

Bachelor of Engineering In Image Processing Techniques For Video Content Extraction Submitted to the faculty of Engineering North Maharashtra University,

Semantic Extraction and Semantics-Based Annotation and Retrieval for Video Databases Authors: Yan Liu & Fei Li Department of Computer Science Columbia.

Query by Image and Video Content: The QBIC System M. Flickner et al. IEEE Computer Special Issue on Content-Based Retrieval Vol. 28, No. 9, September 1995.

MULTIMEDIA DATA MODELS AND AUTHORING

Facilitating Document Annotation Using Content and Querying Value.

Presenting Documents How to Build a Digital Library Ian H. Witten and David Bainbridge.

Digital Video Library - Jacky Ma.

Visual Information Retrieval

Automatic Video Shot Detection from MPEG Bit Stream

Security Issues for Visual Data: Copyright and Access Control

Chapter 10 Image Segmentation.

Multimedia Information Retrieval

Presentation transcript:

Pascal Kelm Technische Universität Berlin Communication Systems Group Thursday, 2 April 2009 Video Key Frame Extraction for image-based Applications

Core partners: TUB (coord.), EPFL, TUD, QMUL Aims: Generation of tags and metadata (signal processing and/or users’ annotation) Keyframe extraction for image search engines Video classification, clustering and summarization Propagation of tags (object detection/ similarity) 2 Goals

Video Key Frame Extraction for image-based Applications Preparation: Setup database from unstructured channel “Travel” on YouTube.com –100 videos + affiliated metadata (keywords, comments, user information etc.) –Annotation of shot boundaries (by TUD and TUB) Demos : 3 Database

Video Key Frame Extraction for image-based Applications 4 Youtube Downloader Tool also used by the IRP “Social Media Data Collection“

Video Key Frame Extraction for image-based Applications 5 Youtube Downloader Information also interesting for IRP “Social Media Data Collection“

Video Key Frame Extraction for image-based Applications -Integration of different expertise: -Image search engines, audio signal processing, video signal processing and text detection/ recognition 6 Overview

Video Key Frame Extraction for image-based Applications 7 Overview Shot Subshot Key Frame Video stream: 1.Temporal segmentation Detection of hard cut, fade and dissolve 2.Subshot boundary detection Special importance for single shot videos and for long shots Detection of new visual content appearing through camera operations or undetected transitions. 3.Extraction of key frames efﬁcient key frame extraction as a handshake between existing image search engines and video domain

Video Key Frame Extraction for image-based Applications 8 Key Frame Extraction

Video Key Frame Extraction for image-based Applications 9 Key Frame Extraction

Video Key Frame Extraction for image-based Applications 10 Demo – Chapter Generation

Video Key Frame Extraction for image-based Applications 11 Demo – Storyboard-like Key Framing