Presentation is loading. Please wait.

Presentation is loading. Please wait.

Digital Video Library - Jacky Ma.

Published byAusten Lucas Modified over 6 years ago

Similar presentations

Presentation on theme: "Digital Video Library - Jacky Ma."— Presentation transcript:

1 Digital Video Library - Jacky Ma

2 Introduction Overview Application System Design Technologies
Speech Recognition Image Understanding Metadata Extraction Challenges

3 Overview Make large video library to be searchable information resources Video Captures the experience of society News, TV, Movie…etc Search and Discovery Automated knowledge extraction from video Integration of speech, image, and natural language understanding for library creation and exploration

4 Application Areas Education and training
Consumer and business access to news and information of interest Entertainment Interactive television Meeting/corporate memory Video conferences

5 Application of Diverse Technologies
Image Understanding Scene Understanding Speech Recognition Metadata/Entity Extraction Natural Language Processing More… Database, Network, User Interface...

6 Library Creation

7 Library Exploration

8 Information Retrieval
Given a large collection of multimedia records, find similar/interesting things Allow fast, approximate queries Find rules/patterns Similarity search Find pairs of documents that are similar Find medical cases similar to Smith’s Find pairs of stocks that move in sync

9 Indexing for Multimedia
Speech Recognition Functions Generates transcript to enable text-base retrieval Provides speech interface to digital library Supplies necessary information for library segmentation and multimedia abstraction

10 Speech Recognition

11 Speech Recognition - cont’d

12 Speech Recognition - cont’d

13 Indexing for Multimedia
Image Understanding Functions Scene segmentation Similarity matching Camera motion determination and object tracking OCR on video text and titles Face detection and recognition Future: Object identification, scene characterization

14 Image Understanding Dimensions of matching are color, texture, shape
Methods Color histogram, Region-based analysis But “similar” has different meaning for different people, or same person but different situation

15 Image Understanding - cont’d

16 Indexing for Multimedia
Metadata Extraction Higher level of abstract knowledge Story summaries Real world knowledge people location time event...

17 Metadata Extraction

18 Challenges Multilingual Processing Cognitive Processing
Library Interoperability Intellectual Property Security Issues

19 Thank you

Download ppt "Digital Video Library - Jacky Ma."

Similar presentations

ESDS Qualidata Libby Bishop, ESDS Qualidata Economic and Social Data Service UK Data Archive ESDS Awareness Day Friday 5 December 2003Royal Statistical.

ESDS Qualidata Libby Bishop, ESDS Qualidata Economic and Social Data Service UK Data Archive ESDS Awareness Day Friday 5 December 2003Royal Statistical.
Pseudo-Relevance Feedback For Multimedia Retrieval By Rong Yan, Alexander G. and Rong Jin Mwangi S. Kariuki 2008-11629.

Pseudo-Relevance Feedback For Multimedia Retrieval By Rong Yan, Alexander G. and Rong Jin Mwangi S. Kariuki
Review of AI from Chapter 3. Journal May 13  What advantages and disadvantages do you see with using Expert Systems in real world applications like business,

Review of AI from Chapter 3. Journal May 13  What advantages and disadvantages do you see with using Expert Systems in real world applications like business,
Interoperability Scenarios All Working Groups Meeting 26-28 May, Rome, Italy.

Interoperability Scenarios All Working Groups Meeting May, Rome, Italy.
Content-based Video Indexing, Classification & Retrieval Presented by HOI, Chu Hong Nov. 27, 2002.

Content-based Video Indexing, Classification & Retrieval Presented by HOI, Chu Hong Nov. 27, 2002.
Mining the web to improve semantic-based multimedia search and digital libraries

Mining the web to improve semantic-based multimedia search and digital libraries
Chapter 11 Beyond Bag of Words. Question Answering n Providing answers instead of ranked lists of documents n Older QA systems generated answers n Current.

Chapter 11 Beyond Bag of Words. Question Answering n Providing answers instead of ranked lists of documents n Older QA systems generated answers n Current.
1 CS 430: Information Discovery Lecture 22 Non-Textual Materials 2.

1 CS 430: Information Discovery Lecture 22 Non-Textual Materials 2.
Presentation Outline  Project Aims  Introduction of Digital Video Library  Introduction of Our Work  Considerations and Approach  Design and Implementation.

Presentation Outline  Project Aims  Introduction of Digital Video Library  Introduction of Our Work  Considerations and Approach  Design and Implementation.
Image Search Presented by: Samantha Mahindrakar Diti Gandhi.

Image Search Presented by: Samantha Mahindrakar Diti Gandhi.
ADVISE: Advanced Digital Video Information Segmentation Engine

ADVISE: Advanced Digital Video Information Segmentation Engine
Supervised by Prof. LYU, Rung Tsong Michael Department of Computer Science & Engineering The Chinese University of Hong Kong Prepared by: Chan Pik Wah,

Supervised by Prof. LYU, Rung Tsong Michael Department of Computer Science & Engineering The Chinese University of Hong Kong Prepared by: Chan Pik Wah,
CS335 Principles of Multimedia Systems Content Based Media Retrieval Hao Jiang Computer Science Department Boston College Dec. 4, 2007.

CS335 Principles of Multimedia Systems Content Based Media Retrieval Hao Jiang Computer Science Department Boston College Dec. 4, 2007.
Multimedia Search and Retrieval Presented by: Reza Aghaee For Multimedia Course(CMPT820) Simon Fraser University March.2005 Shih-Fu Chang, Qian Huang,

Multimedia Search and Retrieval Presented by: Reza Aghaee For Multimedia Course(CMPT820) Simon Fraser University March.2005 Shih-Fu Chang, Qian Huang,
1 CS 430 / INFO 430 Information Retrieval Lecture 22 Metadata 4.

1 CS 430 / INFO 430 Information Retrieval Lecture 22 Metadata 4.
Presentation Outline  Project Aims  Introduction of Digital Video Library  Introduction of Our Work  Considerations and Approach  Design and Implementation.

Presentation Outline  Project Aims  Introduction of Digital Video Library  Introduction of Our Work  Considerations and Approach  Design and Implementation.
1998/5/21by Chang I-Ning1 ImageRover: A Content-Based Image Browser for the World Wide Web Introduction Approach Image Collection Subsystem Image Query.

1998/5/21by Chang I-Ning1 ImageRover: A Content-Based Image Browser for the World Wide Web Introduction Approach Image Collection Subsystem Image Query.
1 Discussion Class 10 Informedia. 2 Discussion Classes Format: Question Ask a member of the class to answer. Provide opportunity for others to comment.

1 Discussion Class 10 Informedia. 2 Discussion Classes Format: Question Ask a member of the class to answer. Provide opportunity for others to comment.
LYU 0102 : XML for Interoperable Digital Video Library Recent years, rapid increase in the usage of multimedia information, Recent years, rapid increase.

LYU 0102 : XML for Interoperable Digital Video Library Recent years, rapid increase in the usage of multimedia information, Recent years, rapid increase.
Department of Computer Science and Engineering, CUHK 1 Final Year Project 2003/2004 LYU0302 PVCAIS – Personal Video Conference Archives Indexing System.

Department of Computer Science and Engineering, CUHK 1 Final Year Project 2003/2004 LYU0302 PVCAIS – Personal Video Conference Archives Indexing System.

Similar presentations

Ads by Google