Presentation is loading. Please wait.

Presentation is loading. Please wait.

An Automatic Video Information Processing and Conversion System for Multimedia Messaging Service and Mobile Internet Miss Chan Pik Wah, Pat Miss Ngai Cheuk.

Published byCamilla Blake Modified over 9 years ago

Similar presentations

Presentation on theme: "An Automatic Video Information Processing and Conversion System for Multimedia Messaging Service and Mobile Internet Miss Chan Pik Wah, Pat Miss Ngai Cheuk."— Presentation transcript:

1 An Automatic Video Information Processing and Conversion System for Multimedia Messaging Service and Mobile Internet Miss Chan Pik Wah, Pat Miss Ngai Cheuk Han, Edith Video over InternEt and Wireless Technologies Lab., CUHK 6 th IT Excellence Awards (Post Secondary) 2004/06/09

2 VIEWLab, CSE, CUHK Video over InternEt and Wireless Technologies Laboratory VIEWLab is a research and application development laboratory Computer Science and Engineering, CUHK Prof. Michael R. Lyu Focus on Video Information Processing Technologies Mobile and Wireless Application Development

3 VIEWLab, CSE, CUHK Presentation Outline Motivation Functionality & Design Demonstration Innovation Prospect for future commercialization Q&A

4 VIEWLab, CSE, CUHK Motivation Needs of mobile video content is increasing Video information processing technologies developed A prototype system is created to automate the video authoring process Enabling faster and cheaper mobile video entertainment

5 VIEWLab, CSE, CUHK Functionality & Design An automatic video information processing and conversion system for MMS and Mobile Internet Targets Fully automation Mechanical processing with pre-defined knowledge Various video content type Short processing time Configurable for different needs

6 VIEWLab, CSE, CUHK Overview of System Advertisement Removal Program Identification Scene Analysis MMS (Pictures + Sound) / Mobile Video Video Streaming / Progressive Download MMS Component Creation Mobile Internet Video Clip Conversion TV Broadcast

7 VIEWLab, CSE, CUHK Video Information Processing These are the technologies to extract information from video using visual and audio channels By extracting/identifying the information, “effective” condensation/summary techniques can be applied through information fusion or recognition steps We define a type of information a “modality” Transcript/Speech On-screen characters Face Visual features

8 VIEWLab, CSE, CUHK Every Bit Counts MMS size is limited to within hundred KB In order to delivery “useful” information to viewer Condensation/summary techniques are required to locate/prioritize the most important bits Bandwidth cost is relatively higher than other channels the “value” of the content transmitted is curial to successfully MMS business Utilize the “value” of the bandwidth use, only transmitting the important bits

9 VIEWLab, CSE, CUHK Main Features of Video2MMS Advertisement removal TV program identification Video condensation/summary MMS creation and adaptation for different mobile handsets

10 VIEWLab, CSE, CUHK Advertisement Removal Based on the logo detection techniques developed, TV program and non TV program segments can be separated automatically Program TV Broadcast Non Program

11 VIEWLab, CSE, CUHK TV Program Identification Based on the visual features and audio characteristics, the desire TV program can be identified

12 VIEWLab, CSE, CUHK Video Condensation / Summary Condense the long video into short slide show presentation Segment the video into different scene  Two pass minimum difference color histogram Choose the most representative shots  Video editing style  Longest scene Video Summary

13 VIEWLab, CSE, CUHK MMS Creation and Adaptation Different handsets have different MMS size and screen size Nokia 7650, 3650 - 100KB, 176 x 136 SonyEricsson T68i, T300 – 30KB, 101 x 80 Panasonic GD88 – 45KB, 176 x 136 Convert the pictures to correct screen size Utilize the MMS size for most information (number of pictures and duration) Configurable for new handsets

14 VIEWLab, CSE, CUHK MMS Matrix MMS Size = audio size + (picture size * n) Audio size = length of audio * 0.8k, (4.75 bit-rate) Picture size = f(screen size, number of colors) HandsetMMS Size DurationScreen Size Number of Color Average Size Number of Pictures Nokia 3650100KB60sec174 x 136 12810K4 ~ 5 SonyEricsson T68i 30KB30sec101 x 80 323K3 ~ 4 Panasonic GD88 45KB45sec176 x 136 645K4 ~ 5

15 VIEWLab, CSE, CUHK Mobile Internet Video Clips Conversion Control third party modules to cut and convert video into short video clips Different handsets have different MMS size and screen size 3GPP format RealVideo format Microsoft Windows Media Format Clips size configurable for different usage 100KB for MMS delivery >100KB for video streaming

16 VIEWLab, CSE, CUHK Demonstration Video (1) (click to play) ATV News Headline AMR + Animated Gif Nokia 3650 100KB 20 seconds 174 x 136 128 colors Animated Gif (6 pic.) AMR Audio

17 VIEWLab, CSE, CUHK Demonstration Video (2) (click to play) ATV News Headline 3GP for Mobile Internet Nokia 3650 195KB 20 seconds 174 x 136 256 colors

18 VIEWLab, CSE, CUHK Demonstration Video (3) (click to play) ATV Weather Report AMR + Animated Gif Nokia 3650 100KB 60 seconds 174 x 136 128 colors Animated Gif (5 pic.) AMR Audio

19 VIEWLab, CSE, CUHK Demonstration Video (4) (click to play) ATV Hourly News AMR + Animated Gif Nokia 3650 100KB 40 seconds 174 x 136 128 colors Animated Gif (6 pic.) AMR Audio

20 VIEWLab, CSE, CUHK Demonstration Video (5) (click to play) Horse Racing 3GP in MMS Nokia 3650 95KB 20 seconds 174 x 136

21 VIEWLab, CSE, CUHK Demonstration Video (6) (click to play) Horse Racing RealVideo in MMS Nokia 3650 95KB 20 seconds 120 x 96

22 VIEWLab, CSE, CUHK Demonstration Video (7) (click to play) Soccer Goal Shot RealVideo in MMS Nokia 3650 92KB 5 seconds 120 x 96

23 VIEWLab, CSE, CUHK System Demonstration Modules Editor Main Panel Task Scheduler Task Profile

24 VIEWLab, CSE, CUHK Innovation We believed this is the first application applied Video Information Processing technologies on automating the content preparation processes for mobile handset in Hong Kong

25 VIEWLab, CSE, CUHK Prospect for future commercialization Base on this prototype, our laboratory technology commercialization team developed a production system called Video2MMS™ Video2MMS™ was licensed to HKCSL in spring 2003 to prepare daily news and weather video clips and MMS Press release http://www.hkcsl.com/show.jsp?pid=4&cnid1=40 7&type1=1&rhtID1=3&lid=2

26 VIEWLab, CSE, CUHK Tested Handsets MMS Nokia 7560, 3650 SonyEricssion T68i, T300 Panasonic GD88 VideoClips (Download) MS PocketPC, XDA

27 VIEWLab, CSE, CUHK Recommended System Requirements Intel P4 1.0G Hz 512MB RAM Microsoft Windows 2000 or above DirectX 8.1 TV Capture Card (MPEG-1) Optional third party software  Real Encoder  Nokia 3GP Encoder  Sony Ericsson AMR Convertor  Microsoft Windows Media Encoder

28 VIEWLab, CSE, CUHK Q&A

Download ppt "An Automatic Video Information Processing and Conversion System for Multimedia Messaging Service and Mobile Internet Miss Chan Pik Wah, Pat Miss Ngai Cheuk."

Similar presentations

Generation of Multimedia TV News Contents for WWW Hsin Chia Fu, Yeong Yuh Xu, and Cheng Lung Tseng Department of computer science, National Chiao-Tung.

Generation of Multimedia TV News Contents for WWW Hsin Chia Fu, Yeong Yuh Xu, and Cheng Lung Tseng Department of computer science, National Chiao-Tung.
Panasonic Singapore Labs – Network Team QoS and Delivery Context in Rule-Based Edge Services Prepared for IWCW2002 By Ng Chan Wah 20020814.

Panasonic Singapore Labs – Network Team QoS and Delivery Context in Rule-Based Edge Services Prepared for IWCW2002 By Ng Chan Wah
4.1Different Audio Attributes 4.2Common Audio File Formats 4.3Balancing between File Size and Audio Quality 4.4Making Audio Elements Fit Our Needs.

4.1Different Audio Attributes 4.2Common Audio File Formats 4.3Balancing between File Size and Audio Quality 4.4Making Audio Elements Fit Our Needs.
Lesson 01: The Digital Experience  Transition from traditional devices to multipurpose digital devices. Wired phones move to cell phones and now smart.

Lesson 01: The Digital Experience  Transition from traditional devices to multipurpose digital devices. Wired phones move to cell phones and now smart.
3.6 Multimedia/Digital Media Components (Audio and Video) by Francisco Oliveira.

3.6 Multimedia/Digital Media Components (Audio and Video) by Francisco Oliveira.
Mobile Entertaiment now and tomorrow…

Mobile Entertaiment now and tomorrow…
How FERNE Uses the Internet: The How’s and Why’s of Videostreaming.

How FERNE Uses the Internet: The How’s and Why’s of Videostreaming.
By ADEBAYO Moses Olajuwon rudiments of multimedia 1.

By ADEBAYO Moses Olajuwon rudiments of multimedia 1.
A New Scheme For Robust Blind Digital Video Watermarking Supervised by Prof. LYU, Rung Tsong Michael Presented by Chan Pik Wah, Pat Mar 5, 2002 Department.

A New Scheme For Robust Blind Digital Video Watermarking Supervised by Prof. LYU, Rung Tsong Michael Presented by Chan Pik Wah, Pat Mar 5, 2002 Department.
MULTIMEDIA DEVELOPMENT 4.3 : AUTHORING TOOLS. At the end of the lesson, students should be able to: 1. Describe different types of authoring tools Learning.

MULTIMEDIA DEVELOPMENT 4.3 : AUTHORING TOOLS. At the end of the lesson, students should be able to: 1. Describe different types of authoring tools Learning.
Performance Analysis of Orb Rabin Karki and Thangam V. Seenivasan 1.

Performance Analysis of Orb Rabin Karki and Thangam V. Seenivasan 1.
Microsense Webcast Streaming Solutions

Microsense Webcast Streaming Solutions
1 CS 430: Information Discovery Lecture 22 Non-Textual Materials 2.

1 CS 430: Information Discovery Lecture 22 Non-Textual Materials 2.
ADVISE: Advanced Digital Video Information Segmentation Engine

ADVISE: Advanced Digital Video Information Segmentation Engine
Supervised by Prof. LYU, Rung Tsong Michael Department of Computer Science & Engineering The Chinese University of Hong Kong Prepared by: Chan Pik Wah,

Supervised by Prof. LYU, Rung Tsong Michael Department of Computer Science & Engineering The Chinese University of Hong Kong Prepared by: Chan Pik Wah,
Video on the Web. Should you add video to your web page? Three main questions 1. How will it enhance the purpose of my page? –Entertain –Explain a process.

Video on the Web. Should you add video to your web page? Three main questions 1. How will it enhance the purpose of my page? –Entertain –Explain a process.
Department of Computer Science and Engineering, CUHK 1 Final Year Project 2003/2004 LYU0302 PVCAIS – Personal Video Conference Archives Indexing System.

Department of Computer Science and Engineering, CUHK 1 Final Year Project 2003/2004 LYU0302 PVCAIS – Personal Video Conference Archives Indexing System.
Multimedia Security Digital Video Watermarking Supervised by Prof. LYU, Rung Tsong Michael Presented by Chan Pik Wah, Pat Nov 20, 2002 Department of Computer.

Multimedia Security Digital Video Watermarking Supervised by Prof. LYU, Rung Tsong Michael Presented by Chan Pik Wah, Pat Nov 20, 2002 Department of Computer.
Microsoft Office 2007- Illustrated Inserting Illustrations, Objects, and Media Clips.

Microsoft Office Illustrated Inserting Illustrations, Objects, and Media Clips.
1 Final Year Project 2003/2004 LYU0302 PVCAIS – Personal Video Conference Archives Indexing System Supervisor: Prof Michael Lyu Presented by: Lewis Ng,

1 Final Year Project 2003/2004 LYU0302 PVCAIS – Personal Video Conference Archives Indexing System Supervisor: Prof Michael Lyu Presented by: Lewis Ng,

Similar presentations

Ads by Google