An Automatic Video Information Processing and Conversion System for Multimedia Messaging Service and Mobile Internet Miss Chan Pik Wah, Pat Miss Ngai Cheuk.

Slides:



Advertisements
Similar presentations
Generation of Multimedia TV News Contents for WWW Hsin Chia Fu, Yeong Yuh Xu, and Cheng Lung Tseng Department of computer science, National Chiao-Tung.
Advertisements

Panasonic Singapore Labs – Network Team QoS and Delivery Context in Rule-Based Edge Services Prepared for IWCW2002 By Ng Chan Wah
4.1Different Audio Attributes 4.2Common Audio File Formats 4.3Balancing between File Size and Audio Quality 4.4Making Audio Elements Fit Our Needs.
Lesson 01: The Digital Experience  Transition from traditional devices to multipurpose digital devices. Wired phones move to cell phones and now smart.
3.6 Multimedia/Digital Media Components (Audio and Video) by Francisco Oliveira.
Mobile Entertaiment now and tomorrow…
How FERNE Uses the Internet: The How’s and Why’s of Videostreaming.
By ADEBAYO Moses Olajuwon rudiments of multimedia 1.
A New Scheme For Robust Blind Digital Video Watermarking Supervised by Prof. LYU, Rung Tsong Michael Presented by Chan Pik Wah, Pat Mar 5, 2002 Department.
MULTIMEDIA DEVELOPMENT 4.3 : AUTHORING TOOLS. At the end of the lesson, students should be able to: 1. Describe different types of authoring tools Learning.
Performance Analysis of Orb Rabin Karki and Thangam V. Seenivasan 1.
Microsense Webcast Streaming Solutions
1 CS 430: Information Discovery Lecture 22 Non-Textual Materials 2.
ADVISE: Advanced Digital Video Information Segmentation Engine
Supervised by Prof. LYU, Rung Tsong Michael Department of Computer Science & Engineering The Chinese University of Hong Kong Prepared by: Chan Pik Wah,
Video on the Web. Should you add video to your web page? Three main questions 1. How will it enhance the purpose of my page? –Entertain –Explain a process.
Department of Computer Science and Engineering, CUHK 1 Final Year Project 2003/2004 LYU0302 PVCAIS – Personal Video Conference Archives Indexing System.
Multimedia Security Digital Video Watermarking Supervised by Prof. LYU, Rung Tsong Michael Presented by Chan Pik Wah, Pat Nov 20, 2002 Department of Computer.
Microsoft Office Illustrated Inserting Illustrations, Objects, and Media Clips.
1 Final Year Project 2003/2004 LYU0302 PVCAIS – Personal Video Conference Archives Indexing System Supervisor: Prof Michael Lyu Presented by: Lewis Ng,
Streaming media over the Internet A million channels and there is still nothing on! By Samuel Shiffman Streaming Technologist Seton Hall University
McGraw-Hill/Irwin The Interactive Computing Series © 2002 The McGraw-Hill Companies, Inc. All rights reserved. Microsoft PowerPoint 2002 Working with External.
Creating & Distributing New Media Content lesson 24.
Multimedia Enabling Software. The Human Perceptual System Since the multimedia systems are intended to be used by human, it is a pragmatic approach to.
Using Digital Video. Contents 1.Why using videos 2.Analog vs digital 3.Transferring your videos to the computer 4.Editing your videos 5.Video file formats.
Chapter Objectives Explain Web page multimedia issues
Video Streaming © Nanda Ganesan, Ph.D..
Web Design, 3 rd Edition 6 Multimedia and Interactivity Elements.
IEEE Region 10 Expanding the reach of Distinguished Lecture Training Programmes via the Internet.
Eyeblaster Video Enhancements for RMP 6.1. Agenda Video Enhancements Goals Main features and Creative Process Flash Video Components Bandwidth Optimization.
1 Helix DNA framework Sylvain Guérin Johann Le Bourgocq.
Glencoe Introduction to Multimedia Chapter 9 Video 1 Chapter Video 9  Section 9.1 Video in Multimedia  Section 9.2 Work with Video Contents.
Final Year Student Projects: Prelude Michael R. Lyu.
Multimedia and The Web.
Supervised by Prof. LYU, Rung Tsong Michael Department of Computer Science & Engineering The Chinese University of Hong Kong Prepared by: Chan Pik Wah,
Department of Computer Science and Engineering, CUHK 1 Final Year Project 2003/2004 LYU0302 PVCAIS – Personal Video Conference Archives Indexing System.
Creating Multimedia Interaction with Windows Media Technologies 7.
MULTIMEDIA DEFINITION OF MULTIMEDIA
Video.
The Future of Training Creating Videos in Camtasia: The Basics Joe Schipper Technology Integration Specialist (ITRT) Western Branch High School, Chesapeake,
Department of Computer Science and Engineering, CUHK 1 Final Year Project 2003/2004 LYU0302 PVCAIS – Personal VideoConference Archives Indexing System.
XP Practical PC, 3e Chapter 15 1 Creating Desktop Video and Animation.
Digital Planet: Tomorrow’s Technology and You
The MPEG-DASH Standard for Multimedia Streaming Over the Internet Chih-Hsiang Chou Advisor: Prof Dr. Ho-Ting Wu Department of Computer Science and Information.
MICROSOFT POWERPOINT (MICROSOFT POWERPOINT)
LECTURE 07 RAZIA NISAR NOORANI Digital Video. Basic Digital Video Concepts CS118 – Web Engineering 2 Movie length Frame size Frame rate Quality Color.
Creating Streaming Video Clips for Web-based Instruction Jay Cofield, Ph.D. The university of Montevallo July 9, 2002.
Chapter 10. The Role of Video in Multimedia  Any presentation or application that uses sound and graphics qualifies as multimedia  Clip A segment of.
11 IMPLEMENTING AND MANAGING SOFTWARE UPDATE SERVICES Chapter 7.
Digital Video Library Network Supervisor: Prof. Michael Lyu Student: Ma Chak Kei, Jacky.
Multimedia in Web Introduction. Multimedia Elements in Web Page Images Voice Music Animation Video Text & Numbers.
Audio Streaming © Nanda Ganesan, Ph.D.. Audio File Features Audio file is a record of captured sound that can be played back –The WAV File is an example.
CREATING A PODCAST Using PowerPoint (2007 version)
California State University, LA Presented by Amanda Steven StevenAamirObaid.
MMS Plato Chen Aug, MMS Brief Introduction MMS is short for Multimedia Messaging Service.Its biggest feature is supported for multimedia functions,
Streaming Media. What is Streaming Media The delivery of audio, video and other multimedia content across the internet using streaming media servers.
Computer Technology Semester 2 Final Exam Review.
Etere MTX NAB 2010 Distributor Meeting. Why MTX  Our vision is to deliver an integrated framework  MTX follows this vision not as a simple video device.
MPEG 7 &MPEG 21.
1 Chapter 15 Creating a Presentation. Practical Computer Literacy, 2 nd edition Chapter 15 2 What’s inside and on the CD? In this chapter, you will learn.
Power Point Overview. Visual Aid Similar to other visual aids used in presentations Similar to other visual aids used in presentations.
Power Point Overview.
Video on the Web.
Supervisor: Prof Michael Lyu Presented by: Lewis Ng, Philip Chan
Creating Desktop Video and Animation
Web Programming– UFCFB Lecture 8
CHAPTER 8 Multimedia Authoring Tools
Web Programming– UFCFB Lecture 8
E-CONTENT GENERATION USING OPEN SOURCE TOOLS
Digital Video Faraz Khan.
Presentation transcript:

An Automatic Video Information Processing and Conversion System for Multimedia Messaging Service and Mobile Internet Miss Chan Pik Wah, Pat Miss Ngai Cheuk Han, Edith Video over InternEt and Wireless Technologies Lab., CUHK 6 th IT Excellence Awards (Post Secondary) 2004/06/09

VIEWLab, CSE, CUHK Video over InternEt and Wireless Technologies Laboratory VIEWLab is a research and application development laboratory Computer Science and Engineering, CUHK Prof. Michael R. Lyu Focus on Video Information Processing Technologies Mobile and Wireless Application Development

VIEWLab, CSE, CUHK Presentation Outline Motivation Functionality & Design Demonstration Innovation Prospect for future commercialization Q&A

VIEWLab, CSE, CUHK Motivation Needs of mobile video content is increasing Video information processing technologies developed A prototype system is created to automate the video authoring process Enabling faster and cheaper mobile video entertainment

VIEWLab, CSE, CUHK Functionality & Design An automatic video information processing and conversion system for MMS and Mobile Internet Targets Fully automation Mechanical processing with pre-defined knowledge Various video content type Short processing time Configurable for different needs

VIEWLab, CSE, CUHK Overview of System Advertisement Removal Program Identification Scene Analysis MMS (Pictures + Sound) / Mobile Video Video Streaming / Progressive Download MMS Component Creation Mobile Internet Video Clip Conversion TV Broadcast

VIEWLab, CSE, CUHK Video Information Processing These are the technologies to extract information from video using visual and audio channels By extracting/identifying the information, “effective” condensation/summary techniques can be applied through information fusion or recognition steps We define a type of information a “modality” Transcript/Speech On-screen characters Face Visual features

VIEWLab, CSE, CUHK Every Bit Counts MMS size is limited to within hundred KB In order to delivery “useful” information to viewer Condensation/summary techniques are required to locate/prioritize the most important bits Bandwidth cost is relatively higher than other channels the “value” of the content transmitted is curial to successfully MMS business Utilize the “value” of the bandwidth use, only transmitting the important bits

VIEWLab, CSE, CUHK Main Features of Video2MMS Advertisement removal TV program identification Video condensation/summary MMS creation and adaptation for different mobile handsets

VIEWLab, CSE, CUHK Advertisement Removal Based on the logo detection techniques developed, TV program and non TV program segments can be separated automatically Program TV Broadcast Non Program

VIEWLab, CSE, CUHK TV Program Identification Based on the visual features and audio characteristics, the desire TV program can be identified

VIEWLab, CSE, CUHK Video Condensation / Summary Condense the long video into short slide show presentation Segment the video into different scene  Two pass minimum difference color histogram Choose the most representative shots  Video editing style  Longest scene Video Summary

VIEWLab, CSE, CUHK MMS Creation and Adaptation Different handsets have different MMS size and screen size Nokia 7650, KB, 176 x 136 SonyEricsson T68i, T300 – 30KB, 101 x 80 Panasonic GD88 – 45KB, 176 x 136 Convert the pictures to correct screen size Utilize the MMS size for most information (number of pictures and duration) Configurable for new handsets

VIEWLab, CSE, CUHK MMS Matrix MMS Size = audio size + (picture size * n) Audio size = length of audio * 0.8k, (4.75 bit-rate) Picture size = f(screen size, number of colors) HandsetMMS Size DurationScreen Size Number of Color Average Size Number of Pictures Nokia KB60sec174 x K4 ~ 5 SonyEricsson T68i 30KB30sec101 x K3 ~ 4 Panasonic GD88 45KB45sec176 x K4 ~ 5

VIEWLab, CSE, CUHK Mobile Internet Video Clips Conversion Control third party modules to cut and convert video into short video clips Different handsets have different MMS size and screen size 3GPP format RealVideo format Microsoft Windows Media Format Clips size configurable for different usage 100KB for MMS delivery >100KB for video streaming

VIEWLab, CSE, CUHK Demonstration Video (1) (click to play) ATV News Headline AMR + Animated Gif Nokia KB 20 seconds 174 x colors Animated Gif (6 pic.) AMR Audio

VIEWLab, CSE, CUHK Demonstration Video (2) (click to play) ATV News Headline 3GP for Mobile Internet Nokia KB 20 seconds 174 x colors

VIEWLab, CSE, CUHK Demonstration Video (3) (click to play) ATV Weather Report AMR + Animated Gif Nokia KB 60 seconds 174 x colors Animated Gif (5 pic.) AMR Audio

VIEWLab, CSE, CUHK Demonstration Video (4) (click to play) ATV Hourly News AMR + Animated Gif Nokia KB 40 seconds 174 x colors Animated Gif (6 pic.) AMR Audio

VIEWLab, CSE, CUHK Demonstration Video (5) (click to play) Horse Racing 3GP in MMS Nokia KB 20 seconds 174 x 136

VIEWLab, CSE, CUHK Demonstration Video (6) (click to play) Horse Racing RealVideo in MMS Nokia KB 20 seconds 120 x 96

VIEWLab, CSE, CUHK Demonstration Video (7) (click to play) Soccer Goal Shot RealVideo in MMS Nokia KB 5 seconds 120 x 96

VIEWLab, CSE, CUHK System Demonstration Modules Editor Main Panel Task Scheduler Task Profile

VIEWLab, CSE, CUHK Innovation We believed this is the first application applied Video Information Processing technologies on automating the content preparation processes for mobile handset in Hong Kong

VIEWLab, CSE, CUHK Prospect for future commercialization Base on this prototype, our laboratory technology commercialization team developed a production system called Video2MMS™ Video2MMS™ was licensed to HKCSL in spring 2003 to prepare daily news and weather video clips and MMS Press release 7&type1=1&rhtID1=3&lid=2

VIEWLab, CSE, CUHK Tested Handsets MMS Nokia 7560, 3650 SonyEricssion T68i, T300 Panasonic GD88 VideoClips (Download) MS PocketPC, XDA

VIEWLab, CSE, CUHK Recommended System Requirements Intel P4 1.0G Hz 512MB RAM Microsoft Windows 2000 or above DirectX 8.1 TV Capture Card (MPEG-1) Optional third party software  Real Encoder  Nokia 3GP Encoder  Sony Ericsson AMR Convertor  Microsoft Windows Media Encoder

VIEWLab, CSE, CUHK Q&A