Nortel Confidential Information 1 Video Sample Production Summary Leigh Thorpe Nortel Paris, 7-11 May 2007.

Slides:



Advertisements
Similar presentations
Nicharee Srirochanakul
Advertisements

ITIS 1210 Introduction to Web-Based Information Systems Chapter 36 How Music and Audio Work on the Internet.
Media: Voice and Video in your SIP Environment Jitendra Shekhawat.
29.1 Chapter 29 Multimedia Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
RTP: A Transport Protocol for Real-Time Applications Provides end-to-end delivery services for data with real-time characteristics, such as interactive.
19 – Multimedia Networking. Multimedia Networking7-2 Multimedia and Quality of Service: What is it? multimedia applications: network audio and video (“continuous.
User Control of Streaming Media: RTSP
Chapter 6 outline r 6.1 Multimedia Networking Applications r 6.2 Streaming stored audio and video m RTSP r 6.3 Real-time, Interactive Multimedia: Internet.
Performance Analysis of Orb Rabin Karki and Thangam V. Seenivasan 1.
CS294-9 :: Fall 2003 ALF and RTP Ketan Mayer-Patel.
Application layer (continued) Week 4 – Lecture 2.
Implementation of Proxy/Buffering Strategies in Mpeg transmission for intermittent connectivity CS218 Samarth Pal, Ujjwal Lahoti, Xiaoyong Su Tutor: Dr.
1 CSE 401N Multimedia Networking Lecture Multimedia, Quality of Service: What is it? Multimedia applications: network audio and video network provides.
TCP/IP Protocol Suite 1 Chapter 25 Upon completion you will be able to: Multimedia Know the characteristics of the 3 types of services Understand the methods.
Streaming media over the Internet A million channels and there is still nothing on! By Samuel Shiffman Streaming Technologist Seton Hall University
ActEyes IP Cam Training Part 2: Basic Camera Features.
Video Streaming © Nanda Ganesan, Ph.D..
CS640: Introduction to Computer Networks
Process-to-Process Delivery:
Using Multimedia on the Web
CS 218 F 2003 Nov 3 lecture:  Streaming video/audio  Adaptive encoding (eg, layered encoding)  TCP friendliness References: r J. Padhye, V.Firoiu, D.
RTSP Real Time Streaming Protocol
1 CMSCD1011 Introduction to Computer Audio Lecture 10: Streaming audio for Internet transmission Dr David England School of Computing and Mathematical.
CIS679: RTP and RTCP r Review of Last Lecture r Streaming from Web Server r RTP and RTCP.
Multimedia and QoS#1#1 Multimedia Applications. Multimedia and QoS#2#2 Multimedia Applications r Multimedia requirements r Streaming r Recovering from.
Document Number ETH West Diamond Avenue - Third Floor, Gaithersburg, MD Phone: (301) Fax: (301)
NV V5.7 Product Presentation. Brand New Professional GUI  Multiple User Interface for different look and feel  Audio indicator on camera (play audio.
Chapter 17 Networking Dave Bremer Otago Polytechnic, N.Z. ©2008, Prentice Hall Operating Systems: Internals and Design Principles, 6/E William Stallings.
E0262 MIS - Multimedia Playback Systems Anandi Giridharan Electrical Communication Engineering, Indian Institute of Science, Bangalore – , India.
1 RTP Payload Format for DV Format Video draft-kobayashi-dv-video-00.txt Akimichi Ogawa Keio University.
Lecture 2 TCP/IP Protocol Suite Reference: TCP/IP Protocol Suite, 4 th Edition (chapter 2) 1.
Daniel Johnson. Playing a media file stored on a remote server on a local client.
© 2007 Cisco Systems, Inc. All rights reserved.Cisco Public ITE PC v4.0 Chapter 1 1 Network Services Networking for Home and Small Businesses – Chapter.
Playing Music in Alice By David Yan Under the direction of Professor Susan Rodger July 2015.
Creating Multimedia Interaction with Windows Media Technologies 7.
1 How Streaming Media Works Bilguun Ginjbaatar IT 665 Nov 14, 2006.
Multimedia Over IP: RTP, RTCP, RTSP “Computer Science” Department of Informatics Athens University of Economics and Business Λουκάς Ελευθέριος.
TCP/IP Protocol Suite 1 Chapter 25 Upon completion you will be able to: Multimedia Know the characteristics of the 3 types of services Understand the methods.
Outline Overview Video Format Conversion Connection with An authentication Streaming media Transferring media.
CS640: Introduction to Computer Networks Aditya Akella Lecture 19 - Multimedia Networking.
HDTV Video and AC-3 Payload Formats Ladan Gharai Allison Mankin USC/ISI.
Chapter 6-2 the TCP/IP Layers. The four layers of the TCP/IP model are listed in Table 6-2. The layers are The four layers of the TCP/IP model are listed.
Chapter 6 outline r 6.1 Multimedia Networking Applications r 6.2 Streaming stored audio and video m RTSP r 6.3 Real-time Multimedia: Internet Phone Case.
Making the Best of the Best-Effort Service (2) Advanced Multimedia University of Palestine University of Palestine Eng. Wisam Zaqoot Eng. Wisam Zaqoot.
03/11/2015 Michael Chai; Behrouz Forouzan Staffordshire University School of Computing Streaming 1.
McGraw-Hill©The McGraw-Hill Companies, Inc., 2004 Chapter 28 Multimedia.
Internet Measurment Multimedia 1. Properties Challenges Tools State of the Art 2.
CS Spring 2014 CS 414 – Multimedia Systems Design Lecture 18 – Multimedia Transport (Part 1) Klara Nahrstedt Spring 2014.
Lecture (Mar 23, 2000) H/W Assignment 3 posted on Web –Due Tuesday March 28, 2000 Review of Data packets LANS WANS.
Internet multimedia: simplest approach audio, video not streamed: r no, “pipelining,” long delays until playout! r audio or video stored in file r files.
Class 9 LBSC 690 Information Technology Multimedia.
TCP/IP Protocol Suite 1 Chapter 25 Upon completion you will be able to: Multimedia Know the characteristics of the 3 types of services Understand the methods.
Ch 6. Multimedia Networking Myungchul Kim
Com 597 Streaming Media Class 6 July 11, Packetization To stream a file over the internet you need to break the file down Kilobyte sized chunks.
California State University, LA Presented by Amanda Steven StevenAamirObaid.
McGraw-Hill Chapter 23 Process-to-Process Delivery: UDP, TCP Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
Streaming Media. What is Streaming Media The delivery of audio, video and other multimedia content across the internet using streaming media servers.
WhatNOW: A System to Enable Videostream in a Mobile Network Alexandre Martini, Sandro Mourão, Wesley Silva Nokia Technology Institute, Manaus, Brazil 報告者:劉源蔁.
The Transport Layer Congestion Control & UDP
19 – Multimedia Networking
Networking Applications
Chapter 14 User Datagram Program (UDP)
Networking Applications
Multimedia networking: outline
Process-to-Process Delivery:
CIS679: MPEG-2 Review of MPEG-1 MPEG-2 Multimedia and networking.
Multimedia networking: outline
Active Tests and Traffic Simulation: Module Objectives
Active Tests and Traffic Simulation: Module Objectives
Process-to-Process Delivery: UDP, TCP
Presentation transcript:

Nortel Confidential Information 1 Video Sample Production Summary Leigh Thorpe Nortel Paris, 7-11 May 2007

Nortel Confidential Information 2 Video Clip Production Lab Setup Real Mobile Producer (Envivio) -used to produce the sample clips encoded at the required format from source YUV files Real Helix Mobile Server -plays out the clips when requested from the client Ineoquest Singulus -used to generate dropped packets Baystack Switch -Ethernet switch to connect everything together Client PC with SQQTClient capture -receives the clips over ethernet with dropped packets, and converts back to uncompressed YUV NAS Drives -containing the SRC and PVS network Encoding PC Server PC Client PC Step 1 – upload SRC to Encoding PC Step 2 – Encode SRC and upload to Server PC Step 3 – Stream encoded file through Singulus for packet loss to Client PC and capture resulting PVS Step 4 – upload PVS to NAS drive

Nortel Confidential Information 3 Video Clip Production Procedure source YUV file from VQEG pool CIF and QCIF (16-bit or 12-bit) file encoded to.3gp using Real Mobile Producer video clip is sent over a network with dropped IP packet impairments generated by Ineoquest Singulus video clip is stored in Real Helix Mobile server for streaming (hint tracks used) video clip received with impairments video clip converted to YUV format using SwissQual tool (appears to be 24-bit)

Nortel Confidential Information 4 Notes on the Common Files Processing Create scenarios reflecting typical current mobile video operating conditions Settings based on reviews of services in Europe and North America QCIF MPEG-4 part 2 SP encoding, 3gppv5 format, 500 bytes / packet setting 10 fps 128 kbps 1% packet loss CIF H.264 encoding, 3gppv6 format, 1000 bytes / packet setting 20 fps 256 kbps 1% packet loss

Nortel Confidential Information 5 Sample Impairment Stills

Nortel Confidential Information 6 Comments Based on Preliminary Work Comments: User experience impacts of packet loss are highly dependent on the player’s response to packet loss stability in face of packet loss loss concealment mechanisms OS and platform and other handset implementation specific details Packet loss also dependant on bytes / packet settings used in hint tracks when encoding the files for streaming particularly for low bit rate streams we selected settings that resulted in a number of RTP packets streamed that aligns with what is being used in networks we’ve studied Packet loss effects will be dependent on encoder and levels / profiles used Some effects of packet loss are masked by motion or encoding impairments particularly at QCIF resolutions and low bit rates Some packet loss results in frame loss and no other obvious impairments (like slice / block errors) on other frames and at low frame rates (10 fps) the lost frames may not be obvious

Nortel Confidential Information 7 Issues and Questions based on Preliminary Work SQQTClient Capture tool Some quirks in capture tool operation (need to close the file explicitly or exit the program between captures as per the Readme) Not sure how the frame timestamps are derived - we see indication of delayed (and likely lost) frames during our IP packet drops but also see variability in timestamps when streaming encoded files without drops (but playback indicates consistent frame rate) see CIF Timecompare tab in uploaded spreadsheet QCIF seems OK Could be on Real Helix server side Seem to be getting a few frames dropped from the end of the files when streaming in some cases – not a problem since we’ll drop 2 seconds anyway Ex. On QCIF time compare tab in spreadsheet -.3gp file is 12.0 s but streamed and captured.avi is s (Quicktime properties view) and.log files shows 117 frames and would have expected 120 frames (10 fps * 12s)

Nortel Confidential Information 8 Nortel / CRC CIF Production Matrix ResolutionEncoded Format Packet Drops Clip Description Frame Rate Bit Rate Clip Length Delivery Protocol Total CIF (352 x 288) H.2640%a15128 k12 secUDP 0.5%b20256 k 1%c30512 k 2%d768 k 4%e 10%f g h Note: Only 136 of the 576 combinations are produced

Nortel Confidential Information 9 Nortel / CRC QCIF Production Matrix ResolutionEncoded Format Packet Drops Clip Description Frame Rate Bit Rate Clip Length Delivery Protocol Total QCIF (176 x 144) MPEG4 P2 SP 0%a7.564 k12 secUDP 0.5%b10128 k 1%c15256 k 2%d20 4%e 10%f g h Note: Only 136 of the 576 combinations are produced

Nortel Confidential Information 10 Notes on the Production Matrix Not all combinations are produced 136 will be produced at each resolution (see the detailed spreadsheet for detailed combinations) Typically the higher the frame rates, the higher the bit rates Therefore the low frame rate/high bit rate and high frame rate/low bit rate are not sensible combinations in the real world This is because if more bandwidth is available, both frame rate and bit rate are increased in order to achieve higher quality video In addition, there will be 16 sequences produced as follows: 8 x QCIF, MPEG-4 Part 2 SP, 128 kb/s, 10 fps, 500-byte packets, 1% burst loss 8 x CIF, H.264, 256 kb/s, 20 fps, 1000-byte packets, 1% burst loss

Nortel Confidential Information 11 Backup Slides

Nortel Confidential Information 12 Notes on the Swiss Qual tool -open URL under “file” -press “play” under “movie” -under “movie”, click “stop” and “rewind” twice -press “record” followed by “play” and the video should download once and be converted to an AVI -be sure to “close AVI” when done -if the procedure needs to be repeated, change the file name or delete the previous AVI and log files, or else the next result will show up in another directory -check “UDP” under options

Nortel Confidential Information 13 Helix Producer -set to 3GPPv6 singlerate for both MPEG4SP and H.264 -make sure the source and destination file names are correct (so that the encoded file can be found again) -keep a record of the encoding details for each output file name

Nortel Confidential Information 14 Helix Producer -select the bit rate, encoding format, and frame rate -uncheck audio to make sure the bit rate is all video

Nortel Confidential Information 15 Helix Producer -uncheck “resize” and/or make sure the resolution is correct

Nortel Confidential Information 16 Helix Producer -check “Progressive Download Profile” so that MPEG4 metadata arrives at beginning of stream -check “Streaming- server profile” to generate hint tracks -set maximum packet size to 500 or 1000 to improve error granularity

Nortel Confidential Information 17 Typical File Sizes and Dropped Packets average packet size: 500% drop target bit rate (kb/s) approx. file size for 12 seconds (kB) total packets packets dropped: note: these figures should be independent of CIF or QCIF

Nortel Confidential Information 18

Nortel Confidential Information 19