1. 1 Video v Video consists of image frames captured from real motion and shown in succession v Animation is similar except that the frames are synthesized v The frame rate is the number of frames shown per second (fps) v One minute of uncompressed video requires significant storage: 1.6 GB to 1.85 GB v Compression can be accomplished on the recording device or using a video capture card v The IEEE 1394 (firewire) interface standard is often used for video capture

2. 2 Analog Video v An image on a TV is drawn row by row from left to right, starting at the top left of the screen v After the image has been drawn, it moves back up and begins again v The refresh rate of a TV is the number of times it draws a new image per second v The refresh rate is measured in Hertz (basically, per second)

3. 3 Analog Video v There are two main TV formats: NTSC - National Television System CommitteeNTSC - National Television System Committee PAL – Phase Alternating LinePAL – Phase Alternating Line v NTSC is used in America and Japan, while PAL is used in Europe and Australia v An NTSC TV has a refresh rate of 60 Hz, while a PAL TV has a refresh rate of 50 Hz v Standard movie frame rate: 24 fps

4. 4 Video Codecs v An algorithm that shrinks the size of a movie to allow the movie to be played on a computer or from a network v codec is short for compressor / decompressor v Use lossy compression v Some video codecs are “software only” while others require special hardware

5. 5 Video Codecs v Most codecs are block-oriented v Divide the frame into blocks v Sometimes you can see the block of pixels when a video plays v Codecs differ in how the blocks are encoded

6. 6 Video Architectures v Handles and synchronizes video files v An architecture creates file formats with its codecs v Examples of Architectures: QuickTimeQuickTime RealSystem G3RealSystem G3 Microsoft Windows MediaMicrosoft Windows Media MPEGMPEG v The architecture you choose determines which codecs you can use v Not all codecs are available for every architecture

7. 7 Compression Techniques v Codecs compress video using two techniques: Temporal CompressionTemporal Compression Spatial CompressionSpatial Compression v Temporal compression eliminates information that is not necessary for visual continuity over time v Spacial compression eliminates information that is not necessary for continuity over area v Other compression can be accomplished by reducing colors, frame rate, and audio quality

8. 8 Temporal Compression v Temporal compression looks for differences between consecutive frames v A keyframe is a frame that is used as the basis for differences v Keyframes contain the entire image v A delta frame (or difference frame) contains only the areas that are different from one frame to the next keyframe, delta, delta, …, keyframe, delta, delta,... v Several keyframes are chosen throughout the movie whenever significant changes occur

9. 9 Spacial Compression v Generally focuses on individual frames v If an area is all one color, the area is defined using geometry and the color stored once v Combines bitmap and raster graphics concepts v Temporal and spacial compression work in concert

10. 10 Asymmetric vs. Symmetric v A codec can be asymmetric: Encoding process is slower than the decoding processEncoding process is slower than the decoding process Better suited for movies that are prerecorded and played backBetter suited for movies that are prerecorded and played back v Or symmetric: Encoding process takes about the same time as the decoding processEncoding process takes about the same time as the decoding process Better suited for live broadcasts or video teleconferencingBetter suited for live broadcasts or video teleconferencing

11. 11 Video Codecs v Some popular video codecs: Sorenson VideoSorenson Video CinepakCinepak MPEG:MPEG: –MPEG-1 –MPEG-2 –MPEG-4 Real Video:Real Video: –RealVideo G2 –RealVideo 8 H.261 / H.263H.261 / H.263

12. 12 Sorenson Video Codec v Developed by Sorenson Vision, Inc (www.s-vision.com) High compressionHigh compression High-quality/low data ratesHigh-quality/low data rates High-end processors NOT neededHigh-end processors NOT needed v Recommended for: Web video (fast viewing rates)Web video (fast viewing rates) CD-ROM video (fit more movies on a CD-ROM)CD-ROM video (fit more movies on a CD-ROM) v It is asymmetric v A hardware specific version is also available

13. 13 Sorenson Video Codec v Sorenson is supported by the QuickTime 3 and 4 architectures v It uses: variable encodingvariable encoding vector quantizationvector quantization motion compensationmotion compensation

14. 14 Variable Encoding v Adjusts the bit depth according to how much action the scene contains v Two-pass encoding technique v Movie is analyzed to determine “easy” and “difficult” sections v Movie is compressed intelligently: Attempts to give each frame the optimum number of bytesAttempts to give each frame the optimum number of bytes

15. 15 Vector Quantization v Image divided into segments (vectors) v The mean value of each segment is subtracted from the individual pixels in the segment (residual vector pattern) v Each residual segment pattern is compared to a set of previously determined patterns (stored in a codebook) v The codebook entry pattern closest to the residual vector pattern is determined v The binary address of the codebook entry is sent to receiver to be decoded

16. 16 Vector Quantization v The decoder only needs the address of the residual pattern and the mean value of the individual segments v If codebook pattern entries are determined ahead of time according to test imagery, the quality of the movie will be good v The number of codebook entries can be increased substantially without too much effect on the bandwidth needed

17. 17 Motion Compensation v From frame-to-frame, there is usually some translation of blocks of pixels due to motion v Successive frames in a motion sequence are searched to determine the motion compensation vectors v Motion compensation vectors indicate the direction and distance of translation of block of pixels that has moved v The whole frame does not have to be translated - the vectors contain the information on how to reconstruct the new frame from the previous frame

18. 18 Sorenson Tools v Allows for a media key so that the video can be locked with a password v Tries to determine when new scenes begin and marks them as key frames (smart screen change detection) v Allows the user to insert a custom watermark on all frames v Allows the user to specify intervals at which frames should be dropped to increase playback performance

19. 19 Cinepak v Codec maintained by Compression Techniques, Inc. v Medium-quality CD-ROM video v Does not require a lot of processing power v Is asymmetric v Uses vector quantization v Cinepak video codec is supported by the following architectures: Video for WindowsVideo for Windows QuickTimeQuickTime

20. 20 MPEG v Developed by Motion Picture Expert’s group v MPEG is both a file format and a codec (a file format that employs compression algorithms) v Usually requires special hardware for encoding v Usually requires substantial CPU power/special hardware for playback v Mainly used for high-end desktop video v MPEG is an open standard

21. 21 MPEG v MPEG is a family of codecs containing: MPEG-1MPEG-1 MPEG-2MPEG-2 MPEG-4 (approved in 1999)MPEG-4 (approved in 1999) v MPEG supported by the following architectures: QuickTime 3QuickTime 3 DirectShow 6DirectShow 6 Video CDVideo CD DVD VideoDVD Video Windows MediaWindows Media

22. 22 RealVideo v RealVideo a family of codecs containing: RealVideo 8RealVideo 8 RealVideo G2RealVideo G2 v Usually used for streaming video v Both RealVideo codecs are scalable compensates if the connection bit rate is slower than the bit rate used to encode the videocompensates if the connection bit rate is slower than the bit rate used to encode the video Allows for smoother playback on a wide range of machinesAllows for smoother playback on a wide range of machines v Asymmetric v Requires a high-end computer for optimal encoding/decoding v RealPlayer 8 supports variable encoding