Diploma Project Real Time Motion Estimation on HDTV Video Streams (using the Xilinx FPGA) Supervisor :Averena L.I. Student:Das Samarjit

Introduction In this project I estimate the motion on HDTV video stream using the fastest motion estimation Algorithm with the FPGA of Xilinx Technology. I also implemented the motion estimation Algorithm to compensate the video frame to achieve better quality with lowest power consumption and flexible platform. Finally I generated the VHDL code for the Data processing unit for it to be implemented inside the FPGA architecture to obtain optimum performance.

Motion Estimation Algorithm Frame differencing method. Vector quantization method

Hybrid Video Encoding Simplified MPEG-1 Encoder

Hybrid Video Decoding Simplified MPEG-1 Decoder

Motion Estimation (Dominant Algorithm) Computational Power Distribution (for HDTV Tools)

Principals of Block Matching Motion Estimation Block Matching Algorithm

Block Matching Process-i

Block Matching Process-ii Block Matching Algorithm

Classification of Motion Estimation Gradient Based Motion Estimation(For Image sequence analysis). Pel-Recursive Motion Estimation(For Image Sequence coding). Block Matching Motion estimation(Best used for Video frame sequence coding). Frequency Domain Motion estimation (For video Encryption)

The Search Algorithm

The Tree step search Algorithm

The 2-D Logarithmic search Algorithm

Hexagonal Based search Algorithm

Motion Estimation Process in H.264/AVC A Fast Integer Pel search to estimate the motion vector. A Fast Integer Pel search to estimate the motion vector. A fractional pel search to determine the motion vector to a higher accuracy. A fractional pel search to determine the motion vector to a higher accuracy.

Block Diagram of H.264/AVC encoder

Motion Compensation with small block size

¼ Pixel accurate motion compensation

Multiple Reference Picture motion compensation

Review of reconfigurable array architecture

The Reconfigurable instruction cell array architecture (RICA)

Design Flow for Algorithm implimentation on (RICA)

Flex WAFE Architecture with FIR Filter DPU Data stream communicators component (LMCs). Data stream communicators component (LMCs). Data stream processor component (DPUs). Data stream processor component (DPUs). Image Algorithm Dependent Global control (AC). Image Algorithm Dependent Global control (AC).

Flex WAFE Architecture with FIR Filter DPU

Flex WAFE Architecture building block LMC (here data is transferred reorganised and stored ). LMC (here data is transferred reorganised and stored ). DPU (It processes the data stream provided by the LMC). DPU (It processes the data stream provided by the LMC). AC (It reacts to the DPU and LMC via point to point connection to control the algorithm. AC (It reacts to the DPU and LMC via point to point connection to control the algorithm.

Comparison between DCT and DWT. Performance comparison of ZTE Wavelet coder

Compression Performance with respect of human visual system HVS A Bc

Test image ROI encoding A test image used to demonstrate the advantages of ROI coding

Implementation to FPGA

Compairing resources of a FPGA used DCT & DWT. (a) Xilinx virtex E-Series (b) Altera’s Apex 20KE series (a)(b)

Implimentation of Fast DCT&IDCT algorithm using various FPGA

Implementation on Xilinx FPGA

Performance of Xilinx FPGA

Overall Result Observing the result graph we depict that only Xilinx’s FPGA is able to process twice the rate required by the HDTV video stream – which is a remarkable achievement. Observing the result graph we depict that only Xilinx’s FPGA is able to process twice the rate required by the HDTV video stream – which is a remarkable achievement. By implementing a very fast DCT algorithm in Xilinx FPGA, I am able to process HDTV frames at a higher rate By implementing a very fast DCT algorithm in Xilinx FPGA, I am able to process HDTV frames at a higher rate So by implementing a very fast DCT algorithm (using the selected xilinx FPGA) I encrypt therefore encode the static image of video frame and then I implement the motion estimation algorithm to compensate the video frame to achieve better quality with lowest power consumption and time – therefore estimate the motion estimation on HDTV video streams in the real time using the Xilinx FPGA technology. So by implementing a very fast DCT algorithm (using the selected xilinx FPGA) I encrypt therefore encode the static image of video frame and then I implement the motion estimation algorithm to compensate the video frame to achieve better quality with lowest power consumption and time – therefore estimate the motion estimation on HDTV video streams in the real time using the Xilinx FPGA technology.