Software / Hardware Co-Design of a JPEG Encoder Team Members: Joe Salemi Brandon Sterner

What is Software/Hardware Co-Design? Using software and hardware in parallel to execute a given application, with the goal of increasing overall performance. Using software and hardware in parallel to execute a given application, with the goal of increasing overall performance. SW/HW co-design may effectively be applied to any application that is both computationally intensive and can be partitioned into separate units. SW/HW co-design may effectively be applied to any application that is both computationally intensive and can be partitioned into separate units.

Baseline DCT-JPEG Encoding Algorithm JPEG Encoding involves using DCT (Discrete Cosign Transforms) operations, which can involve roughly 300 floating point operations each. Encoding a JPEG file usually involves thousands of DCT operations. JPEG Encoding involves using DCT (Discrete Cosign Transforms) operations, which can involve roughly 300 floating point operations each. Encoding a JPEG file usually involves thousands of DCT operations. Our hypothesis is that if we were to partition the DCT operations out and execute them with FPGA’s working in parallel with a PC, application performance would be greatly increased. Our hypothesis is that if we were to partition the DCT operations out and execute them with FPGA’s working in parallel with a PC, application performance would be greatly increased.

Baseline DCT- JPEG Encoding Algorithm Initial image file is a PPM (Portable Pixel Map). This format was chosen because the data is stored as integer RGB values. Initial image file is a PPM (Portable Pixel Map). This format was chosen because the data is stored as integer RGB values. Separate image into three color planes, RGB. Separate image into three color planes, RGB. Convert the color planes to the YIQ color space, which takes better into consideration some known facts about the human vision. Convert the color planes to the YIQ color space, which takes better into consideration some known facts about the human vision. Each color plane subdivides into sub regions of 8 x 8 pixels each. Each color plane subdivides into sub regions of 8 x 8 pixels each. A two dimensional discrete cosine transform (DCT2) is then applied to each 8 x 8 sub region separately. The matrices are now in the frequency domain. Since the transformation matrix is band-limited, only 8 x 8 = 64 frequency components are included in the result. A two dimensional discrete cosine transform (DCT2) is then applied to each 8 x 8 sub region separately. The matrices are now in the frequency domain. Since the transformation matrix is band-limited, only 8 x 8 = 64 frequency components are included in the result. Each 8x8 matrix is then scaled by an 8 x 8 matrix Q (known as the quantization matrix), which is determined by empirical studies of human visual perception. Since the human eye is more perceptive to lower frequencies than to higher frequencies, the idea is to scale the amplitude of each frequency by a quantization factor to eliminate the higher frequencies. Each 8x8 matrix is then scaled by an 8 x 8 matrix Q (known as the quantization matrix), which is determined by empirical studies of human visual perception. Since the human eye is more perceptive to lower frequencies than to higher frequencies, the idea is to scale the amplitude of each frequency by a quantization factor to eliminate the higher frequencies. Each sequence is then encoded using Huffman compression. Each sequence is then encoded using Huffman compression.

Baseline DCT-JPEG Encoding Algorithm

Equipment Purple Box Purple Box A small purple 486 computer running at 100MHz A small purple 486 computer running at 100MHz Digilent Digilab 2 development board Digilent Digilab 2 development board Xilinx Spartan 2 XC2S200 FPGA Xilinx Spartan 2 XC2S200 FPGA 200,000 gate FPGA, 143 user IO pins 200,000 gate FPGA, 143 user IO pins Digilent DIO Module Digilent DIO Module Switches, Push Buttons, LEDs, Seven Segment Displays, etc. Switches, Push Buttons, LEDs, Seven Segment Displays, etc. Digilent Memory Module Digilent Memory Module Two 512KB SRAM banks Two 512KB SRAM banks Development PC with Tornado for monitoring the timing of the system. Development PC with Tornado for monitoring the timing of the system.

Diamond Prometheus Development Kit

Digilent Digilab 2

Digilent Memory Module and DIO Board

Block Diagram of System Communication:  Communication between PC and “Purple Box” is over the RIT network.  “Purple Box” is connected to the FPGA via a LPT1  SRAM module is connected to D2 expansion slot

User Interface Command Line Interface Command Line Interface Used for starting Used for starting Displaying timing data Displaying timing data Displaying Errors Displaying Errors Status Lights (FPGA) Status Lights (FPGA) Idle Idle Computing Computing Memory Transfers Memory Transfers Image Viewing - Uncertain Image Viewing - Uncertain Would prefer to send resulting JPEG file back to the development PC. This depends on whether SE security policy will allow us to do this. Would prefer to send resulting JPEG file back to the development PC. This depends on whether SE security policy will allow us to do this. Alternative would be to display the image directly from the purple box. This depends on whether the difficulties can be resolved in downloading the new version of VxWorks onto the “purple box”. Alternative would be to display the image directly from the purple box. This depends on whether the difficulties can be resolved in downloading the new version of VxWorks onto the “purple box”.

Progress/Timeline PurpleBox File System Testing Done PurpleBox File System Testing Done PurpleBox Parallel Port Testing Done PurpleBox Parallel Port Testing Done Software ImplementationIn Progress Software ImplementationIn Progress Hardware ImplementationIn Progress Hardware ImplementationIn Progress Testing and Analysis of Results Testing and Analysis of Results

Hardware Costs DescriptionCost Dell PC $1500 “Purple Box” $800 Digilab 2 FPGA board $99.95 Digilent Memory Module $48.95 Digilent DIO Module $79.00 TOTAL$

Software WindRiver VxWorks WindRiver VxWorks WindRiver Tornado WindRiver Tornado Xilinx ISE 6.0 Xilinx ISE 6.0 Matlab Matlab

Difficulties File IO File IO By default, redirected to FTP By default, redirected to FTP Remember to close files Remember to close files Purple box crashing Purple box crashing Unexplainable crashes Unexplainable crashes SE security policy SE security policy Can’t write to C drive Can’t write to C drive FTP policy FTP policy

Questions ?