Sharper Images from a One-Chip Solution:

Slides:



Advertisements
Similar presentations
StreamBlade SOE TM Initial StreamBlade TM Stream Offload Engine (SOE) Single Board Computer SOE-4-PCI Rev 1.2.
Advertisements

V. Filimonov, T. Hemperek, F. Hügging, H. Krüger, N. Wermes
Aztec PC Scope Preliminary Design Review Fall 2006 Michael MasonJed Brown Andrew YoungsJosh Price.
Engineering 1040: Mechanisms & Electric Circuits Fall 2011 Introduction to Embedded Systems.
Digital Video An Introduction to the Digital Signal File Formats Acquisition IEEE 1394.
Camera Interfacing using ARM7
Camera Link Communication Interface for Vision Applications J. Egri 6/7/05.
USB host for web camera connection
The 6713 DSP Starter Kit (DSK) is a low-cost platform which lets customers evaluate and develop applications for the Texas Instruments C67X DSP family.
® ChipScope ILA TM Xilinx and Agilent Technologies.
XP Practical PC, 3e Chapter 17 1 Upgrading and Expanding your PC.
Lab 2: Capturing and Displaying Digital Image
Introduction to USB Development. USB Development Introduction Technical Overview USB in Embedded Systems Recent Developments Extensions to USB USB as.
RADIO + MCU + FLASH + USB Low-Power RF System-on-Chip
NetBurner MOD 5282 Network Development Kit MCF 5282 Integrated ColdFire 32 bit Microcontoller 2 DB-9 connectors for serial I/O supports: RS-232, RS-485,
Multimedia & Communications ATMEL Bluetooth Background information on Bluetooth technology ATMEL implementation of Bluetooth spec.
02/2008 MATRIX VISION GmbH 1 Presentation The intelligent camera and Image processing sensor.
Pinewood Derby Timing System Using a Line-Scan Camera Rob Ostrye Class of 2006 Prof. Rudko.
Power delivery product applies to any USB speed
Design Win Replication: FX3: Cypress USB 3.0 Solution for HD Video
Typical Microcontroller Purposes
SPCA554A Mobile Camera Multimedia Processor By Harrison Tsou.
Design Win Replication: FX3 Solution for 3-D Imaging
Sharper Images From a One-Chip Solution:
Owner : SAYD Cypress Confidential Sales Training 2/21/ FTDI FT232R vs. USB Serial CY7C65213 USB - UART Converter Cable USB to UART Conversion at.
Sharper Images From a One-Chip Solution:
Owner: VBHUSales Training 03/15/2013 Cypress Confidential IDT 72T36135M vs. Cypress CYF072x Video Buffering Applications High density FIFOs with unmatched.
FX3: Cypress USB 3.0 Solution for HD Video
Proposal for an Open Source Flash Failure Analysis Platform (FLAP) By Michael Tomer, Cory Shirts, SzeHsiang Harper, Jake Johns
FX3 Solution for 3-D Imaging
USB host for web camera connection Characterization presentation Presenters: Alexander Shapiro Sergey Alexandrov Supervisor: Mike Sumszyk High Speed Digital.
VIVOTEK Technology Roadmap Presenter: Steve Ma / Director of Product Marketing.
The basic idea : Miniaturized and low cost camera with advanced features High resolution (4K and up) cameras are most often of a big size – usually have.
2D-Graphic Accelerator
Voice Controlled Robot by Cell Phone with Android App
Maj Jeffrey Falkinburg Room 2E46E
Cypress Roadmap: TrueTouch® Touchscreen Controllers
Lab 4 HW/SW Compression and Decompression of Captured Image
Cypress Roadmap: Platform PSoC®
VIVOTEK 2007 Product Roadmap
Introduction to the ARM mbed Platform– A Hands-on Course
FX3S RAID-on-Chip for Server Virtualization
iHome Automation System
Lab 1: Using NIOS II processor for code execution on FPGA
IP Speed Dome Solution 2006-Feb-22.
What’s new and What’s coming Guy Arazi: Director of Products
Vinculum II Development Modules
Depth Analysis With Stereo Cameras
VC-A20P Full HD PTZ Camera
Hands On SoC FPGA Design
Processing the image with Python
Cypress Roadmap: CapSense® Controllers
Android.
SUBMITTED BY EDGEFX TEAM
Cypress Roadmap: USB Controllers
CP220x The Industry’s Smallest Ethernet Controller
Chapter III Desktop Imaging Systems & Issues
Cypress HX3 vs. Via Labs VL812 Docking Station Applications
This chapter provides a series of applications.
AMCOM Digital Archive Design Review - Week 3.
Future Designs, Inc. Your Development Partner
Serial Data Hub (Proj Dec13-13).
ریز پردازنده. ریز پردازنده مراجع درس میکروکنترلرهای AVR برنامه نویسی اسمبلی و C محمدعلی مزیدی، سپهر نعیمی و سرمد نعیمی مرجع کامل میکروکنترلرهای AVR.
AT91RM9200 Boot strategies This training module describes the boot strategies on the AT91RM9200 including the internal Boot ROM and the U-Boot program.
Communication Interface for Vision Applications
LT Product Brief 2-Port MIPI to HDMI1.4 Converter
Cypress Roadmap: CapSense® Controllers
XC9500XL New 3.3v ISP CPLDs.
Greg Bell Business Development Mgr Industrial & Security Markets
Introduction to Single Board Computer
Presentation transcript:

CX3: CSI-2 to USB 3.0 Solution for HD Video CSI-2 = Camera Serial Interface v2.0 Sharper Images from a One-Chip Solution: CX3 Powers the World’s Most Advanced HD Video Cameras

HD Video Requires USB 3.0 Bandwidth The market requirements for video cameras are changing Consumers are demanding cameras that support high-definition (HD) video with high image quality HD video requires 1.5-Gbps bandwidth USB 2.0 provides only 480 Mbps and requires compression, which degrades image quality USB 3.0 provides 5 Gbps and delivers high-resolution image quality without the need for compression USB 3.0 delivers high-resolution image quality that today’s consumers demand The USB 3.0 Advantage Bandwidth (Gbps) Bandwidth required for Full-HD (1920 x 1080 @ 30 fps) video Compressed USB 2.0 HD video degrades image quality Uncompressed USB 3.0 HD video delivers the best image quality USB 3.0

Terms You Will Hear Today Bandwidth Bandwidth = # pixels per frame (resolution) x frames per second (frame rate) x # color bits per pixel (color depth) For example, Bandwidth required by 1080p video = 2.07 megapixels x 30 frames per second x 24-bit color = 1.5 Gbps Compression Reduces the Bandwidth requirement of an image using a mathematical algorithm Modifies pixels, degrading image quality Requires an external Compression Engine, usually implemented with FPGA or ASIC CSI-2 (Camera Serial Interface v2.0) A specification that defines the standard data transmission and control interfaces between an image sensor and an image processor Includes a unidirectional serial interface with data and clock signals, and a bidirectional I2C control interface Image Signal Processing (ISP) Algorithms implemented in hardware (FPGA or ASIC) or software to enhance the image quality Mobile Industry Processor Interface (MIPI) Alliance An open membership organization that develops interface specifications for the mobile handset industry Common Video Standards Standard Column Pixels Row Pixels Mega-Pixels Color Depth Frame Rate Bandwidth 1080p 1920 1080 2.07 24 30 1.5 Gbps 720p 1280 720 0.92 664 Mbps VGA 640 480 0.31 16 147 Mbps

Additional Terms USB 3.0 (SuperSpeed USB) USB 3.0 Host, USB 3.0 Device Operates at 5 Gbps – 10x faster than USB 2.0 (Hi-Speed USB) Distributes 1.8x more power to bus-powered devices than USB 2.0 Provides backward compatibility with USB 2.0 USB 3.0 Host, USB 3.0 Device The USB 3.0 Host (e.g., a PC) directs traffic flow and distributes power over the bus The USB 3.0 Device (e.g., a video camera) is a peripheral on the bus USB 3.0 Peripheral Controller A microcontroller in the USB Device that handles the USB 3.0 protocol and communicates with the USB Host Graphics Processing Unit (GPU) A specialized IC designed to accelerate image creation for output to a display USB Video Class (UVC) A specification that defines the standard behavior of a USB video camera, known as a “UVC camera” Has been widely adopted in consumer cameras and supported by major PC operating systems USB3 Vision A specification that defines the standard behavior of USB 3.0 cameras for machine vision and industrial applications

CX3 Terms EZ-USB® CX3™ CX3 Reference Design Kit (RDK) Cypress’s programmable CSI-2 to USB 3.0 bridge controller with an integrated USB 3.0 transceiver Includes a powerful on-chip ARM9™ processor with 512KB RAM for firmware storage and data buffering Provides additional peripheral connectivity via I2C, I2S, SPI, UART and 12 GPIOs Includes a software development kit (SDK) with example code to reduce your design effort CX3 Reference Design Kit (RDK) A USB 3.0 video camera reference design featuring CX3 and a 5-megapixel (MP) Omnivision OVT5640 image sensor CX3 Application Programming Interface (API) Firmware in the SDK library that implements CX3-specific functions EZ-USB® FX3™ Cypress’s programmable USB 3.0 Peripheral Controller with integrated USB 3.0 PHY Includes a powerful on-chip ARM9 processor with 512KB RAM Provides a 32-bit General Programmable Interface (GPIF II), allowing FX3 to communicate with virtually any system at 100 MHz Interfaces directly with image sensors via GPIF II, providing 3.2 Gbps data throughput for streaming uncompressed HD video Adopted by customers worldwide, including Avermedia, Canon, Kodak, Leap Motion, Microsoft, Panasonic, Sony, Toshiba, etc. Complements the CX3, together offering a compelling portfolio of USB 3.0 solutions for HD imaging

Cypress USB 3.0 Solutions for HD Video Feature CSI-2 to USB 3.0 Bridge Controller GPIF II to USB 3.0 Peripheral Controller USB 3.0 Certified Yes; Test ID 340880047 Yes; Test ID 340800007 Programmability Yes; ARM9, 512KB RAM Image Sensor Interface Serial, two- or four-lane CSI-2 Parallel, 16- or 32-bit GPIF II Maximum Throughput 2.4 Gbps 3.2 Gbps Hardware DVK CX3 RDK FX3 DVK SDK EZ-USB SDK version 1.3 or later EZ-USB SDK version 1.0 or later UVC Support Yes Package Option 121-ball BGA 121-ball BGA, 131-ball WLCSP Applications Machine vision, medical imaging, video conferencing, 3-D motion tracking, document scanning, PC webcam Machine vision, medical imaging, video conferencing, 3-D motion tracking, document scanning, PC webcam, video capturing Add SDK, FPGA support, UVC Support

CX3: One-Chip CSI-2 to USB 3.0 Bridge High-resolution image sensors are going serial Most image sensors with a resolution greater than 3 MP use CSI-2 to meet higher bandwidth requirement CX3 provides four CSI-2 lanes, interfacing directly with any CSI-2 image sensor without a need for glue logic Example: CX3 Design Using a 5-MP Image Sensor 5-MP Image Sensor USB 3.0 Host System CSI-2 USB 3.0 CX3 4 Low-resolution image sensors remain parallel Image sensors with a resolution less than 3 MP continue to offer a parallel interface FX3 provides a 32-bit GPIF II, interfacing directly with any parallel image sensors Example 1: FX3 Design Using a 1.3-MP Image Sensor Example 2: FX3 Design Using Two VGA Sensors for 3-D Imaging USB 3.0 Host System VGA Image Sensor USB 3.0 Host System 1.3-MP Image Sensor 8 GPIF II USB 3.0 GPIF II USB 3.0 FX3 FX3 16 VGA Image Sensor 16 8

CX3: Not a Fixed-Function Bridge CX3 is programmable, so it supports standard or custom camera features Video Conferencing Machine Vision PC Webcam 3-D Motion Tracking UVC or proprietary USB3 Vision or proprietary UVC UVC extensions for camera control Variable frame rate control Custom frame cropping Pan, tilt, zoom control Image sensor configuration User interface design (buttons, LEDs) Infrared LED control Camera Protocol Firmware Customization I2C, SPI, UART, GPIOs

CX3 Solution vs. Competition’s Features CYUSB3065 RTS5880 USB 3.0 Yes CSI-2 Interface 4 lanes, 1 Gbps per lane ISP No Package Size 121-ball BGA (100 mm2) 48-pin QFN (36 mm2) Color Format Support RAW8/10/12/141, YUV422/4442, RGB888/666/5653 RAW, YUV422 Camera Protocol UVC or proprietary UVC only Interfaces I2C, I2S, UART, SPI, 12 GPIOs I2C, I2S, SPI, 6 GPIOs Programmability Yes; ARM9 No; fixed-function bridge Development Kit SDK, $249 RDK Applications Machine vision, medical imaging, video conferencing, 3-D motion tracking, document scanning, PC webcam PC webcam 1 Video format for raw video data 2 Video format for luminance and chrominance components 3 Video format for red, green and blue pixel components

CX3: Made for High-Megapixel Cameras Solution # 1: Image sensor with built-in ISP Image sensor captures and processes the image Image sensor sends processed image to CX3 CX3 sends processed image to the host Image Sensor CSI-2 ISP 2 or 4 USB 3.0 Host System USB 3.0 CX3 Solution # 2: Image sensor + discrete ISP ASIC/FPGA Image sensor sends captured image to ISP ASIC/FPGA ISP ASIC/FPGA processes the image and sends it to CX3 CX3 sends processed image to the host Image Sensor ISP ASIC/ FPGA USB 3.0 Host System CSI-2 CSI-2 USB 3.0 CX3 2 or 4 2 or 4 Solution # 3: Image sensor + host ISP software Image sensor sends captured image to CX3 CX3 sends captured image to the host The ISP software running on the host GPU processes the image Image Sensor USB 3.0 Host System CSI-2 USB 3.0 CX3 2 or 4 GPU, ISP

CX3 Reference Design Kit Hardware Fully functional USB camera with interchangeable image sensor module Includes a 5-MP OVT5460 module capable of 1080p video at 30 fps Preloaded with UVC firmware that works with any PC Includes RS232 and JTAG connectors for firmware debugging Powered by a USB cable without the need for an external 5-V supply Available for $249 at: www.e-consystems.com/CX3-Reference-Design-Kit.asp Software Includes e-CAMView, a free video-capture application for Windows PCs, and sample camera control plug-ins for: Brightness Contrast Hue Saturation Sharpness White balance (auto/manual) Exposure (auto/manual) Focus (auto/manual) Available for download at: CX3 RDK by e-con Systems Supported Image Resolution and Frame Rate1 HD Std Column Pixels Row Frame Rate (fps) Data Rate (Gbps) VGA 640 480 60 0.3 720p 1280 720 0.9 1080p 1920 1080 30 1.0 5 MP 2592 1944 15 1.2 1 Using 16-bit color, YUV422 video data format

CX3 Reference Design Kit Details Omnivision OV5640 Module 5-MP OV5640 Image Sensor CSI-2 Connector CX3 RDK CX3 Baseboard USB 3.0 connector JTAG Header CSI-2 Connector for Interchangeable Image Sensor Modules CX3 RS232 Connector GPIO Header

CX3 Software Development Kit (SDK) CX3 is now part of the EZ-USB FX3 SDK (version 1.3 or later) New CX3 APIs: Initialization and configuration of CSI-2 interface Configuration of CSI-2 image sensors Configuration of GPIOs for camera control or user-defined functions New CX3 firmware example codes: Configuration of Omnivision OV5640 and Aptina AS0260 image sensor Implementation of a UVC camera for Full-HD video (1080p at 30 fps) Familiar FX3 development tools and documentation: Eclipse Integrated Development Environment (IDE) ARM tool chain and debugger SDK release notes Firmware API guide Programmer’s manual SDK troubleshooting guide Technical Reference Manual Eclipse IDE Firmware API Guide Available for download at: www.cypress.com/?rID=57990

Here’s How to Get Started Visit the EZ-USB CX3 web page Download the CX3 datasheet Buy the CX3 Reference Design Kit Download the FX3 Software Development Kit Contact your local sales representatives for CX3 samples

CX3 USB 3.0 Solution Summary Applications Block Diagram Consumer webcams Notebook PCs, tablet embedded cameras Industrial, medical, machine vision cameras Document, fingerprint scanners Game consoles Teleconferencing systems Image acquisition systems 5 CX3 Bridge JTAG 512KB RAM ARM9 Features Image Sensor, Image Processor USB 3.0-compliant video-class controller Four-lane MIPI Camera Serial Interface v2.0 (CSI-2) input Camera Control Interface (CCI) for image sensor configuration Supports industry-standard video data formats: RAW8/10/12/141, YUV422/4442, RGB888/666/5653 Supports uncompressed streaming video: 1080p at 30 fps, 720p at 60 fps On-chip ARM9 with 512KB RAM for data processing Supports I2C, I2S, SPI, UART and 12 GPIOs 121-ball BGA (10 x 10 x 1.7 mm) 4 32 32 32 6 MIPI CSI-2 USB 3.0 USB 3.0 Host 32 UART I2C I2S SPI GPIO 4 2 4 4 12 Collateral Availability Datasheet: CX3 datasheet Reference Design Kit: CX3 RDK Software Development Kit: EZ-USB SDK Sampling: Now Production: Q4 2013 1 Video format for raw video data 2 Video format for luminance and chrominance components 3 Video format for red, green and blue pixel components