Camellia IST Key Action IV.1.1 W. M. Kruijtzer / Philips 21 Febr 2003 Project introduction 1 st EC Review Meeting, Brussels Febr 21 st, 2003

Camellia IST Key Action IV W. M. Kruijtzer / Philips 21 Febr 2003 IEEE Computer September 2002

Camellia IST Key Action IV W. M. Kruijtzer / Philips 21 Febr 2003 Smart Camera application areas Consumer Surveillance Automotive Mobile

Camellia IST Key Action IV W. M. Kruijtzer / Philips 21 Febr 2003 Mobile Camera and other Markets Huge Market : Need to differentiate => Smart Imaging Source: PL Imaging Solutions Other Biometric Automotive PDA/ handhelds Toys PC Camera Digital Still Camera Security Digital Camcorder Analog Camcorder Mobile Communication M$

Camellia IST Key Action IV W. M. Kruijtzer / Philips 21 Febr 2003 Overview of Camellia Core for Ambient and Mobile intELLigent Imaging Applications

Camellia IST Key Action IV W. M. Kruijtzer / Philips 21 Febr 2003 Goal Low-Cost and Low-Power Video Processor for Automotive and Mobile Applications with Intelligent Imaging Capabilities SW motion estimator texture encoder stream processor bridge ARM ARM memory image memory smart imaging HW assist ASIP

Camellia IST Key Action IV W. M. Kruijtzer / Philips 21 Febr 2003 Camellia EP Consortium... Project –Start 1st April 2002; Duration: 30 months –Effort: 26.4 py ( EC Budget = 2.3Meuro ) Partners –PEN: Philips Research & PS/PLI (6.3 py) –CAOR: ARMINES & ENSMP (5.2 py) –PSH: Philips Semiconductors Hamburg (4.3 py) –REN: Renault (2.5 py) –UH: University of Hannover (3 py) –ULP: University of Las Palmas G.C. ( 5.1 py)

Camellia IST Key Action IV W. M. Kruijtzer / Philips 21 Febr 2003 … key contributions ApplicationAlgorithmMappingArchitecture Renault CSI PSH ENSMP UH Philips Research ULP Center of gravity

Camellia IST Key Action IV W. M. Kruijtzer / Philips 21 Febr 2003 CAMELLIA in a nutshell u Specification phase: u Classification and selection of automotive and mobile smart imaging applications u Algorithm phase: u Provide four (2 automotive + 2 mobile) algorithms to support the application scenarios defined in the specification phase u Mapping phase: u Exploration of smart-imaging architecture extensions u Architecture phase: u Specification of smart imaging architecture extensions to enable smart imaging as explored in the mapping phase u Integration phase : u Develop prototype of the smart imaging core u Validation phase : u Evaluate effectiveness and flexibility of smart imaging core

Camellia IST Key Action IV W. M. Kruijtzer / Philips 21 Febr 2003 Key project milestones M9.Template of architecture available; Initial algorithms 1 and 2 ready (M11). M18. Mapping results for all four initial algorithms ready. M27. Prototype system available demonstrating all 4 smart imaging applications. M30. Validation results available. End of project

Camellia IST Key Action IV W. M. Kruijtzer / Philips 21 Febr 2003 Work plan WP2 Specification WP3 Algorithm WP5 Mapping WP4 Architec- ture WP6 Integration Q4-02 Q3-03 Q2-04 WP7 Validation Q3-04 Q1-02 Initial architecture template and algorithms ready Mapping results for all initial algorithms ready Validation results available. End of project Prototype system demonstrating imaging applications Project start

Camellia IST Key Action IV W. M. Kruijtzer / Philips 21 Febr 2003 Conclusions Camellia brings together System Integrators, a Semiconductor Vendor, and Universities to develop and apply a smart imaging core –It adopts a video encoder architecture –It asserts the smart imaging core against the requirements of two application domains Mobile Automotive –It validates the resulting core through implementation on a prototyping environment

Camellia IST Key Action IV W. M. Kruijtzer / Philips 21 Febr 2003 Workpackage overview WP2 Specification WP3 Algorithm WP5 Mapping WP4 Architecture WP1 Project Mngmt WP8 Dissemi- nation WP6 Integration WP7 Validation

Camellia IST Key Action IV W. M. Kruijtzer / Philips 21 Febr 2003 Main challenge is the mapping of smart imaging algorithms onto a video encoder architecture. Smart imaging is an important enabler of ambient intelligent u Specification phase: u Classification and selection of automotive and surveillance smart imaging applications (scenarios) u Algorithm phase: u Provide four (2 automotive + 2 surveillance) algorithms to support the application scenarios defined in the specification phase u Architecture phase: u Definition of smart imaging architecture template including extensions to enable smart imaging as explored in the mapping phase u Mapping phase: u Exploration of smart-imaging architecture extensions u Integration phase : u Develop prototype of the smart imaging core u Validation phase : u Evaluate effectiveness and flexibility of smart imaging core CAMELLIA in a nutshell WP2 Specification WP3 Algorithm WP5 Mapping WP4 Architecture WP6 Integration WP7 Validation