Bridging the gap between knowledge technologies and multimedia Pierre-Paul Sondag DG Information Society Unit: Knowledge Management & Content Creation Luxembourg

Lisbon summit March 2000 Labour productivity growth in EU, US and Japan average annual growth of GDP per employed person Manufacturing is going to emerging countries, While strong gap between America and Europe on high tech. Source: European Commission

Strategic objectives implemented through the E R A => Towards a knowledge-based economy and society Lisbon Summit: the European Union aims “to become the most competitive and dynamic knowledge-based economy in the world, capable of sustainable economic growth with more and better jobs and greater social cohesion” in 2010, reinforced by the Barcelona summit (2002) boosting R&D in the EU by increasing expenditure to reach 3% of GDP by 2010, two thirds of is expected to come from the private sector. The Lisbon European Council Summit in March 2000 set an objective to ‘make the European Union the most competitive and dynamic knowledge-based economy in the world by 2010’. This has since been interpreted as requiring focused community-wide investment in research, and the improvement of innovation and entrepreneurship. ERA European Research Area: reach critical mass, remove national barriers, introducing competition, attracting best foreign researchers EU Heads of State and Government, in Barcelona in March 2002, agreed the objective of boosting R&D and innovation in the EU by increasing expenditure to approach three per cent of GDP by 2010. Aim to close the gap between the EU and its major competitors. Two thirds of the new investment in R&D is expected to come from the private sector which invests proportionately less than that in its major global competitor countries. implemented through the E R A

anywhere anytime natural access to IST services for all Total IST Budget Euro 3,625 Mio. in FP6 Knowledge and Interface Technologies IST Components Microsystems Communication Computing Software Future and Emerging Technologies Technologies for major economic and societal challenges Vision anywhere anytime natural access to IST services for all basic research: long-term, “understand” content, master knowledge embedded in multimedia objects applied research: enable smarter, next-generation multimedia and web To develop semantic-based and context-aware systems to acquire, organise, process, share and use the knowledge embedded in multimedia content. aim to maximise automation of the complete knowledge lifecycle achieve semantic interoperability between Web resources and services.

Drivers digital media becomes the standard, => capability to transport, process and store content in an homogeneous way generalisation of sensors, actuators generalisation of DSL, WiFi, 3G mobile immersive, 3 D, intuitive forms of content GRID, dynamic content agent driven web services Convergence of the media formats Ambient technology

Challenges ability to exploit and retrieve content ability to share knowledge complex work processes collaborative work flows trust, privacy The media environment is saturated with content massive, heterogeneous data sets unstructured content (e-mails…) linear audio visual (DVD, broadcasting…

Workprogramme 2003-2004 Workprogramme 2005-2006 under discussion 1st Call Semantic-based Knowledge Systems deadline 24 April 2003, 124 proposals retained 3 IP, 4 NoE, 7 streps, 73 M€ 2nd Call Cross-media content for leisure, entertainment deadline 15 October 2003, 6 IPs 1 NoE, 8 Streps 55 M€ 3rd Call to be published 18 May 2004, deadline 22 Sept. only SSA,CA to support new MS, INCO, ERA 4th Call to be published end 2004, re-open themes of call 1 and 2 geared towards SME and new member states Workprogramme 2005-2006 under discussion

Call 1 - Semantic based K systems Theme 1 Semantic-enabled systems and services Next generation web services, interoperable, able to negotiate networked knowledge discovery multimedia content mining information visualisation Theme 2 Knowledge based adaptive systems ability to reason over / act on large volumes of data with fuzzy boundary for: decision support, time-critical applications, modelling and optimisation, anytime-anywhere inferencing

Call 2 - Cross-media Digital Content towards new forms of multimedia interaction Theme 1 Creation of new, compelling forms of content for interactive, creative or artistic consumption advancing in imaging and AV representations, 3D, 4D, immersive virtual and mixed reality, featuring higher levels of quality contextualisation, personalisation, multimodal input Theme 2 Developing integrated content programming allowing to retrieve content from different sources, types, locations store, compress & categorise it to realise appropriate programming to a particular audience or delivery channel focus on interactive D TV, e-cinema, online games - music

KT objectives Digital content is growing tremendously but has to be turned into knowledge to be exploitable Knowledge should enable to make better decisions, to improve productivity, Lisbon objectives Technologies should disclose tacit knowledge Support collaborative processes, like virtual knowledge communities automate knowledge flows intelligent knowledge-based systems and services adding high level semantics to annotate multimedia to be shared by humans, software agents and devices

multimedia objectives smart content: highly interactive, environment-aware, mobile ambient intelligence vision natural interaction innovative business models (e.g.replace the audi CD decline)

research Two intertwined goals: basic research: “understand” content, master knowledge embedded in multimedia objects applied research: exemplary applicative showcases Strong multidisciplinarity with many constituent disciplines & technologies; significant integration issues

How to use the knowledge embedded in (multimedia) content ? Future challenges How to use the knowledge embedded in (multimedia) content ? How to improve usability of multimedia ?

Future challenges Segmenting multimedia, adding metadata, automatic mark-up, Liking content to ontologies, achieving interoperability Matching MM low level features with high level concepts Bringing K-management and MM communities together

…to know more about About FP6 (CORDIS) http://fp6.cordis.lu/fp6 Knowledge Management and Content Creation: http://www.cordis.lu/ist/directorate_e/kmcc.htm More about new Instruments: europa.eu.int/comm/research/fp6/networks-ip.html or check your ideas with EC staff: pierre-paul.sondag@cec.eu.int