26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-71 DIMMI Project a DI gital M ulti M edia I nfrastructure - Project Idea – Walter Allasia - Andrea Manieri -

26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-7Page 2 The problem We are going towards a Digital Representation of every thing  The Digital CONVERGENCE Today every Research Community deals with Digital Repositories and handles heterogeneous Multimedia essences Working with Multi Media Materials and Digital Repositories REQUIRES high Computing power Storage capabilities Bandwidth availability

26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-7Page 3 The available technology Multimedia Research Projects provides solutions and competences for feature extraction, content analysis, semantic analysis, digital format representation, metadata management. GRID enabled Digital Libraries demonstrate how dynamic virtual research groups can collaborate and access shared knowledge GRID Infrastructures provide computing and storage features Networking Infrastructures provides needed connectivity

26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-7Page 4 The solution: DIMMI project DIMMI main objective is to integrate available GRID and Multimedia technologies in order to create a test bed to support Research Communities dealing with Digital Repositories (Multimedia Research Communities, Social Science and Humanities Communities, Broadcasters, Training Centres, Universities, etc) DIMMI will demonstrate the improvement of Multimedia Management using e-Infrastructures creating new exploitable scenario and business opportunities

26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-7Page 5 Contacts Walter Allasia EURIXGROUP Multimedia and Innovation Technologies Department - Andrea Manieri Engineering Research Laboratory –

26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-7Page 6 Main Issues Deployment of an open test infrastructure for New Media Research Communities, integrating and validating the state-of- the-art technology in Multimedia research, validations methods, demonstrator environments and IPR management. The Project will investigate synergies between Media and Audio visual communities and Grid technology centres, analysing the possibility to extend and exploit Grid infrastructure in Media context. In addition the Project will provide an open based Grid solution for the on-demand creation of Digital Media Labs allowing Research Communities to store and process large images, audios and videos, and to manage their IPR on a secure and distributed environment.

26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-7Page 7 The approach A Pragmatic Approach: To implement an evolutionary Multimedia Infrastructure extending the current grid-based Digital Library Infrastructure (i.e. DILIGENT) To experiment and test Grid Infrastructures for Multimedia paving the way towards a multidisciplinary European Grid Infrastructure To aggregate a large number of key research actors in Media and Audiovisual communities the project will ensure a proper sustainable plan for Grid infrastructures.

26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-7Page 8 European Impact Europe needs of Innovation will require to re-think the relations between Science, Industry and Media in order to meet challenges of the new century. The digital convergence and the knowledge society will require new tools and instrument to integrate media and ITC. On-demand digital libraries, allowed by production grids will enhance the required capabilities to archive, process and retrieve an huge amount of digital multimedia data Production grid will benefits from serving new heterogeneous community receiving feedback on real usage scenarios and possibly new requirements (e.g. DRM) Tests on management and integration of Metadata coming out from heterogeneous Research Communities will provide an innovative exploitable Scenario

26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-7Page 9 DIMMI proposed solutions DIMMI Project extends current grid-based infrastructure with services enabling researcher to: Deal with heterogeneous metadata structures in order to managing distributed “information retrieval system” based on GRID Capture and extract information from any media Store in a scalable, efficient and device-independent infrastructure Access and Retrieve any piece of information Aggregate and distribute within the Research Community

26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-7Page 10 Technology availability Audiovisual storage, access and retrieval actual facilities allow preservation and distribution through the Internet on-demand Digital Libraries, allow to manage content in a easy and cost effective way, (i.e. DILIGENT) European production Grids are ready and solution customised for specific Research Communities can be created to meet any Research needs (i.e. EGEE) High speed communication network and bandwidth enhancement open new opportunities (i.e. GEANT and G2) Now it is possible to integrate all these results and going ahead in a new step in using infrastructure and ITC technologies

26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-7Page 11 Technical advancement Analysis and tests of “Metadata management” on current GRID infrastructures for integrating and accessing features of Research Communities. The Test-bed will provide an real user-friendly system for the New Media Research communities, including usage and usability trials On a technical point of view the Project will enhance the State of the Art improving Grid-based Digital Libraries infrastructure with the following functionalities: Specific features for storing large audio visual file Different Image format codification exchange IPR management Video Annotation and Feature extraction Content Management System for audiovisual format

26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-7Page 12 Technical Architecture GRID INFRASTRUCTURE Research Community Research Community Research Community Content Providers Others UI M3F DIMMI TEST BED MultiMedia Metadata Management Framework Directory Services Routing Services Mapping Services

26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-7Page 13 Effective IPR We want to exploit production GRID infrastructures in order to verify the content control feasibility on digital material coming out from the infrastructure itself or outside it with a predefined service quality level. Without intellectual property right control, creators will not have certainty of revenue from their creative acts, hence art and research investments could be affected Legal Frameworks (national or international) and copyright policies are effective if and only if they are supported by traceability and digital content analysis tools. No Digital Rights Management, no exploitation!

26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-7Page 14 IPR solution Authenticity tools are so complex (matching against anything) and require huge computing and storage features as well as bandwidth availability. Intellectual Property Rights are defined by Author and will be represented in a suitable metadata format System will certify any new data authenticity during its upload and will control against any other new item (or part of it) at runtime. We can figure out the system as a service running on a federation of production GRIDs controlling their data, extracting features and matching copyrighted materials under author predefined rules.

26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-7Page 15 DIMMI IPR Architecture Certified X Multimedia Data Authenticity recognition IPR Index Multimedia Data Authenticity recognition GRID INFRASTRUCTURE