Prof.dr. Inald Lagendijk, Coordinator Delft University of Technology Faculty of Electrical Engineering, Mathematics and Computer Science 1 Network of Excellence.

Slides:



Advertisements
Similar presentations
Pisa Research Area National Research Council Computer Science Institutes ERCIM Italian Partners Norma Lijtmaer.
Advertisements

Information & Communication Technology Labs Magnus Madfors Ericsson, R&D Director EIT ICT Labs Executive Board.
GMD German National Research Center for Information Technology Darmstadt University of Technology Perspectives and Priorities for Digital Libraries Research.
National Technical University of Athens Department of Electrical and Computer Engineering Image, Video and Multimedia Systems Laboratory
5th FP7 Networked Media Concertation Meeting, Brussels 3-4 February 2010 A unIfied framework for multimodal content SEARCH Short Project Overview.
DRIVER Step One towards a Pan-European Digital Repository Infrastructure Norbert Lossau Bielefeld University, Germany Scientific coordinator of the Project.
DELOS Highlights COSTANTINO THANOS ITALIAN NATIONAL RESEARCH COUNCIL.
Information Society Technologies Third Call for Proposals Norbert Brinkhoff-Button DG Information Society European Commission Key action III: Multmedia.
Dissemination & Awareness Strategy Meeting, Luxembourg, 15 – 16 February, 2006 Network of Excellence, K-Space: Knowledge Space of semantic inference for.
Distributed search for complex heterogeneous media Werner Bailer, José-Manuel López-Cobo, Guillermo Álvaro, Georg Thallinger Search Computing Workshop.
Overview of FI-CONTENT 2 Experiments and User Community Activation 1 Carmen Mac Williams, Grassroots Arts and Research 1st March Barcelona 1st.
1 Multimedia Knowledge Management Network: Industry meets Academia! Glasgow University Imperial College London Northumbria University Open University Queen.
SEVENPRO – STREP KEG seminar, Prague, 8/November/2007 © SEVENPRO Consortium SEVENPRO – Semantic Virtual Engineering Environment for Product.
DEVELOPMENT OF A EUROPEAN NETWORK OF LIBRARIES Hans Geleijnse Director of Library and IT Services & CIO Tilburg University, The Netherlands.
New Media Innovation Centre (NewMIC) AN INDUSTRY - UNIVERSITY - GOVERNMENT COLLABORATION.
Introduction to HCC and HCM. Human Centered Computing Philosophical-humanistic position regarding the ethics and aesthetics of a workplace Any system.
Chorus cluster meeting, Vilamoura April SAPIR Search in Audio-visual content using P2p IR Yosi Mass, Raul Santos.
MS DB Proposal Scott Canaan B. Thomas Golisano College of Computing & Information Sciences.
Supervised by Prof. LYU, Rung Tsong Michael Department of Computer Science & Engineering The Chinese University of Hong Kong Prepared by: Chan Pik Wah,
SING* and ToNC * Scientific Foundations for Internet’s Next Generation Sirin Tekinay Program Director Theoretical Foundations Communication Research National.
Yannis Ioannidis University of Athens, Hellas Digital Libraries at a Crossroads Toward the Future Generation of Digital Library Mgmt Systems.
The MARVEL Project – Aims and Objectives Dieter Müller University of Bremen Research Centre artec.
Semantic Web and Web Mining: Networking with Industry and Academia İsmail Hakkı Toroslu IST EVENT 2006.
MUSCLE WP9 E-Team Integration of structural and semantic models for multimedia metadata management Aims: (Semi-)automatic MM metadata specification process.
Network of Excellence in Content Based Semantic Scene Analysis and Information Retrieval Coordinating Partner: Centre for Research and Technology Hellas.
Consultation Workshop “Future R&D Challenges on Networked Media Systems” Welcome and Context Luis Rodríguez-Roselló Director a.i “Converged Networks &
Engineering & Physical Sciences Research Council.
1 WARINTEK ? WARINTEK (Technology Information Kiosk) is Indonesian Multipurpose Community Telecentres that could encourage and support.
CS598CXZ Course Summary ChengXiang Zhai Department of Computer Science University of Illinois, Urbana-Champaign.
Exploring Europe's Television Heritage in Changing Contexts Connected to: Funded by the European Commission within the eContentplus programme
Network of Excellence in Professional Learning Coordinator Wolfgang Nejdl Learning Lab Lower Saxony Swedish Coordinator Ambjörn Naeve Knowledge Management.
Co-ordination & Harmonisation of Advanced e-Infrastructures Research Infrastructures – Grant Agreement n Regional progress report: Mediterranean.
Institute of Informatics and Telecommunications – NCSR “Demokritos” Bootstrapping ontology evolution with multimedia information extraction C.D. Spyropoulos,
Communication & Web Presence David Eichmann, Heather Davis, Brian Finley & Jennifer Laskowski Background: Due to its inherently complex and interdisciplinary.
1 DELOS Network of Excellence on Digital Libraries with a focus on the Preservation Cluster Andreas Rauber Vienna University of Technology
Chuck Humphrey Data Library Co-ordinator University of Alberta May 16, Capitalising on Metadata Tool development plans IASSIST 2007.
NANOSTRUCTURED AND FUNCTIONAL POLYMER- BASED MATERIALS AND NANOCOMPOSITES NANOFUN-POLY, NETWORK OF EXCELLENCE WP14 : Spreading of Excellence - Communication.
TESTBED FOR FUTURE INTERNET SERVICES TEFIS at the EU-Canada Future Internet Workshop, March Annika Sällström – Botnia Living Lab at Centre for.
Integrated Projects & Networks of Excellence Examples in IST.
Participation in 7FP Anna Pikalova National Research University “Higher School of Economics” National Contact Points “Mobility” & “INCO”
Prof. Thomas Sikora Technische Universität Berlin Communication Systems Group Thursday, 2 April 2009 Integration Activities in “Tools for Tag Generation“
Network of Excellence PROfessional LEARNing Dr.-Ing. Martin Wolpers Learning Lab Lower Saxony [L3S] University of Hannover, Germany.
K-Space: bridging the semantic gap Craig Stewart (QMUL)
Codes, Peers and Mates Media processing meets future networks EU Workshop on thematic priorities in Networked Media Brussels January 19 th 2010 Ebroul.
Recent Developments in CLARIN-NL Jan Odijk P11 LREC, Istanbul, May 23,
08/05/06 Slide # -1 CCI Workshop Snowmass, CO CCI Roadmap Discussion Jim Bottum and Patrick Dreher Building the Campus Cyberinfrastructure Roadmap Campus.
Enabling Access to Sound Archives through Integration, Enrichment and Retrieval Annual Review Meeting - Introduction.
Bringing the Media Internet to Life EU Concertation Meeting Brussels 3 rd February 2010 Ebroul Izquierdo Head of Multimedia & Vision Group Queen Mary,
Co-ordinated by aparsen.eu #APARSEN Co-funded by the European Union under FP7-ICT The importance of interoperability and intelligibility in digital.
26/05/2005 Research Infrastructures - 'eInfrastructure: Grid initiatives‘ FP INFRASTRUCTURES-71 DIMMI Project a DI gital M ulti M edia I nfrastructure.
Semantic Extraction and Semantics-Based Annotation and Retrieval for Video Databases Authors: Yan Liu & Fei Li Department of Computer Science Columbia.
Pascal Kelm Technische Universität Berlin Communication Systems Group Thursday, 2 April 2009 Video Key Frame Extraction for image-based Applications.
eSciDoc Community Model Draft eSciDoc Community Model Overview 1.Introduction 2.Requirements on the Community Model 3.Organizational.
Virtual Information and Knowledge Environments Workshop on Knowledge Technologies within the 6th Framework Programme -- Luxembourg, May 2002 Dr.-Ing.
NCP Info DAY, Brussels, 23 June 2010 NCP Information Day: ICT WP Call 7 - Objective 1.3 Internet-connected Objects Alain Jaume, Deputy Head of Unit.
Excellence in Media Computing and Communication Ebroul Izquierdo and George Whale Queen Mary, University of London.
Margret Plank 17th International Conference on Grey Literature 1st and 2nd December 2015, Amsterdam (Netherlands) Move beyond text – How TIB manages the.
The DEER Distributed European Electronic Resource Dr Suzanne Keene Francesca Monti University College London.
EU Project LIVE: Live Staging of Media Event Wolfgang Vonolfen Dissemination & Awareness Strategy Meeting, Luxembourg 15/
Connect communicate collaborate GÉANT - The GN3 Project Goals - Challenges - Vision Hans Döbbeling, DANTE TNC 2009, Malaga,
This project has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under.
Exploitation of ISS Scientific data EGI-Aparsen Workshop March Science Park– Amsterdam – The Netherlands Cooperative ISS Research data Conservation.
2. The funding schemes ICT Proposer’s Day Köln, 1 February 2007 The ICT Theme in FP7 How to participate to ICT in FP 7.
Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Grant.
From CLEF to TrebleCLEF Promoting Technology Transfer
Visual Information Retrieval
INTAROS WP5 Data integration and management
Peer-to-Peer Tagged Media: Advances and perspectives
Multimedia and Vision Lab, Queen Mary,
WP1 Video analysis and annotation WP5a Architecture and Interfaces
Presentation transcript:

Prof.dr. Inald Lagendijk, Coordinator Delft University of Technology Faculty of Electrical Engineering, Mathematics and Computer Science 1 Network of Excellence PetaMedia Peer-to-Peer Tagged Media (42 months, started March 1, 2008)

2 Partner Concept of PetaMedia: EU Network of National Networks

3 Technical Scope of PetaMedia What: Developing new paradigms and technologies for efficient and effective access to multimedia content How: Multimedia content analysis meets P2P/social networks Best of three worlds Peer to peer/social networks (Tribler software) User-based taggingContent analysis

4 Objectives of NoE PetaMedia Four main objectives: 1.European network formation and strengthening in the area of multimedia content access. Consolidation of the network beyond lifetime of NoE as Virtual Centre of Excellence. 2. Progress state of art in (the combination of) user tagging - content analysis - P2P/social networking via joint research. 3.Converge of results to demonstration and experimentation. 4. Dissemination of knowledge (P2P technology, content analysis, information retrieval, …) inside and outside NoE.

5 Example of Scenario and Research (1)

6 Example of Scenario and Research (2) user 1: tree sun dog cloud user 2: tree sun vacation cloud dog clouds score: tree sun dog cloud

7 Example of Scenario and Research (3) Temporal tag integration (learning) Temporal generalization (tag a frame given tagged neighboring frames) Temporal segmentation (into tag-based shots)

8 Example of Scenario and Research (4) Object detection: Spatially connect tags to objects Ask user to collaboratively click on objects, given the temporal tags Use resulting spatio-temporal tags demonstration/field tests Video segment (shot) retrieval Browsing Recommendation

9 Build on Tribler P2P Software (1) Value creation and intelligence goes to the edges: P2P Tribler: Operational P2P system, started Feb 2006 Long term, experimental living lab Largest dataset collection Empirical approach Tribler downloads Open Source & community building Social File sharing Unified search & viewing Bittorrent, Youtube.com, Liveleak.com Distributed sharing, rating, recommendation Research team: 18 full-time people

10

11 Build on Tribler P2P Software (2) Tribler core toolkit and API Tribler Delft: May 27, 2008 More: IP Layer Tribler core toolkit and API P2P peer discovery recommendation download/stream Appl. Specific #1Appl. Specific #2Appl. Specific #3

12 Special Interest Groups Formed during KickOff Content/tag (nonlinear) life cycle and required supporting (distributed) architecture, incl. cooperative content authoring Need for distributed processing and content swapping (in particular scenarios) Automatic object and/or action segmentation and recognition Keep-it-simple user interface supporting tagging and tag-use Incentives to tag: games, type of content, social tagging (friends), contesting and reputation Experience tagging – beyond visual cues: sensor-based tagging (camera, microphone, bio, …) Group intelligence building: trust, reputation, friends, cooperative authority Correctness/quality/originator/evaluation of tags and ways of feedback (create trust) Prepare tags, use tags, link tags: recommendation, personalization, profiling, indexing of video segments

13 Special Interest Groups Formed during KickOff

14 May 27

15 Backup Slides

16 PetaMedia: Network of National Networks Consortium of four national networks in the area of multimedia content analysis and networking Four networks and leading partners in PetaMedia: NIRICT: Netherlands Institute for Research on ICT (Delft University of Technology) IM2: Interactive Multimodal Information Management (Ecole Polytechnique Fédérale de Lausanne) MMKM: Multimedia Knowledge Management network (Queen Mary, University of London) HC3: (Extended) Human-Centric Communication Cluster (Technische Universität Berlin)

17 Strength and Focus of National Networks Four national network encompasses researchers in field of Multimedia (audio and video) processing and networking Personalized multimedia content access Multimodal processing and recognition Methods, algorithms and theoretical foundations for human-centric data search and interpretations User’s perspective, interface and content recommendation in P2P connected virtual communities Distributed semi-automatic metadata extraction, self-adaptation and interconnection (Distributed) database management Common background in COST292: Semantic Multimodal Analysis of Digital Multimedia

18 Dimensions of PetaMedia Joint program of Activities along three Dimension 1.People: Disseminating and outreach Workshops, travel grants, funding junior researchers 2.Organization: Towards a virtual centre of excellence Organization form that extends the national networks 3. Technology: Integrative research and experiments Roadmapping Research for large scale experiments using MCA/Tagging on top of P2P software Tribler User and technological experiments with software

19 Work Packages (42 months) WP Number Work package titleStart month End month Joint Program on Integration and Sustainability (JPIS) JPIS.1Integration of People and Organizations142 JPIS.2Integration of Technologies142 JPIS.3Towards a Virtual Centre of Excellence1942 Joint Program on Research Activities (JPRA) JPRA.1Fundamental Research on MCA and P2P142 JPRA.2Technology Roadmap and Architecture118 JPRA.3Research for Field Trial and Future of P2P/MCA736 JPRA.4Execution of Field Trials using P2P/MCA3142 Joint Program on Spreading Excellence (JPSE) JPSESpreading Excellence742 JPMNetwork Management142

20 Kickoff Presence (in Addition to Leading Partners) Switzerland IDIAP, Uni. Geneva, Uni. Western Switzerland Germany Univ. Aachen, Univ. Hannover UK Imperial, Univ. Sheffield, Goldsmith College, Univ. Glasgow, Open Univ. Netherlands CWI, Univ. Twente, Telematics Inst. Project officer; Advisory board