GLOCAL Event-based Retrieval of Networked Media NEM Concertation Meeting Brussels, Feb

SOME DATA ABOUT THE PROJECT NEM – Concertation meeting Brussels, Feb FP GLOCAL

THE CONSORTIUM NEM – Concertation meeting Brussels, Feb FP GLOCAL

Content-based retrieval systems failed so far to provide general-purpose, reliable systems: – semantic gap – content vs. context New tools are needed to represent, organize, index and access media, which should be: – Intuitive and user-centric (near to human way of organizing data) – Effortless (do not bother the user with complex and time-consuming annotation, tagging, cataloguing, etc) – Scalable and extensible (support ever increasing types and amounts of media documents) – Distributed (suited to widespreading media-driven social networks) GLOCAL OBJECTIVES NEM – Concertation meeting Brussels, Feb FP GLOCAL

GLOCAL envisages a solution to such problems by exploiting three major assets: – The use of events as a primary mean to contextualize data – The interaction of peers at local and global level to build a social intelligence as the way to automate media organization – The construction of new search paradigms based on the above elements GLOCAL S&T ISSUES NEM – Concertation meeting Brussels, Feb FP GLOCAL

THE GLOCAL MODEL Events are entities with attributes and relational attributes (links) to other entities (e.g., events, locations, people, media) Related events (event network): Sub-event relationship (granularity) Cause-effect relationship (causality) Temporal relationship (continuity) … Media populate events: Events contextualize media (experiential dimension) Many-to-many relationship (viewpoints): One media linked to many events One event linked to many media TIME SPACE PERSON MEDIA ATTRIB. TYPE OTHER EVENT Linked events Linked persons Linked locations Linked media EVENT (UID) NEM – Concertation meeting Brussels, Feb FP GLOCAL

Query: a set of metadata from the event model – Simple or composite (QbyText, QbyExample, QbyMetadata,..., as well as their combination) – No need to specify all parameters (metadata) – Takes into account uncertainty (e.g., temporal and geographic range) QUERY Refinement and navigation mechanisms –Query answering produces a ranked list of pointers to the event net –Refinement through hyperspace navigation (graphics, interfaces) Example Event: text description What “Soccer match Milan” Time: temporal range When May 15, 2008 Space: geo location Where Milano, Italy Entities: actors, objects Who Milan, Beckham Sample media Which Photo of 1st goal NEM – Concertation meeting Brussels, Feb FP GLOCAL GLOCAL SEARCH

Event: Soccer match Milan, Milano, Original query: “Soccer match Milan” Sub-Event 2 Sub - Event 1 EXAMPLE: A SPORTS EVENT FP GLOCAL NEM – Concertation meeting Brussels, Feb Sub-event Beckham goal

Event: Soccer match Milan, Milano, Matches with other teams, same league Other SIMILAR events FP GLOCAL NEM – Concertation meeting Brussels, Feb EXAMPLE: FINDING SIMILAR EVENTS Original query: “Soccer match Milan”

Event: Soccer match Milan, Milano, Other Milan Soccer matches at different TIME Previous event of the same soccer team FP GLOCAL NEM – Concertation meeting Brussels, Feb EXAMPLE: FINDING PAST EVENTS Original query: “Soccer match Milan”

Event: Soccer match Milan, Milano, Other events in nearby PLACES Other events around Milano on FP GLOCAL NEM – Concertation meeting Brussels, Feb Original query: “Soccer match Milan” EXAMPLE: FINDING CO-LOCATED EVENTS

Event: Soccer match Milan, Milano, Sub-event Beckham goal Sub-Event 2 Sub - Event 1 Events with same actor Other events with BECKHAM Matches with Beckham in different team Victoria Beckham FP GLOCAL NEM – Concertation meeting Brussels, Feb Original query: “Soccer match Milan” EXAMPLE: AN EVENT NETWORK…

Which are the enabling technologies? – Event modelling (media & knowledge) – Event instantiation (matching models to reality: create, evolve and maintain events) – Event population (effortlessly attaching media to events) – Event sharing (sharing event structures and contents) – Event-based indexing and search (using events to access media) – Event-based interfacing (putting the user in the loop) GLOCAL TECHNOLOGIES NEM – Concertation meeting Brussels, Feb FP GLOCAL

kkk GLOCAL SCENARIOS NEM – Concertation meeting Brussels, Feb FP GLOCAL Five initial use cases with a lot of UGC content on the web and main events with a rather large set of content (text for metadata, event modeling, photo, video, graphics)