10/7/2015art.live - 3 rd IST Concertation meeting 3 rd IST Concertation Meeting art.live (IST 10942) Xavier Marichal, UCL ADERSA - ADETTI - Casterman - CSELT - EPFL - Fastcom - UCL - UJF
10/7/2015art.live - 3 rd IST Concertation meeting Project Objectives ARchitecture and authoring Tools prototype for Living Images and new Video Experiments “ The goal of the project is to develop an architecture and a set of tools, both generic and application dependent, for the enhancement of narrative spaces thanks the production of a mixed-reality environment.”
10/7/2015art.live - 3 rd IST Concertation meeting Glossary Mixed Reality Augmented Reality Augmented Virtuality Reality-Virtuality Continuum Real environmentVirtual environment (World unmodeled)(World completely modeled) Telepresence
10/7/2015art.live - 3 rd IST Concertation meeting Pre-Work
10/7/2015art.live - 3 rd IST Concertation meeting Concept
10/7/2015art.live - 3 rd IST Concertation meeting Installation Overview server/router visual database LAN viewer authoring tool command WWW camera(s) + DSP
10/7/2015art.live - 3 rd IST Concertation meeting System architecture
10/7/2015art.live - 3 rd IST Concertation meeting Technical Innovation Intelligent camera: real-time integrated solution based on DSPs for the low-level signal processing Model-based segmentation: low-level high-level interaction Query system: dynamic database that takes into account the MPEG-7 standard Mixed 2D-3D approach: 2D and 3D objects within 2D/3D backgrounds Agent-based system: basic architecture (autonomous distributed system); behavior handling; (FIPA-compliant) Authoring tool
10/7/2015art.live - 3 rd IST Concertation meeting Socio-cultural Innovation Techno-narrative fusion Intrinsic properties of the digital media: strong synergies between conceptual methodologies and technological devices Exploit all aspects: procedural, participatory, spatial and encyclopedic
10/7/2015art.live - 3 rd IST Concertation meeting art.live position Original live narrative content within artistic worlds Architecture and tools to produce it with regular machines (PCs) FIPA-compliant platform Internal usage of MPEG-7 descriptors Use of MPEG-4 tools for transmission Link with COST211 for image seg. & an.
10/7/2015art.live - 3 rd IST Concertation meeting Progress so far State of the art & in-depth definition Preliminary integration for IST 2000 demo: –procedural real-time system with “actors”: Camera acquisit. Object segment. Gravity centers Triggers (interpr.) Scenario Mgt Scene compos. Screen display
10/7/2015art.live - 3 rd IST Concertation meeting Future work Trial 1 –“Jardins de la BD”, Bercy, Paris –March 1st - 21st –Real-time system with “players”: Database Mgt of all ‘external’ data elements (narrative graphs, drawings, maps...) through the database Exhaustive list of descriptors (via MPEG-7 descriptions) and associated triggers MPEG-4 communication aspects Agentification of the interfaces Basic authoring tool for author/director to insert material in the database Embedded camera demonstration
10/7/2015art.live - 3 rd IST Concertation meeting Cooperation with other projects AMOVITE: –possibility for camera plug in art.live architecture, but later on INTERFACE: –joint ICAV3D workshop: special session on Mixed Reality SoNG: –discussion for MPEG-4 tools