A new container model for 3D file formats Rozenn Bouville Berthelot (Orange Labs/IRISA Rennes, France) Jérôme Royan (Orange Labs Rennes, France) Thierry Duval (Université Rennes 1/IRISA Rennes, France) Bruno Arnaldi (INSA/IRISA Rennes, France)

Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC 3D application Rendering engine Physics engine  Goal :  enable composing of 3D files in a single 3D application  Solution requirements :  preventive of functionalities loss  extensible to most 3D formats  operable with most rendering components

Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  More than 140 3D file formats …  visualize  exchange  reuse

Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  More than 140 3D file formats …  visualize : no universal viewer  exchange  reuse

Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC Tool C  More than 140 3D file formats …  visualize  exchange : production pipelines : a different format at each step  reuse Tool A In Out Tool B In Out In Out

Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  More than 140 3D file formats …  visualize  exchange  reuse : save time and money ease importation

Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  More than 140 3D file formats …  visualize  exchange  reuse  Solutions standard

Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  More than 140 3D file formats …  visualize  exchange  reuse  Solutions standard conversion

Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  More than 140 3D file formats …  visualize  exchange  reuse  Solutions standard conversion interoperability

Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  Two aspects : 1. between input files and 3D application → I app 3D application Rendering engine Physics engine I app

Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  Two aspects : 1. between input files and 3D application → I app 2. between input files of the 3D application → I format 3D application Rendering engine Physics engine I format I app

Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  I app →  I app → Scene Graph Adapter (SGA) architecture  enables interoperability between 3D file formats and 3D application

Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  I app →  I app → Scene Graph Adapter (SGA) architecture  enables interoperability between 3D file formats and 3D application  I format →  I format → 3DFC container model  enables interoperability between 3D file formats of 3D application

IntroductionConclusionConclusion3DFC State of the Art - Contribution 3DFC 3D Application Engine 1 API Engine n Engine n API Format n decoder Format n decoder Format 1 decoder Format 1 decoder......

IntroductionConclusionConclusion3DFC State of the Art - Contribution 3DFC 3D Application Rendering engine Rendering engine Renderer API Format n decoder Format n decoder Format 1 decoder Format 1 decoder format scene graphs engine scene graph

IntroductionConclusionConclusion3DFC State of the Art - Contribution 3DFC 3D Application Scene Graph Adapter Format adapter API Rendering engine Rendering engine Renderer API Node Indexer Format n decoder Format n decoder Format 1 decoder Format 1 decoder Engine adapter API Format 1 Wrapper Format n Wrapper Renderer Wrapper ( Bouville Berthelot et al., 2011 )

IntroductionConclusionConclusion3DFC State of the Art - Contribution 3DFC 3D Application  2012 version : Scene Graph Adapter Format adapter API Engine 1 API Engine n Engine n API SGA Kernel API Node Indexer Format n decoder Format n decoder Format 1 decoder Format 1 decoder Engine adapter API Physics adapter API Physics adapter API Renderer adapter API Format 1 Wrapper Format n Wrapper Engine 1 Wrapper Engine n Wrapper......

IntroductionConclusionConclusion3DFC State of the Art - Contribution 3DFC 3D Application Scene Graph Adapter Format 1 Wrapper Engine 1 Wrapper Format adapter API Format n Wrapper Engine 1 API Engine n Wrapper Engine n Engine n API SGA Kernel API Node Indexer Format n decoder Format n decoder Format 1 decoder Format 1 decoder Engine adapter API Physics adapter API Physics adapter API Renderer adapter API

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  To aggregate contents of different types  For digital media files  storage (AVI)  transport (DIVX)  For software architecture  Salomé Project (Bergeaud and Tajchman, 2007)  For 3D files  3DMLW (3D Technologies R&D, 2009)

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  Requirements for a 3D files container : 1. encapsulate most 3D file formats 2. spatially organize models within a scene 3. enable interactions between models of different formats 4. enable annotations C ONTAINER

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  Requirements for a 3D files container : 1. encapsulate most 3D file formats 2. spatially organize models within a scene 3. enable interactions between models of different formats 4. enable annotations C ONTAINER

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  Requirements for a 3D files container : 1. encapsulate most 3D file formats 2. spatially organize models within a scene 3. enable interactions between models of different formats 4. enable annotations C ONTAINER

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  Requirements for a 3D files container : 1. encapsulate most 3D file formats 2. spatially organize models within a scene 3. enable interactions between models of different formats 4. enable annotations C ONTAINER a… b…c… d…

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  3D graphics API : loading functionalities  Java3D, OpenSG, … → problem : conversion  Interchange formats  OFF (Rost,1989), P3D (Welling et al.,1990), FBX (Autodesk), Collada (Khronos Group),… → problem : encapsulation not provided

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  3DFC = 3D File Container

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  3DFC = 3D File Container  Answers our 4 requirements  most 3D file formats  spatial organization  enable interactions  annotations

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  3DFC = 3D File Container  Answers our 4 requirements  Not a new format, just a model !

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  3DFC = 3D File Container  Answers our 4 requirements  Not a new format, just a model !  Relies on the Scene Graph Adapter architecture

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion 3D Application SGA 3DFC Decoder 3DFC Decoder 3DFC Format 1 Decoder F1F1 F1F1 Format n Decoder FnFn FnFn Engine 1 3DFC Wrapper Format 1 Wrapper Format 2 Wrapper Engine 1 Wrapper Engine n Wrapper Engine n

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  As few as possible  Structuring nodes : GROUP TRANSFORM CONTENT  Interaction/communication nodes : ROUTE MATCH CONVERTER  Other functionalities provided by input formats

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  Input : X3D, COLLADA and 3DFC  Output : Ogre and Bullet 3D Application SGA X3D COLLADA DAE 3DFC Ogre Bullet

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion X3D

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion DAE

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion 3D Application SGA X3D Decoder X3D Collada Decoder DAE 3DFC Decoder 3DFC OgreBullet + +

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion 3D Application SGA X3D Decoder X3D Collada Decoder DAE 3DFC Decoder 3DFC OgreBullet + +

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  Add a path between X3D’s Interpolator and Collada’s propeller <Route fromFile="X3DFile" toFile="DAEFile" fromNode="AnimationOI" toNode="prop" fromField="value_changed" toField="rotate" conversion="convertor_1" /> <Converter DEF="convertor_1" type="VectRotToQuaternion" /> <Route fromFile="X3DFile" toFile="DAEFile" fromNode="AnimationOI" toNode="prop" fromField="value_changed" toField="rotate" conversion="convertor_1" /> <Converter DEF="convertor_1" type="VectRotToQuaternion" /> Collada Decoder X3D Decoder X3D Decoder R R M M C C

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  Match the mass of Collada’s plane to X3D’s cube <Match fromFile="DAEFile" toFile="X3DFile" fromNode="plane" toNode="cube_RED" field="mass"/> <Match fromFile="DAEFile" toFile="X3DFile" fromNode="plane" toNode="cube_RED" field="mass"/> Collada Decoder X3D Decoder X3D Decoder M M

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion 3D Application SGA X3D Decoder X3D Collada Decoder DAE 3DFC Decoder 3DFC OgreBullet + +

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - Contribution3DFC State of the Art - Contribution 3DFC  Benefits :  enables interaction between 3D models of different formats  easy integration of 3DFC model in any existing scene-graph-based file format  relies on the flexible Scene Graph Adapter framework  Limitations:  matching nodes implies search in Node Indexer → reasonable impact on performance  updates implies additional call of methods → low impact on performance  several representation of the same scene graphs (commonly used in rendering engines) → require cache management for huge scenes

Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - Contribution3DFC State of the Art - Contribution 3DFC  Add a network engine  to assess the usability of our framework for online virtual platforms  Extend 3DFC model  to add specific attributes to a node rights, user interaction properties, …

Questions ? Contact :