1. A new container model for 3D file formats Rozenn Bouville Berthelot (Orange Labs/IRISA Rennes, France) Jérôme Royan (Orange Labs Rennes, France) Thierry Duval (Université Rennes 1/IRISA Rennes, France) Bruno Arnaldi (INSA/IRISA Rennes, France)

2. Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC 3D application Rendering engine Physics engine  Goal :  enable composing of 3D files in a single 3D application  Solution requirements :  preventive of functionalities loss  extensible to most 3D formats  operable with most rendering components

3. Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  More than 140 3D file formats …  visualize  exchange  reuse

4. Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  More than 140 3D file formats …  visualize : no universal viewer  exchange  reuse

5. Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC Tool C  More than 140 3D file formats …  visualize  exchange : production pipelines : a different format at each step  reuse Tool A In Out Tool B In Out In Out

6. Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  More than 140 3D file formats …  visualize  exchange  reuse : save time and money ease importation

7. Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  More than 140 3D file formats …  visualize  exchange  reuse  Solutions standard

8. Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  More than 140 3D file formats …  visualize  exchange  reuse  Solutions standard conversion

9. Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  More than 140 3D file formats …  visualize  exchange  reuse  Solutions standard conversion interoperability

10. Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  Two aspects : 1. between input files and 3D application → I app 3D application Rendering engine Physics engine I app

11. Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  Two aspects : 1. between input files and 3D application → I app 2. between input files of the 3D application → I format 3D application Rendering engine Physics engine I format I app

12. Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  I app →  I app → Scene Graph Adapter (SGA) architecture  enables interoperability between 3D file formats and 3D application

13. Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion3DFC State of the Art - Contribution 3DFC  I app →  I app → Scene Graph Adapter (SGA) architecture  enables interoperability between 3D file formats and 3D application  I format →  I format → 3DFC container model  enables interoperability between 3D file formats of 3D application

14. IntroductionConclusionConclusion3DFC State of the Art - Contribution 3DFC 3D Application Engine 1 API Engine n Engine n API...... Format n decoder Format n decoder Format 1 decoder Format 1 decoder......

15. IntroductionConclusionConclusion3DFC State of the Art - Contribution 3DFC 3D Application Rendering engine Rendering engine Renderer API Format n decoder Format n decoder Format 1 decoder Format 1 decoder...... format scene graphs engine scene graph

16. IntroductionConclusionConclusion3DFC State of the Art - Contribution 3DFC 3D Application Scene Graph Adapter Format adapter API Rendering engine Rendering engine Renderer API Node Indexer Format n decoder Format n decoder Format 1 decoder Format 1 decoder...... Engine adapter API Format 1 Wrapper Format n Wrapper...... Renderer Wrapper ( Bouville Berthelot et al., 2011 )

17. IntroductionConclusionConclusion3DFC State of the Art - Contribution 3DFC 3D Application  2012 version : Scene Graph Adapter Format adapter API Engine 1 API Engine n Engine n API SGA Kernel API Node Indexer...... Format n decoder Format n decoder Format 1 decoder Format 1 decoder...... Engine adapter API Physics adapter API Physics adapter API Renderer adapter API Format 1 Wrapper Format n Wrapper...... Engine 1 Wrapper Engine n Wrapper......

18. IntroductionConclusionConclusion3DFC State of the Art - Contribution 3DFC 3D Application Scene Graph Adapter Format 1 Wrapper Engine 1 Wrapper Format adapter API Format n Wrapper Engine 1 API Engine n Wrapper Engine n Engine n API SGA Kernel API Node Indexer.................. Format n decoder Format n decoder Format 1 decoder Format 1 decoder...... Engine adapter API Physics adapter API Physics adapter API Renderer adapter API

19. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  To aggregate contents of different types  For digital media files  storage (AVI)  transport (DIVX)  For software architecture  Salomé Project (Bergeaud and Tajchman, 2007)  For 3D files  3DMLW (3D Technologies R&D, 2009)

20. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  Requirements for a 3D files container : 1. encapsulate most 3D file formats 2. spatially organize models within a scene 3. enable interactions between models of different formats 4. enable annotations C ONTAINER

21. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  Requirements for a 3D files container : 1. encapsulate most 3D file formats 2. spatially organize models within a scene 3. enable interactions between models of different formats 4. enable annotations C ONTAINER

22. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  Requirements for a 3D files container : 1. encapsulate most 3D file formats 2. spatially organize models within a scene 3. enable interactions between models of different formats 4. enable annotations C ONTAINER

23. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  Requirements for a 3D files container : 1. encapsulate most 3D file formats 2. spatially organize models within a scene 3. enable interactions between models of different formats 4. enable annotations C ONTAINER a… b…c… d…

24. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  3D graphics API : loading functionalities  Java3D, OpenSG, … → problem : conversion  Interchange formats  OFF (Rost,1989), P3D (Welling et al.,1990), FBX (Autodesk), Collada (Khronos Group),… → problem : encapsulation not provided

25. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  3DFC = 3D File Container

26. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  3DFC = 3D File Container  Answers our 4 requirements  most 3D file formats  spatial organization  enable interactions  annotations

27. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  3DFC = 3D File Container  Answers our 4 requirements  Not a new format, just a model !

28. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  3DFC = 3D File Container  Answers our 4 requirements  Not a new format, just a model !  Relies on the Scene Graph Adapter architecture

29. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion 3D Application SGA 3DFC Decoder 3DFC Decoder 3DFC Format 1 Decoder F1F1 F1F1 Format n Decoder FnFn FnFn Engine 1 3DFC Wrapper Format 1 Wrapper Format 2 Wrapper Engine 1 Wrapper Engine n Wrapper Engine n........................

30. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  As few as possible  Structuring nodes : GROUP TRANSFORM CONTENT  Interaction/communication nodes : ROUTE MATCH CONVERTER  Other functionalities provided by input formats

31. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  Input : X3D, COLLADA and 3DFC  Output : Ogre and Bullet 3D Application SGA X3D COLLADA DAE 3DFC Ogre Bullet

32. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion X3D

33. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion DAE

34. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion 3D Application SGA X3D Decoder X3D Collada Decoder DAE 3DFC Decoder 3DFC OgreBullet + +

35. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion 3D Application SGA X3D Decoder X3D Collada Decoder DAE 3DFC Decoder 3DFC OgreBullet + +

36. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  Add a path between X3D’s Interpolator and Collada’s propeller <Route fromFile="X3DFile" toFile="DAEFile" fromNode="AnimationOI" toNode="prop" fromField="value_changed" toField="rotate" conversion="convertor_1" /> <Converter DEF="convertor_1" type="VectRotToQuaternion" /> <Route fromFile="X3DFile" toFile="DAEFile" fromNode="AnimationOI" toNode="prop" fromField="value_changed" toField="rotate" conversion="convertor_1" /> <Converter DEF="convertor_1" type="VectRotToQuaternion" /> Collada Decoder X3D Decoder X3D Decoder R R M M C C

37. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion  Match the mass of Collada’s plane to X3D’s cube <Match fromFile="DAEFile" toFile="X3DFile" fromNode="plane" toNode="cube_RED" field="mass"/> <Match fromFile="DAEFile" toFile="X3DFile" fromNode="plane" toNode="cube_RED" field="mass"/> Collada Decoder X3D Decoder X3D Decoder M M

38. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - ContributionConclusionConclusion 3D Application SGA X3D Decoder X3D Collada Decoder DAE 3DFC Decoder 3DFC OgreBullet + +

39. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - Contribution3DFC State of the Art - Contribution 3DFC  Benefits :  enables interaction between 3D models of different formats  easy integration of 3DFC model in any existing scene-graph-based file format  relies on the flexible Scene Graph Adapter framework  Limitations:  matching nodes implies search in Node Indexer → reasonable impact on performance  updates implies additional call of methods → low impact on performance  several representation of the same scene graphs (commonly used in rendering engines) → require cache management for huge scenes

40. Introduction Scene Graph Adapter State of the ArtContribution State of the Art - Contribution Scene Graph Adapter State of the ArtContribution State of the Art - Contribution3DFC State of the Art - Contribution 3DFC  Add a network engine  to assess the usability of our framework for online virtual platforms  Extend 3DFC model  to add specific attributes to a node rights, user interaction properties, …

41. Questions ? Contact : rozennb@gmail.com