X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 David Bruner, [TC] 2 Siggraph 2008 Booth #136
X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 Scan time 7 seconds Instructions and Light Optimization 20 sec Total Duration 60 seconds
X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 Digital Humans (Avatars) from 3D body scans Virtual Communities – Social Networks Private Environment – personal Virtual Dressing, Virtual Fitness Assessment Entertainment Networks – multi-player gaming, content creation Business Networks –Online Conferences –Speeches –Job Interviews –Product Research Industrial/Technical Applications -Ergonomics
X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 Allen, Curless, Popovic – Siggraph 2003 University of Washington
X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 Long time vs Real time [TC] 2 – new direct transformation using markers only ~ 2 seconds Key Similarity – morphing a pre-existing template mesh to 3D scan data Key Difference – Allen uses sparse (70) manually placed landmark markers vs. [TC] 2 dense (3,000) automatic landmark markers Key Difference – [TC] 2 easy integration of any reference mesh with wide ranging mesh densities (~ 4K – 80K vertices) Key Difference – [TC] 2 inclusion of joints/skeleton structure in the skin transformation
X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 Automatic Dense (~3000) Geometry Markers ~ 1 second Landmarks intelligently placed based on Body Geometry-Shape Features
X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 Reference Mesh – Scan Subject
X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 Basic idea – drag template mesh to the 3D scan geometry using a common distribution of dense landmarks as the guide
X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 Template Mesh Resulting Avatar
X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 Distance Based Weighting
X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 For b references over N vertices with affine combination constraint Weight Formulation (Pre-computed) *Similar to James, Twigg “Skinning Mesh Animations”, Carnegie Mellon
X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 Marker Landmark (reference mesh) to Marker Landmark (body scan) Transformation Vectors T j = l ref – l scan j landmark markers j~ 3000
Updated Vertex Locations X i = X i ref + T
X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008
X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 Morph Skeleton and Joints along with Skin
Augmented Morphing - Virtual Fashion without Draping
X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 Face Texture from Photo
X3D: Real Time 3D Solution for the web Web3D Tech Talk – Aug 13, SIGGRAPH 2008 X3D H-ANIM -Any format template (mesh, skeleton/joints, texture), only vertex locations are updated from the template mesh (polygon count and organization unchanged) -For now – VRML, X3D, and.obj
X3D H-Anim Using Flux Studio – Flux Player from Vivaty