1. © 2006 Autodesk1 Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com

2. © 2006 Autodesk2 CORPORATE INFORMATION REALVIZ: Founded March 98 Exclusive technology from INRIA Sophia-Antipolis  Technology from the Robotvis group Headquarters and R&D in Sophia Antipolis, Southern France 90% of revenue outside France, 50% in the USA Just acquired by Autodesk (PSEB division)

3. © 2006 Autodesk3 MISSION Image-based technologies empower designers and graphic artists to efficiently create the most effective visual content based on digital photographs and videos. Post-production Architecture Digital Imaging Multimedia CAD Video Games Dinotopia - Courtesy of Framestore CFC Monkey – Courtesy of Quiet Man

4. © 2006 Autodesk4 USE CASES Panoramic Photography Image Based Modeling SFX Solutions Motion Capture

5. © 2006 Autodesk5 PANORAMIC PHOTOGRAPHY Panoramic Photography

6. © 2006 Autodesk6 Creation of panoramic images up to full spheres (360° horizontal by 180° vertical) – fully automatic Thousands users : professional photographers, digital imaging hobbyists, multimedia & web designers, architects, post-production artists IMAGE STITCHING

7. © 2006 Autodesk7 Click inside to see the full screen, full spherical QuickTime VR Panorama Courtesy of VR Way FULL SPHERICAL PANORAMAS

8. © 2006 Autodesk8 USE CASES Panoramic Photography Image Based Modeling SFX Solutions Motion Capture

9. © 2006 Autodesk9 IMAGE BASED MODELING Bridging the gap between 2D and 3D Image Based Modeling

10. © 2006 Autodesk10 IMAGE BASED MODELING Creation of 3D photo-textured objects from photographs (1 to many) Applications  Virtual reality: 3D Simulation/Storytelling  Urban planning & perspective matching for 3D CAD models  Photogrammetry  Video games  3D animation & special effects

11. © 2006 Autodesk11 IMAGE BASED MODELING From stills… … calibrated in 3D from the manual placement of matching points … … for photo-realistic 3D models !

12. © 2006 Autodesk12 IMAGE BASED MODELING From a panorarma or a still picture… … to a photo-realistic 3D environment ! … more demos

13. © 2006 Autodesk13 Panoramic Photography Image Based Modeling SFX Solutions Motion Capture USE CASES

14. © 2006 Autodesk14 SPECIAL EFFECTS SFX Solutions

15. © 2006 Autodesk15 CAMERA TRACKING Click inside to see the movie. Courtesy of Platige Image 2005 Click inside to see the movie. Courtesy of Platige Image 2005 Camera path & 3D points extracted with MatchMover 3D content Rendered in 3D animation software Click inside to see the movie. Before…… After

16. © 2006 Autodesk16 CAPTURING 3D RIGID MOTION - Feature points are extracted and tracked across sequences - Based on parallax and rigidity (epipolar geometry), the algorithm extracts: - Camera path and parameters (zoom, distortion) over time - 3D point coordinates - Ready for 2D/3D video-montage… all in one click!

17. © 2006 Autodesk17 SOME MOVIES

18. © 2006 Autodesk18 USE CASES Panoramic Photography Image Based Modeling SFX Solutions Motion Capture

19. © 2006 Autodesk19 MOTION CAPTURE Motion Capture

20. © 2006 Autodesk20 VIDEO-BASED MOCAP Capture non-rigid 3D motion from several videos

21. © 2006 Autodesk21 VIDEO-BASED MOCAP Video-based motion capture solution Applications: animation, bio-medical, ergonomy…etc Covering facial, full body, and on-set mocap Total flexibility  From 2 cameras to as many as needed  Cameras can fixed or moving.  Cameras can be of different frame rate and different definitions.  No need for a motion capture studio Computed data  Tracked 3D points  Camera data

22. © 2006 Autodesk22 VIDEO-BASED MOCAP

23. © 2006 Autodesk23 MATCHMOVING One moving camera observing a rigid scene : Parallax (i.e relative 2D image motion) allows recovering 3D camera motion and scene structure 1 N..t.. FROM RIGID MOTION…

24. © 2006 Autodesk24 … TO NON-RIGID MOTION - Several synchronous cameras are used - Same geometric problem as matchmoving at each time Cam1 Cam2 Cam3 Time 1 Cam1 Cam2 Cam3 Time N - Bonus: We can handle camera motion as well!

25. © 2006 Autodesk25 VIDEO-BASED MOCAP …Result

26. © 2006 Autodesk26 ON-SET MOCAP -All sequences shot with -- 2 fixed cameras: HD digital (1920x1080) - 1 mobile camera (the main shooting cam): film, scanned at 2048x1536 …Result

27. © 2006 Autodesk27 Q&A