1. Bridging the Gap to the Real Wojciech Matusik Adobe Systems, Inc.

2. Computer Graphics: Past, Present, Future Goal of this Talk –Look at Trends –Extrapolate –New Challenges Disclaimer: My personal (very biased) view I have not even taken a cg course. Time Milestones

3. Time Milestones Computer Graphics: Past, Present, Future Goal of this Talk –Look at Trends –Extrapolate –New Challenges Disclaimer: I will present my own biased view.

4. A Simulation to Generate Images or Videos Simulation Lights Shading Motion Geometry

5. Traditional Computer Graphics Simulation Lights Shading Motion Geometry Components –Hand Modeled –Procedurally Defined –Analytical Formulas Courtesy of Wikimedia

6. Traditional Computer Graphics: Geometry Simulation Lights Shading Motion Geometry axiom = F production rule F -> FF-[-F+F+F]+[+F-F-F] L-Systems Fractals Perlin Noise, Hypertextures Courtesy of Wikimedia Courtesy of Ken Perlin Courtesy of Wikimedia

7. Traditional Computer Graphics: Lights Simulation Lights Shading Motion Geometry Directional Point Spot Courtesy of Wikimedia

8. Traditional Computer Graphics: Shading Simulation Lights Shading Motion Geometry Cook’s Shade Trees Phong Blinn-Phong Cook-Torrance Courtesy of Rob Cook

9. Traditional Computer Graphics: Animation Simulation Lights Shading Motion Geometry Animation Controllers Keyframing Courtesy of Jessica Hodgins

10. Traditional Computer Graphics Real World Lights, Geometry, Shading, Motion, Simulations Editing and User Input Computer Graphics

11. Data-driven Computer Graphics: 90s - now Real World Lights, Geometry, Shading, Motion, Simulations Input Devices Progress in development of sensors Cheap storage and computation power for data processing

12. Data-driven Computer Graphics: Geometry Simulation Lights Shading Motion Geometry 3D Scanning Courtesy of Marc Levoy

13. Data-driven Computer Graphics: Lights Simulation Lights Shading Motion Geometry Environment Mapping HDR Imaging Courtesy of Paul DebevecCourtesy of Wikimedia

14. Data-driven Computer Graphics: Shading Simulation Lights Shading Motion Geometry Measured Appearance Courtesy of Kristin Dana Courtesy of Wikimedia

15. Data-driven Computer Graphics: Animation Simulation Lights Shading Motion Geometry Motion Capture Courtesy of Wikimedia

16. Data-driven Computer Graphics Real World Lights, Geometry, Shading, Motion, Simulations Input Devices

17. Data-driven Modeling and Editing Real World Lights, Geometry, Shading, Motion, Simulations Input Devices Editing and User Input

18. Data-driven Modeling and Editing: Geometry Simulation Lights Shading Motion Geometry Modeling by Example, 2004 Funkhouser et al.

19. Data-driven Modeling and Editing: Lights Simulation Lights Shading Motion Geometry Skyfinder : Attribute-based Sky Image Search, 2009 Tao et al.

20. Data-driven Modeling and Editing: Shading Simulation Lights Shading Motion Geometry Data-driven Reflectance Model, 2003 Matusik et al.

21. Data-driven Modeling and Editing: Animation Simulation Lights Shading Motion Geometry Motion Graphs, 2002 Kovar et al., Lee et al., Arikan & Forsyth

22. Data-driven Computer Graphics: 90s - now Real World Representations Abstractions Simulations Input Devices Editing and User Input

23. Computer Graphics: Future Real World Representations Abstractions Simulations Input Devices Editing and User Input

24. Shape Capture, Modeling, and Fabrication Real Object 3D Model 3D Scanning 3D Printing Output User Edits Courtesy of Wikimedia

25. Motion Capture, Modeling, and Robotics Human Motion Motion Model Mocap Controller Design Humanoid Robot User Edits Courtesy of Wikimedia

26. Light Field Capture, Modeling, and Display 3D Scene Light Field Camera Array Autostereoscopic Display Light Out User Edits Courtesy of M.Levoy Courtesy of F. Durand

27. Appearance Capture, Modeling, and Fabrication Real Material Data-driven Model Measurement Fabrication Output User Edits

28. Challenges: Output Mapping Data Abstraction Device Capabilities Device Capabilities Data Abstraction

29. Output Mapping Examples –Gamut Mapping –Tone Mapping –Image Retargeting Courtesy of Wikimedia Courtesy of Shai Avidan Courtesy of Wikimedia

30. Different Phenomena –Reflectance, Scattering, Deformations, Motion Rules –Linear vs. Perceptually-Based –Global vs. Local Generalized Output Mapping Algorithms

31. Complex aggregates from base materials with known properties Future Printers, Displays, and Output Devices

32. Future Output Devices Future Printers, Displays, and Output Devices Data-driven Representations and Abstractions Output Mapping

33. Computer Graphics: Closing the Loop Real World Representations Abstractions Simulations Input Devices Editing and User Input

34. My Vision Statement The future of Computer Graphics and Interactive Techniques lies in novel input and output devices that operate in real- world environments and are accessible to everyone.