1. DAB:Interactive Haptic Painting with 3D Virtual Brushes Bill Baxter Vincent Scheib Ming C. Lin Dinesh Manocha SIGGRAPH 2001 Presentation by Pin Ren Feb 27 th, 2003

2. Previous work Computer-Generated Painting Meier 96, Curtis et al. 97, Hertzmann 98, Litwinowicz 97 Modeling of Paint Curtis et al. 97, Cockshott et al. 92, Hasse & Meyer ’92, Kubelka & Munk ’31 Modeling of Brushes & Strokes S. Saito et al. 99, Wong et al. 00, Strassmann 86 User Interface A. R. Smith 78, Painter, Z-Brush, Deep Paint Hanrahan & Haeberli 90, Agrawala et al. 95 Johnson et al. 99, Gregory et al. 00

3. When computers try to make paintings Can computers really create paitnings artistically? What do the artists think about that? Are they afraid of losing jobs? Are they angry?

4. “I am not satisfied by those painting machines!” ---- Picasso(really?) Artists are simply not satisfied They don’t like being asked to set some parameters and waiting around for the final pictures. They want to computers to assist their creative work, not to be deprived the fun of making art. They want natural environment,equivalent tools and creation experiences to the real world

5. “Art is not only about beautiful pictures” Craft of the painting vs. the Art Craft is about the study of materials, and the whole process of painting. Artists cannot divorce one from the other

6. Motivation 3D deformable brush [action] Haptic feedback [touch] Paint model [sight] User interface [action] [feeling] Capturing the Sight, Touch, Action and Feeling of Painting

7. dAb System: interface

8. System Design [flash]

9. dAb System: Components Brush Model Haptic Model Paint Model

10. Brush Model Design considerations Interactivity (~30Hz) Unconditional stability Flexibility

11. Brush Model Dynamic model Spring-mass particle system Geometric model Subdivision surface

12. Brush Equations Newtonian Dynamics F=ma, or Semi-Implicit numerical integration (Desbrun’s 99) Linear force Non-linear force Constant!

13. Brush Equations Overdamped inertial system Eliminate explicit damping Solve F=mv (Aristotelian)

14. Haptics Simple model Designed to run easily at 1kHz Decoupled from dynamics Effective for control

15. Haptics: Simulation Linear spring Linear spring Nonlinear spring + angular falloff Nonlinear spring + angular falloff Force vector at a point Force vector at a point

16. Haptics – Linear slope k 2 Normal Force Brush head penetration depth % slope k 1 0100 device limit Normal Force Friction

17. Bend Buckle Mash Haptics – Non-linear (Spline) Normal Force Brush head penetration depth % 0100 f 1,k 1 f 2, k 2 f 3, k 3

18. Buckle Haptics – Angular Dependence 45° 0°0° 0.0 0.5 1.0

19. Painting Model Interactive Oil/Acrylic Paint Make use of 3D Brush

20. Paint Transfer

21. Paint Effects Bi-directional paint transfer Glazing wet paint over dry Controlled by various bush pressure and speed Variable wetness Depended on the timing

22. Paint Layers Surface Reservoir Wet Dry

23. Paint Blending

24. Paint Rendering Alpha blend wet over dry Volume of paint determine the opacity Embossing of paint volume Brush is rendered with just the surface layer over a bristle texture

25. Example Pic (1) James Ball

26. Example Pic (2) Rebecca Holmberg

27. Example Pic (3) Rebecca Holmberg

28. Summary (1) Novel modeling for real world art craft Deformable 3D brush Haptic feedback Paint model

29. Summary (2) Simple, yet rich interface Strokes Color mixing Brush loading Digital advantages

30. Future Challenges Improve current models Expand from 2D canvas to 3D models Training and Study

31. All pics, flashs and video clips from original siggraph presentation slides and their project website: http://www.cs.unc.edu/Research/geom/dab/

32. Thanks! Any Questions?