1. Understanding the effect of lighting in images Ronen Basri

2. Light field Rays travel from sources to objects There they are either absorbed or reflected Energy decreases with distance and number of bounces Camera captures the set of rays that travel through the focal center

3. Specular reflectance (mirror) When a surface is smooth light reflects in the opposite direction of the surface normal

4. Specular reflectance When a surface is slightly rough the reflected light will fall off around the specular direction

5. Diffuse reflectance When the surface is very rough light may be reflected equally in all directions

6. Diffuse reflectance When the surface is very rough light may be reflected equally in all directions

7. BRDF

8. Lambertian reflectance

9. Lambert’s law

10. Preliminaries

11. Photometric stereo Given several images of the a lambertian object under varying lighting Assuming single directional source

12. Photometric stereo We can solve for S if L is known (Woodham) If L is unknown we can use SVD factorization (Hayakawa)

13. Factorization Use SVD to find a rank 3 approximation Define Factorization is not unique, since invertible To reduce ambiguity we impose integrability – up to generalized bas relief transformation (Belhumeur et al.)

14. Integrability

15. Shape from shading (SFS)

16. Shape from shading

18. Distance transform

19. Solution

20. Example