Presentation is loading. Please wait.

Presentation is loading. Please wait.

Nonphotorealistic rendering, and future cameras Computational Photography, 6.882 Bill Freeman Fredo Durand May 11, 2006.

Published byNoreen Robinson Modified over 9 years ago

Similar presentations

Presentation on theme: "Nonphotorealistic rendering, and future cameras Computational Photography, 6.882 Bill Freeman Fredo Durand May 11, 2006."— Presentation transcript:

1 Nonphotorealistic rendering, and future cameras Computational Photography, 6.882 Bill Freeman Fredo Durand May 11, 2006

2 Organization of NPR methods Automated methods –2-d processing –3-d processing Interactive methods –2-d processing –3-d processing

3 Computer generated watercolor http://www.cs.utah.edu/npr/papers/npr_course_Sig99.pdf

4 http://citeseer.ist.psu.edu/cache/papers/cs/12745/http:zSzzSzcdserver.icemt.iastate.eduzSzcdzSzs97cpzSzcontentszSzpaperszSzcurtiszSzcurtis.pdf/curtis97computergenerated.pdf

5

6

7

8

9

10

11 Interactive application. But too slow to let you paint in real-time. http://citeseer.ist.psu.edu/cache/papers/cs/12745/http:zSzzSzcdserver.icemt.iastate.eduzSzcdzSzs97cpzSzcontentszSzpaperszSzcurtiszSzcurtis.pdf/curtis97computergenerated.pdf

12 Offline application http://citeseer.ist.psu.edu/cache/papers/cs/12745/http:zSzzSzcdserver.icemt.iastate.eduzSzcdzSzs97cpzSzcontentszSzpaperszSzcurtiszSzcurtis.pdf/curtis97computergenerated.pdf User inputs

13 http://citeseer.ist.psu.edu/cache/papers/cs/12745/http:zSzzSzcdserver.icemt.iastate.eduzSzcdzSzs97cpzSzcontentszSzpaperszSzcurtiszSzcurtis.pdf/curtis97computergenerated.pdf

14

15 Steps in the rendering (user-supplied region mask not shown)

16 Resulting watercolor http://citeseer.ist.psu.edu/cache/papers/cs/12745/http:zSzzSzcdserver.icemt.iastate.eduzSzcdzSzs97cpzSzcontentszSzpaperszSzcurtiszSzcurtis.pdf/curtis97computergenerated.pdf

17 Source image for a 3d animation

18

19

20 Pen and ink illustration, exploiting 3d geometry http://www.cs.utah.edu/npr/papers/npr_course_Sig99.pdf

21

22

23 The artist approved of this one… http://www.cs.utah.edu/npr/papers/npr_course_Sig99.pdf

24 Future cameras Computational Photography, 6.882 Bill Freeman Fredo Durand May 11, 2006

25

26

27 What can be improved about current cameras? Dynamic range Blurred photos Post-shot controllable depth of field Post-shot editable lighting, positions, etc. Size of camera (your list first…)

28 What crazy other things? The previous list is all mostly with reference to the functionality of a film camera. Surely unexpected camera capabilities and uses, only possible with digital media, will come with future cameras.

29 Some possible future directions Assorted pixels Foveon imager Coded shutter flutter Light field camera Gradient camera

30 Some possible future directions Assorted pixels Foveon imager Coded shutter flutter Light field camera Gradient camera

31 Color pixel mosaic http://www1.cs.columbia.edu/CAVE/publications/pdfs/Narasimhan_PAMI05.pdf

32 Intensity attenuation mosaic http://www1.cs.columbia.edu/CAVE/publications/pdfs/Narasimhan_PAMI05.pdf

33 Color and intensity mosaic http://www1.cs.columbia.edu/CAVE/publications/pdfs/Narasimhan_PAMI05.pdf

34 Color and polarization mosaic http://www1.cs.columbia.edu/CAVE/publications/pdfs/Narasimhan_PAMI05.pdf

35 Temporal sensitivity modulation http://www1.cs.columbia.edu/CAVE/publications/pdfs/Narasimhan_PAMI05.pdf

36 Shree Nayar, Columbia University

37 http://www1.cs.columbia.edu/CAVE/publications/pdfs/Narasimhan_PAMI05.pdf

38

39

40

41

42

43 Original (12 bits) http://www1.cs.columbia.edu/CAVE/publications/pdfs/Narasimhan_PAMI05.pdf

44 As sampled (8 bits) http://www1.cs.columbia.edu/CAVE/publications/pdfs/Narasimhan_PAMI05.pdf

45 Cubic spline interpolation to 12 bits http://www1.cs.columbia.edu/CAVE/publications/pdfs/Narasimhan_PAMI05.pdf

46 Linear regression interpolation to 12 bits http://www1.cs.columbia.edu/CAVE/publications/pdfs/Narasimhan_PAMI05.pdf

47 Some possible future directions Assorted pixels Foveon imager Coded shutter flutter Light field camera Gradient camera

48 http://www.foveon.com/

49 http://www.foveon.com/files/CIC13_Hubel_Final.pdf

50

51 http://www.foveon.com/

52

53

54

55

56 Foveon features Use the optical properties of silicon itself to separate colors. –Different wavelengths get absorbed at different depths of the silicon—blue, then green, then red. More efficient at capturing light—don’t discard 2/3 of the spectrum at each pixel. Variable pixel size, depending on photo mode or video mode. 2002: “…destined to become the standard in image sensors for electronic cameras.”, said Carver Mead, Foveon’s founder. Status now…?

57 http://www.foveon.com/

58

59 Some possible future directions Assorted pixels Foveon imager Coded shutter flutter Light field camera Gradient camera

60

61

62

63

64 Blurring convolution kernel Fourier transforms into sinc Fourier transforms into a function with no zeros

65 Some possible future directions Assorted pixels Foveon imager Coded shutter flutter Light field camera Gradient camera

66 http://graphics.stanford.edu/papers/lfcamera/lfcamera-150dpi.pdf

67

68

69

70

71

72

73

74

75 Some possible future directions Assorted pixels Foveon imager Coded shutter flutter Light field camera Gradient camera

76

77

78

79

80 end

Download ppt "Nonphotorealistic rendering, and future cameras Computational Photography, 6.882 Bill Freeman Fredo Durand May 11, 2006."

Similar presentations

3-D Computational Vision CSc 83020 Image Processing II - Fourier Transform.

3-D Computational Vision CSc Image Processing II - Fourier Transform.
Manual Camera Settings

Manual Camera Settings
Photography and CS Philip Chan. Film vs Digital Camera What is the difference?

Photography and CS Philip Chan. Film vs Digital Camera What is the difference?
Light Fields PROPERTIES AND APPLICATIONS. Outline  What are light fields  Acquisition of light fields  from a 3D scene  from a real world scene 

Light Fields PROPERTIES AND APPLICATIONS. Outline  What are light fields  Acquisition of light fields  from a 3D scene  from a real world scene 
The Generic Sensor Each photosite converts lightwave energy into photo- electrons Pixels in the output image are a measure of the number of photo-electrons.

The Generic Sensor Each photosite converts lightwave energy into photo- electrons Pixels in the output image are a measure of the number of photo-electrons.
Computer Graphics Computer Animation& lighting Faculty of Physical and Basic Education Computer Science Dep. 2014-2015 Lecturer: 16 Azhee W. MD. E-mail:

Computer Graphics Computer Animation& lighting Faculty of Physical and Basic Education Computer Science Dep Lecturer: 16 Azhee W. MD.
Generalized Mosaics Yoav Y. Schechner, Shree Nayar Department of Computer Science Columbia University.

Generalized Mosaics Yoav Y. Schechner, Shree Nayar Department of Computer Science Columbia University.
CS248 Midterm Review. CS248 Midterm Mon, November 4, 7-9 pm, Terman Aud Mostly “short answer” questions – Keep your answers short and sweet! Covers lectures.

CS248 Midterm Review. CS248 Midterm Mon, November 4, 7-9 pm, Terman Aud Mostly “short answer” questions – Keep your answers short and sweet! Covers lectures.
Computer Vision Introduction to Image formats, reading and writing images, and image environments Image filtering.

Computer Vision Introduction to Image formats, reading and writing images, and image environments Image filtering.
Image Forgery Detection by Gamma Correction Differences.

Image Forgery Detection by Gamma Correction Differences.
High Dynamic Range Imaging: Spatially Varying Pixel Exposures Shree K. Nayar, Tomoo Mitsunaga CPSC 643 Presentation # 2 Brien Flewelling March 4 th, 2009.

High Dynamic Range Imaging: Spatially Varying Pixel Exposures Shree K. Nayar, Tomoo Mitsunaga CPSC 643 Presentation # 2 Brien Flewelling March 4 th, 2009.
Linear View Synthesis Using a Dimensionality Gap Light Field Prior

Linear View Synthesis Using a Dimensionality Gap Light Field Prior
Computational Photography Light Field Rendering Jinxiang Chai.

Computational Photography Light Field Rendering Jinxiang Chai.
Processing Image and Video for An Impressionist Effect Peter Litwinowicz Apple Computer, Inc. Siggraph1997.

Processing Image and Video for An Impressionist Effect Peter Litwinowicz Apple Computer, Inc. Siggraph1997.
Introduction to Computer Graphics

Introduction to Computer Graphics
Achieving True Color Fidelity

Achieving True Color Fidelity
6.098 Digital and Computational Photography 6.882 Advanced Computational Photography Photography Survival Kit Bill Freeman Frédo Durand MIT - EECS.

6.098 Digital and Computational Photography Advanced Computational Photography Photography Survival Kit Bill Freeman Frédo Durand MIT - EECS.
Light Field. Modeling a desktop Image Based Rendering  Fast Realistic Rendering without 3D models.

Light Field. Modeling a desktop Image Based Rendering  Fast Realistic Rendering without 3D models.
Photography Is the capture of reflective light on light sensitive material. Film-Base Photography used “silver” as the light sensitive material. Digital.

Photography Is the capture of reflective light on light sensitive material. Film-Base Photography used “silver” as the light sensitive material. Digital.
Digital Photography Basics. Pixels A pixel is a contraction if the term PIcture ELement. Digital images are made up of small squares, just like a tile.

Digital Photography Basics. Pixels A pixel is a contraction if the term PIcture ELement. Digital images are made up of small squares, just like a tile.

Similar presentations

Ads by Google