Bringing Photographs to Life With View Morphing Bringing Photographs to Life With View Morphing Steve Seitz University of Wisconsin—Madison

Images Are Static Photographs Lack –Movement — scene is frozen in time –Depth — image is two-dimensional Can we animate the scene via the image?

Objective: Scene Interaction Via Photos Scene Viewing –Move virtual camera, view real scene Scene Interaction –Move objects — cut and paste –Change objects — paint, sculpt –Animate the scene — make things walk, talk

Adding Movement Original Image Expression Change

Adding Depth Original Image Perspective Change

Talk Outline Adding Motion and Depth View Morphing Applications Visualization, photo correction, special effects Interacting With the Scene Scene editing via photographs

PhotographPhotograph

Morphed View Virtual Camera

1. Prewarp align views

1. Prewarp align views 2. Morph move camera

1. Prewarp align views 2. Morph move camera 3. Postwarp point camera

Features of View Morphing Provides –A mobile virtual camera –Better image morphs Requires no prior knowledge –No 3D shape information –No camera information –No training on other images

Applications: Visualization User-controlled Virtual Camera –Telepresence — visit a remote scene –Web commerce — product viewing over Internet –Viewing historical sites –Animating paintings

Applications: Photo Correction Image Postprocessing –Alter image perspective in the lab Image Databases –Normalize images for better indexing –Simplify face recognition tasks

Corrected Photographs Original Photographs

Applications: Better Image Transitions –Avoid bending and shearing distortions –Shapes do not need to be aligned Image Morph View Morph

The Next Step: Interacting With the Scene Scene Editing Via Photographs –Move objects — cut and paste –Change objects — paint, warp Scene Painted Photo Photo Propagation

Original Photo

Painted Photo Cut Photo Original Photo

Painted Photo Cut Photo New Views of Modified Scene Original Photo

Conclusions Photographs Come Alive –Motion, depth added by View Morphing User-Scene Interaction Via Photos –Still images interactive movies –What kinds of scene changes are possible? –Which modes of interaction are natural?