The Uncanny Valley in 3D Modeling Steve Seitz and Rick Szeliski BIRS Workshop on Computer Vision and the Internet August 31, 2009.

Slides:



Advertisements
Similar presentations
Interactive Deformation of Light Fields Billy Chen Eyal Ofek Heung-Yeung Shum Marc Levoy.
Advertisements

Free-viewpoint Immersive Networked Experience February 2010.
Graphics Pipeline.
Interactive Video Tours MSR Interactive Visual Media Group //msrweb/vision/IBR Rick Szeliski, Sing Bing Kang, Matt Uyttendaele, Simon Winder, Antonio Criminisi.
Introduction to Image-Based Rendering Jian Huang, CS 594, Spring 2002 A part of this set of slides reference slides used at Standford by Prof. Pat Hanrahan.
Digital Interactive Entertainment Dr. Yangsheng Wang Professor of Institute of Automation Chinese Academy of Sciences
Recent work in image-based rendering from unstructured image collections and remaining challenges Sudipta N. Sinha Microsoft Research, Redmond, USA.
Real-Time Rendering SPEACIAL EFFECTS Lecture 03 Marina Gavrilova.
Vision For Graphics ICCV 2005 Vision for Graphics Larry Zitnick, Sing Bing Kang, Rick Szeliski Interactive Visual Media Group Microsoft Research Steve.
Dana Cobzas-PhD thesis Image-Based Models with Applications in Robot Navigation Dana Cobzas Supervisor: Hong Zhang.
Image-Based Modeling, Rendering, and Lighting
Constructing immersive virtual space for HAI with photos Shingo Mori Yoshimasa Ohmoto Toyoaki Nishida Graduate School of Informatics Kyoto University GrC2011.
A new approach for modeling and rendering existing architectural scenes from a sparse set of still photographs Combines both geometry-based and image.
Video Texture : Computational Photography Alexei Efros, CMU, Fall 2006 © A.A. Efros.
Copyright  Philipp Slusallek Cs fall IBR: Model-based Methods Philipp Slusallek.
Multiple View Geometry : Computational Photography Alexei Efros, CMU, Fall 2005 © Martin Quinn …with a lot of slides stolen from Steve Seitz and.
Direct Methods for Visual Scene Reconstruction Paper by Richard Szeliski & Sing Bing Kang Presented by Kristin Branson November 7, 2002.
Image-Based Rendering Computer Vision CSE576, Spring 2005 Richard Szeliski.
High-Quality Video View Interpolation
Image-Based Rendering Produce a new image from real images. Combining images Interpolation More exotic methods.
3D from multiple views : Rendering and Image Processing Alexei Efros …with a lot of slides stolen from Steve Seitz and Jianbo Shi.
Copyright  Philipp Slusallek IBR: View Interpolation Philipp Slusallek.
Image or Object? Michael F. Cohen Microsoft Research.
CSCE 641 Computer Graphics: Image-based Rendering (cont.) Jinxiang Chai.
Introduction to Computer Vision CS223B, Winter 2005.
CSCE 641: Computer Graphics Image-based Rendering Jinxiang Chai.
CS 563 Advanced Topics in Computer Graphics View Interpolation and Image Warping by Brad Goodwin Images in this presentation are used WITHOUT permission.
 Marc Levoy IBM / IBR “The study of image-based modeling and rendering is the study of sampled representations of geometry.”
Data-driven methods: Video : Computational Photography Alexei Efros, CMU, Fall 2007 © A.A. Efros.
 Marc Levoy IBM / IBR “The study of image-based modeling and rendering is the study of sampled representations of geometry.”
CS 563 Advanced Topics in Computer Graphics Introduction To IBR By Cliff Lindsay Slide Show ’99 Siggraph[6]
Constructing immersive virtual space for HAI with photos Shingo Mori Yoshimasa Ohmoto Toyoaki Nishida Graduate School of Informatics Kyoto University GrC2011.
Multiple View Geometry : Computational Photography Alexei Efros, CMU, Fall 2006 © Martin Quinn …with a lot of slides stolen from Steve Seitz and.
David Luebke Modeling and Rendering Architecture from Photographs A hybrid geometry- and image-based approach Debevec, Taylor, and Malik SIGGRAPH.
Manhattan-world Stereo Y. Furukawa, B. Curless, S. M. Seitz, and R. Szeliski 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.
The University of Ontario CS 4487/9587 Algorithms for Image Analysis n Web page: Announcements, assignments, code samples/libraries,
Being There: Capturing and Experiencing a Sense of Place Richard Szeliski Microsoft Research Symposium on Computational Photography and Video.
Generating panorama using translational movement model.
Image-Based Rendering. 3D Scene = Shape + Shading Source: Leonard mcMillan, UNC-CH.
Image-Based Rendering from a Single Image Kim Sang Hoon Samuel Boivin – Andre Gagalowicz INRIA.
Automatic Registration of Color Images to 3D Geometry Computer Graphics International 2009 Yunzhen Li and Kok-Lim Low School of Computing National University.
Video Textures Arno Schödl Richard Szeliski David Salesin Irfan Essa Microsoft Research, Georgia Tech.
REAL-TIME VIDEO EFFECTS USING A DEPTH SENSOR Robbie Fraser and Ridho Jeftha.
Recap from Monday Image Warping – Coordinate transforms – Linear transforms expressed in matrix form – Inverse transforms useful when synthesizing images.
Image-based rendering Michael F. Cohen Microsoft Research.
Image stitching Digital Visual Effects Yung-Yu Chuang with slides by Richard Szeliski, Steve Seitz, Matthew Brown and Vaclav Hlavac.
Image-based Rendering. © 2002 James K. Hahn2 Image-based Rendering Usually based on 2-D imagesUsually based on 2-D images Pre-calculationPre-calculation.
CS-378: Game Technology Lecture #4: Texture and Other Maps Prof. Okan Arikan University of Texas, Austin V Lecture #4: Texture and Other Maps.
Image Based Rendering. Light Field Gershun in 1936 –An illuminated objects fills the surrounding space with light reflected of its surface, establishing.
Multimedia Programming 21: Video and its applications Departments of Digital Contents Sang Il Park Lots of Slides are stolen from Alexei Efros, CMU.
Data dan Teknologi Multimedia Sesi 07 Nofriyadi Nurdam.
112/5/ :54 Graphics II Image Based Rendering Session 11.
Sky Boxes and Vector Math 2 Course Information CVG: Programming 4 My Name: Mark Walsh Website:
Yizhou Yu Texture-Mapping Real Scenes from Photographs Yizhou Yu Computer Science Division University of California at Berkeley Yizhou Yu Computer Science.
CSCE 641 Computer Graphics: Image-based Rendering (cont.) Jinxiang Chai.
Image-Based Rendering Geometry and light interaction may be difficult and expensive to model –Think of how hard radiosity is –Imagine the complexity of.
MASKS © 2004 Invitation to 3D vision. MASKS © 2004 Invitation to 3D vision Lecture 1 Overview and Introduction.
Video Textures Arno Schödl Richard Szeliski David Salesin Irfan Essa Microsoft Research, Georgia Tech.
3D Animation 1. Introduction Dr. Ashraf Y. Maghari Information Technology Islamic University of Gaza Ref. Book: The Art of Maya.
Presented by 翁丞世  View Interpolation  Layered Depth Images  Light Fields and Lumigraphs  Environment Mattes  Video-Based.
Presented by 翁丞世  View Interpolation  Layered Depth Images  Light Fields and Lumigraphs  Environment Mattes  Video-Based.
Advanced Computer Graphics
Photorealistic Rendering vs. Interactive 3D Graphics
Jun Shimamura, Naokazu Yokoya, Haruo Takemura and Kazumasa Yamazawa
Steps Towards the Convergence of Graphics, Vision, and Video
Image-Based Rendering
Image-Based Rendering
© 2005 University of Wisconsin
CS-378: Game Technology Lecture #4: Texture and Other Maps
Chapter 13 Image-Based Rendering
Presentation transcript:

The Uncanny Valley in 3D Modeling Steve Seitz and Rick Szeliski BIRS Workshop on Computer Vision and the Internet August 31, 2009

The Uncanny Valley "The uncanny valley hypothesis holds that when robots and other facsimiles of humans look and act almost like actual humans, it causes a response of revulsion among human observers. The "valley" in question is a dip in a proposed graph of the positivity of human reaction as a function of a robot's lifelikeness. It was introduced by Japanese roboticist Masahiro Mori in 1970."

Final Fantasy

Polar Express

Façade

1.Select building blocks 2.Align them in each image 3.Solve for camera pose and block parameters (using constraints)

View-dependent texture mapping 1.Determine visible cameras for each surface element 2.Blend textures (images) depending on distance between original camera and novel viewpoint

Model-based stereo Compute offset from block model Some more results:

Graz reconstruction

Photo Tourism

Piecewise planar proxies Sinha, Steedly, Szeliski ICCV’09 us/um/redmond/groups/ivm/PlanarStereo/

Reflections

Change blindness

Lightness constancy

Image Based Rendering Real Scene Real Cameras -or- Expensive Image Synthesis Images+Model Image Output Synthetic Camera

Graphics/Imaging Continuum LumigraphLight field Geometry centric Image centric Warping Interpolation Polygon rendering + texture mapping Fixed geometry View- dependent geometry View- dependent texture Concentric mosaics Sprites with depth LDI

Video-Based Walkthroughs Move camera along a rail (“dolly track”) and play back a 360  video Applications: –Homes and architecture –Outdoor locations (tourist destinations)

Surround video acquisition system OmniCam (six-camera head)

OmniCam Built by Point Grey Research (Ladybug) Six camera head Portable hard drives, fiber-optic link Resolution per image: 1024 x 768 FOV: ~100 o x ~80 o Acquisition speed: 15 fps uncompressed

Acquisition platforms Robotic cart Wearable

Video Textures How can we turn a short video clip into an  amount of continuous video? –dynamic elements in 3D games and presentations –alternative to 3D graphics animation? [Schödl, Szeliski, Salesin, Essa, SG’2000]

Video Textures uFind cyclic structure in the video u(Optional) region-based analysis uPlay frames with random shuffle uSmooth over discontinuities (morph)

A complete animation

Feedback: Privacy Policy Feedback
Do Not Sell My Personal Information
About project: SlidePlayer Terms of Service

© 2025 SlidePlayer.com. Inc. All rights reserved.