Projector with Radiometric Screen Compensation Shree K. Nayar, Harish Peri Michael Grossberg, Peter Belhumeur Support: National Science Foundation Computer.

Slides:

Advertisements

Similar presentations

Point-based Graphics for Estimated Surfaces

Advertisements

Real-Time Projector Tracking on Complex Geometry Using Ordinary Imagery Tyler Johnson and Henry Fuchs University of North Carolina – Chapel Hill ProCams.

A Robust Super Resolution Method for Images of 3D Scenes Pablo L. Sala Department of Computer Science University of Toronto.

Graphics Pipeline.

Procam and Campro Shree K. Nayar Computer Science Columbia University Support: NSF, ONR Procams 2006 PROCAMS Shree K. Nayar,

Evaluation of processes used in screen imperfection algorithms Siavash A. Renani.

Cameras and Projectors

Multimedia Specification Design and Production 2012 / Semester 1 / week 6 Lecturer: Dr. Nikos Gazepidis

IITB-Monash Research Academy An Indian-Australian Research Partnership IIT Bombay Projection Defocus Correction using Adaptive Kernel Sampling and Geometric.

16421: Vision Sensors Lecture 6: Radiometry and Radiometric Calibration Instructor: S. Narasimhan Wean 5312, T-R 1:30pm – 2:50pm.

Matting and Transparency : Computational Photography Alexei Efros, CMU, Fall 2007.

1 Lecture 2 Main components of graphical systems Graphical devices.

1 Color Segmentation: Color Spaces and Illumination Mohan Sridharan University of Birmingham

Radiometric Self Calibration

Spectrophotometer Jan 28, 2002 Deryck Hong Suryadi Gunawan.

A Personal Surround Environment: Projective Display with Correction for Display Surface Geometry and Extreme Lens Distortion Tyler Johnson, Florian Gyarfas,

High Dynamic Range from Multiple Images: Which Exposures to Combine?

Camerabased projector calibration, investigation of the Bala method

Michael Grossberg and Shree Nayar CAVE Lab, Columbia University Partially funded by NSF ITR Award What can be Known about the Radiometric Response from.

Photorealistic Rendering of Rain Streaks Department of Computer Science Columbia University Kshitiz Garg Shree K. Nayar SIGGRAPH Conference July 2006,

Image-based Rendering of Real Objects with Complex BRDFs.

IAT 3551 Computer Graphics Overview Color Displays Drawing Pipeline.

Detector lens image Traditional Camera Shree Nayar, ICIP, 2001.

Structured Light in Scattering Media Srinivasa Narasimhan Sanjeev Koppal Robotics Institute Carnegie Mellon University Sponsor: ONR Shree Nayar Bo Sun.

Projection Defocus Analysis for Scene Capture and Image Display Li Zhang Shree Nayar Columbia University IIS SIGGRAPH Conference July 2006, Boston,

Lensless Imaging with A Controllable Aperture Assaf Zomet and Shree K. Nayar Columbia University IEEE CVPR Conference June 2006, New York, USA.

General Imaging Model Michael Grossberg and Shree Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July 2001 Partially funded by NSF ITR.

Computer Science 111 Fundamentals of Programming I Introduction to Digital Image Processing.

Basic Principles of Imaging and Photometry Lecture #2 Thanks to Shree Nayar, Ravi Ramamoorthi, Pat Hanrahan.

A Brief Overview of Computer Vision Jinxiang Chai.

Basic Graphics Concepts Day One CSCI 440. Terminology object - the thing being modeled image - view of object(s) on the screen frame buffer - memory that.

Computer Graphics Computer Graphics is everywhere: Visual system is most important sense: High bandwidth Natural communication Fast developments in Hardware.

© 1999 Rochester Institute of Technology Color. Imaging Science Workshop for Teachers ©Chester F. Carlson Center for Imaging Science at RIT Color Images.

Camera Geometry and Calibration Thanks to Martial Hebert.

1 Image Basics Hao Jiang Computer Science Department Sept. 4, 2014.

Computer Graphics Lecture 1 July 11, Computer Graphics What do you think of? The term “computer graphics” is a blanket term used to refer to the.

Computer Graphics Raster Devices Transformations Areg Sarkissian.

Computer Graphics An Introduction. What’s this course all about? 06/10/2015 Lecture 1 2 We will cover… Graphics programming and algorithms Graphics data.

Sebastian Enrique Columbia University Relighting Framework COMS 6160 – Real-Time High Quality Rendering Nov 3 rd, 2004.

C O M P U T E R G R A P H I C S Guoying Zhao 1 / 14 C O M P U T E R G R A P H I C S Guoying Zhao 1 / 14 Going-through.

1 After completing this lesson, you will be able to: Identify the key differences between analog and digital technologies. Define digital camera terms,

A Camera-Projector System for Real-Time 3D Video Marcelo Bernardes, Luiz Velho, Asla Sá, Paulo Carvalho IMPA - VISGRAF Laboratory Procams 2005.

Color Spectrum The visible color spectrum, with wavelengths indicated in nanometers. From 441pxWithnm.png.

Computer Science 111 Fundamentals of Programming I Introduction to Digital Image Processing.

Introduction to OpenGL  OpenGL is a graphics API  Software library  Layer between programmer and graphics hardware (and software)  OpenGL can fit in.

How digital cameras work The Exposure The big difference between traditional film cameras and digital cameras is how they capture the image. Instead of.

Radiometric Compensation in a Projector-Camera System Based on the Properties of the Human Visual System Dong WANG, Imari SATO, Takahiro OKABE, and Yoichi.

Review on Graphics Basics. Outline Polygon rendering pipeline Affine transformations Projective transformations Lighting and shading From vertices to.

Student Name: Honghao Chen Supervisor: Dr Jimmy Li Co-Supervisor: Dr Sherry Randhawa.

Conditionals-Mod8-part41 Conditionals – part 4 Replace background Barb Ericson Georgia Institute of Technology May 2007.

Chapter 1: Image processing and computer vision Introduction

Projector-camera system Application of computer vision projector-camera v3a1.

Matting and Transparency : Computational Photography Alexei Efros, CMU, Spring 2010.

Che-An Wu Background substitution. Background Substitution AlphaMa p Trimap Depth Map Extract the foreground object and put into another background Objective.

Viewing. Classical Viewing Viewing requires three basic elements - One or more objects - A viewer with a projection surface - Projectors that go from.

Digital Cameras in the Classroom Day One Basics Ann Howden UEN Professional Development

Bo Sun Kalyan Sunkavalli Ravi Ramamoorthi Peter Belhumeur Shree Nayar Columbia University Time-Varying BRDFs.

COMPUTER GRAPHICS AND LINEAR ALGEBRA AN INTRODUCTION.

Shaders, part 2 alexandri zavodny.

The Colour of Light: Additive colour theory.

Multiplexed Illumination

CS451Real-time Rendering Pipeline

The Graphics Pipeline Lecture 5 Mon, Sep 3, 2007.

network of simple neuron-like computing elements

眼動儀與互動介面設計廖文宏 6/26/2009.

Computer Basics: How Do Computers Work? Part II

Colors Computers build colors from Red, Green, and Blue; not Red, Blue, and Yellow. RGB = Red Green Blue Creating Colors Red + Blue = Purple No Red, No.

Chapter 6 Conditionals - part 4

Fig. 2 System and method for determining retinal disparities when participants are engaged in everyday tasks. System and method for determining retinal.

Fig. 2 System and method for determining retinal disparities when participants are engaged in everyday tasks. System and method for determining retinal.

Presentation transcript:

Projector with Radiometric Screen Compensation Shree K. Nayar, Harish Peri Michael Grossberg, Peter Belhumeur Support: National Science Foundation Computer Science Columbia University Procams Workshop ICCV 2003, Nice, France

Projecting on Any Surface ?

Textured Screen Camera Computer Projector Projector-Camera System

Geometric Calibration Projector InputCamera Output Maximum Error: 0.6 pixels, RMS Error: 0.18 pixels

Display Device Projector Screen I D P E x i x d x s Camera Capture Device B M C L x b x m Projector-Camera Pipeline: Radiometry What Display Image (I) will produce a Desired Captured Image (M) ?

Radiometric Model (for each pixel) Display Device Projector Screen I D P E Camera Capture Device B M C L display reponseprojector reponse capture reponsecamera reponse projector channel screencamera channel camera irradianceprojector brightness color mixing matrix

Finding the Model Parameters (at each pixel) Display Device Projector Screen I D P E Camera Capture Device B M C L camera irradianceprojector brightness color mixing matrix display image color projector color composite response camera irradianceprojector brightness modified color mixing matrix (known)

Finding the Color Mixing Matrix camera irradianceprojector brightness modified color mixing matrix (known) arbitrary imageonly change in red only change in green only change in blue

Color Mixing: V Matrices

Radiometric Calibration: Color Projector InputCamera Output desired projector output compensated display image composite response

Texture of Screen Color Experiment Uncompensation outputs (flat gray inputs: 100, 150, 200 gray levels) Compensation images (flat gray inputs: 100, 150, 200 gray levels) Compensated outputs (flat gray inputs: 100, 150, 200 gray levels) Compensation Accuracy 50,50,50 100,100, ,150, ,200,200 25,26,26 66,70,71 75,98,95 50,99,90 2,3,7 6,8,14 19,15,21 39,29, ,24.2, ,57.2, ,44.5, ,47.5, , 0.8, , 1.9, , 3.1, ,4.0,10.7 Projected Brightness Max. ErrorRMS Error Without Comp. With Comp. (R, G, B) Without Comp. With Comp.

Original (desired) image (I)Uncompensated output (M) Face Image on Checkerboard Screen Compensated output (M) ~ Compensation image ( I ) ~

Face Video on Brick Texture Normal ProjectorProjector With Compensation

Scene Video on Brick Texture Normal ProjectorProjector With Compensation

Face Video on Butterfly Poster Normal ProjectorProjector With Compensation

Summary Off-Line Method for Radiometric Calibration On-Line Algorithm for Screen Compensation Refinement using Continuous Feedback Radiometric Model for Projector-Camera System