Video & Capture SIGGRAPH Asia 2011 0. Modeling and Generating Moving Trees from Video Chuan Li, Oliver Deussen, Yi-Zhe Song, Phil Willis, Peter Hall Media.

Slides:



Advertisements
Similar presentations
ME. Final Piece For your final piece you will be producing a large scale self portrait. The media and way you approach the subject is up to you. You should.
Advertisements

Paul Debevec, Tim Hawkins, Chris Tchou, H.P. Duiker, Westley Sarokin, and Mark Sagar Acquiring the Reflectance Field of a Human Face UC.
1. Facial Expression Editing in Video Using a Temporally- Smooth Factorization 2. Face Swapping: Automatically Replacing Faces in Photographs.
Computational Photography and Capture: Time-Lapse Video Analysis & Editing Gabriel Brostow & Tim Weyrich TAs: Clément Godard & Fabrizio Pece.
Vision Sensing. Multi-View Stereo for Community Photo Collections Michael Goesele, et al, ICCV 2007 Venus de Milo.
Temporally Coherent Completion of Dynamic Shapes Hao Li, Linjie Luo, Daniel Vlasic, Pieter Peers, Jovan Popović, Mark Pauly, Szymon Rusinkiewicz ACM Transactions.
Kernel-based tracking and video patch replacement Igor Guskov
Image-based Clothes Animation for Virtual Fitting Zhenglong Zhou, Bo Shu, Shaojie Zhuo, Xiaoming Deng, Ping Tan, Stephen Lin * National University of.
3D Face Modeling Michaël De Smet.
AAM based Face Tracking with Temporal Matching and Face Segmentation Dalong Du.
Personal Photo Enhancement using Example Images Neel Joshi Wojciech Matusik, Edward H. Adelson, and David J. Kriegman Microsoft Research, Disney Research,
SIGGRAPH Course 30: Performance-Driven Facial Animation For Latest Version of Bregler’s Slides and Notes please go to:
METHODS OF OBJECT TRACKING IN VISION SYSTEMS Grzegorz Bieszczad Tutor: Tomasz Sosnowski ph.d. Military University of Technology Faculty of Electronics.
Advanced Computer Graphics CSE 190 [Spring 2015], Lecture 14 Ravi Ramamoorthi
Advanced Computer Vision Introduction Goal and objectives To introduce the fundamental problems of computer vision. To introduce the main concepts and.
SIGGRAPH Course 30: Performance-Driven Facial Animation Section: Markerless Face Capture and Automatic Model Construction Part 2: Li Zhang, Columbia University.
May 10, 2004Facial Tracking and Animation Todd Belote Bryan Harris David Brown Brad Busse.
Advanced Computer Graphics (Fall 2010) CS 283, Lecture 16: Image-Based Rendering and Light Fields Ravi Ramamoorthi
Advanced Computer Graphics (Spring 2005) COMS 4162, Lecture 21: Image-Based Rendering Ravi Ramamoorthi
Representations of Visual Appearance COMS 6160 [Spring 2007], Lecture 4 Image-Based Modeling and Rendering
Image-Based Modeling and Rendering CS 6998 Lecture 6.
Introduction Steve Seitz Carnegie Mellon University Brian Curless University of Washington SIGGRAPH 2000 Course on 3D Photography
HK UST * Hong Kong University of Science and Technology HK UST Modeling Hair from Multiple Views Y. Wei, E. Ofek, L. Quan and H. Shum.
SIGGRAPH Course 30: Performance-Driven Facial Animation Section: Marker-less Face Capture and Automatic Model Construction Part 1: Chris Bregler, NYU Part.
Computer Vision for Interactive Computer Graphics Mrudang Rawal.
CSCE 641 Computer Graphics: Image-based Rendering (cont.) Jinxiang Chai.
Introduction to Computer Vision CS223B, Winter 2005.
Using Photographs to Enhance Videos of a Static Scene Pravin Bhat 1, C. Lawrence Zitnick 2, Noah Snavely 1, Aseem Agarwala 3, Maneesh Agrawala 4, Michael.
Computer Vision (CSE P576) Staff Prof: Steve Seitz TA: Jiun-Hung Chen Web Page
CSCE 641: Computer Graphics Image-based Rendering Jinxiang Chai.
Facial Tracking and Animation Project Proposal Computer System Design Spring 2004 Todd BeloteDavid Brown Brad BusseBryan Harris.
Computer Vision (CSE/EE 576) Staff Prof: Steve Seitz TA: Aseem Agarwala Web Page
Computer Animation CS 445/645 Fall Let’s talk about computer animation Must generate 30 frames per second of animation (24 fps for film) Issues.
The University of Ontario CS 4487/9587 Algorithms for Image Analysis n Web page: Announcements, assignments, code samples/libraries,
Multi-Aperture Photography Paul Green – MIT CSAIL Wenyang Sun – MERL Wojciech Matusik – MERL Frédo Durand – MIT CSAIL.
Light Field Video Stabilization ICCV 2009, Kyoto Presentation for CS 534: Computational Photography Friday, April 22, 2011 Brandon M. Smith Li Zhang University.
Real-Time High Quality Rendering CSE 291 [Winter 2015], Lecture 6 Image-Based Rendering and Light Fields
Digital Face Cloning David Bennett Christophe HerySteve Sullivan George Borshukov J.P. Lewis Lance Williams Paul Debevec Fred Pighin Li Zhang.
3D/Multview Video. Outline Introduction 3D Perception and HVS 3D Displays 3D Video Representation Compression.
Announcements Class web site – Handouts –class info –lab access/accounts –survey Readings.
MERL, MIT Media Lab Reinterpretable Imager Agrawal, Veeraraghavan & Raskar Amit Agrawal, Ashok Veeraraghavan and Ramesh Raskar Mitsubishi Electric Research.
Advanced Computer Graphics (Spring 2013) CS 283, Lecture 15: Image-Based Rendering and Light Fields Ravi Ramamoorthi
Peter Sturm INRIA Grenoble – Rhône-Alpes (Institut National de Recherche en Informatique et Automatique) An overview of multi-view stereo and other topics.
Automatic Registration of Color Images to 3D Geometry Computer Graphics International 2009 Yunzhen Li and Kok-Lim Low School of Computing National University.
GENERAL PRESENTATION SUBMITTED BY:- Neeraj Dhiman.
Digital Face Replacement in Photographs CSC2530F Project Presentation By: Shahzad Malik January 28, 2003.
Detecting Pedestrians Using Patterns of Motion and Appearance Paul Viola Microsoft Research Irfan Ullah Dept. of Info. and Comm. Engr. Myongji University.
Computer Vision Why study Computer Vision? Images and movies are everywhere Fast-growing collection of useful applications –building representations.
Computing & Information Sciences Kansas State University Lecture 15 of 42CIS 636/736: (Introduction to) Computer Graphics Lecture 15 of 42 William H. Hsu.
Stereo Many slides adapted from Steve Seitz.
Presented by Matthew Cook INFO410 & INFO350 S INFORMATION SCIENCE Paper Discussion: Dynamic 3D Avatar Creation from Hand-held Video Input Paper Discussion:
Lec 22: Stereo CS4670 / 5670: Computer Vision Kavita Bala.
2D Animation Techniques for 3D Animation Research - KCGS Conference. Spring, In-Kwon Lee Game Animation Center Division of Media Ajou University.
Temporally Coherent Completion of Dynamic Shapes AUTHORS:HAO LI,LINJIE LUO,DANIEL VLASIC PIETER PEERS,JOVAN POPOVIC,MARK PAULY,SZYMON RUSINKIEWICZ Presenter:Zoomin(Zhuming)
3D Face Recognition Using Range Images
AAM based Face Tracking with Temporal Matching and Face Segmentation Mingcai Zhou 1 、 Lin Liang 2 、 Jian Sun 2 、 Yangsheng Wang 1 1 Institute of Automation.
CSCE 641 Computer Graphics: Image-based Rendering (cont.) Jinxiang Chai.
Paper presentation topics 2. More on feature detection and descriptors 3. Shape and Matching 4. Indexing and Retrieval 5. More on 3D reconstruction 1.
1 Real-Time High-Quality View-dependent Texture Mapping using Per-Pixel Visibility Damien Porquet Jean-Michel Dischler Djamchid Ghazanfarpour MSI Laboratory,
Advanced Computer Graphics
A Unified Algebraic Approach to 2D and 3D Motion Segmentation
Image Deblurring Using Dark Channel Prior
Scale: Kilometers.
Image Based Modeling and Rendering (PI: Malik)
Introduction to Game Development
History of computer graphics
Game Development Animation
Computer Vision (CSE 490CV, EE400B)
Scale: Kilometers.
Unrolling the shutter: CNN to correct motion distortions
Presentation transcript:

Video & Capture SIGGRAPH Asia

Modeling and Generating Moving Trees from Video Chuan Li, Oliver Deussen, Yi-Zhe Song, Phil Willis, Peter Hall Media Technology Research Centre, Unicersity of Konstanz, Centre fro Digital Entertainment 1 Contribution: improving 3D model and moving The user outline the tree in an initial video frame

Modeling and Generating Moving Trees from Video Chuan Li, Oliver Deussen, Yi-Zhe Song, Phil Willis, Peter Hall Media Technology Research Centre, Unicersity of Konstanz, Centre fro Digital Entertainment 2 Video → 2D skeleton: using technique (Diener [2006]) → 3D tree model: Copy 2D skeleton and place them → 3D tree motion: using Bayes`rule ( probabilistic Motion modeling )

Candid Portrait Selection From Video Juliet Fiss, Aseem Agarwala, Brian Curless University of Washington, Adobe Systems 3 Select still frames from video Contribution: the design and execution of a large- scale psychology study Human subjects collect ratings of video frames

Candid Portrait Selection From Video Juliet Fiss, Aseem Agarwala, Brian Curless University of Washington, Adobe Systems 4 [System] Face tracking using system by Saragih [2009] Normalized data from human rating and exception(blink and blur)

Candid Portrait Selection From Video Juliet Fiss, Aseem Agarwala, Brian Curless University of Washington, Adobe Systems 5

Multiview Face Capture using Polarized Spherical Gradient Illumination Abhijeet Gosh, Paul Debevec at et al USC Institute for Creative Technologies 6 Making facial geometry with high resolution using Polarized Spherical Gradient Illumination Prior limited: position of camera and polarizer Contribution: A new pair of linearly polarized lightning patterns

Multiview Face Capture using Polarized Spherical Gradient Illumination Abhijeet Gosh, Paul Debevec at et al USC Institute for Creative Technologies 7 The patterns; following lines of latitude and longitude

Multiview Face Capture using Polarized Spherical Gradient Illumination Abhijeet Gosh, Paul Debevec at et al USC Institute for Creative Technologies 8 Results

Video Face Replacement Kevin Dale, Hanspeter Pfister et at al Harvard Univ, MIT CSAIL, Lantos Technologies, Disney research Zurich 9 A method for replacing facial performances in video From source video to target video It does not require ‘manual operation’ and ‘acquisition hardware’

Video Face Replacement Kevin Dale, Hanspeter Pfister et at al Harvard Univ, MIT CSAIL, Lantos Technologies, Disney research Zurich 10 Tracking: multilinear method and data (Vlasic [2005]) Retiming: Dynamic Time Warping (Rabiner and Juang [1993]) Blending: to the next page

Video Face Replacement Kevin Dale, Hanspeter Pfister et at al Harvard Univ, MIT CSAIL, Lantos Technologies, Disney research Zurich 11 Blending: Optimization for seamless face texture Result