VideoTrace: Interactive 3d modelling for all

Slides:

Advertisements

Similar presentations

FEA Reference Guide See additional material herehere.

Advertisements

3D Model Matching with Viewpoint-Invariant Patches(VIP) Reporter ：鄒嘉恆 Date ： 10/06/2009.

For Internal Use Only. © CT T IN EM. All rights reserved. 3D Reconstruction Using Aerial Images A Dense Structure from Motion pipeline Ramakrishna Vedantam.

Qualifying Exam: Contour Grouping Vida Movahedi Supervisor: James Elder Supervisory Committee: Minas Spetsakis, Jeff Edmonds York University Summer 2009.

Lapped Textures Emil Praun and Adam Finkelstien (Princeton University) Huges Hoppe (Microsoft Research) SIGGRAPH 2000 Presented by Anteneh.

Computer Vision REU Week 2 Adam Kavanaugh. Video Canny Put canny into a loop in order to process multiple frames of a video sequence Put canny into a.

GATE D Object Representations (GATE-540) Dr.Çağatay ÜNDEĞER Instructor Middle East Technical University, GameTechnologies & General Manager SimBT.

RANSAC-Assisted Display Model Reconstruction for Projective Display Patrick Quirk, Tyler Johnson, Rick Skarbez, Herman Towles, Florian Gyarfas, Henry Fuchs.

Flexible Bump Map Capture From Video James A. Paterson and Andrew W. Fitzgibbon University of Oxford Calibration Requirement:

Introduction to Computer Vision 3D Vision Topic 9 Stereo Vision (I) CMPSCI 591A/691A CMPSCI 570/670.

Lecture 11: Structure from motion CS6670: Computer Vision Noah Snavely.

Planar Matchmove Using Invariant Image Features Andrew Kaufman.

1 3D –graphics and animation Magazines, Web material, Exam question areas Harri Airaksinen;

CSCE 641 Computer Graphics: Image-based Modeling (Cont.) Jinxiang Chai.

Scenes, Cameras & Lighting. Outline  Constructing a scene  Using hierarchy  Camera models  Light models.

3D Scene Models Object recognition and scene understanding Krista Ehinger.

Computer Animation Rick Parent Computer Animation Algorithms and Techniques Motion Capture.

MS. WILLIAMS Anatomy of a 3D Model. 3D Model 3D Models are one of the essential building blocks of 3D computer graphics. Without them there would be no.

Automatic Camera Calibration

Computer vision: models, learning and inference

A Brief Overview of Computer Vision Jinxiang Chai.

1 Intelligent Robotics Research Centre (IRRC) Department of Electrical and Computer Systems Engineering Monash University, Australia Visual Perception.

Computer Graphics Computer Graphics is everywhere: Visual system is most important sense: High bandwidth Natural communication Fast developments in Hardware.

Computer Graphics An Introduction. What’s this course all about? 06/10/2015 Lecture 1 2 We will cover… Graphics programming and algorithms Graphics data.

Reconstructing 3D mesh from video image sequences supervisor : Mgr. Martin Samuelčik by Martin Bujňák specifications Master thesis

I 3D: Interactive Planar Reconstruction of Objects and Scenes Adarsh KowdleYao-Jen Chang Tsuhan Chen School of Electrical and Computer Engineering Cornell.

SKM 4200 Computer Animation Chapter 4: Animation (3D Computer Animation – Part 1)

CSCE 643 Computer Vision: Structure from Motion

Slide 1 Standard Grade Computing Multimedia and Presentation.

12/03/10 ANIMASI TEKNOLOGI IF.UB. Eriq Muhammad Adams J. -

Acquiring 3D models of objects via a robotic stereo head David Virasinghe Department of Computer Science University of Adelaide Supervisors: Mike Brooks.

© 2005 Martin Bujňák, Martin Bujňák Supervisor : RNDr.

Interactive Point-based Modeling of Complex Objects from Images Pierre Poulin (a,b) Marc Stamminger (a,c) François Duranleau (b) Marie-Claude Frasson (a)

12/7/10 Looking Back, Moving Forward Computational Photography Derek Hoiem, University of Illinois Photo Credit Lee Cullivan.

Chapter 5 Multi-Cue 3D Model- Based Object Tracking Geoffrey Taylor Lindsay Kleeman Intelligent Robotics Research Centre (IRRC) Department of Electrical.

Scene Reconstruction Seminar presented by Anton Jigalin Advanced Topics in Computer Vision ( )

Jack Pinches INFO410 & INFO350 S INFORMATION SCIENCE Computer Vision I.

High Resolution Surface Reconstruction from Overlapping Multiple-Views

Image-Based Rendering Geometry and light interaction may be difficult and expensive to model –Think of how hard radiosity is –Imagine the complexity of.

MASKS © 2004 Invitation to 3D vision. MASKS © 2004 Invitation to 3D vision Lecture 1 Overview and Introduction.

Computer Vision Computer Vision based Hole Filling Chad Hantak COMP December 9, 2003.

Computer – Aided Design Terminology You must have a generic understanding of commands and techniques which are used in a number of packages (YOU CANNOT.

Computer Photography -Scene Fixed 陳立奇.

Applications and Rendering pipeline

3D Rendering 2016, Fall.

Games Development Practices 3D Modelling

3D Single Image Scene Reconstruction For Video Surveillance Systems

Computer Graphics.

Multiple View Geometry

Computer Animation Ying Zhu Georgia State University

CS201 Lecture 02 Computer Vision: Image Formation and Basic Techniques

The Brightness Constraint

Interactive Computer Graphics

Homography From Wikipedia In the field of computer vision, any

© 2005 University of Wisconsin

Computer Graphics.

Vehicle Segmentation and Tracking in the Presence of Occlusions

The Brightness Constraint

Introduction to Game Development

The Brightness Constraint

Procedural Animation Lecture 3: Types of 3D models

ATCM 6317 Procedural Animation

Computer Animation UV Mapping.

Chapter I Introduction

Computer Animation Displaying animation sequences raster animation

Computer Graphics Lecture 15.

Introduction to spagetti and meatballs

Filtering An image as a function Digital vs. continuous images

Lecture 15: Structure from motion

Presentation transcript:

VideoTrace: Interactive 3d modelling for all Anton van den Hengel Director, Australian Centre for Visual technologies Associate Professor, Adelaide University, South Australia Director, PunchCard Visual technologies

Input

Modelling

Results

Interactive 3D modelling 3D modelling is critical to all sorts of application Special effects, but also mining, architecture, defence, urban planning, … People are getting more visually sophisticated More 3D data is being generated More cameras, but also scanners etc The interfaces of modelling programs are usually very hard to fathom

Why? Insert your own objects into a game Put your couch into second life Model your house for Google Earth Video editing Cut and paste between sequences Remove someone from your home videos

Put your truck into a game

Put your truck into a game

Modelling for animation

Video editing requires models

Dense surface reconstruction

Video editing requires models

Structure from motion

The process Capture and import the video Perform structure and motion analysis Interact with the system to generate and edit the model Export to your application

The approach Pre-compute where possible Then interact Structure from motion (camera tracking) Superpixels Then interact Interactions allow user to exploit precomputed results

Structure from motion Camera tracking Calculates Reconstructed point cloud Camera parameters Location Orientation Intrinsics (eg. Focal length) Informs interaction interpretation process

Interactive modelling from video

Interactions Straight lines Curves Mirroring Extrusion Closed sets of lines define planar polygons Curves For planar shapes with curved edges For NURBS surfaces Mirroring Duplicates existing geometry Extrusion

Fitting planar faces User specifies boundary Boundary specifies infinitely many planes Similar to pre-emptive RANSAC Generate bounded plane hypotheses from point cloud Eliminate hypotheses that fail a series of tests Run simplest / most robust tests first Generally 3d tests before 2d tests

Fitting planar faces Line of sight Object points Image plane

Hierarchical RANSAC Generate bounded plane hypotheses Tests Support from point cloud Reprojects within new image boundaries Constraints on relative edge length and face size Colour histogram matching on faces Colour matching on edge projections Reprojection is not self-occluding

Curves

Mirroring

Extrusion

Dense surface reconstruction Needs to be at interactive speed Calculated as a max-flow graph-cut over a Markov Random Field Link cost based on photoconsitency

Modelling without features

Modelling without features

Recent model

Future work Other interactions Other data sources Occluding contours Interactive SFM De / Re-lighting