Automated Construction of Parameterized Motions Lucas Kovar Michael Gleicher University of Wisconsin-Madison.

Slides:



Advertisements
Similar presentations
Distinctive Image Features from Scale-Invariant Keypoints David Lowe.
Advertisements

Word Spotting DTW.
Presented by Xinyu Chang
Fast Algorithms For Hierarchical Range Histogram Constructions
Partially Observable Markov Decision Process (POMDP)
1.The Challenge of Interactivity 2.Parametric Blending -Building Blend-Spaces -Building Blend-Spaces -Using Virtual Example Grids for Parameterization.
Automatically Annotating and Integrating Spatial Datasets Chieng-Chien Chen, Snehal Thakkar, Crail Knoblock, Cyrus Shahabi Department of Computer Science.
Verbs and Adverbs: Multidimensional Motion Interpolation Using Radial Basis Functions Presented by Sean Jellish Charles Rose Michael F. Cohen Bobby Bodenheimer.
Object Recognition using Invariant Local Features Applications l Mobile robots, driver assistance l Cell phone location or object recognition l Panoramas,
Database-Based Hand Pose Estimation CSE 6367 – Computer Vision Vassilis Athitsos University of Texas at Arlington.
Automatic Feature Extraction for Multi-view 3D Face Recognition
Automating Graph-Based Motion Synthesis Lucas Kovar Michael Gleicher University of Wisconsin-Madison.
Lapped Textures Emil Praun and Adam Finkelstien (Princeton University) Huges Hoppe (Microsoft Research) SIGGRAPH 2000 Presented by Anteneh.
A Novel Scheme for Video Similarity Detection Chu-Hong Hoi, Steven March 5, 2003.
Clustered alignments of gene- expression time series data Adam A. Smith, Aaron Vollrath, Cristopher A. Bradfield and Mark Craven Department of Biosatatistics.
Introduction to Data-driven Animation Jinxiang Chai Computer Science and Engineering Texas A&M University.
ACM Multimedia 2008 Feng Liu 1, Yuhen-Hu 1,2 and Michael Gleicher 1.
Boundary matting for view synthesis Samuel W. Hasinoff Sing Bing Kang Richard Szeliski Computer Vision and Image Understanding 103 (2006) 22–32.
Plenoptic Stitching: A Scalable Method for Reconstructing 3D Interactive Walkthroughs Daniel G. Aliaga Ingrid Carlbom
Automated Extraction and Parameterization of Motions in Large Data Sets SIGGRAPH’ 2004 Lucas Kovar, Michael Gleicher University of Wisconsin-Madison.
ADVISE: Advanced Digital Video Information Segmentation Engine
A Study of Approaches for Object Recognition
Video Google: Text Retrieval Approach to Object Matching in Videos Authors: Josef Sivic and Andrew Zisserman ICCV 2003 Presented by: Indriyati Atmosukarto.
Curve Analogies Aaron Hertzmann Nuria Oliver Brain Curless Steven M. Seitz University of Washington Microsoft Research Thirteenth Eurographics.
1. 2 General problem Retrieval of time-series similar to a given pattern.
Video Google: Text Retrieval Approach to Object Matching in Videos Authors: Josef Sivic and Andrew Zisserman University of Oxford ICCV 2003.
Interactive Control of Avatars Animated with Human Motion Data Jehee Lee Carnegie Mellon University Seoul National University Jehee Lee Carnegie Mellon.
Behavior Planning for Character Animation Manfred Lau and James Kuffner Carnegie Mellon University.
Automatic Image Alignment (feature-based) : Computational Photography Alexei Efros, CMU, Fall 2006 with a lot of slides stolen from Steve Seitz and.
Radial Basis Function Networks
Fast Subsequence Matching in Time-Series Databases Christos Faloutsos M. Ranganathan Yannis Manolopoulos Department of Computer Science and ISR University.
Bag of Video-Words Video Representation
Motion Blending (Multidimensional Interpolation) Jehee Lee.
Introduction Tracking the corners Camera model and collision detection Keyframes Path Correction Controlling the entire path of a virtual camera In computer.
Internet-scale Imagery for Graphics and Vision James Hays cs195g Computational Photography Brown University, Spring 2010.
TEMPLATE BASED SHAPE DESCRIPTOR Raif Rustamov Department of Mathematics and Computer Science Drew University, Madison, NJ, USA.
Motion Modeling for Online Locomotion Synthesis Taesoo Kwon and Sung Yong Shin KAIST.
A Statistical Approach to Speed Up Ranking/Re-Ranking Hong-Ming Chen Advisor: Professor Shih-Fu Chang.
Particle Filters for Shape Correspondence Presenter: Jingting Zeng.
Video Based Palmprint Recognition Chhaya Methani and Anoop M. Namboodiri Center for Visual Information Technology International Institute of Information.
Fast and Accurate Goal- Directed Motion Synthesis For Crowds Mankyu Sung Lucas Kovar Michael Gleicher University of Wisconsin- Madison
Coordinate-Invariant Methods For Motion Analysis and Synthesis Jehee Lee Dept. Of Electric Engineering and Computer Science Korea Advanced Institute of.
Multifactor GPs Suppose now we wish to model different mappings for different styles. We will add a latent style vector s along with x, and define the.
Identifying Patterns in Time Series Data Daniel Lewis 04/06/06.
Easiest-to-Reach Neighbor Search Fatimah Aldubaisi.
Stabbing balls and simplifying proteins Ovidiu Daescu and Jun Luo Department of Computer Science University of Texas at Dallas Richardson, TX
A Geometric Database of Gene Expression Data for the Mouse Brain Tao Ju, Joe Warren Rice University.
2006 Mouse AHM Mapping 2D slices to 3D atlases - Application of the Digital Atlas Erh-Fang Lee Laboratory of NeuroImage UCLA.
A B C D E F A ABSTRACT A novel, efficient, robust, feature-based algorithm is presented for intramodality and multimodality medical image registration.
Using simplified meshes for crude registration of two partially overlapping range images Mercedes R.G.Márquez Wu Shin-Ting State University of Matogrosso.
CSE 185 Introduction to Computer Vision Feature Matching.
Written by Changhyun, SON Chapter 5. Introduction to Design Optimization - 1 PART II Design Optimization.
1 Minimum Error Rate Training in Statistical Machine Translation Franz Josef Och Information Sciences Institute University of Southern California ACL 2003.
Flexible Automatic Motion Blending with Registration Curves
The synthesis of motion capture data Author : Tomáš Sako Supervisor : RNDr. Stanislav Stanek.
Interactive Control of Avatars Animated with Human Motion Data By: Jehee Lee, Jinxiang Chai, Paul S. A. Reitsma, Jessica K. Hodgins, Nancy S. Pollard Presented.
Line Matching Jonghee Park GIST CV-Lab..  Lines –Fundamental feature in many computer vision fields 3D reconstruction, SLAM, motion estimation –Useful.
Implicit Active Shape Models for 3D Segmentation in MR Imaging M. Rousson 1, N. Paragio s 2, R. Deriche 1 1 Odyssée Lab., INRIA Sophia Antipolis, France.
Spring 2014 CS274: Automatic Rigging
Reverse Engineering of Point Clouds to Obtain Trimmed NURBS Lavanya Sita Tekumalla Advisor: Prof. Elaine Cohen School of Computing University of Utah Masters.
G W. Yan 1 Multi-Model Fusion for Robust Time-Series Forecasting Weizhong Yan Industrial Artificial Intelligence Lab GE Global Research Center.
Video Google: Text Retrieval Approach to Object Matching in Videos Authors: Josef Sivic and Andrew Zisserman University of Oxford ICCV 2003.
Constrained Synthesis of Textural Motion for Animation Shmuel Moradoff Dani Lischinski The Hebrew University of Jerusalem.
MotionVis Donovan Parks. Outline  Project motivation and goal  Details of projects  Video showing results  Future work and conclusions.
Lecture 26 Hand Pose Estimation Using a Database of Hand Images
Video Google: Text Retrieval Approach to Object Matching in Videos
Lecture 6 Implementing Spatial Analysis
Data Transformations targeted at minimizing experimental variance
Video Google: Text Retrieval Approach to Object Matching in Videos
CSE 185 Introduction to Computer Vision
Presentation transcript:

Automated Construction of Parameterized Motions Lucas Kovar Michael Gleicher University of Wisconsin-Madison

Parameterized Motion (Wiley and Hahn ’97; Rose et al. ’98,’01; Park et al.’02) Blend (interpolate) captured motions to make new ones Map blend weights to motion features for intuitive control

Adapting Parameterized Motion to Large Data Sets Previous work used manual blending methods on small, contrived data sets. We introduce automated tools that simplify working with larger, more general data sets –Automatically locate examples –Automatic blending (discussed previously) –Accurate, efficient, and “stable” parameterization Inputs: one example + feature of interest

Outline 1.Finding example motions 2.Parameterizing blends 3.Results

Outline 1.Finding example motions 2.Parameterizing blends 3.Results

Finding Motions Example motions are buried in longer motions. Strategy: search for motion segments similar to a query. ready stancepunchdodgepunch

Related Work: Searching Time Series Databases (Faloutsos et al. ’94): place low-dimensional approximation in spatial hierarchy –(Cardle et al. ’03, Liu et al. ’03; Keogh et al. ‘04): motion data Goal: find data segments (“matches”) whose distance to query is < ε. Confuses unrelated motions with distinct variants

Logically Similar ≠ Numerically Similar!

Our Search Strategy Find “close” matches and use as new queries. Precompute potential matches to gain efficiency.

Determining Numerical Similarity Segment 1 Segment 2, Time alignment Factor out timing with a time alignment (just as with registration curves). Compare average distance between corresponding frames with threshold.

Precomputing Matches: Intuitions Any subset of an optimal path is optimal. Optimal paths are redundant under endpoint perturbation. Motion 1 Motion 2

Match Webs Compute a grid of frame distances and find long, locally optimal paths. Motion 2 Motion 1 Represents all possibly similar segments.

Searching With Match Webs At run time, intersect queries with the match web to find matches. Motion 2 Motion 1

Search Results 37,000 frame data set with ~10 kinds of motion. 50 min. to create match web, 21MB on disk All searches (up to 97 queries) in ≤ 0.5s Manual verification of accuracy –Can not discern meaning of motions! picking upputting back

Outline 1.Finding example motions 2.Parameterizing blends 3.Results

Natural Parameterizations parametersmotion Blend weights offer a poor parameterization. We need more natural parameters. reaching turning jumping hand position at apex change in hip orientation max height of center of mass

From Parameters to Blend Weights blend weights blendparameters It is easy to map blend weights to parameters. But we want ! This has no closed-form representation.

Building Parameterizations Can approximate from samples with scattered data interpolation (Rose et al ’98). Accuracy: create blends to generate new samples. (see also: Rose et al ’01)

Sampling Require sampled weights to be “nearly convex”: andfor Sample blend weights only for subsets of nearby motions.

Scattered Data Interpolation Previous work uses an RBF interpolation method that does not constrain blend weights. –(Rose et al ’98,’01); (Park et al. ’02) K-nearest-neighbor interpolation is (almost) and ensures blend weights are nearly convex.

Outline 1.Finding example motions 2.Parameterizing blends 3.Results

Results

Discussion Parameterized motions make it easy to synthesize and edit motion. We want lots of them, so we need tools that simplify their construction –Automated extraction of examples –Efficient and accurate parameterization that respects boundaries implied by data