Data-driven Image Processing Fubo Han Images in computer graphics IMAGE: the most engaging visual content in the internet. Image Superiority.

Slides:



Advertisements
Similar presentations
Indoor Segmentation and Support Inference from RGBD Images Nathan Silberman, Derek Hoiem, Pushmeet Kohli, Rob Fergus.
Advertisements

An Interactive-Voting Based Map Matching Algorithm
Context-based object-class recognition and retrieval by generalized correlograms by J. Amores, N. Sebe and P. Radeva Discussion led by Qi An Duke University.
A Unified Framework for Context Assisted Face Clustering
Foreground Focus: Finding Meaningful Features in Unlabeled Images Yong Jae Lee and Kristen Grauman University of Texas at Austin.
TI: An Efficient Indexing Mechanism for Real-Time Search on Tweets Chun Chen 1, Feng Li 2, Beng Chin Ooi 2, and Sai Wu 2 1 Zhejiang University, 2 National.
Ming-Ming Cheng 1 Ziming Zhang 2 Wen-Yan Lin 3 Philip H. S. Torr 1 1 Oxford University, 2 Boston University 3 Brookes Vision Group Training a generic objectness.
SPONSORED BY SA2014.SIGGRAPH.ORG Annotating RGBD Images of Indoor Scenes Yu-Shiang Wong and Hung-Kuo Chu National Tsing Hua University CGV LAB.
Patch to the Future: Unsupervised Visual Prediction
Automatic scene inference for 3D object compositing Kevin Karsch (UIUC), Sunkavalli, K. Hadap, S.; Carr, N.; Jin, H.; Fonte, R.; Sittig, M., David Forsyth.
Data-driven Visual Similarity for Cross-domain Image Matching
Intelligent Systems Lab. Recognizing Human actions from Still Images with Latent Poses Authors: Weilong Yang, Yang Wang, and Greg Mori Simon Fraser University,
Grey County GIS Overview Grey County Public Works Association – April 4, 2012.
Large dataset for object and scene recognition A. Torralba, R. Fergus, W. T. Freeman 80 million tiny images Ron Yanovich Guy Peled.
Object-based Image Representation Dr. B.S. Manjunath Sitaram Bhagavathy Shawn Newsam Baris Sumengen Vision Research Lab University of California, Santa.
Centre for Water Resources Software Vietnam Water Resources Institute 269 Chua Boc – Dong Da – Ha Noi, Viet Nam.
LARGE-SCALE NONPARAMETRIC IMAGE PARSING Joseph Tighe and Svetlana Lazebnik University of North Carolina at Chapel Hill CVPR 2011Workshop on Large-Scale.
1 Visual Information Extraction in Content-based Image Retrieval System Presented by: Mian Huang Weichuan Dong Apr 29, 2004.
Visual Information Retrieval Chapter 1 Introduction Alberto Del Bimbo Dipartimento di Sistemi e Informatica Universita di Firenze Firenze, Italy.
CAP4730: Computational Structures in Computer Graphics Basic Graphics Hardware.
Agenda Introduction Bag-of-words models Visual words with spatial location Part-based models Discriminative methods Segmentation and recognition Recognition-based.
What is it? The use of computers to present text, sound, graphics, animation and video in an integrated way.
Creating and Exploring a Large Photorealistic Virtual Space INRIA / CSAIL / Adobe First IEEE Workshop on Internet Vision, associated with CVPR 2008.
SBU Digital Media CSE 690 Internet Vision Organizational Meeting Tamara Berg Assistant Professor SUNY Stony Brook.
Presenting by, Prashanth B R 1AR08CS035 Dept.Of CSE. AIeMS-Bidadi. Sketch4Match – Content-based Image Retrieval System Using Sketches Under the Guidance.
Image Based Positioning System Ankit Gupta Rahul Garg Ryan Kaminsky.
PageRank for Product Image Search Kevin Jing (Googlc IncGVU, College of Computing, Georgia Institute of Technology) Shumeet Baluja (Google Inc.) WWW 2008.
Characterizing activity in video shots based on salient points Nicolas Moënne-Loccoz Viper group Computer vision & multimedia laboratory University of.
Object Stereo- Joint Stereo Matching and Object Segmentation Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on Michael Bleyer Vienna.
NREL is a national laboratory of the U.S. Department of Energy, Office of Energy Efficiency and Renewable Energy, operated by the Alliance for Sustainable.
Having access to loads of information enables people to have a global picture of current affairs and therefore to evaluate them before drawing personal.
1 Mpeg-4 Overview Gerhard Roth. 2 Overview Much more general than all previous mpegs –standard finished in the last two years standardized ways to support:
Scale-less Dense Correspondences Tal Hassner The Open University of Israel ICCV’13 Tutorial on Dense Image Correspondences for Computer Vision.
Video Google: A Text Retrieval Approach to Object Matching in Videos Josef Sivic and Andrew Zisserman.
Eurographics 2012, Cagliari, Italy 3D Material Style Transfer Chuong H. Nguyen 1, Tobias Ritschel 2, Karol Myszkowski 1, Elmar Eisemann 2, Hans-Peter Seidel.
80 million tiny images: a large dataset for non-parametric object and scene recognition CS 4763 Multimedia Systems Spring 2008.
 Detecting system  Training system Human Emotions Estimation by Adaboost based on Jinhui Chen, Tetsuya Takiguchi, Yasuo Ariki ( Kobe University ) User's.
Semantic Wordfication of Document Collections Presenter: Yingyu Wu.
12/7/10 Looking Back, Moving Forward Computational Photography Derek Hoiem, University of Illinois Photo Credit Lee Cullivan.
Scene Completion Using Millions of Photographs James Hays, Alexei A. Efros Carnegie Mellon University ACM SIGGRAPH 2007.
Information Scent as a Driver of Web Behavior Graphs: Results of a Protocol Analysis Method for Web Usability.
Pad++: A Zooming Graphical Interface for Exploring Alternate Interface Physics Presented By: Daniel Loewus-Deitch.
“A picture is worth a thousand words…” Visual Displays of Data People have used pictures for thousands of years (long before language) to communicate.
Image Classification for Automatic Annotation
CDVS on mobile GPUs MPEG 112 Warsaw, July Our Challenge CDVS on mobile GPUs  Compute CDVS descriptor from a stream video continuously  Make.
© ACTS-MoMuSys All Rights Reserved. VOGUE The Video Object Generator with User Environment Ecole Nationale Supérieure des Mines de Paris, France.
A Multiresolution Symbolic Representation of Time Series Vasileios Megalooikonomou Qiang Wang Guo Li Christos Faloutsos Presented by Rui Li.
Semantic Extraction and Semantics-Based Annotation and Retrieval for Video Databases Authors: Yan Liu & Fei Li Department of Computer Science Columbia.
Discontinuous Displacement Mapping for Volume Graphics, Volume Graphics 2006, July 30, Boston, MA Discontinuous Displacement Mapping for Volume Graphics.
Yixin Chen and James Z. Wang The Pennsylvania State University
Soon Joo Hyun Database Systems Research and Development Lab. US-KOREA Joint Workshop on Digital Library t Introduction ICU Information and Communication.
SA2014.SIGGRAPH.ORG SPONSORED BY Automatic Semantic Modeling of Indoor Scenes from Low-quality RGB-D Data using Contextual Information Kang Chen 1 Yu-Kun.
Quiz Week 8 Topical. Topical Quiz (Section 2) What is the difference between Computer Vision and Computer Graphics What is the difference between Computer.
Learning Photographic Global Tonal Adjustment with a Database of Input / Output Image Pairs.
2D to 3D Conversion Using 3D Database For Football Scenes Kiana Calagari Final Project of CMPT880 July 2013.
Contextual Snapshots: Enriched Visualization with Interactive Spatial Annotations Peter Mindek 1, Stefan Bruckner 2,1 and M. Eduard Gröller 1 1 Institute.
Introduction to MPEG  Moving Pictures Experts Group,  Geneva based working group under the ISO/IEC standards.  In charge of developing standards for.
Che-An Wu Background substitution. Background Substitution AlphaMa p Trimap Depth Map Extract the foreground object and put into another background Objective.
Artificial Intelligence DNA Hypernetworks Biointelligence Lab School of Computer Sci. & Eng. Seoul National University.
Data mining in web applications
Visual Information Retrieval
Presenter: Waqas Nawaz
Concept Visualization for Ontologies of Learning Agents
Nonparametric Semantic Segmentation
Instagram A Mobile Partner for the Tourism Industry
Descriptions of 3-D Objects and Scenes
CHAPTER 14: Information Visualization
Human-object interaction
Motivation Semantic Transformation Module Most of the existing works neglect the semantic relationship between the visual feature and linguistic knowledge,
Marketing Strategies That Would Actually Work In 2019
Presentation transcript:

Data-driven Image Processing Fubo Han

Images in computer graphics IMAGE: the most engaging visual content in the internet. Image Superiority Effect: A picture’s worth a thousand words Images constituted 93% of the most engaging posts, compared with status updates, links, and even video.

Data-driven image processing Data-driven image processing in following aspects:  How to collect image databases  Large & well organized  How to understand the content  Automatically & efficiently  How to use the data in variant application  Strengthen old ones & create new ones

Image databases ImageNetImageNet in Stanford Vision Lab: 15 million images Tiny Images DatasetTiny Images Dataset NYU&MIT: 80 million images(Gist descriptors for each)

Scene understanding Depth TransferDepth Transfer: Depth Extraction from Video Using Non-parametric Sampling: Kevin Karsch et.al. TPAMI 2014 Nonparametric Scene Parsing via Label TransferNonparametric Scene Parsing via Label Transfer: Ce Liu et.al. TPAMI 2011

Data-driven application BiggerPictureBiggerPicture: Data-driven Image Extrapolation Using Graph Matching. Miao Wang et.al. SIGGRAPH Asia 2014 PatchNetPatchNet: A Patch-based Image Representation for Interactive Library-driven Image Editing. Shi-Min Hu et.al. SIGRAPH Asia 2013

Our work Overview of our algorithm

Our work Segmentation Graph matching segmentation matching

Conclusion Data-driven image editing becomes more powerful using content-oriented representations Combining with spatial relationships and local appearance provide an efficient way to encode the visual contents in an image library. Images not only have relationship by global similarity, but also have intrinsic inter-relationships between each visual element inside them. Organizing and utilizing images in this finer level can bring out larger potentials of the data-driven methods.

Thank you!

Data-driven application Sketch2PhotoSketch2Photo: Internet Image Montage. Tao Chen et.al. SIGGRAPH Asia 2009 ShadowDrawShadowDraw: Real-Time User Guidance for Freehand Drawing. Yong Jae Lee et.al. SIGGRAPH 2011