Qiaochu Li, Qikun Guo, Saboya Yang and Jiaying Liu* Institute of Computer Science and Technology Peking University Scale-Compensated Nonlocal Mean Super.

Slides:

Advertisements

Similar presentations

Distinctive Image Features from Scale-Invariant Keypoints

Advertisements

Feature Detection. Description Localization More Points Robust to occlusion Works with less texture More Repeatable Robust detection Precise localization.

Complex Networks for Representation and Characterization of Images For CS790g Project Bingdong Li 9/23/2009.

Distinctive Image Features from Scale-Invariant Keypoints David Lowe.

A Robust Super Resolution Method for Images of 3D Scenes Pablo L. Sala Department of Computer Science University of Toronto.

3D Model Matching with Viewpoint-Invariant Patches(VIP) Reporter ：鄒嘉恆 Date ： 10/06/2009.

Author :Andrea Selinger Salgian Department of Computer Science

Road-Sign Detection and Recognition Based on Support Vector Machines Saturnino, Sergio et al. Yunjia Man ECG 782 Dr. Brendan.

Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.

The SIFT (Scale Invariant Feature Transform) Detector and Descriptor

Hongliang Li, Senior Member, IEEE, Linfeng Xu, Member, IEEE, and Guanghui Liu Face Hallucination via Similarity Constraints.

Face Alignment with Part-Based Modeling

Patch-based Image Deconvolution via Joint Modeling of Sparse Priors Chao Jia and Brian L. Evans The University of Texas at Austin 12 Sep

Patch to the Future: Unsupervised Visual Prediction

Low Complexity Keypoint Recognition and Pose Estimation Vincent Lepetit.

Temporal Video Denoising Based on Multihypothesis Motion Compensation Liwei Guo; Au, O.C.; Mengyao Ma; Zhiqin Liang; Hong Kong Univ. of Sci. & Technol.,

Recognition using Regions CVPR Outline Introduction Overview of the Approach Experimental Results Conclusion.

Natan Jacobson, Yen-Lin Lee, Vijay Mahadevan, Nuno Vasconcelos, Truong Q. Nguyen IEEE, ICME 2010.

1 Robust Video Stabilization Based on Particle Filter Tracking of Projected Camera Motion (IEEE 2009) Junlan Yang University of Illinois,Chicago.

Efficient Moving Object Segmentation Algorithm Using Background Registration Technique Shao-Yi Chien, Shyh-Yih Ma, and Liang-Gee Chen, Fellow, IEEE Hsin-Hua.

Robust Super-Resolution Presented By: Sina Farsiu.

Efficient Motion Vector Recovery Algorithm for H.264 Based on a Polynomial Model Jinghong Zheng and Lap-Pui Chau IEEE TRANSACTIONS ON MULTIMEDIA, June.

Segmentation Divide the image into segments. Each segment:

ON THE IMPROVEMENT OF IMAGE REGISTRATION FOR HIGH ACCURACY SUPER-RESOLUTION Michalis Vrigkas, Christophoros Nikou, Lisimachos P. Kondi University of Ioannina.

Automatic Image Alignment (feature-based) : Computational Photography Alexei Efros, CMU, Fall 2005 with a lot of slides stolen from Steve Seitz and.

Scale Invariant Feature Transform (SIFT)

1 LYU0503 Document Image Restoration on Mobile Phone Using Onboard Camera Supervisor: Prof. Michael R.Lyu Group Member: Leung Man Kin, Stephen Ng Ying.

1 Invariant Local Feature for Object Recognition Presented by Wyman 2/05/2006.

Automatic Image Alignment (feature-based) : Computational Photography Alexei Efros, CMU, Fall 2006 with a lot of slides stolen from Steve Seitz and.

Miguel Lourenço, João P. Barreto, Abed Malti Institute for Systems and Robotics, Faculty of Science and Technology University of Coimbra, Portugal Feature.

Overview Introduction to local features

A Scale and Rotation Invariant Approach to Tracking Human Body Part Regions in Videos Yihang BoHao Jiang Institute of Automation, CAS Boston College.

Computer vision.

1 Patch Complexity, Finite Pixel Correlations and Optimal Denoising Anat Levin, Boaz Nadler, Fredo Durand and Bill Freeman Weizmann Institute, MIT CSAIL.

1 Interest Operators Harris Corner Detector: the first and most basic interest operator Kadir Entropy Detector and its use in object recognition SIFT interest.

Recognition and Matching based on local invariant features Cordelia Schmid INRIA, Grenoble David Lowe Univ. of British Columbia.

Characterizing activity in video shots based on salient points Nicolas Moënne-Loccoz Viper group Computer vision & multimedia laboratory University of.

Overview Harris interest points Comparing interest points (SSD, ZNCC, SIFT) Scale & affine invariant interest points Evaluation and comparison of different.

Local invariant features Cordelia Schmid INRIA, Grenoble.

Tzu ming Su Advisor ： S.J.Wang MOTION DETAIL PRESERVING OPTICAL FLOW ESTIMATION 2013/1/28 L. Xu, J. Jia, and Y. Matsushita. Motion detail preserving optical.

Robust global motion estimation and novel updating strategy for sprite generation IET Image Processing, Mar H.K. Cheung and W.C. Siu The Hong Kong.

Evaluation of interest points and descriptors. Introduction Quantitative evaluation of interest point detectors –points / regions at the same relative.

Scene Completion Using Millions of Photographs James Hays, Alexei A. Efros Carnegie Mellon University ACM SIGGRAPH 2007.

Local invariant features Cordelia Schmid INRIA, Grenoble.

AdvisorStudent Dr. Jia Li Shaojun Liu Dept. of Computer Science and Engineering, Oakland University Automatic 3D Image Segmentation of Internal Lung Structures.

1 Image Matching using Local Symmetry Features Daniel Cabrini Hauagge Noah Snavely Cornell University.

Optical Flow. Distribution of apparent velocities of movement of brightness pattern in an image.

Ivica Dimitrovski 1, Dragi Kocev 2, Suzana Loskovska 1, Sašo Džeroski 2 1 Faculty of Electrical Engineering and Information Technologies, Department of.

Overview Introduction to local features Harris interest points + SSD, ZNCC, SIFT Scale & affine invariant interest point detectors Evaluation and comparison.

Markerless Augmented Reality Platform Design and Verification of Tracking Technologies Author：J.M. Zhong Date： Speaker：Sian-Lin Hong.

Journal of Visual Communication and Image Representation

Matching of Objects Moving Across Disjoint Cameras Eric D. Cheng and Massimo Piccardi IEEE International Conference on Image Processing

Presented by David Lee 3/20/2006

Speaker Min-Koo Kang March 26, 2013 Depth Enhancement Technique by Sensor Fusion: MRF-based approach.

Image features and properties. Image content representation The simplest representation of an image pattern is to list image pixels, one after the other.

Objective Quality Assessment Metrics for Video Codecs - Sridhar Godavarthy.

A. M. R. R. Bandara & L. Ranathunga

Fast edge-directed single-image super-resolution

Presented by David Lee 3/20/2006

Scale Invariant Feature Transform (SIFT)

3D Vision Interest Points.

PRESENTED BY Yang Jiao Timo Ahonen, Matti Pietikainen

Low Bit Rate Video Coding with Geometric Transformation

Super-resolution Image Reconstruction

CSE 455 – Guest Lectures 3 lectures Contact Interest points 1

KFC: Keypoints, Features and Correspondences

Source: Pattern Recognition Letters 29 (2008)

Presented by Xu Miao April 20, 2005

Recognition and Matching based on local invariant features

Detecting Digital Forgeries using Blind Noise Estimation

Presentation transcript:

Qiaochu Li, Qikun Guo, Saboya Yang and Jiaying Liu* Institute of Computer Science and Technology Peking University Scale-Compensated Nonlocal Mean Super Resolution 2013

2 Outline Introduction  Multi-frame SR  Nonlocal means SR (NLM SR) Our Algorithm  Scale-detector  Scale-Compensated NLM  Experimental results Conclusion & Future work

3 Outline Introduction  Multi-frame SR  Nonlocal means SR (NLM SR) Our Algorithm  Scale-detector  Scale-Compensated NLM  Experimental results Conclusion & Future work

4 Multi-Frame SR Converge low resolution images into a high resolution image  Direct motion estimation INVALID in complex situation

5 Nonlocal Means SR Image content repeats in neighborhoods  In temporal and spatial domains  Probabilistic motion estimation  Weighted average NLM weight distribution. The weights go from 1 (white) to 0 (black).

6 Problem Scale may be varied in frames by zooming.  Camera motion  Object motion Scale changing effects in adjacent frames. (a) Two adjacent frames, (b) some critical areas of the frames.

7 Outline Introduction  Multi-frame SR  Nonlocal means SR (NLM SR) Our Algorithm  Scale-detector  Scale-Compensated NLM  Experimental results Conclusion & Future work

8 Scale-Detector Using SIFT descriptor to compute scales Partial matched keypoints and the corresponding scale values.

9 Verification Verification of scale-detector Always appears region The performances of scale-detector in different standard scales and different resolutions, (a) average error by frame scale, (b) average error by frame resolution. (a) (b)

10 Scale-Compensated NLM SC NLM finds more similar patches Comparison of unmodified and modified patch-extractor in patch matching.

11 Procedures Overview of SC NLM Scale- detector Patch extraction & modification Patch extraction & modification NLM SR

12 Experimental Results Downsample  Blurred using 3×3 uniform mask  Decimated by 3× factor  Additive noise with standard deviation 2 Objective measurement Subjective measurement

13 Experimental Results 3×, Objective measurement (PSNR) SequenceNLMARI-SWRSC-NLM Foreman Tempete Text Man

14 Experimental Results 3×, Subjective measurement (SSIM) SequenceNLMARI-SWRSC-NLM Foreman Tempete Text Man

15 Experimental Results a) Result of whole frame. b) High resolution frame. c) NLM SR. d) SC NLM.

16 Experimental Results a) Result of whole frame. b) High resolution frame. c) NLM SR. d) SC NLM

17 Outline Introduction  Multi-frame SR  Nonlocal means SR (NLM SR) Our Algorithm  Scale-detector  Scale-Compensated NLM  Experimental results Conclusion & Future work

18 Conclusion When patches are convert into SAME SCALE, we can find more SIMILAR PATCHES, we can use more COMPLEMENTARY INFORMATION to reconstruct a HIGH RESOLUTION & QUANLITY IMAGE.

19 Future Work More accurate scale-detector  Segmentation based scale-detector Combination of rotation and translation- invariant algorithm  Rotation-invariant measurement  Translation-invariant measurement

20