H. R. Sheikh, A. C. Bovik, “Image Information and Visual Quality,” IEEE Trans. Image Process., vol. 15, no. 2, pp. 430-444, Feb. 2006 Lab for Image and.

Slides:



Advertisements
Similar presentations
Evaluating Color Descriptors for Object and Scene Recognition Koen E.A. van de Sande, Student Member, IEEE, Theo Gevers, Member, IEEE, and Cees G.M. Snoek,
Advertisements

Forecasting Using the Simple Linear Regression Model and Correlation
A No-Reference Image Blur Metric Based on the Cumulative Probability of Blur Detection (CPBD) Niranjan D. Narvekar and Lina J. Karam, Senior Member, IEEE.
Artifact and Textured region Detection - Vishal Bangard.
Hiroyuki Takeda, Hae Jong Seo, Peyman Milanfar EE Department University of California, Santa Cruz Jan 11, 2008 Statistical Image Quality Measures.
Guillaume Lavoué Mohamed Chaker Larabi Libor Vasa Université de Lyon
“POLITEHNICA” UNIVERSITY OF TIMIOARA FACULTY OF ELECTRONICS AND TELECOMMUNICATIONS DEPARTMENT OF COMMUNICATIONS DIPLOMA THESIS VIDEO QUALITY ASSESSMENT.
1 Wavelets and compression Dr Mike Spann. 2 Contents Scale and image compression Signal (image) approximation/prediction – simple wavelet construction.
Chinese University of Hong Kong Department of Information Engineering A Capacity Estimate Technique for JPEG-to-JPEG Image Watermarking Peter Hon Wah Wong.
Image Information and Visual Quality Hamid Rahim Sheikh and Alan C. Bovik IEEE Transactions on Image Processing, Feb Presented by Xiaoli Wang for.
Introduction to Image Quality Assessment
Mean Squared Error : Love It or Leave It ?. Why do we love the MSE ? It is simple. It has a clear physical meaning. The MSE is an excellent metric in.
SUSAN: structure-preserving noise reduction EE264: Image Processing Final Presentation by Luke Johnson 6/7/2007.
Independent Component Analysis (ICA) and Factor Analysis (FA)
EE565 Advanced Image Processing Copyright Xin Li Statistical Modeling of Natural Images in the Wavelet Space Parametric models of wavelet coefficients.
1 Blind Image Quality Assessment Based on Machine Learning 陈 欣
Quantitative Business Analysis for Decision Making Simple Linear Regression.
Perceived video quality measurement Muhammad Saqib Ilyas CS 584 Spring 2005.
Colour Image Compression by Grey to Colour Conversion Mark S. Drew 1, Graham D. Finlayson 2, and Abhilash Jindal 3 1 Simon Fraser University 2 University.
(1) A probability model respecting those covariance observations: Gaussian Maximum entropy probability distribution for a given covariance observation.
Image Quality Assessment: From Error Visibility to Structural Similarity Zhou Wang.
School of Electrical & Computer Engineering Image Denoising Using Gaussian Scale Mixtures in the Wavelet domain Alex Cunningham Ben Clarke Dy narath Eang.
Under the guidance of Dr. K R. Rao Ramsanjeev Thota( )
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 12 Describing Data.
Correlation.
UF S.Klimenko LIGO-G Z l Introduction l Goals of this analysis l Coherence of power monitors l Sign X-Correlation l H2-L1 x-correlation l Conclusion.
Comparative study of various still image coding techniques. Harish Bhandiwad EE5359 Multimedia Processing.
بسمه تعالی IQA Image Quality Assessment. Introduction Goal : develop quantitative measures that can automatically predict perceived image quality. 1-can.
What is Image Quality Assessment?
MULTIMEDIA PROCESSING (EE 5359) SPRING 2011 DR. K. R. RAO PROJECT PROPOSAL Error concealment techniques in H.264 video transmission over wireless networks.
Implementation of AIC based on I-frame only coding in H.264 and comparison with other still frame image coding standards such as JPEG, JPEG 2000, JPEG-LS,
Updating the Standard Spatial Observer for contrast detection Summary Watson and Ahumada (2005) constructed a Standard Spatial Observer (SSO) model for.
Purdue University Page 1 Color Image Fidelity Assessor Color Image Fidelity Assessor * Wencheng Wu (Xerox Corporation) Zygmunt Pizlo (Purdue University)
R. Ray and K. Chen, department of Computer Science engineering  Abstract The proposed approach is a distortion-specific blind image quality assessment.
MDDSP Literature Survey Presentation Eric Heinen
Templates and Image Pyramids Computational Photography Derek Hoiem, University of Illinois 09/03/15.
Robert Edge  Dr. James Walker  Mathematics  University of Wisconsin-Eau Claire Universal Image Quality PSNR IQI BEST IQI BOATASWDRJPEGASWDRJPEG 1:
School of Electrical & Computer Engineering Image Denoising Using Steerable Pyramids Alex Cunningham Ben Clarke Dy narath Eang ECE November 2008.
PS221 project : pattern sensitivity and image compression Eric Setton - Winter 2002 PS221 Project Presentation Pattern Sensitivity and Image Compression.
Single Image Super-Resolution: A Benchmark Chih-Yuan Yang 1, Chao Ma 2, Ming-Hsuan Yang 1 UC Merced 1, Shanghai Jiao Tong University 2.
Advances in digital image compression techniques Guojun Lu, Computer Communications, Vol. 16, No. 4, Apr, 1993, pp
REGRESSION DIAGNOSTICS Fall 2013 Dec 12/13. WHY REGRESSION DIAGNOSTICS? The validity of a regression model is based on a set of assumptions. Violation.
Department of computer science and engineering Evaluation of Two Principal Image Quality Assessment Models Martin Čadík, Pavel Slavík Czech Technical University.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Model Building and Model Diagnostics Chapter 15.
Vamsi Krishna Vegunta University of Texas, Arlington
Regression Analysis1. 2 INTRODUCTION TO EMPIRICAL MODELS LEAST SQUARES ESTIMATION OF THE PARAMETERS PROPERTIES OF THE LEAST SQUARES ESTIMATORS AND ESTIMATION.
1 Marco Carli VPQM /01/2007 ON BETWEEN-COEFFICIENT CONTRAST MASKING OF DCT BASIS FUNCTIONS Nikolay Ponomarenko (*), Flavia Silvestri(**), Karen.
By: Santosh Kumar Muniyappa ( ) Guided by: Dr. K. R. Rao Final Report Multimedia Processing (EE 5359)
Spread Spectrum and Image Adaptive Watermarking A Compare/Contrast summary of: “Secure Spread Spectrum Watermarking for Multimedia” [Cox ‘97] and “Image-Adaptive.
Objective Quality Assessment Metrics for Video Codecs - Sridhar Godavarthy.
Date of download: 5/30/2016 Copyright © 2016 SPIE. All rights reserved. Comparison of images with different perceptual qualities: (a) original image, (b)
Heechul Han and Kwanghoon Sohn
No-reference Image Quality Assessment for High Dynamic Range Images
Fuzzy type Image Fusion using hybrid DCT-FFT based Laplacian Pyramid Transform Authors: Rajesh Kumar Kakerda, Mahendra Kumar, Garima Mathur, R P Yadav,
Regression Analysis AGEC 784.
Structure Similarity Index
PERFORMANCE ANALYSIS OF VISUALLY LOSSLESS IMAGE COMPRESSION
Nikolay Ponomarenkoa, Vladimir Lukina, Oleg I. Ieremeieva,
Regression-Based Prediction for Artifacts in JPEG-Compressed Images
Structural Similarity Index
A Review in Quality Measures for Halftoned Images
Comparative study of various still image coding techniques.
Texture Image Extrapolation for Compression
Digital television systems (DTS)
Origin and Function of Tuning Diversity in Macaque Visual Cortex
Author: Minoru Kuribayashi, Hatsukazu Tanaka
Image quality measures
Detecting Hidden Message Using Higher Order Statistical Models Hany Farid By Jingyu Ye Yiqi Hu.
A Second Order Statistical Analysis of the 2D Discrete Wavelet Transform Corina Nafornita1, Ioana Firoiu1,2, Dorina Isar1, Jean-Marc Boucher2, Alexandru.
Presentation transcript:

H. R. Sheikh, A. C. Bovik, “Image Information and Visual Quality,” IEEE Trans. Image Process., vol. 15, no. 2, pp , Feb Lab for Image and Video Engi., Dept. of ECE Univ. of Texas at Austin

Outline  Introduction of Image Quality Assessment  Visual Information Fidelity  Experiments and Results  Conclusion

Quality Assessment (QA)  For testing, optimizing, bench-marking, and monitoring applications. Quality?

Three Broad QA Categories  Full-Reference (FR) QA Methods  Non-Reference (NR) QA Methods  Reduced-Reference (RR) QA Methods Reference Image Distorted Image FR QA Quality

PSNR  Simple but not close to human visual quality Contrast enhancement Blurred JPEG compressed VIF = 1.10 VIF = 0.07 VIF = 0.10

Prior Arts  Image Quality Assessment based on Error Sensitivity CSF: Contrast Sensitivity Function Channel Decomposition: DCT or Wavelet Transform Error Normalization: Convert the Error into Units of Just Noticeable Difference (JND) Error Pooling:

Problems of Error-Sensitivity Approaches  The Quality Definition Problem  The Suprathreshold Problem  The Natural Image Complexity Problem  The Decorrelation Problem  The Cognitive Interaction Problem

Visual Information Fidelity Natural Image Source Channel (Distortion) Channel (Distortion) HVS CD F E Reference Image Test Image Human Visual System Reference Image Information Human Visual System Test Image Information

Definition of VIF Natural Image Source Channel (Distortion) Channel (Distortion) HVS CD F E

Source Model  The natural images are modeled in the wavelet domain using Gaussian scale mixtures (GSMs). The subband coefficients are partitioned into nonoverlapping blocks of M coefficients each

Gaussian scale mixture (GSM)  Wavelet coefficient => non-Gaussian The variance is proportional to the squared magnitudes of coefficients at spatial positions. V. Strela, J. Portilla, and E. Simoncelli, “Image denoising using a local Gaussian scale mixture model in the wavelet domain,” Proc. SPIE, vol. 4119, pp. 363–371, 2000.

Implementation Issues  Assumption about the source model: V. Strela, J. Portilla, and E. Simoncelli, “Image denoising using a local Gaussian scale mixture model in the wavelet domain,” Proc. SPIE, vol. 4119, pp. 363–371, 2000.

Distortion Model

Distorted Images Synthesized versions

Distorted Images

Human Visual System (HVS) Model Natural Image Source Channel (Distortion) Channel (Distortion) HVS CD F E

Visual Information Fidelity Criterion (IFC) Natural Image Source Channel (Distortion) Channel (Distortion) HVS CD F E CE Mutual Information I(C;E)

Mutual Information  Assuming that G, and are known C E Mutual Information I(C;E)

Mutual Information

Implementation Issues  Assumption about the source model: V. Strela, J. Portilla, and E. Simoncelli, “Image denoising using a local Gaussian scale mixture model in the wavelet domain,” Proc. SPIE, vol. 4119, pp. 363–371, 2000.

Implementation Issues  Assumption about the distortion model: use B x B window centered at coefficient i to estimate and at i  Assumption about the HVS model: Hand-optimize the value of (by linear regression)

Definition of VIF Natural Image Source Channel (Distortion) Channel (Distortion) HVS CD F E

Experiments  Twenty-nine high-resolution(768x512) 24- bits/pixel RGB color images  Five distortion types: JPEG 2000, JPEG, white noise in RGB components, Gaussian blur, and transmission errors  human observers  Perception of quality: “Bad,” “Poor,” “Fair,” “Good,” and “Excellent”  Scale to range and obtain the difference mean opinion score (DMOS) for each distorted image  Data base:

Scatter Plots for Four Objective Quality Criteria (x) JPEG2000, (+) JPEG, (o) white noise in RGB space, (box) Gaussian blur, and (diamond) transmission Errors in JPEG2000 stream over fast-fading Rayleigh channel

Scatter Plots for the Quality Prediction

Validation Scores THE VALIDATION CRITERIA ARE: CORRELATION COEFFICIENT (CC), MEAN ABSOLUTE ERROR (MAE), ROOT MEAN-SQUARED ERROR (RMS), OUTLIER RATIO(OR), AND SPEARMAN RANK-ORDER CORRELATION COEFFICIENT (SROCC) Two version of VIF: VIF using the finest resolution at all orientations and Using the horizontal and vertical orientations only

Cross-Distortion Performance

(dark solid) JPEG2000, (dashed) JPEG, (dotted) white noise, (dash-dot) Gaussian blur, and (light solid) transmission errors in JPEG2000 stream over fast-fading Rayleigh channel

Dependence on the HVS Parameter Dependence of VIF performance on the parameter. (solid) VIF, (dashed) PSNR, (dash-dot) Sarnoff JNDMetrix 8.0, and (dotted) MSSIM.

Conclusion  A VIF criterion for full-reference image QA is presented.  The VIF was demonstrated to be better than a state-of-the-art HVS-based method, the Sarnoff’s JND-Metrix, as well as a state-of-the-art structural fidelity criterion, the SSIM index  The VIF provides the ability to predict the enhanced image quality by contrast enhancement operation.

Reference 1. H. R. Sheikh, A. C. Bovik, “Image Information and Visual Quality,” IEEE Trans. Image Process., vol. 15, no. 2, pp , Feb H. R. Sheikh, A. C. Bovik, and G. de Veciana, “An information fidelity criterion for image quality assessment using natural scene statistics,” IEEE Trans. Image Process., vol. 14, no. 12, pp. 2117–2128, Dec Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image quality assessment: From error measurement to structural similarity,” IEEE Trans. Image Process., vol. 13, no. 4, pp. 600–612, Apr V. Strela, J. Portilla, and E. Simoncelli, “Image denoising using a local Gaussian scale mixture model in the wavelet domain,” Proc. SPIE, vol. 4119, pp. 363–371, 2000.