Lecture 11: Quality Assessment

Slides:



Advertisements
Similar presentations
Tim Smyth and Jamie Shutler Assessment of analysis and forecast skill Assessment using satellite data.
Advertisements

Dr. Mohamed Bingabr University of Central Oklahoma
Medical Imaging Mohammad Dawood Department of Computer Science University of Münster Germany.
Introduction to Image Quality Assessment
Darlene Goldstein 29 January 2003 Receiver Operating Characteristic Methodology.
Chapter 9.2 ROC Curves How does this relate to logistic regression?
Digtial Image Processing, Spring ECES 682 Digital Image Processing Oleh Tretiak ECE Department Drexel University.
Perceived video quality measurement Muhammad Saqib Ilyas CS 584 Spring 2005.
Chapter 9.2 ROC Curves How does this relate to logistic regression?
Information Fusion Yu Cai. Research Article “Comparative Analysis of Some Neural Network Architectures for Data Fusion”, Authors: Juan Cires, PA Romo,
Biomedical Image Analysis and Machine Learning BMI 731 Winter 2005 Kun Huang Department of Biomedical Informatics Ohio State University.
Image Quality Assessment: From Error Visibility to Structural Similarity Zhou Wang.
Medical Image Analysis Introduction Figures come from the textbook: Medical Image Analysis, by Atam P. Dhawan, IEEE Press, 2003.
U N I V E R S I T À D E G L I S T U D I D I M I L A N O C17 SC for Environmental Applications and Remote Sensing I M S C I A Soft Computing for Environmental.
IIS for Image Processing Michael J. Watts
Medical Image Analysis Image Enhancement Figures come from the textbook: Medical Image Analysis, by Atam P. Dhawan, IEEE Press, 2003.
REVISED CONTEXTUAL LRT FOR VOICE ACTIVITY DETECTION Javier Ram’ırez, Jos’e C. Segura and J.M. G’orriz Dept. of Signal Theory Networking and Communications.
Medical Image Analysis Image Reconstruction Figures come from the textbook: Medical Image Analysis, by Atam P. Dhawan, IEEE Press, 2003.
EDGE DETECTION IN COMPUTER VISION SYSTEMS PRESENTATION BY : ATUL CHOPRA JUNE EE-6358 COMPUTER VISION UNIVERSITY OF TEXAS AT ARLINGTON.
Baseband Demodulation/Detection
Medical Image Analysis Dr. Mohammad Dawood Department of Computer Science University of Münster Germany.
Fundamentals of Sensation and Perception EXPLORING PERCEPTION BY STUDYING BEHAVIOUR ERIK CHEVRIER SEPTEMBER 16 TH, 2015.
Medical Imaging. What is an image? ● An image is a function – from a spatial or temporal domain – into a two, three, or four dimensional space – such.
Just Noticeable Difference Estimation For Images with Structural Uncertainty WU Jinjian Xidian University.
Templates, Image Pyramids, and Filter Banks
Functional Brain Signal Processing: EEG & fMRI Lesson 14
Pattern Classification an Diagnostic Decision Yongnan Ji.
Non-Linear Transformations Michael J. Watts
1 Marco Carli VPQM /01/2007 ON BETWEEN-COEFFICIENT CONTRAST MASKING OF DCT BASIS FUNCTIONS Nikolay Ponomarenko (*), Flavia Silvestri(**), Karen.
Introduction to Medical Imaging Week 6: Introduction to Medical Imaging Week 6: Denoising (part II) – Variational Methods and Evolutions Guy Gilboa Course.
Visual Information Processing. Human Perception V.S. Machine Perception  Human perception: pictorial information improvement for human interpretation.
Automatic Lung Cancer Diagnosis from CT Scans (Week 3)
Medical Image Analysis
Chapter-4 Single-Photon emission computed tomography (SPECT)
MAIN PROJECT IMAGE FUSION USING MATLAB
CT Multi-Slice CT.
Advanced Image Processing
PERFORMANCE ANALYSIS OF VISUALLY LOSSLESS IMAGE COMPRESSION
Medical Imaging System BME 330 Lecture 0: Opening
Research Institute for Future Media Computing
CSSE463: Image Recognition Day 11
Tone Dependent Color Error Diffusion
IIS for Image Processing
Nikolay Ponomarenkoa, Vladimir Lukina, Oleg I. Ieremeieva,
Schedule Week 1 Introduction to Common Law Horario Mon 21 Tues 22
Super-resolution Image Reconstruction
CS 698 | Current Topics in Data Science
Machine Learning Week 10.
Tone Dependent Color Error Diffusion
Improved Rooftop Detection in Aerial Images with Machine Learning
CSSE463: Image Recognition Day 11
Presenter by : Mourad RAHALI
Towards Understanding the Invertibility of Convolutional Neural Networks Anna C. Gilbert1, Yi Zhang1, Kibok Lee1, Yuting Zhang1, Honglak Lee1,2 1University.
A Review in Quality Measures for Halftoned Images
Presented by :- Vishal Vijayshankar Mishra
Foundation of Video Coding Part II: Scalar and Vector Quantization
Digital Image Processing
COSC 4214: Digital Communications
Chapter 6 (B): Thresholds and Sensory Adaptation
CSSE463: Image Recognition Day 11
Roc curves By Vittoria Cozza, matr
Image quality measures
CSSE463: Image Recognition Day 11
Lecture 7: Signal Processing
Lecture 13: CT Reconstruction
Biomedical Imaging Center
Biomedical Imaging Center
Matlab Tutorial #2 Kathleen Chen February 13, 2018.
Lecture 6: Fourier Transform
Volodymyr Bobyr Supervised by Aayushjungbahadur Rana
Presentation transcript:

Lecture 11: Quality Assessment 38655 BMED-2300-02 Lecture 11: Quality Assessment Ge Wang, PhD Biomedical Imaging Center CBIS/BME, RPI wangg6@rpi.edu February 27, 2018

BB Schedule for S18 Tue Topic Fri 1/16 Introduction 1/19 MatLab I (Basics) 1/23 System 1/26 Convolution 1/30 Fourier Series 2/02 Fourier Transform 2/06 Signal Processing 2/09 Discrete FT & FFT 2/13 MatLab II (Homework) 2/16 Network 2/20 No Class 2/23 Exam I 2/27 Quality & Performance 3/02 X-ray & Radiography 3/06 CT Reconstruction 3/09 CT Scanner 3/20 MatLab III (CT) 3/23 Nuclear Physics 3/27 PET & SPECT 3/30 MRI I 4/03 Exam II 4/06 MRI II 4/10 MRI III 4/13 Ultrasound I 4/17 Ultrasound II 4/20 Optical Imaging 4/24 Machine Learning 4/27 Exam III Office Hour: Ge Tue & Fri 3-4 @ CBIS 3209 | wangg6@rpi.edu Kathleen Mon 4-5 & Thurs 4-5 @ JEC 7045 | chens18@rpi.edu

5th Chapter

Outline General Measures MSE KL Distance SSIM System Specific Noise, SNR & CNR Resolution (Spatial, Contrast, Temporal, Spectral) Artifacts Task Specific Sensitivity & Specificity ROC & AUC Human Observer Hotelling Observer Neural Network/Radiomics

Mean Squared Error Many yi One θ

More Variants

Very Reasonable!

Information Divergence Kullback-Leibler Distance

Mutual Info as K-L Distance

Entropy

Observation: MSE=225

Structural Distortion Philosophy HVS Extracts Structural Information HVS Highly Adapted for Contextual Changes Classical “New” Bottom-up Top-down Error Visibility Structural Distortion How to define structural information? How to separate structural & nonstructural info?

Instant Classic

Example SSIM=1 SSIM=0.949 SSIM=0.989 SSIM=0.671 SSIM=0.688 MSSIM=0.723

Structural Similarity

Similarity: Luminance, Contrast, & Structure

Three Postulates

Luminance Comparison

Analysis on Luminance Term

Contrast Comparison

Analysis on Contrast Term Weber’s law, also called Weber-Fechner law, historically important psychological law quantifying the perception of change in a given stimulus. The law states that the change in a stimulus that will be just noticeable is a constant ratio of the original stimulus. It has been shown not to hold for extremes of stimulation.

Change over Background

Structural Comparison

Cauchy–Schwarz Inequality

SSIM Is Born!

Example

SSIM Extensions Color Image Quality Assessment Video Quality Assessment Multi-scale SSIM Complex Wavelet SSIM Toet & Lucassen, Displays, ’03 Wang, et al., Signal Processing: Image Communication, ’04 Wang, et al., Invited Paper, IEEE Asilomar Conf. ’03 Wang & Simoncelli, ICASSP ’05

Comments on Exam 1 in S’18

Comments on Exam 1 in S’17 2 : 95-90 3 : 90-85 4 : 85-80 5 : 80-75 6 : 75-70 7 : 70-65 8 : 65-60 9 : 60-55 10: 55-50 11: 50-45 12: 45-40

Grading Policy & Distribution’16 The final grade in this course will be based on the student total score on all components of the course. The total score is broken down into the following components: Class participation: 10% Exam I: 20% Exam II: 20% Exam III: 20% Homework: 30% Subject to further calibration

Outline General Measures MSE KL Distance SSIM System Specific Noise, SNR & CNR Resolution (Spatial, Contrast, Temporal, Spectral) Artifacts Task Specific Sensitivity & Specificity ROC & AUC Human Observer Hotelling Observer Neural Network/Radiomics

Signal to Noise Ratio (SNR)

Spatial Resolution

Modulation Transfer Function

Contrast Resolution

Metal Artifacts

Outline General Measures MSE KL Distance SSIM System Specific Noise, SNR & CNR Resolution (Spatial, Contrast, Temporal, Spectral) Artifacts Task Specific Sensitivity & Specificity ROC & AUC Human Observer Hotelling Observer Neural Network/Radiomics

Need for Task-specific Measures

Four Cases (Two Error Types) Edge Not Not Edge True Positive False Negative

Sensitivity & Specificity Likelihood of a positive case Or % of edges we find How sure we say YES Sensitivity=TP/(TP+FN) Likelihood of a negative case Or % of non-edges we find How sure we say NOPE Specificity =TN/(TN+FP)

PPV & NPV

Example

Receiver Operating Characteristic Report sensitivity & specificity Give an ROC curve Average over many data Sensitivity Any detector on this side can do better by flipping its output 1-Specificity

TPF vs FPF

Ideal Case Non-diseased Diseased Threshold

More Realistic Case Non-diseased Diseased

ROC: Less Aggressive Non-diseased TPF, Sensitivity Diseased FPF, 1-Specificity

ROC: Moderate Non-diseased TPF, Sensitivity Diseased FPF, 1-Specificity

ROC: More Aggressive Non-diseased TPF, Sensitivity Diseased FPF, 1-Specificity

ROC Curve Non-diseased TPF, Sensitivity Diseased FPF, 1-Specificity Example Adapted from Robert F. Wagner, Ph.D., OST, CDRH, FDA

Diagnostic Performance 51 Diagnostic Performance Chance Line TPF, Sensitivity Reader Skill Technology Power FPF, 1-Specificity Same Thing But Viewed Differently

Area under ROC Curve (AUC) Area Under Curve Area under ROC Curve (AUC)

Example TPF vs FPF for 108 US radiologists in study by Beam et al.

Example Chest film study by E. James Potchen, M.D., 1999

Model Observers

Imaging Model

Binary Classification

Ideal Observer

Hotelling Observer

Channelized Observer

Four Channels

Radiomics

Nonlinear Observer

Supervised Learning https://www.youtube.com/watch?v=kNPGXgzxoHw

Fuzzy XOR Problem

Deep Radiomics https://www.nature.com/articles/s41598-017-05848-2.pdf

BB11 Homework Use the MatLab code on http://www.cns.nyu.edu/~lcv/ssim/ to compute SSIM of the two photos (or other two photos): Compute sensitivity and specificity Make an example so that sensitivity and specificity are 90% and 80% respectively Due Date: Same (Week Later)