Deep screen image crop and enhance

Slides:



Advertisements
Similar presentations
Chapter Teacher: Remah W. Al-Khatib. This lecture will cover:  The human visual system  Light and the electromagnetic spectrum  Image representation.
Advertisements

Chapter 8 Lossy Compression Algorithms. Fundamentals of Multimedia, Chapter Introduction Lossless compression algorithms do not deliver compression.
Logan Lebanoff Mentor: Haroon Idrees
Convolutional Neural Networks for Direct Text Deblurring
Lecture 4b Data augmentation for CNN training
SUPER RESOLUTION USING NEURAL NETS Hila Levi & Eran Amar Weizmann Ins
Deeply-Recursive Convolutional Network for Image Super-Resolution
Wenchi MA CV Group EECS,KU 03/20/2017
Generative Adversarial Nets
Quality Evaluation and Comparison of SVC Encoders
Object Detection based on Segment Masks
The Problem: Classification
Textual Video Prediction Week 2
Perceptual Loss Deep Feature Interpolation for Image Content Changes
Inception and Residual Architecture in Deep Convolutional Networks
Hierarchical Deep Convolutional Neural Network
Synthesis of X-ray Projections via Deep Learning
Sujay Yadawadkar, Virginia Tech
Super-resolution Image Reconstruction
Single Image Super-Resolution
Efficient Deep Model for Monocular Road Segmentation
Deep Residual Learning for Image Recognition
Presenter: Hajar Emami
Textual Video Prediction
Low Dose CT Image Denoising Using WGAN and Perceptual Loss
Deep Learning Convoluted Neural Networks Part 2 11/13/
Photoshop Tools & Techniques
Historic Document Image De-Noising using Principal Component Analysis (PCA) and Local Pixel Grouping (LPG) Han-Yang Tang1, Azah Kamilah Muda1, Yun-Huoy.
Face Recognition with Deep Learning Method
Image Classification.
Two-Dimensional Signal and Image Processing Chapter 8 - pictures
A Comparative Study of Convolutional Neural Network Models with Rosenblatt’s Brain Model Abu Kamruzzaman, Atik Khatri , Milind Ikke, Damiano Mastrandrea,
Convolutional Neural Networks for Visual Tracking
Image Enhancement in the
Image Enhancement in the
Counting in Dense Crowds using Deep Learning
Automatic Advertisement Rating
A Proposal Defense On Deep Residual Network For Face Recognition Presented By SAGAR MISHRA MECE
Visualizing CNNs and Deeper Deep Architectures
Example of a simple deep network architecture.
Video Analysis via Nonlinear Dimensionality Reduction Technique
Textual Video Prediction
Progress Report 2019/4/30 PHHung.
Car Damage Classification
U-Net: Convolutional Network for Segmentation
Task Fashion Landmark Detection. Task Fashion Landmark Detection.
Textual Video Prediction
VERY DEEP CONVOLUTIONAL NETWORKS FOR LARGE-SCALE IMAGE RECOGNITION
Angel A. Cantu, Nami Akazawa Department of Computer Science
Weeks 1 and 2 Aaron Ott.
Example of a simple deep network architecture.
Time Series Forecasting with Recurrent Neural Networks NN3 Competition Mahmoud Abou-Nasr Research & Advanced Engineering Ford Motor Company
Deep screen image crop and enhance
Deep screen image crop and enhance
End-to-End Facial Alignment and Recognition
Appearance Transformer (AT)
Deep screen image crop and enhance
Self-Supervised Cross-View Action Synthesis
End-to-End Speech-Driven Facial Animation with Temporal GANs
Actor-Object Relation in Videos
Self-Supervised Cross-View Action Synthesis
Deep screen image crop and enhance
Report 7 Brandon Silva.
Jiahe Li
Recent Developments on Super-Resolution
Truman Action Recognition Status update
CRCV REU 2019 Aaron Honculada.
Deep screen image crop and enhance
Directional Occlusion with Neural Network
Even Discrete Cosine Transform The Chinese University of Hong Kong
Presentation transcript:

Deep screen image crop and enhance Week 2 (Aaron Ott, Amir Mazaheri)

Problem We have taken a photo of an image, and we want the original image. This can be broken into 2 parts: Image Detector/Cropper Image Enhancer

Enhancer - Pretrained EDSR (trained on DIV2K) https://github.com/krasserm/super-resolution - Pretrained EDSR (trained on DIV2K) - Modified form of Resnet - Actually scales up the image 4x Lim, Son, Kim, Nah, Lee. “Enhanced Deep Residual Networks for Single Image Super-Resolution”. 10 July 2017

Combining the Cropper and Enhancer Had to use lambda functions and AveragePooling2D to get the Enhancer to properly work with the Cropper Loss Functions: - Trained Cropper on VGG+CosineProximity - Trained Enhancer on VGG+MSE

Last Week (Cropper) Metrics: PSNR: 11.1903 SSIM: 0.4254 MSE: 0.0796 Last Week (Cropper) Cropper using a Spatial Transformation Network Input Output Actual

This Week (Cropper + Enhancer) Metrics: PSNR: 15.8368 SSIM: 0.4807 MSE: 0.0316 This Week (Cropper + Enhancer) Input Output Actual

Metrics Compared Model \ Metric PSNR SSIM MSE Cropper 11.1903 0.4254 0.0796 Cropper + Enhancer 15.8368 0.4807 0.0316

Shortcomings of PSNR, SSIM, and MSE Model \ Metric PSNR SSIM MSE Cropper 11.1903 0.4254 0.0796 Cropper + Enhancer 15.8368 0.4807 0.0316 Cropper + Enhancer w/ MSE Loss 18.2626 0.5314 0.0166

Shortcomings of PSNR, SSIM, and MSE Metrics: PSNR: 18.2626 SSIM: 0.5314 MSE: 0.0166 Input Output Loss Functions VGG + Cosine Proximity MSE Actual

Next Week Create and refine GAN architecture Refine EDSR or try a different SISR (WDSR)