Image Processing and Multi-domain Translation

Slides:



Advertisements
Similar presentations
Face Recognition: A Convolutional Neural Network Approach
Advertisements

The Extended Cohn-Kanade Dataset(CK+):A complete dataset for action unit and emotion-specified expression Author:Patrick Lucey, Jeffrey F. Cohn, Takeo.
FACIAL EMOTION RECOGNITION BY ADAPTIVE PROCESSING OF TREE STRUCTURES Jia-Jun Wong and Siu-Yeung Cho Forensic and Security Lab School of Computer Engineering.
Aula 5 Alguns Exemplos PMR5406 Redes Neurais e Lógica Fuzzy.
Smart Traveller with Visual Translator for OCR and Face Recognition LYU0203 FYP.
AN ANALYSIS OF SINGLE- LAYER NETWORKS IN UNSUPERVISED FEATURE LEARNING [1] Yani Chen 10/14/
MACHINE LEARNING AND ARTIFICIAL NEURAL NETWORKS FOR FACE VERIFICATION
Viewpoint Tracking for 3D Display Systems A look at the system proposed by Yusuf Bediz, Gözde Bozdağı Akar.
Face Recognition Using Neural Networks Presented By: Hadis Mohseni Leila Taghavi Atefeh Mirsafian.
SSIP Project 2 GRIM GRINS Michal Hradis Ágoston Róth Sándor Szabó Ilona Jedyk Team 2.
Hurieh Khalajzadeh Mohammad Mansouri Mohammad Teshnehlab
Face Recognition System By Arthur. Introduction  A facial recognition system is a computer application for automatically identifying or verifying a person.
Object Recognition in Images Slides originally created by Bernd Heisele.
Dr. Z. R. Ghassabi Spring 2015 Deep learning for Human action Recognition 1.
The Viola/Jones Face Detector A “paradigmatic” method for real-time object detection Training is slow, but detection is very fast Key ideas Integral images.
Evaluation of Gender Classification Methods with Automatically Detected and Aligned Faces Speaker: Po-Kai Shen Advisor: Tsai-Rong Chang Date: 2010/6/14.
ZAGAZIG UNIVERSITY-BENHA BRANCH SHOUBRA FACULTY OF ENGINEERING ELECTRICAL ENGINGEERING DEPT. COMPUTER SYSTEM DIVISION GRAUDATION PROJECT 2003.
Facial Smile Detection Based on Deep Learning Features Authors: Kaihao Zhang, Yongzhen Huang, Hong Wu and Liang Wang Center for Research on Intelligent.
Under Guidance of Mr. A. S. Jalal Associate Professor Dept. of Computer Engineering and Applications GLA University, Mathura Presented by Dev Drume Agrawal.
Face Recognition based on 2D-PCA and CNN
Big data classification using neural network
Hybrid Deep Learning for Reflectance Confocal Microscopy Skin Images
Deep Learning for Dual-Energy X-Ray
Automatic Lung Cancer Diagnosis from CT Scans (Week 1)
Department of Psychology Stephen F. Austin State University
Convolutional Neural Network
Deeply learned face representations are sparse, selective, and robust
The Relationship between Deep Learning and Brain Function
Object Detection based on Segment Masks
Deep Learning Amin Sobhani.
Compact Bilinear Pooling
Automatic Lung Cancer Diagnosis from CT Scans (Week 2)
Sentence Modeling Representation of sentences is the heart of Natural Language Processing A sentence model is a representation and analysis of semantic.
AHED Automatic Human Emotion Detection
Saliency-guided Video Classification via Adaptively weighted learning
Performance of Computer Vision
Automatic Lung Cancer Diagnosis from CT Scans (Week 4)
ABSTRACT FACE RECOGNITION RESULTS
Proposed architecture of a Fully Integrated
Hybrid Features based Gender Classification
Recovery from Occlusion in Deep Feature Space for Face Recognition
Classification of Hand-Written Digits Using Scattering Convolutional Network Dongmian Zou Advisor: Professor Radu Balan.
Mean Euclidean Distance Error (mm)
The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression By: Patrick Lucey, Jeffrey F. Cohn, Takeo.
A Convolutional Neural Network Cascade For Face Detection
Finding Clusters within a Class to Improve Classification Accuracy
Multiple Organ Detection in CT Volumes using CNN Week 2
Bird-species Recognition Using Convolutional Neural Network
Introduction to Neural Networks
A Comparative Study of Convolutional Neural Network Models with Rosenblatt’s Brain Model Abu Kamruzzaman, Atik Khatri , Milind Ikke, Damiano Mastrandrea,
Vessel Extraction in X-Ray Angiograms Using Deep Learning
AHED Automatic Human Emotion Detection
Detecting Myocardial Infarctions (Heart Attack) using Neural Network
Age and Gender Classification using Convolutional Neural Networks
Lecture: Deep Convolutional Neural Networks
YOLO-LITE: A Real-Time Object Detection Web Implementation
AHED Automatic Human Emotion Detection
Machine Learning based Data Analysis
Housam Babiker, Randy Goebel and Irene Cheng
AHED Automatic Human Emotion Detection
Heterogeneous convolutional neural networks for visual recognition
Face Recognition: A Convolutional Neural Network Approach
CIS 519 Recitation 11/15/18.
Human-object interaction
MULTI-VIEW VISUAL SPEECH RECOGNITION BASED ON MULTI TASK LEARNING HouJeung Han, Sunghun Kang and Chang D. Yoo Dept. of Electrical Engineering, KAIST, Republic.
THE TOPICS AND TITLES OF RESEARCH
End-to-End Facial Alignment and Recognition
Report 2 Brandon Silva.
Fig. 1 Fully unified pipeline for wild chimpanzee face tracking and recognition from raw video footage. Fully unified pipeline for wild chimpanzee face.
Presented By: Firas Gerges (fg92)
Presentation transcript:

Image Processing and Multi-domain Translation Martin Takáč , Judy Lu, Xi He, Shihwei Wang We have developed a convolutional neural network (CNN) to classify human facial emotions and accomplish real time facial emotion recognition. We use transfer learning on the fully- connected layers of an existing convolutional neural network which was trained for human emotion classification. A variety of datasets, as well as our own unique image dataset, is used to train the model. So far, an overall training accuracy of 90% is achieved. Introduction Emotions Detection To train the neural network model, we use two different datasets: the extended Cohn-Kanade dataset (CK+) and the Japanese Female Facial Expression (JAFFE) database. Figure 1 (a) Japanese Female Facial Expression (JAFFE) database (b) Cohn-Kanade dataset (CK+) StarGAN To do facial attribute translation, train StarGAN on dataset CelebA (200,000 images, 40 facial binary attributes). To do facial emotion translation, train StarGAN on the same image datasets (7 types of emotions) as emotions detection. Figure 2 (a) CelebA dataset attributes labels (b) CelebA image Data Preparation Model Architecture Datasets Image Processing: Emotions Detection Emotions Detection: Convolutional Neural Network Figure 4 CNN StarGAN Procedures StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation StarGAN's model takes both image and domain information as inputs and learns to translate the input image into the corresponding domain flexibly.  In this project, we proposed StarGAN to perform image-to-image translations for multiple domains using only a single model. We are working on facial attribute and facial emotion transfer. Data Augmentation Facial attribute translation Figure 3 Procedures: data preparation, tuned model, train model, apply “Don’t forget to smile” 😄 Combine emotions detector and generator to develop a model to translate all facial emotions to smile. Future Works Facial emotion translation [1] “Coding facial expressions with gabor wavelets,” in Automatic Face and Gesture Recognition, 1998. Proceedings. Third IEEE In- ternational Conference on, pp. 200–205, Apr 1998. [2] Computer Vision and Pattern Recognition [3] Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Confer- ence on, pp. 94–101, June 2010 References