Eliminating Background-Bias for Robust Person Re-identification

Slides:



Advertisements
Similar presentations
A brief review of non-neural-network approaches to deep learning
Advertisements

ImageNet Classification with Deep Convolutional Neural Networks
DeepID-Net: deformable deep convolutional neural network for generic object detection Wanli Ouyang, Ping Luo, Xingyu Zeng, Shi Qiu, Yonglong Tian, Hongsheng.
Learning Convolutional Feature Hierarchies for Visual Recognition
DeeperVision and DeepInsight Solutions
Spatial Pyramid Pooling in Deep Convolutional
From R-CNN to Fast R-CNN
Richard Socher Cliff Chiung-Yu Lin Andrew Y. Ng Christopher D. Manning
Automatic Image Annotation by Using Concept-Sensitive Salient Objects for Image Content Representation Jianping Fan, Yuli Gao, Hangzai Luo, Guangyou Xu.
INTRODUCTION Heesoo Myeong and Kyoung Mu Lee Department of ECE, ASRI, Seoul National University, Seoul, Korea Tensor-based High-order.
Skeleton Based Action Recognition with Convolutional Neural Network
Learning Features and Parts for Fine-Grained Recognition Authors: Jonathan Krause, Timnit Gebru, Jia Deng, Li-Jia Li, Li Fei-Fei ICPR, 2014 Presented by:
1 End-to-End Learning for Automatic Cell Phenotyping Paolo Emilio Barbano, Koray Kavukcuoglu, Marco Scoffier, Yann LeCun April 26, 2006.
Learning Hierarchical Features for Scene Labeling
Deep Residual Learning for Image Recognition
Deep Learning Overview Sources: workshop-tutorial-final.pdf
Deep Residual Learning for Image Recognition
Scalable Person Re-identification on Supervised Smoothed Manifold
LSUN Semantic Segmentation Extended PSPNet
CS 4501: Introduction to Computer Vision Object Localization, Detection, Semantic Segmentation Connelly Barnes Some slides from Fei-Fei Li / Andrej Karpathy.
CNN-RNN: A Unified Framework for Multi-label Image Classification
Faster R-CNN – Concepts
Deeply learned face representations are sparse, selective, and robust
Object Detection based on Segment Masks
Compact Bilinear Pooling
Data Mining, Neural Network and Genetic Programming
A Pool of Deep Models for Event Recognition
Announcements Project proposal due tomorrow
Regularizing Face Verification Nets To Discrete-Valued Pain Regression
Combining CNN with RNN for scene labeling (segmentation)
Rotational Rectification Network for Robust Pedestrian Detection
Saliency detection Donghun Yeo CV Lab..
Intro to NLP and Deep Learning
Structured Predictions with Deep Learning
Efficient Deep Model for Monocular Road Segmentation
CS6890 Deep Learning Weizhen Cai
Deep Residual Learning for Image Recognition
Presenter: Hajar Emami
Adversarially Tuned Scene Generation
Object detection.
A Convolutional Neural Network Cascade For Face Detection
Zan Gao, Deyu Wang, Xiangnan He, Hua Zhang
Aoxiao Zhong Quanzheng Li Team HMS-MGH-CCDS
Attention-based Caption Description Mun Jonghwan.
Rob Fergus Computer Vision
RGB-D Image for Scene Recognition by Jiaqi Guo
Progress Report Meng-Ting Zhong 2015/5/6.
8-3 RRAM Based Convolutional Neural Networks for High Accuracy Pattern Recognition and Online Learning Tasks Z. Dong, Z. Zhou, Z.F. Li, C. Liu, Y.N. Jiang,
Object Detection Creation from Scratch Samsung R&D Institute Ukraine
Semantic segmentation
Outline Background Motivation Proposed Model Experimental Results
RCNN, Fast-RCNN, Faster-RCNN
Iterative Crowd Counting
Learning Object Context for Dense Captioning
Zhedong Zheng, Liang Zheng and Yi Yang
边缘检测年度进展概述 Ming-Ming Cheng Media Computing Lab, Nankai University
Department of Computer Science Ben-Gurion University of the Negev
Human-object interaction
Deep Object Co-Segmentation
Motivation Semantic Transformation Module Most of the existing works neglect the semantic relationship between the visual feature and linguistic knowledge,
Semantic Segmentation
Object Detection Implementations
Presented By: Harshul Gupta
Learning Deconvolution Network for Semantic Segmentation
Jiahe Li
Dataset statistic Images:164k Instance segmentation masks:2.2 million
SDSEN: Self-Refining Deep Symmetry Enhanced Network
ICCV 2019.
CVPR 2019 Poster.
CVPR2019 Jiahe Li SiamRPN introduces the region proposal network after the Siamese network and performs joint classification and regression.
Presentation transcript:

Eliminating Background-Bias for Robust Person Re-identification Maoqing Tian, Shuai Yi, Hongsheng Li, Shihua Li, Xuesen Zhang, Jianping Shi, Junjie Yan, Xiaogang Wang CVPR 2018 Poster 2019/3/11 Xu Gao, Peking University. gaoxu1024@pku.edu.cn

Xu Gao, Peking University. gaoxu1024@pku.edu.cn Background Existing models are biased to capture too much relevance between background appearances. 已有方法忽视了background-bias,并且数据集也没有涵盖全,拍摄的camera比较少。 Probe Image Same Person Same Camera Diff Person Same Camera Similar Background Same Person Diff Camera 2019/3/11 Xu Gao, Peking University. gaoxu1024@pku.edu.cn

Investigation on Background-Bias Build four types of datasets from existing reid datasets. Network framework: Learning Deep Feature Representations with Domain Guided Dropout for Person Re-Identification. CVPR 2016. Foreground Mask: DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. ArXiv 2016. 2019/3/11 Xu Gao, Peking University. gaoxu1024@pku.edu.cn

Investigation on Background-Bias Existing model fails due to background bias. Train on the original dataset. Test on CUHK03. Reason: Overfitting the training dataset with background bias. 2019/3/11 Xu Gao, Peking University. gaoxu1024@pku.edu.cn

Investigation on Background-Bias Background can help distinguish persons? Train on the background-only dataset. Test on CUHK03. The background appearances of the same persons are usually similar in existing datasets, and the networks are easily biased by such similar backgrounds. 2019/3/11 Xu Gao, Peking University. gaoxu1024@pku.edu.cn

Investigation on Background-Bias How to eliminate background-bias? Train on the mean-background and the random-background datasets. Test on CUHK03. Conclusion: Trained model from random-background data should be much more robust to new scenes. 2019/3/11 Xu Gao, Peking University. gaoxu1024@pku.edu.cn

Xu Gao, Peking University. gaoxu1024@pku.edu.cn More Results Test on CUHK03 Test on Market1501 在此处键入公式。 2019/3/11 Xu Gao, Peking University. gaoxu1024@pku.edu.cn

The Proposed Framework Similar structure as the whole-person main network, followed by a upsampling module. Output: 4-class parsing map (background + 3 foregrounds) 2019/3/11 Xu Gao, Peking University. gaoxu1024@pku.edu.cn

The Proposed Framework Some results of the person parsing network. 2019/3/11 Xu Gao, Peking University. gaoxu1024@pku.edu.cn

Xu Gao, Peking University. gaoxu1024@pku.edu.cn Training Scheme Stage 1: Pretrain the person parsing network with LIP, Human-Parsing and MS-COCO human parsing datasets. Stage 2: The whole-person main network is train independently. Stage 3: Fix parameters of the main network, and train the person- region guided pooling sub-network. Stage 4: The main network and the guided-pooling sub-network are trained end-to-end. 2019/3/11 Xu Gao, Peking University. gaoxu1024@pku.edu.cn

Xu Gao, Peking University. gaoxu1024@pku.edu.cn Experiments Training on HumanParsing, LIP, MS-COCO. Testing on CUHK03, CUHK01, VIPER, 3dpes, Market-1501. Top-K metric. 2019/3/11 Xu Gao, Peking University. gaoxu1024@pku.edu.cn

Xu Gao, Peking University. gaoxu1024@pku.edu.cn Experiments 2019/3/11 Xu Gao, Peking University. gaoxu1024@pku.edu.cn

Evaluation on Background Influence Dataset Compare with DGD. DGD suffers great performance drop when testing on the mean- background and the random- background dataset. 2019/3/11 Xu Gao, Peking University. gaoxu1024@pku.edu.cn

Analysis of Each Component To Do: More branches … 2019/3/11 Xu Gao, Peking University. gaoxu1024@pku.edu.cn

Xu Gao, Peking University. gaoxu1024@pku.edu.cn Conclusion +Investigation on background-bias. +New ReID network with segmenting person into three parts. -More experiments could be conducted. -The framework is similar with previous works in attention. 2019/3/11 Xu Gao, Peking University. gaoxu1024@pku.edu.cn