InSight: Recognizing Humans without Face Recognition He Wang, Xuan Bao, Romit Roy Choudhury, Srihari Nelakuditi.

Slides:

Advertisements

Similar presentations

Finger Gesture Recognition through Sweep Sensor Pong C Yuen 1, W W Zou 1, S B Zhang 1, Kelvin K F Wong 2 and Hoson H S Lam 2 1 Department of Computer Science.

Advertisements

Introduction.  Custom form application ◦ Create custom forms via web browser ◦ Deploy to smartphone, tablet or browser  Integrates media ◦ Attach images,

Image Retrieval: Current Techniques, Promising Directions, and Open Issues Yong Rui, Thomas Huang and Shih-Fu Chang Published in the Journal of Visual.

Kien A. Hua Division of Computer Science University of Central Florida.

1 Challenge the future HON4D: Histogram of Oriented 4D Normals for Activity Recognition from Depth Sequences Omar Oreifej Zicheng Liu CVPR 2013.

Presented by: Tom Staley. About Paper by Emiliano Miluzzo Alexander Varshavsky Suhrid Balakrishnan Romit Roy Choudhury Originally presented at MobiSys2012,

1 “Did you see Bob?”: Human Localization using Mobile Phones Ionut Constandache Co-authors: Xuan Bao, Martin Azizyan, and Romit Roy Choudhury Modified.

Spatial Histograms for Head Tracking Sriram Rangarajan Department of Electrical and Computer Engineering, Clemson University, Clemson, SC

Detecting Categories in News Video Using Image Features Slav Petrov, Arlo Faria, Pascal Michaillat, Alex Berg, Andreas Stolcke, Dan Klein, Jitendra Malik.

LING 111 Teaching Demo By Tenghui Zhu Introduction to Edge Detection Image Segmentation.

Managing Redundant Content in Bandwidth Constrained Wireless Networks Tuan Dao, Amit K. Roy- Chowdhury, Srikanth V. Krishnamurthy U.C. Riverside Harsha.

Did You See Bob?: Human Localization using Mobile Phones Constandache, et. al. Presentation by: Akie Hashimoto, Ashley Chou.

TagSense: A Smartphone-based Approach to Automatic Image Tagging - Ujwal Manjunath.

Successive Interference Cancellation: A Back of the Envelope Perspective Souvik Sen, Naveen Santhapuri, Romit Roy Choudhury, Srihari Nelakuditi I have.

SurroundSense: Mobile Phone Localization via Ambience Fingerprinting MARTIN AZIZYAN, IONUT CONSTANDACHE, ROMIT ROY CHOUDHURY Presented by Lingfei Wu.

SurroundSense: Mobile Phone Localization via Ambience Fingerprinting Written by Martin Azizyan, Ionut Constandache, & Romit Choudhury Presented by Craig.

Report on Intrusion Detection and Data Fusion By Ganesh Godavari.

Evaluation of Speak Project 2b Due March 24th. Overview Experiments to evaluate performance of your audioconference (proj2) Focus not only on how your.

Paper Title Your Name CMSC 838 Presentation. CMSC 838T – Presentation Motivation u Problem paper is trying to solve  Characteristics of problem  … u.

LYU0203 Smart Traveller with Visual Translator for OCR and Face Recognition Supervised by Prof. LYU, Rung Tsong Michael Prepared by: Wong Chi Hang Tsang.

Pedestrian Recognition Machine Perception and Modeling of Human Behavior Manfred Lau.

Smart Traveller with Visual Translator. What is Smart Traveller? Mobile Device which is convenience for a traveller to carry Mobile Device which is convenience.

Visually Fingerprinting Humans without Face Recognition

Rufeng Meng, Sheng Shen, Srihari Nelakuditi, Romit Roy Chouhury

ICA Workshop on Generalisation and Multiple Representation; August Leicester Data Enrichment for adaptive Generalisation Moritz.

OverLay: Practical Mobile Augmented Reality

PROVIDING THOROUGH PROTECTION FOR OUR CLIENTS AND THEIR ASSOCIATES. WITH BIOMETRICS INC.

Crowd++: Unsupervised Speaker Count with Smartphones Chenren Xu, Sugang Li, Gang Liu, Yanyong Zhang, Emiliano Miluzzo, Yih-Farn Chen, Jun Li, Bernhard.

Introduction --Classification Shape ContourRegion Structural Syntactic Graph Tree Model-driven Data-driven Perimeter Compactness Eccentricity.

SoundSense: Scalable Sound Sensing for People-Centric Application on Mobile Phones Hon Lu, Wei Pan, Nocholas D. lane, Tanzeem Choudhury and Andrew T. Campbell.

Presented by: Z.G. Huang May 04, 2011 Did You See Bob? Human Localization using Mobile Phones Romit Roy Choudhury Duke University Durham, NC, USA Ionut.

Satellites in Our Pockets: An Object Positioning System using Smartphones Justin Manweiler, Puneet Jain, Romit Roy Choudhury TsungYun

SurroundSense: Mobile Phone Localization via Ambience Fingerprinting Martin Azizyan, Ionut Constandache, Romit Roy Choudhury Mobicom 2009.

1 SurroundSense: Mobile Phone Localization via Ambience Fingerprinting Ionut Constandache Co-authors: Martin Azizyan and Romit Roy Choudhury.

Andrea Ricci - ISIS Brussels, 12 April 2012 Smart Grids: Overview of the study and main challenges 1.

Tracking with Unreliable Node Sequences Ziguo Zhong, Ting Zhu, Dan Wang and Tian He Computer Science and Engineering, University of Minnesota Infocom 2009.

The Collocation of Measurement Points in Large Open Indoor Environment Kaikai Sheng, Zhicheng Gu, Xueyu Mao Xiaohua Tian, Weijie Wu, Xiaoying Gan Department.

Report on Intrusion Detection and Data Fusion By Ganesh Godavari.

TapPrints: Your Finger Taps Have Fingerprints Emiliano Miluzzo*, Alex Varshavsky*, Suhrid Balakrishnan*, Romit R. Choudhury + * at&t Labs – Research, USA.

Virtual Contact Sheets Wolfgang Richter Kiryong Ha, Alok Shankar, Ardalan Amiri Sani *, Jan Harkes, Lin Zhong *, Mahadev Satyanarayanan PARALLEL DATA LABORATORY.

A Statistical Method for 3D Object Detection Applied to Face and Cars CVPR 2000 Henry Schneiderman and Takeo Kanade Robotics Institute, Carnegie Mellon.

James Pittman February 9, 2011 EEL 6788 MoVi: Mobile Phone based Video Highlights via Collaborative Sensing Xuan Bao Department of ECE Duke University.

CATA 2010 March 2010 Jewels, Himalayas and Fireworks, Extending Methods for Visualizing N Dimensional Clustering W. Jockheck Dept. of Computer Science.

Counting How Many Words You Read

1 SurroundSense: Mobile Phone Localization via Ambience Fingerprinting.

Review Future Technology. Definition Biometrics refers to technologies used to detect and recognize human physical characteristics.

An Image Retrieval Approach Based on Dominant Wavelet Features Presented by Te-Wei Chiang 2006/4/1.

MACHINE VISION GROUP MOBILE FEATURE-CLOUD PANORAMA CONSTRUCTION FOR IMAGE RECOGNITION APPLICATIONS Miguel Bordallo, Jari Hannuksela, Olli silvén Machine.

Data Mining for Surveillance Applications Suspicious Event Detection Dr. Bhavani Thuraisingham.

CS332 Visual Processing Department of Computer Science Wellesley College High-Level Vision Face Recognition I.

Query by Image and Video Content: The QBIC System M. Flickner et al. IEEE Computer Special Issue on Content-Based Retrieval Vol. 28, No. 9, September 1995.

Classifying Covert Photographs CVPR 2012 POSTER. Outline  Introduction  Combine Image Features and Attributes  Experiment  Conclusion.

By Guadalupe Mondaca. This picture follows the rule of thirds because the bench and the tree aren’t at the center of the picture they are in the first.

Introduction to Biometrics Dr. Bhavani Thuraisingham The University of Texas at Dallas Lecture #6 Guest Lecture + Some Topics in Biometrics September 12,

BeNeFri University Vision assistance for people with serious sight problems Moreno Colombo Marin Tomić Future User Interfaces, BeNeFri University.

What is your favorite color?

Adam Kortylewski Departement of Mathematics and Computer Science

Digital Video Library - Jacky Ma.

AutoLabel: Labeling Places from Pictures and Websites

Content-Based Image Retrieval Readings: Chapter 8:

Personalized Social Image Recommendation

Object Recognition in the Dynamic Link Architecture

TagSense: A Smartphone-based Approach to Automatic Image Tagging

By Pradeep C.Venkat Srinath Srinivasan

Presentation Outlines

Pattern Recognition Binding Edge Detection

T H E P U B G P R O J E C T.

Mole: Motion Leaks through Smartwatch Sensors

Presentation transcript:

InSight: Recognizing Humans without Face Recognition He Wang, Xuan Bao, Romit Roy Choudhury, Srihari Nelakuditi

Motivation – Application Scenarios 2 2 share a ride to airport Bob Elle Bret

Overview – Self-Fingerprints 3 Cloud Bret Bob John Elle Self-Fingerprints

Overview – Recognition 4 Cloud Glass

Overview – Recognition 5 Cloud Glass

Overview – Recognition 6 Cloud Glass

Challenges Perspectives are different Clothes have wrinkles Lighting conditions change 7

Extracting Fingerprints 8 Colors Patterns Spatiograms Wavelets

Extracting Fingerprints – Colors 9 RGBHSV Spatiograms Color Conversion

Extracting Fingerprints – Colors RGBHSV 10 color histogram spatial distribution Spatiograms

Extracting Fingerprints – Patterns 11 Wavelets Wavelet sub-bands: vertical, horizontal and diagonal dimensions.

Fingerprint Matching 12 Cloud Glass Matching Spatiograms S = {n’, µ’, σ’} S = {n, µ, σ} cloud glass Similarity = color histograms spatial distributions

Fingerprint Matching 13 Cloud Glass Matching Wavelets Bagged Decision Tree (BDT) W = {f 1, f 2, f 3,…} W = {f 1 ’, f 2 ’, f 3 ’,…} cloud glass

Evaluation Setting PivotHead glass captured users from the front. 15 users was dressed in their regular attires. Users actively used their smartphones. Phone opportunistically took “proﬁle” pictures of the user. 14

Evaluation - Matching Color Spatiograms front

Evaluation - Matching Wavelets of Patterns front

Evaluation – Combining Colors and Patterns 17 Evaluation – front

Evaluation – Performance with Self-Fingerprints Matching front view 18 front

Self-fingerprints may not be Sufficient Clothes’ difference is not captured when clothes are similar? Clothes have different colors/patterns at the back? 19 Bret Paul Dan Bret

Refining the Self-Fingerprint (Similar Clothes) Cloud Dan Paul Glass Cannot recognize!

Refining the Self-Fingerprint (Similar Clothes) 21 Cloud Glass Dan Bob John refining self- fingerprint

Refining the Self-Fingerprint (Similar Clothes) 22 Dan Paul Cloud Glass Can recognize after refinement!

Refining the Self-Fingerprint 23 Dan Dan = {F1} Dan = {F1, F2} Dan = {F1, F2, F3} F1 F2 F2 F3

Refining the Self-Fingerprint (Back View) 24 Glass Cloud refining back view fingerprint Bret

Evaluation – Performance with Self-Fingerprints Matching back view 25 back

Evaluation – Performance with Refined Fingerprints Matching back view after refining fingerprints 26 back

Discussion Privacy of opportunistic pictures o User consent before uploading Overlapping users in view o Fingerprint refinement helps Incremental deployment with some non-participants o More time and mobility help Cloud vs p2p o Different trade-offs 27

Conclusion Colors and patterns on clothes help ﬁngerprint humans. Preliminary evaluation with 15 people provides promising results. Other type of fingerprints exists such as motion. 28

29 Looking for interns Anyone for beer after this talk? New Primitive for Broadcasting to Visible Vicinity.

Questions, Comments? Thank You