Video Surveillance is Useless Peter Kovesi School of Computer Science & Software Engineering The University of Western Australia.

Slides:



Advertisements
Similar presentations
Forensic Applications of Computer Vision
Advertisements

Shapelets Correlated with Surface Normals Produce Surfaces Peter Kovesi School of Computer Science & Software Engineering The University of Western Australia.
Video Surveillance: Legally Blind? Peter Kovesi School of Computer Science & Software Engineering The University of Western Australia.
Md. Monjur –ul-Hasan Department of Computer Science & Engineering Chittagong University of Engineering & Technology Chittagong 4349
Digital Signal Processing
Wavelets Fast Multiresolution Image Querying Jacobs et.al. SIGGRAPH95.
Kien A. Hua Division of Computer Science University of Central Florida.
1 Image Authentication by Detecting Traces of Demosaicing June 23, 2008 Andrew C. Gallagher 1,2 Tsuhan Chen 1 Carnegie Mellon University 1 Eastman Kodak.
Walter Huang, OD Yuanpei University Department of Optometry
Improvement of Audio Capture in Handheld Devices through Digital Filtering Problem Microphones in handheld devices are of low quality to reduce cost. This.
Visual Acuity Adler’s Physiology of the Eye 11th Ed.
IT-101 Section 001 Lecture #8 Introduction to Information Technology.
GMM-Based Multimodal Biometric Verification Yannis Stylianou Yannis Pantazis Felipe Calderero Pedro Larroy François Severin Sascha Schimke Rolando Bonal.
Temperature Dependence of FPN in Logarithmic CMOS Image Sensors Dileepan Joseph¹ and Steve Collins² ¹University of Alberta, Canada ²University of Oxford,
Fast High-Dimensional Feature Matching for Object Recognition David Lowe Computer Science Department University of British Columbia.
School of Computing Science Simon Fraser University
Multimedia for the Web: Creating Digital Excitement Multimedia Element -- Graphics.
FACE RECOGNITION BY: TEAM 1 BILL BAKER NADINE BROWN RICK HENNINGS SHOBHANA MISRA SAURABH PETHE.
Tutorial 7 Working with Multimedia. XP Objectives Explore various multimedia applications on the Web Learn about sound file formats and properties Embed.
Real-Time Face Detection and Tracking Using Multiple Cameras RIT Computer Engineering Senior Design Project John RuppertJustin HnatowJared Holsopple This.
Facial Recognition Facial recognition software - based on the ability to recognize a face and then measure the various features of the face. Each human.
Facial Recognition. 1. takes a picture of a person 2. runs that image through the database 3. finds a match and identifies the person Humans have always.
1 Basics of Digital Imaging Digital Image Capture and Display Kevin L. Lorick, Ph.D. FDA, CDRH, OIVD, DIHD.
What is it? The use of computers to present text, sound, graphics, animation and video in an integrated way.
How the Camera Works ( both film and digital )
雅虎邮箱地址 : PW:zjuopt. Chapter 2 System Evaluation.
Visual Representation of Information
Additional Material on Digitization: Aliasing By Rick Pitchford.
Associative Pattern Memory (APM) Larry Werth July 14, 2007
Tutorial 7 Working with Multimedia. XP Objectives Explore various multimedia applications on the Web Learn about sound file formats and properties Embed.
BIOMETRICS By: Lucas Clay and Tim Myers. WHAT IS IT?  Biometrics are a method of uniquely identifying a person based on physical or behavioral traits.
Graphics and Animation Multimedia Projects Part 2.
CCTV Camera Component and Technology Imaging sensor Optic - Lens Camera Technology IP vs analogue CCTV Uniview IPC features Fundamental of CCTV.
Tutorial 7 Working with Multimedia
Tutorial 7 Designing a Multimedia Web Site
Tutorial 7 Working with Multimedia. New Perspectives on HTML, XHTML, and XML, Comprehensive, 3rd Edition 2 Objectives Explore various multimedia applications.
Tutorial 7 Working with Multimedia. New Perspectives on HTML, XHTML, and XML, Comprehensive, 3rd Edition 2 Objectives Explore various multimedia applications.
Multimedia Data Introduction to Image Processing Dr Sandra I. Woolley Electronic, Electrical.
BIOMETRICS.
Visual Acuity Adler’s Physiology of the Eye 11th Ed. Chapter 33 - by Dennis Levi
IRIS RECOGNITION. CONTENTS  1. INTRODUCTION  2. IRIS RECOGNITION  3. HISTORY AND DEVELOPMENT  4. SCIENCE BEHIND THE TECHNOLOGY  5. IMAGE ACQUISITION.
Multimedia. What is a graphic?  A graphic can be a: Chart Drawing Painting Photograph Logo Navigation button Diagram.
OUTLINE I.Biometrics: What Is It? II.Why Ear Biometrics? III.Ear Biometrics IV.How A Biometric System Works V.Conclusion.
Visual Computing Computer Vision 2 INFO410 & INFO350 S2 2015
1 Machine Vision. 2 VISION the most powerful sense.
Introduction to Image Processing Representasi Citra Tahap-Tahap Kunci pada Image Processing Aplikasi dan Topik Penelitian pada Image Processing.
Introduction to Image Processing. What is Image Processing? Manipulation of digital images by computer. Image processing focuses on two major tasks: –Improvement.
Learning Photographic Global Tonal Adjustment with a Database of Input / Output Image Pairs.
1 What is Multimedia? Multimedia can have a many definitions Multimedia means that computer information can be represented through media types: – Text.
Robotics Chapter 6 – Machine Vision Dr. Amit Goradia.
WEB GRAPHICS EXPLORING COMPUTER SCIENCE - LESSON 3-4.
Face Recognition Technology By Catherine jenni christy.M.sc.
By Kyle Bickel. Road Map Biometric Authentication Biometric Factors User Authentication Factors Biometric Techniques Conclusion.
A facial recognition system is a computer application for automatically identifying or verifying a person from a digital image or a video frame from.
Smart Camera Network Localization Using a 3D Target John Kassebaum Nirupama Bulusu Wu-Chi Feng Portland State University.
© ExplorNet’s Centers for Quality Teaching and Learning 1 Objective % Understand digital graphics production methods, software, and hardware.
By: Suvigya Tripathi (09BEC094) Ankit V. Gupta (09BEC106) Guided By: Prof. Bhupendra Fataniya Dept. of Electronics and Communication Engineering, Nirma.
FACE RECOGNITION. A facial recognition system is a computer application for automatically identifying or verifying a person from a digital image or a.
3D CAMERA PRESENTATION ON By:- K.MANOJ (08M51A0449 )
Exploring Computer Science - Lesson 3-4
Visual Acuity.
Exploring Computer Science - Lesson 3-4
Gait Recognition Gökhan ŞENGÜL.
FACE RECOGNITION TECHNOLOGY
Exploring Computer Science - Lesson 3-4
Tutorial 7 Working with Multimedia
Facial Recognition in Biometrics
William Claycomb and Dongwan Shin
Bruce & Young’s model of face recognition (1986)
Higher School of Economics , Moscow, 2016
Presentation transcript:

Video Surveillance is Useless Peter Kovesi School of Computer Science & Software Engineering The University of Western Australia

Video Surveillance is Useless Peter Kovesi School of Computer Science & Software Engineering The University of Western Australia for Identification

Questions What image quality do we need for identification? How do you measure image quality? What is the image quality from a video camera? What is the effect on image quality when you: record to video tape? use frame grabbers of different quality? use image compression?

Humans are very bad at recognizing unfamiliar faces Kemp, Towell and Pike (1997) tested the value of having photos on credit cards. When a user presented a card with a photograph of someone else that had some resemblance to the user, they were challenged less than 40% of the time. Bruce et al. (1999, 2001) have tested the ability of people to match good quality CCTV images of unfamiliar faces under a variety of scenarios. Correct recognition rates are typically only 70-80%.

Good quality photograph of target Array of 10 good quality CCTV images Bruce et al (1999). Is this person in the array? If they are present match the person.

Good quality photograph of target Array of 10 good quality CCTV images When target was present in the array. 12% picked wrong person and 18% said they were not present (overall only 70% correct). When target was not present in the array 70% still matched the target to someone in the array. Bruce et al (1999). Is this person in the array? If they are present match the person.

Automated Face Recognition is improving, but there is some way to go. Face Recognition Vendor Test 2002 Identification performance results: ~ 90% for a database of about 100 individuals ~ 65-75% for a database of about 37,000 individuals (US visa application photos taken with standardized equipment and with white backgrounds)

Identification performance appears to decline with database size in a log-linear manner. database size system performance parameter

Even with good quality images face recognition performance, by human or machine, is poor. Surveillance video rarely provides good quality images.

Even with good quality images face recognition performance, by human or machine, is poor. Surveillance video rarely provides good quality images. What image quality is needed for face identification?

Image quality is defined by many attributes Minimum feature size that can be resolved Noise level Quality of luminance reproduction Quality of colour reproduction.

It is possible to build up any waveform by adding up a series of sine waves. The human visual system analyses many aspects of images in terms of different frequency components. Frequency Analysis of images Minimum feature size that can be resolved…

(Nasanen 1999) In humans it has been found that face recognition is tuned to a set of spatial frequencies ranging from about 20 cycles per face width down to about 5 cycles per face width. The most important spatial frequency for face recognition corresponds to about 10 cycles/face width. To be able to recognize with some confidence you need to be able to resolve 20 cycles/face width 20 cycles 10 cycles 5 cycles Human Face Recognition

(Nasanen 1999) In humans it has been found that face recognition is tuned to a set of spatial frequencies ranging from about 20 cycles per face width down to about 5 cycles per face width. ~ 160mm 20 cycles 10 cycles 5 cycles Human Face Recognition 8mm 16mm The most important spatial frequency for face recognition corresponds to about 10 cycles/face width. To be able to recognize with some confidence you need to be able to resolve 20 cycles/face width

1951 USAF Chart Groupings of 6 pairs of bars. Each successive set is half the size of the previous.

1951 USAF Chart Groupings of 6 pairs of bars. Each successive set is half the size of the previous. 16mm 8mm

Eye charts also provide a simple way of measuring the minimum feature size that can be resolved.

20/20 Vision… … or in metric, 6/6 vision Snellen fraction 6 6 Distance at which you should be able to read the line Distance at which you can read the line on the chart Minimum Angle of Resolution

88mm 72mm 58mm 36mm 44mm 6/6 6/12 6/24 6/48 Snellen fraction Letter height Number plate letters 80mm Average eye spacing 65mm logMAR Chart 9mm 18mm

Tests conducted with Pulnix TM6CN 1/2” CCD camera positioned 6m from the target. Images were digitized directly from the camera using a Data Translation 3155 frame grabber (a good quality monochrome digitizer). C-mount lenses: 4mm 6mm 8.5mm 12.5mm 16mm

4mm lens

6mm lens

8.5mm lens

12.5mm lens

16mm lens

Camera image recorded to video, then played back and digitized. (Look at the USAF chart) Camera image digitized directly. Expect to lose quality when images are recorded to video (cropped images taken with 12.5mm lens)

Compression is problematic. Test targets survive compression well, but faces do not. JPEG image quality 0 (14kB)JPEG image quality 4 (24kB) Original PNG image (190kB) JPEG images compressed using Photoshop. Image ‘quality’ can range from

JPEG (14kB)JPEG (24kB)Original Faces do not survive compression well

Image from a Logitech webcam (640x480 image)

A Real Surveillance Camera Installation…

4.8 m

Image quality is defined by many attributes Minimum feature size that can be resolved Noise level Quality of luminance reproduction Quality of colour reproduction.

Luminance and colour cues are at least as important as shape cues People perform about equally well using just shape information or just pigmentation cues. O’Toole et al 1999 see also Russell et al 2004 Fixed shape varying pigmentation Fixed pigmentation varying shape Original faces

Luminance and colour cues are at least as important as shape cues People perform about equally well using just shape information or just pigmentation cues. Image compression typically quantizes colour information very heavily… O’Toole et al 1999 also Russell et al 2004 Fixed shape varying pigmentation Fixed pigmentation varying shape Original faces

Conclusions Surveillance video, as it is currently used, is almost useless for identification. Surveillance cameras should be sited strategically to capture close ups of people as they pass through a constrained point, such as a doorway. Image quality standards should be developed for surveillance camera installations. Work is needed to develop measures of image degradation caused by compression.

Conclusions Identification errors will occur in biometric systems. As database sizes grow this will be an increasing problem. Claims of misidentification have to be taken seriously. Face recognition performance is poor. It should probably only be used for verification of identity (one to one test), and not for identification (one to many test).

Conclusions Identification errors will occur in biometric systems. As database sizes grow this will be an increasing problem. Claims of misidentification have to be taken seriously. Face recognition performance is poor. It should probably only be used for verification of identity (one to one test), and not for identification (one to many test). Conan O’Brien US talk show host Tarja Halonen President of Finland

Conclusions Identification errors will occur in biometric systems. As database sizes grow this will be an increasing problem. Claims of misidentification have to be taken seriously. Face recognition performance is poor. It should probably only be used for verification of identity (one to one test), and not for identification (one to many test).

Conclusions Identification errors will occur in biometric systems. As database sizes grow this will be an increasing problem. Claims of misidentification have to be taken seriously. Face recognition performance is poor. It should probably only be used for verification of identity (one to one test), and not for identification (one to many test).