FINAL PRESENTATION HiMax: Facial Biometrics With a CogniMem Device (Neural Processor)

Presentation Overview: Team and Member Introduction Brief Project Overview Block Diagrams - Controlled Environment (Standard and Variable Settings) - CogniMem Device and Software Development Kits - CogniMem Device (Details) - Laptop Temporary Setup & Training (CogniSight Control Panel) Approaches – Phase 1 (Completed); Discussion of results and “lesson-learned” – Phase 2 (ON-HOLD); Controlled Group Characterization – Phase 3 (ON-HOLD): Un-controlled Group (Noise) Introduction – Phase 4 (Maybe): It depends on Phase 2 & 3 results. Got Problems!? (Yes, we had some!) End of Semester Project Goals Project Timeline Presentation Summary Q&A session

EE Advisor: Dr. Tep Dobry ICS-Sub Advisors: Dr. Neil Scott Dr. Winyu Chinthammit Members: Raymundo Flores James Cuaresma FINAL PRESENTATION HiMax: Biometrics With a CogniMem Device (Neural Processor)

Project Overview: This technology is fairly new, so we propose: 1. Research methodology for an “efficient training” of the CogniMem Neural processor. 2. Concurrently, develop “reproducible procedures” for a "high-level confidence" for “Facial Biometric recognition” application in a static physical environment. 3. As needed, create hardware interface with the device; develop software for a particular application.

Block Diagram: Controlled Environment Diagram Side View Top View Standard Settings: - Method of training: Easy-Video Recognition - Image Recognition Type: Moderate - Region Of Interest (ROI): (244,126)-(208,195) - Light elevations: 65.5” Variable Settings - Refer to Scripted Matrix Call-out

Block Diagram: CogniMem Device and Applications

Block Diagram: CogniMem Device (Details)

Block Diagram: Laptop Temporary Setup & Training (CogniSight Control Panel)

Approaches: Phase 1 (Completed)  Create a “controlled environment” to characterize the Biometric limits of the CogniMem device with respect to known environmental changes (more elaboration is just a sec).  “Lesson learned “ comprehensive review of result (completed). Phase 2  With lesson learned in Phase 1 and suggestions from advisors, will implement a controlled-group “open environment” characterization/testing of the device (more elaboration is just a sec). Phase 3  Introduce testing of the uncontrolled-group (False-Positives) Phase 4  Control group & Uncontrolled Group unscripted open-environment testing.

Phase 1: Results  Result Discussion: o Lighting Variation Effects o External Facial Accessories Variation Effect o Facial Change Variation Effects o Facial Expression Variation Effects

Phase 1: Lesson Learned o Perform training in “general office lighting environment” o “Zoom-in” ROI size to facial contour. o If possible, set camera configurations to “manual mode” (i.e. shutter speed, gain, etc.) o First neuron committed should be on the background environment. o CogniMem device is somewhat unstable. - Froze 3X (after 10, 2 & 40 minutes of operation). - Uncontrolled neuron assignment.

Phase 1: Region Of Interest Phase 2: Region Of Interest

What’s next? Phase 2 (On-Hold) Phase 2  With lesson learned in Phase 1: o Will implement a controlled-group “open environment” characterization/testing/modified deception testing of the device.  Concurrently, research causes for the o CogniMem to “freeze” o Uncontrolled neuron assignment o USB port assignment erratic

What’s next? Phase 3 Phase 3  Introduction of uncontrolled group (noise) to characterize “False-Positive” recognition.  Control group (thru external & facial manipulation) to deceive & create “Positive  Unknown” identification

What’s next? Phase 4 Phase 4  Control group (with external & facial deception) and uncontrolled group unscripted open environment testing.  Real life simulation.

Problems (Yes, we have them): Hardware & Software o CogniMem becomes unresponsive o Uncontrolled neuron assignments (without any keyboard or mouse activity); normally happens right after the CogniMem device becomes unresponsive. o USB port assignment erratic Legal (Privacy) Issues o Privacy Act of 1974 o Letters and Forms Consent Letter Protection, handling, storage, and use of collected ‘digital facial biometric information’. Inter-Disciplinary Dynamics (EE-ICS) o Professional conflict goal resolution.

End of Semester Project Goals: Our projected goals are: Develop efficient training methodology of the CogniMem device. Develop “reproducible procedures” for a "high-level confidence" Biometric recognition training. Have a working model for a static Facial Biometric identification that is reliable. Hopefully, find solutions to the hardware and software problems we are experiencing to have a more stable system. EE496: Lay the ground-work for a “dynamic” Facial/Body Biometric follow-on project.

9/15-9/269/27-10/1010/11-10/2410/25-11/1711/18-11/2111/22-12/512/6-12/12 Presentations ProposalComplete PDR Complete CDR Complete Final Complete Task Obtain LabComplete Setup LabComplete Familiarize with CogniMem (James)Complete Phase 1: Preliminary Testing Complete Solicit Student Volunteers Complete Phase 2: Training with Controlled Volunteer On-Hold Phase 3: Training with Uncontrolled Volunteer On-Hold Phase 4: Controlled group (with deception) and uncontrolled group unscripted open environment testing (REAL LIFE SIMULATION) On-Hold

?Any Questions?