1. Plenoptic Time of Flight (ToF) Occupancy Sensing Systems
Presenter: Robert F. Karlicek, Jr.
Center for Lighting Enabled Systems & Applications (LESA)
Rensselaer Polytechnic Institute

2. Plenoptic ToF ToF capabilities for occupancy sensing and localization
Project Description
ToF capabilities for occupancy sensing and localization
Develop new plenoptic sensor for wide field of view occupancy sensing
Develop sparse sensor image processing algorithms for accurate counting/tracking and self commissioning

3. Plenoptic ToF Novel sensor design with CMOS APD detector
Project Description
Novel sensor design with CMOS APD detector
Novel integrated optic with repurposed VLC sensor array designed for wide field of view, high sensitivity
Novel sparse sensor image processing with tracking and “conservation of people” counting/localization
Challenges to be overcome
ToF range limited by SNR, too costly for routine sensing
Optics cost high, must be integrated in IC
Key performance metrics
ToF range – 5 meters
No false positive/negative detection
Adaptive – corrects for minor room layout changes

4. Team Team Karlicek (RPI) Program Management Module Development
T2M tasks
Zarkesh-Ha (UNM)
IC Optics Integration
Plenoptic Testing
Radke (RPI)
ToF Module Specs
Image Processing
Count/Track Algorithm
Brueck (UNM)
ToF Module Specs
Plenoptic Design
Plenoptic Testing
Hella (RPI)
ToF IC Design & Test
APD Receiver Design
IR Source Driver Design
Carr (ABB)
Testbed Validation
HVAC Savings Validation

5. Predictions One Year Out Greatest Challenges: Project Goals
COTS TOF pod built/tested
Proof of concept algorithm demonstrated (in test bed)
First IC (single channel) ToF module designed/tested
Greatest Challenges:
ToF range (> 5m) with good SNR
IC fabrication with integrated waveguide

6. Commercialization has two components:
Technology-to-Market
Commercialization has two components:
Plenoptic IC Design – License core IP from UNM (Ideally, secure two or more IC design houses to commercialize the IC)
Module/Software system – Startup or partnership with Lighting or BMS company (Hot area for lighting companies as they look for sustainability)