1. Augmented Reality: Internet of Things
ECE Computer Engineering Design Project
Augmented Reality: Internet of Things
Adam Sanche • Andrei Usenka • Jiawei Wu • Satyen Akolkar
2017
Project Objective
We constructed a data collection module that enables field technicians wearing a Microsoft HoloLens to automatically gather and review electrical data from a circuit breaker panel. Using a modified version of ScopeAR’s WorkLink App the technician can follow a sequence of steps to service the breaker box safely.
Project Diagram
Server
To transmit sensor data to the HoloLens, we created a RESTful API server in Node.js using Javascript that executes in the Linux environment running on our SoC board. This was possible due to the integration of an ARM processor on the DE0 Nano SoC along with its FPGA components. Express.js was the framework we chose to use on top of Node.js to simplify routing and request handling as it gave us access to great open source libraries. With access to the aforementioned libraries, we were able to address crucial requirements and concerns with our project such an implementing a RESTful API service and IoT security in a much more robust manner. Data storage was accomplished using MongoDB, an open-source NoSQL database, running on our SoC board along with the server.
For colour ideas, University Visual Identity Guidelines can be found here:
Breakers
User
HoloLens 6 5
Implementation
The system polls the voltage and current sensors at 125 Hz
A C program running on the ARM Cortex A9 in the DE0 Nano SoC converts the sensor data into JSON files for processing by the server
Circuit Breaker data for the past 20 minutes are stored in MongoDB database
The Server and Sensor Interfacing programs require 70% CPU utilization on average
ScopeAR’s WorkLink Circuit Breaker App was modified to project real-time information 4 2 1 3
DE0 Nano SoC
Router
Sensors
Core Components
System Data Flow
Current and Voltage sensors interface with breaker box.
Breakers and integrated system provide sensor values to DE0 Nano Soc
DE0 hosts a server which polls the sensors
HoloLens connects to network and can request data from the server
The HoloLens user can choose to see visualizations of past data
Client: ScopeAR
Department of Electrical & Computer Engineering