Electrical and Computer Engineering SMART GOGGLES To Chong Ryan Offir Matt Ferrante James Kestyn Advisor: Dr. Tilman Wolf Preliminary Design Review

2 Electrical and Computer Engineering Augmented Reality Goggle Application An Example of Augmented Reality Goggle Application

3 Electrical and Computer Engineering Project Overview  Augmented reality vision technology Sensing a user’s location and direction of view Computing what to display in the user’s field of view Displaying the visual content without obstructing the user’s view of real objects  Simple, efficient, and functional smart goggle Sensor unit Intel Atom Processor Goggle-based display

4 Electrical and Computer Engineering Design Layout System Block Diagram

5 Electrical and Computer Engineering Conceptual System Design Bird’s eye view of the system design as worn

6 Electrical and Computer Engineering Hardware & Software Components  Sensor board GPS Gyroscope Compass/Accelerometer AVR microcontroller ∙Kalman filter  Intel Atom Processor – Tunnel Creek board Windows Embedded 7 OS OpenGL – API and graphical application  Goggle - Provided by Microvision, Inc. VGA connection  Battery Pack – 12V Sense location and direction of view through a Kalman filter

7 Electrical and Computer Engineering Sensor Board  PCB Size: 1 x 2.5 in Consumes < V GPS - USART Gyroscope, Compass, Accelerometer – I 2 C USB-powered, 3.3V and 1.8V regulators On-board 32-bit microcontroller Design completed Sending out this week

8 Electrical and Computer Engineering GPS – MN1010  USART connection to the microcontroller  Determines the location of the user  Features: 12-channel GPS receiver, RF filtering, flash memory Operates at 35mA < 75 mW total power consumption 10mm x 10mm x 2mm, 36 pin LGA packet Outputs NMEA PPS Frequency: MH

9 Electrical and Computer Engineering Gyroscope - L3G4200DTR  I2C bus connection to the microcontroller  Determines head orientation of the user  Features: Operates at 6.1mA Three-axis angular rate sensor X-axis: pitch axis Y-axis: roll axis Z-axis: yaw axis 16 bit-rate value data output

10 Electrical and Computer Engineering Accelerometer/Compass - LSM303DLHC  Single I2C bus connection to the microcontroller  Accelerometer determines head movements  Compass determines the direction user is facing  Features: 0.11 mA 3 magnetic field channels and 3 acceleration channels From ±1.3 to ±8.1 gauss magnetic field full-scale ±2g/±4g/±8g/±16g selectable full-scale 3x5x1mm

11 Electrical and Computer Engineering AVR Microcontroller - AT32UC3B0256-Z2UT  High Performance, Low Power AVR®32 UC3 32-Bit Microcontroller  Executes > 1 MIPS / MHz  Universal Serial Bus (USB) Bootloader  Internal High-Speed SRAM, Single-Cycle Access at Full Speed: 96KB (256KB Flash)  Single Cycle Access up to 60 MHz  Single 3.3V Power Supply  Implements the Kalman Filter

12 Electrical and Computer Engineering Kalman Filter

13 Electrical and Computer Engineering Kalman Filter  A recursive predictive algorithm  Increases accuracy of noisy measurements  Measurements: Gyroscope, Accelerometer, Compass, GPS  Inputs: Measurements, Previous State of System, Bias Terms  Outputs (State Vector): Location, Orientation  Predicts the users location/orientation based on previous values, measurements, covariance, and noise

14 Electrical and Computer Engineering Kalman Filter

15 Electrical and Computer Engineering Intel Atom E680 – Tunnel Creek  Operates at 1.6GHz  Up to 2GB DDR2  1MB BIOS Flash, on-board reprogrammable  VGA port  USB port  2 x SATA hard disk interface  2 x 1000 BaseT Ethernet ports  Small size – 75 x 65mm (What is the size from Cornell????)  6W power consumption (Cornell???)  Supply voltage: 5V (Cornell spec please!!!)

16 Electrical and Computer Engineering Software  Windows Embedded 7 OS  Develop 3D environment application with OpenGL  OpenGL allows us to easily update graphical position  Translate users movement and orientation into a virtual environment to be used for 3D graphic application  API Development

17 Electrical and Computer Engineering Picture example of openGL over image

18 Electrical and Computer Engineering Picture example of openGL over image 2

19 Electrical and Computer Engineering Goggle-Based Display  VGA connection port  Input image projected on corrective lens  Semitransparent reflective lens  To be provided by Microvision, Inc.

20 Electrical and Computer Engineering Cost Schedule

21 Electrical and Computer Engineering Battery  12VDC battery pack

22 Electrical and Computer Engineering Proposed MDR Deliverables  Demonstrate the orientation of the Sensor Unit  Design a simple 3D environment using OpenGL PC version

23 Electrical and Computer Engineering Questions