1. Electrical and Computer Engineering Smart Goggles To Chong Ryan Offir Matt Ferrante James Kestyn Advisor: Dr. Tilman Wolf Team Wolf

2. 2 Electrical and Computer Engineering Augmented Reality Glasses  Virtually superimpose graphics onto real environment  Context-specific information supplied to users real-time

3. Electrical and Computer Engineering Gaming

4. 4 Electrical and Computer Engineering Gaming Industry Advancement

5. 5 Electrical and Computer Engineering 3D View of our system Tunnel Creek Board & Battery Sensor Board

6. 6 Electrical and Computer Engineering Specifications for Augmented Reality  System Refresh Rate: 20 Hz Human visual frame rate: 10-12 FPS  Location Accuracy σ L : ±2 feet Average Walking Speed = 4.4 ft/s Average Running Speed = 22 ft/s  Orientation Accuracy σ θ : ±5°  Angle Update Speed: 80 deg/s Captures “typical” human movement

7. 7 Electrical and Computer Engineering Block Diagram

8. 8 Electrical and Computer Engineering Sensing

9. 9 Electrical and Computer Engineering Sensor Board Design

10. 10 Electrical and Computer Engineering Prototyping  Arduino + Sparkfun Sensors and GPS

11. 11 Electrical and Computer Engineering Technical Challenges – Data Accuracy Gyroscope Drift Measured Over Five Minutes Time

12. 12 Electrical and Computer Engineering Technical Challenges – Data Accuracy

13. 13 Electrical and Computer Engineering Technical Challenges – Data Accuracy

14. 14 Electrical and Computer Engineering Measuring Kalman Filter Performance SLOW TURN – 10 degrees per second

15. 15 Electrical and Computer Engineering Measuring Kalman Filter Performance FAST TURN – 50 degrees per second

16. 16 Electrical and Computer Engineering Computation

17. 17 Electrical and Computer Engineering Technical Challenges – Image Alignment BAD GOOD

18. 18 Electrical and Computer Engineering OpenGL  Draws whole environment  Call simple functions to update camera location  Example:  OpenGL only changes camera position since environment is already computed // rotate 45 in z dir glRotatef(45.0f, 0.0f, 0.0f, 1.0f); model->Draw(); glFlush();

19. 19 Electrical and Computer Engineering OpenGL Camera // rotate 45 in z dir glRotatef(45.0f, 0.0f, 0.0f, 1.0f); Camera Actual View

20. 20 Electrical and Computer Engineering Display

21. 21 Electrical and Computer Engineering Goggle-Based Display http://www.microvision.com

22. 22 Electrical and Computer Engineering Pico Projector Displays Image -> Electrical Signals Electrical Signals drive RGB laser light: intensity & information RGB + Combiner Optic = single modulated light path Light output + MEMS Scanning Mirror = Image

23. 23 Electrical and Computer Engineering Cost Schedule ComponentPricePrice per 1000 Sensor board components - GPS$35.00$27.02 - Gyroscope$12.95$6.35 - Microcontroller$10.25$5.72 - Accelerometer/Compass$8.43$3.97 - Other parts$14.37$10.00 Total$81.00$53.06 PCB Manufacturing$450.00$150.00 Battery$50.00$25.00 Total$581.00$228.06

24. 24 Electrical and Computer Engineering Timeline

25. 25 Electrical and Computer Engineering Work in Progress  Developing Kalman Filter  Testing/Debugging Sensor Board  Developing final application

26. 26 Electrical and Computer Engineering FPR  Final Application: PACMAN  Sensor Board 3D Filter Displacement

27. 27 Electrical and Computer Engineering Demo Pictures Tilt RightTilt Left

28. 28 Electrical and Computer Engineering Demo Pictures Tilt DownTilt Up

29. 29 Electrical and Computer Engineering Demo Video

30. 30 Electrical and Computer Engineering Questions