1. Mobile Augmented Reality Game Development Jeff Chastine Southern Polytechnic State University Georgia State University, Mar. 27, 2013

2. Hi!

3. Overview What got us here? Paradigm Shift! Case Study: Qualcomm Challenges of AR Game Dev If time: code review

4. A Little AR History 1968 Ivan Sutherland Optical Combiner

5. A Little AR History 1992 Tom Caudell and David Mizell coin the term “Augmented Reality”

6. 1994 Virtual Reality (VR) attempts to completely synthesize Augmented Reality (AR) integrates virtual objects into the physical world A Little AR History Real Environment Virtual Environment (VR) Mixed Reality Augmented Virtuality (AV) Augmented Reality (AR)

7. A Little AR History 1996 – Rekimoto tracks in 6 DoF! –x, y, z –yaw, pitch, roll

8. 1997 Azuma states three requirements: 1.Combines the real and virtual worlds 2.Interactive in real time 3.Registered in 3D A Little AR History

9. 1997 Feiner et. al create the “Touring Machine” First mobile augmented reality system

10. A Little History 1999 ARToolkit Free/Open Source Kato/Billinghurst Good for intro to AR

11. Visual Tracking (ARToolkit)

12. A Little History 2000 Landmark breakthrough! AR with Duran Duran

13. Hardware Requirements HMDs/Displays Rendering Tracking

14. Tabletops Tablets & Phones HMDs –Optical (see-through) Stereo? –Video (closed-view) Display

15. GPS, HA-GPS, GPS/RTK Acoustic (IS-900) Electro-magnetic (Polhemus) Visual (ARToolkit) Tracking

16. AR Examples

17. Medical Scientific Visualization Expert/Technician 17 Scenarios

18. Medical Scientific Visualization Expert/Technician 18 Scenarios

19. Medical Scientific Visualization Expert/Technician 19

20. AR in Education

21. Navigation

22. Nightvision Commercial

23. Military

24. Tracking Accuracy Optical vs. Video –Optical – High Resolution/FoV. Synching/Delay issues, brightness issues –Video – safety: camera vs. eye offset Registration Problems –location –lag in rendering Weight / Battery Life Interaction –Techniques –Physical objects General Problems

25. Other Issues: Interaction

26. Paradigm Shift! Note: –Media is cool –Mobile is cool –Media+Mobile must be really cool Unity supports scripting –Basic programming concepts –Reinforces OO –Javascript or C# (or Boo) Provides scaffolding to remove barriers (or at least lower them)

27. Moving into Mobile Nearest Tube Layar

28. Moving into Mobile (2007) Magic Books

29. Moving into Mobile ARToolkit on an iPhone (2008)

30. Moving into Mobile (2009) I MAED A GAM3 W17H AR 1N 1T – (not really, it’s called AAAARRRRRGH!)

31. Moving into Mobile

32. Let’s make a Magic Book Mark Billinghurst et al. The hard part is finding a tracker…

33. Need a good tracker –GPS + Gyros is NOT good enough! –Qualcomm has released their free tracker! Need a good/cheap display –Phone is a window into the virtual world Need a way to make games/render Mobile AR Gaming + = Easy AR!

34. Not anymore…

38. AR Preprocessed Images (pictures + tracking information) Into the ImageTargetTextures folder Tracking XML file and data file“Page” Textures Into the Streaming Assets / QCAR folder

40. Very Cool Unity Mobile API Input.acceleration –Returns orientation as a Vector3 Input.GetKeyDown(KeyCode.Mouse0) –Screen tap event iPhoneUtils.Vibrate() –Makes the phone vibrate GPS/Location –Unity 3.2 or Java LocationManager interface and native wrapper

41. AR Demo

42. Using accelerometers

43. ARToolkit –Free –Written in C –Uses fiducials –http://www.hitl.washington.edu/artoolkit/http://www.hitl.washington.edu/artoolkit/ What you’ll need: –A webcam –A printer –A compiler –Graphics card? A safe place to get started

44. Free Works with Android –Java –JNI –C++ Runs on Qualcomm chipsets –HTC Incredible –Nexus One –Others https://ar.qualcomm.com/qdevnet/ The Qualcomm AR SDK

45. Others Dekko SDK –No training! 13 th Lab’s PointCloud –Dynamic building of the scene

46. The Burden of AR Gaming Printing out fiducials –Is this really “mobile”? User training –Do your parents know what AR is? –How do you interact in AR environments? –Don’t block the tracker! –Don’t shake the camera!

47. The Burden of AR Gaming How do you interact? –Point and click? –Tactile feedback? Will people get physically tired?

48. User Acceptance is Key Tracking is a challenge Lazy players AR must “go beyond” ( and why AR?) Where’s the killer app?

49. 5 Common AR Mistakes (if you don’t believe me) 1.Poor education 2.Not investing in content 3.Different AR app for every campaign 4.AR and 3D for the sake of AR 5.Make content engaging http://www.mobilemarketer.com/cms/news/software-technology/14435.html?goback=%2Egde_67494_member_226398138

50. The Future of AR? Lots of hype right now Project Glass?

51. Thank you! Questions?