1. Computer games In Post PC perspective Ruby Shamir, 2005

2. Mama do not worry!

3. Your son will not spend all day sitting lonely, playing computer games

4. He will play them while running and jumping with his friends

5. Lecture outline 1. Games characteristics 2. Available technologies 3. A gaming scenario 4. Current developments 5. A game prototype

6. 1. Games characteristics Computer games “Natural” games

7. computer games Sitting alone in front of a screen, all the body is static and only the eyes and hands, doing repetitive movements.

8. computer games risks carpal tunnel syndrome Back and neck pain Tension, stress, headaches Eyestrain ( http://www.lasa.org.uk/knowledgebase/pages/mngcomphealthsafety.shtml )http://www.lasa.org.uk/knowledgebase/pages/mngcomphealthsafety.shtml Mental damage ?

9. computer games benefits You can be anywhere, everyone and in any time You can communicate with other players Which may be very far away

10. computer games benefits Enjoy games with Graphical effects Sound effects Communication with other players From: Star Wars Galaxies: An Empire DividedStar Wars Galaxies: An Empire Divided

11. computer games benefits From The final fantasy

12. computer games benefits From Yahoo games

13. “Natural” games Players Running, Jumping, Climbing, Yelling, …

14. “Natural” Games risks Accidents Players are Running, Jumping, Climbing, Yelling, … Players might fall and be injured …

15. “Natural” Games benefits Moving the body, “More natural”

16. Can we merge the game styles and enjoy the benefits of both worlds?

17. YES! By Merging Mobile Computing, Localization, and Gaming technologies we can get the Best of Both Worlds! By Merging Mobile Computing, Localization, and Gaming technologies we can get the Best of Both Worlds!

18. 2. Available technologies

19. Mobile Phones

20. 2. Available technologies Mobile Phones 1.52 billion mobile users (140 million at US) www.cellular.co.za/stats/stats-main.htm World Population estimation: http://www.ibiblio.org/lunarbin/worldpophttp://www.ibiblio.org/lunarbin/worldpop

21. 2. Available technologies Mobile Phones Half of world to have mobile phone by 2015 (Jorma Ollila, Chairman and CEO of Nokia) http://www.geek.com/news/geeknews/2004Feb/bpd20040226024015.htm World Population estimation: http://www.ibiblio.org/lunarbin/worldpophttp://www.ibiblio.org/lunarbin/worldpop

22. 2. Available technologies Mobile Phones with camera Front view Back view For example: Sony Ericsson K700i

23. 2. Available technologies Mobile Phones with camera Camera Phones Set to Dominate Mobile Phone Handset Market http://www.tekrati.com/T2/Analyst_Research/ResearchAnnouncementsDetails.asp?Newsid=4305

24. 2. Available technologies Mobile Phones display devices 320x240 pixels 262 K colors 300 GBP Sharp TM200 Sagem myX-8

25. 2. Available technologies Mobile Phones with navigation system for example: CoPilot Live Smartphone with Mini SD128 QS Card, £134.98 what is GPS / GNSS ? Look at: http://www.redsword.com/GPS/apps/general/how.htm http://www.redsword.com/GPS/apps/general/how.htm

26. 2. Available technologies Mobile Phones with navigation system “the number of GNSS-enabled phones worldwide will increase from 28 million in 2003 to close to two billion in 2020” http://www.gpsworld.com/gpsworld/article/articleDetail.jsp?id=72185&sk=&date=&&pageID=2

27. 2. Available technologies HMD devices

28. 2. Available technologies HMD devices Available HMD compared at: http://www.stereo3d.com/hmd.htm 180$ and up HMD devices without navigation. 650$ and up HMD devices with 3 DOF navigation. Navigation systems for HMD 3 DOF from 1000$ 6 DOF from 2800$

29. 2. Available technologies Augmented Reality Systems Align and Merge between virtual and real worlds A good start: www.se.rit.edu/~jrv/research/ar/introduction.htmlwww.se.rit.edu/~jrv/research/ar/introduction.html AR System

30. 2. Available technologies Augmented Reality Systems Align between virtual and real worlds Using vision techniques Get locations of objects relative to user’s view. Local navigation. Small error. Using physical systems Get locations of objects relative to the user. Global navigation. large error.

31. 2. Available technologies Integration of technologies for gaming

32. 3. A game scenario

33. HMD with Camera and navigation system Cellphone with Camera and navigation system

34. Ruby have some time…

35. 21/12 17:30 Calls Phones book Settings Games Main menu So, he starts a D&D game

36. 21/12 17:30 Ping Pong Jumpy Fish Basketball Dungeons & Dragons Games menu

37. 21/12 17:30 Dungeons & Dragons Successfully Connected to Games Server

38. 21/12 17:31 Dungeons & Dragons Ruby selects his preferred character,weapon and armor

39. 21/12 17:31 Dungeons & Dragons

40. 21/12 17:32 Dungeons & Dragons

41. Now the mobile phone of Ruby is a deadly weapon and an enhanced 3D D&D world is displayed throw his HMD sunglasses and Mobile phone

45. After some fight Ruby wins and finds a treasure map…

47. Ruby navigate himself to the treasure. In the way he fights some creatures and collects helpful staff…

50. Ruby fights against other human player, which try to protect the treasure

51. A sign indicates that navigation is correct

52. A hard question Ruby send SMS with the right answer

53. The final fight…

55. 4. Current state overview Current mobile phone games Current augmented reality games Several research sites Only one (very limited) commercial game Many 80’s and 90’s games are available to download (Java)

56. Mobile phones games Current mobile phone games Current augmented reality games

57. Current mobile phone games www.myphonegames.co.uk www.myphonegames.co.uk From: www.myphonegames.co.ukwww.myphonegames.co.uk

58. Augmented Reality games Current mobile phone games Current augmented reality games

59. Current Augmented Reality games Eyetoy Current Augmented Reality games Eyetoy From : PlayStation

60. Current Augmented Reality games Eyetoy Current Augmented Reality games Eyetoy Technologies used: Camera Vision based techniques Technologies not used: Global Navigation system Communication Mobile device 3D graphics

61. Current Augmented Reality games Eyetoy Current Augmented Reality games Eyetoy Limits: No 3D graphics No Mobility No far Multiplayer

62. Current Augmented Reality games GPS::Tron Current Augmented Reality games GPS::Tron From : http://datenmafia.org/gpstron/index-english.phphttp://datenmafia.org/gpstron/index-english.php Regular Tron

63. Current Augmented Reality games GPS::Tron Current Augmented Reality games GPS::Tron

64. Regular tron

65. Current Augmented Reality games GPS::Tron Current Augmented Reality games GPS::Tron Technologies used: Mobile device Global Navigation system Communication Technologies not used: Vision based techniques 3D graphics Camera

66. Current Augmented Reality games GPS::Tron Current Augmented Reality games GPS::Tron Limits: No 3D graphics, No Reality enhancement,

67. Current Augmented Reality games Current Augmented Reality games Savannah From : http://www.nestafuturelab.org/showcase/savannah/savannah.htmhttp://www.nestafuturelab.org/showcase/savannah/savannah.htm

68. Current Augmented Reality games Current Augmented Reality games Savannah

69. Technologies used: Mobile device Global Navigation system Communication Technologies not used: Vision based techniques 3D graphics Camera

70. Current Augmented Reality games Current Augmented Reality games Savannah Limits: No 3D graphics, No Reality enhancement,

71. Current Augmented Reality games The invisible train Current Augmented Reality games The invisible train From: http://studierstube.org/invisible_train/http://studierstube.org/invisible_train/

72. Current Augmented Reality games The invisible train Current Augmented Reality games The invisible train

74. Technologies used: Mobile device with camera Vision based techniques Communication 3D graphics Technologies not used: Global Navigation system

75. Current Augmented Reality games The invisible train Current Augmented Reality games The invisible train Limits: Play with a specific board, so you are not so mobile…

76. Current Augmented Reality games AR quake Current Augmented Reality games AR quake From : http://wearables.unisa.edu.au/projects/ARQuake/www/index.htmlhttp://wearables.unisa.edu.au/projects/ARQuake/www/index.html

77. Current Augmented Reality games AR quake Current Augmented Reality games AR quake

78. Current Augmented Reality games AR Quake Current Augmented Reality games AR Quake Technologies used: Mobile device with camera Global Navigation system Communication HMD Technologies not used: Vision based techniques

79. Current Augmented Reality games AR Quake Current Augmented Reality games AR Quake Limits: No precise location in multiplayer game. Can be played in a known environment only.

80. Current Augmented Reality games Current Augmented Reality games Human Pac - Man From : http://mixedreality.nus.edu.sg/research/HP/HP_webpage/research-HP-infor.htmhttp://mixedreality.nus.edu.sg/research/HP/HP_webpage/research-HP-infor.htm Regular Pac-Man

81. Current Augmented Reality games Current Augmented Reality games Human Pac - Man

82. From : http://mixedreality.nus.edu.sg/research/HP/HP_webpage/research-HP-infor.htmhttp://mixedreality.nus.edu.sg/research/HP/HP_webpage/research-HP-infor.htm

83. Current Augmented Reality games Current Augmented Reality games Human Pac - Man Technologies used: Mobile device Global Navigation system Communication 3D graphics Camera Technologies not used: Vision based techniques

84. Current Augmented Reality games Current Augmented Reality games Human Pac - Man Limits: Can be played only in a known game zone.

85. 6. A game prototype

86. Survive A first person shooting game prototype. This game mixing computer and “natural” game characteristics. The aim of the game is to shoot your enemy before he will do that to you… Due to time constraint this prototype wrote with MATLAB and it works with laptops, but it can be written with JAVA and work on other mobile devices as well. 6. A game prototype

87. Survive System structure Game Data Enhanc e view World Enhanc e view World Player 1Player 2

88. 6. A game prototype Technologies used: Mobile device Communication Camera Vision based techniques Technologies not used: 3D graphics Global Navigation system

89. 6. A game prototype Limits: No global navigation 2D graphics

90. Play !

91. Thank you !