1. A DAPTIVE I NTELLIGENT AGENT IN REAL - TIME STRATEGY GAMES An Introduction

2. P ROJECT M EMBERS Omar Enayet Amr Saqr Ahmed Atta Abdelrahman Al-Ogail Dr. Mostafa Aref Dr. Ibrahim Fathy

3. A GENDA Problem Definition Theoretical Areas of Problem. Project Domain. Specific Problem Definition. Motivations. Objectives. Project Background Survey & Approach. Domain Platform. AI Engine Architecture. Expected Deliverables. Development Tools. Project Time Plan. Web Resources & References.

4. T HEORETICAL A REAS Learning Make the machine learn.

5. T HEORETICAL A REAS Planning Plan then re-plan according to new givens.

6. T HEORETICAL A REAS Knowledge Sharing Let everyone know instantly what you knew through experience.

7. T HEORETICAL A REAS - S UMMARY Learning Planning Knowledge Sharing

8. P ROJECT D OMAIN RTS Games Real-Time Strategy Games.

9. P ROBLEM D EFINITION Predictability Computer Opponent actions easily predicted.

10. P ROBLEM D EFINITION Non-Adaptability Computer Opponent doesn’t adapt to changes in human actions.

11. P ROBLEM D EFINITION Static Scripts Computer AI relies on static scripting techniques.

12. P ROBLEM D EFINITION Experience Loss The Absence of sharing experience costs a lot.

13. P ROBLEM D EFINITION - S UMMARY Predictability Non-Adaptability Static Scripting Experience Loss

14. M OTIVATIONS Interested In Machine Learning

15. M OTIVATIONS Interested In RTS Games

16. M OTIVATIONS Meets Our Career Ambitions as AI Programmers

17. W HY THIS D OMAIN Rich Environment. Severe Time Constraints – Real-Time AI – Many Objects – Imperfect Information – Micro-Actions

18. W HY THIS D OMAIN Active Research Theses and Papers are from 2003 to 2009.

19. W HY THIS D OMAIN Wars Simulation Research in this field contributes to the modern warfare Research. Half of The USA’s Army will be robots in the coming years.

20. O BJECTIVES Adaptive A.I. Making the Computer Opponent adapt to changes like human do.

21. O BJECTIVES Mobile Experience Making Sharing Experience Possible Among Machines

22. S URVEY Recent Papers We Collected more than 30 papers concerning this field, different in their way of approaching the problem and the techniques used to solve the problem. Examples of them are above ^ Adaptive Reinforcement Learning Agents in RTS Games Case-based planning and execution for real-time strategy games. Transfer Learning in Real-Time Strategy Games Using Hybrid CBR/RL

23. S URVEY Asking Experts Alex Champandard, Eric Kok and more. Alex ChampandardEric Kok

24. S URVEY Reference Book The Book “AI Game Engine Programming” talks about the drawbacks in learning and planning in RTS Games.

25. A PPROACHES - T ECHNIQUES Reinforcement Learning A Sub-Science of Machine Learning.

26. A PPROACHES - T ECHNIQUES Case-Based Planning Planning using Case-based reasoning.

27. A PPROACHES - T ECHNIQUES BDI Agents Tech. Beliefs-Desires-Intentions Agents.

28. T ECHNIQUES - S UMMARY Reinforcement Learning Case-Based Planning BDI-Agent Tech.

29. A PPROACHES - L ANGUAGES C++ The Main Language our Open Source Game is coded with.

30. A PPROACHES - L ANGUAGES 2APL An Agent-Oriented Language.

31. A PPROACHES - L ANGUAGES LUA A Scripting Language widely used in Video-Games.

32. P LATFORM – N OT C HOSEN ORTS An Open-Source RTS Game

33. P LATFORM – N OT C HOSEN Wargus An Open-Source RTS Game based in Stratagus Game Engine

34. P LATFORM – T HE C HOSEN O NE BosWars An Open-Source RTS Game based in Stratagus Game Engine

35. P ROJECT T IME P LAN

36. G AME E NGINE AI Engine AI Engine That’s our guy

37. AI E NGINE A RCHITECTURE

38. E XPECTED D ELIVERABLES Enhanced AI Engine An AI Engine which makes the computer behavior in the game as human as possible.

39. E XPECTED D ELIVERABLES Experimental Results Comparison of the results of the enhanced AI Engine with ordinary static AI.

40. Visual Studio 2008 Professional Edition 2APL Environment C++ Libraries : Boost, Guichan..etc. D EVELOPMENT T OOLS

41. Project Blog : http://rtsairesearch.wordpress.com/ SVN Repository : https://mzrtaiengine.googlecode.com/svn/trunk/ W EB R ESOURCES

42. Book : AI Game Engine Programming Book : Artificial Intelligence for Games The Most Important Papers/Theses : Thanks R EFERENCES Eric Kok - Adaptive Reinforcement Learning Agents in RTS Games –– Master Thesis – University of Utrecht - 2008 Santi Onta˜n´on, Kinshuk Mishra, Neha Sugandh, and Ashwin Ram. Case- based planning and execution for real-time strategy games. In Proceedings of ICCBR - 2007 - 2007 Manu Sharma, Michael Holmes, Juan Carlos Santamaria, Arya Irani, Charles Lee Isbell Jr., Ashwin Ram: Transfer Learning in Real-Time Strategy Games Using Hybrid CBR/RL. IJCAI 2007: 1041-1046

43. W EB R EFERENCES http://gadgets.softpedia.com/news/US-Soldiers- Will-be-Half-Robots-Half-Human-by-2015-1334- 01.html http://www.france24.com/en/20090205-sciences- usa-robot-future-american-army-videogame- soldiers-machine