1. Introdution We are -What are we going to talk about

2. Click to edit Master text styles Second level Third level Fourth level Fifth level Anal ysis

3. Click to edit Master text styles Second level Third level Fourth level Fifth level Anal ysis Elements of winning: – Build Order – Information Gathering – Macro – Micro

4. Click to edit Master text styles Second level Third level Fourth level Fifth level Anal ysis Terran Tactics – Timing Attack – Pushing – Harassment

5. Click to edit Master text styles Second level Third level Fourth level Fifth level Anal ysis Unit analysis – Marine – Vulture – Wraiths

6. Click to edit Master text styles Second level Third level Fourth level Fifth level Bays ian Net wor ks

7. Click to edit Master text styles Second level Third level Fourth level Fifth level Bays ian Net wor k Choice of decision model – Bayesian Networks – Decision Trees

8. Click to edit Master text styles Second level Third level Fourth level Fifth level Bays ian Net wor k Spawn Prediction

9. Click to edit Master text styles Second level Third level Fourth level Fifth level Bays ian Net wor k Threat level prediction – tvt

10. Click to edit Master text styles Second level Third level Fourth level Fifth level Pote ntial Fiel ds

11. Click to edit Master text styles Second level Third level Fourth level Fifth level Pote ntial Fiel d In Gen eral Attractive behavior Repulsive behavior From vector to number

12. Click to edit Master text styles Second level Third level Fourth level Fifth level Our Pote ntial Fiel d Fun ctio n Behavior is determined by + or – due vs de (2de - due)

13. Click to edit Master text styles Second level Third level Fourth level Fifth level Chan ged Whe n Impl eme ntin g Pote ntial Field All forces are positive Forces are learned

14. Click to edit Master text styles Second level Third level Fourth level Fifth level Rein forc eme nt Lear ning Generalization of Q-Learning

15. Click to edit Master text styles Second level Third level Fourth level Fifth level Enviro nment Variabl es Distance to Ally Distance from Current Tile to Ally Distance to Center of Squad Distance from Current Tile to Center of Squad Distance to Enemy Distance from Current Tile to Enemy Distance to Cliff or Edge Distance from Current Tile to Cliff or Edge A State is defined as the combination of all the following characteristics: Number of units Health Lost Damage Dealt Number of Units Time Weapons Cool Down Shooting Range

16. Click to edit Master text styles Second level Third level Fourth level Fifth level Rein forc eme nt Lear ning

17. Click to edit Master text styles Second level Third level Fourth level Fifth level Gen erali zati on For mul as Q-Approximation Reward

18. Click to edit Master text styles Second level Third level Fourth level Fifth level Updati ng Rules

19. Click to edit Master text styles Second level Third level Fourth level Fifth level Algo rith m Image that im still doing

20. Click to edit Master text styles Second level Third level Fourth level Fifth level TES T

21. Click to edit Master text styles Second level Third level Fourth level Fifth level Buil ding a test Figure of StarEdit – a Starcraft BroodWar map editor

22. Click to edit Master text styles Second level Third level Fourth level Fifth level Bas e cas e Testing without Reinforcement learning, and potential fields

23. Click to edit Master text styles Second level Third level Fourth level Fifth level Bas e cas e Testing with potential fields, but not reinforcement learning

24. Click to edit Master text styles Second level Third level Fourth level Fifth level Will it con verg e? Which Alpha and Gamma values? How many iterations is needed?

25. Click to edit Master text styles Second level Third level Fourth level Fifth level Will it con verg e? Running tests with different values

26. Click to edit Master text styles Second level Third level Fourth level Fifth level Will it con verg e? Values Alpha 0,2 and Gamma 0,9 (30852)

27. Click to edit Master text styles Second level Third level Fourth level Fifth level Will it con verg e? Values Alpha 0,4 and Gamma 0,6 (135936)

28. Click to edit Master text styles Second level Third level Fourth level Fifth level Predict spa wn and buil d ord er

29. Click to edit Master text styles Second level Third level Fourth level Fifth level Con clusi on