1. 1 S ystems Analysis Laboratory Helsinki University of Technology Kai Virtanen, Janne Karelahti, Tuomas Raivio, and Raimo P. Hämäläinen Systems Analysis Laboratory Helsinki University of Technology Influence Diagram Game Modeling of Maneuvering Decisions in One-on-One Air Combat

2. 2 S ystems Analysis Laboratory Helsinki University of Technology Maneuvering decisions in one-on-one air combat Outcome depends on all the maneuvers of both players  Dynamic game problem Objective Find the best maneuvering sequences with respect to the overall goals of a pilot! - Preference model - Uncertainties - Behavior of the adversary - Dynamic decision environment t=  t t=0  t=  t 

3. 3 S ystems Analysis Laboratory Helsinki University of Technology Influence diagram (ID) (Howard et al. 1984) Directed acyclic graphs Describes the major factors of a decision problem Widely used in decision analysis application areas Decision Chance Deterministic Informational arc Conditional arc Alternatives available to DM Random variables Deterministic variables Time precedence Probabilistic or functional dependence Utility A utility function Conditional arc

4. 4 S ystems Analysis Laboratory Helsinki University of Technology Influence diagram (continued) State of the world is described by attributes States are associated with –Utility –Probability Utility is a commensurable measure for goodness of attributes Results include probability distributions over utility Decisions based on utility distributions Information gathering and updating using Bayesian reasoning

5. 5 S ystems Analysis Laboratory Helsinki University of Technology Decision theoretical maneuvering models Single stage influence diagram (Virtanen et al. 1999): –Short-sighted decision making Multistage influence diagram (Virtanen et al. 2004): –Long-sighted decision making –Preference optimal flight path against a given trajectory Single stage influence diagram game (Virtanen et al. 2003): –Short-sighted decision making –Components representing the behavior of the adversary New multistage influence diagram game model: Long-sighted decision making Components representing the behavior of the adversary Solution with a moving horizon control approach

6. 6 S ystems Analysis Laboratory Helsinki University of Technology Influence diagram for a single maneuvering decision Adversary’s State Maneuver Present Threat Situation Assessment State Combat State Threat Situation Assessment Situation Evaluation Present State Adversary's Present State Present Combat State Measurement Present Measurement Adversary's Maneuver

7. 7 S ystems Analysis Laboratory Helsinki University of Technology Influence diagram air combat game Goals of the players: 1. Avoid being captured by the adversary 2. Capture the adversary Four possible outcomes Evolution of the players’ states described by a set of differential equations, a point mass model Evolution of the probabilities described by Bayes’ theorem Resulting game optimal controls - the cumulative expected utility is maximized - feedback Nash equilibrium Black White

8. 8 S ystems Analysis Laboratory Helsinki University of Technology Multistage influence diagram game Black’s viewpoint White's viewpoint Combat state Situation Evaluation at t-1 Situation Evaluation at t Situation Evaluation Cumulative expected utility Situation Evaluation at t+1 Situation Evaluation at t-2 stage t-1stage t

9. 9 S ystems Analysis Laboratory Helsinki University of Technology Players’ states at stage t Truncated influence diagram game lasting stages t, t+  t,…, t+K  t Game optimal control sequences over stages t, t+  t, …, t+K  t Implement the controls of stage t Players’ states at stage t+  t t:=t+  t Moving horizon control approach Dynamic programming Terminate? K  t = length of the planning horizon

10. 10 S ystems Analysis Laboratory Helsinki University of Technology Numerical example White Black Altitude, m Y-range, m X-range, m Symmetric initial state White’s aircraft more agile White wins

11. 11 S ystems Analysis Laboratory Helsinki University of Technology Conclusions The multistage influence diagram game: –Models preferences under uncertainty and multiple competing objectives in one-on-one air combat –Takes into account Rational behavior of the adversary Dynamics of flight and decision making The moving horizon control approach => Game optimal control sequences w.r.t the preference model of the players Utilization: –Air combat simulators, a good computer guided aircraft –Contributions to the existing air combat game formulations Several computational difficulties are avoided Roles of the players are varied dynamically Producing reprisal strategies –Planning fighter maneuvers

12. 12 S ystems Analysis Laboratory Helsinki University of Technology References Virtanen, K., Raivio, T., and Hämäläinen, R.P., "Decision Theoretical Approach to Pilot Simulation," Journal of Aircraft, Vol. 36, No. 4, 1999. Virtanen, K., Raivio, T., and Hämäläinen, R.P., "Influence Diagram Modeling of Decision Making in a Dynamic Game Setting," Proceedings of the 1st Bayesian Modeling Applications Workshop of the 19th Conference on Uncertainty in Artificial Intelligence, 2003 Virtanen, K., Raivio, T., and Hämäläinen, R.P., "Modeling Pilot's Sequential Maneuvering Decisions by a Multistage Influence Diagram," Journal of Guidance, Control, and Dynamics, Vol. 27, No. 4, 2004.