1 S ystems Analysis Laboratory Helsinki University of Technology Manuscript “On the Use of Influence Diagrams in a One-on-One Air Combat Game” in Kai Virtanen’s.

Slides:



Advertisements
Similar presentations
Bengt-Göran Sundqvist Saab Aerosystems
Advertisements

Modelling CGFs for tactical air-to-air combat training
Episode 3 / CAATS II joint dissemination event Gaming Techniques Episode 3 - CAATS II Final Dissemination Event Patricia López Aena Episode 3 Brussels,
Multi‑Criteria Decision Making
1 Research Topics Group: Professor Raimo P. Hämäläinen Graduate School Seminar University of Jyväskylä.
M I T I n t e r n a t i o n a l C e n t e r f o r A i r T r a n s p o r t a t i o n Influence of Structure on Complexity Management Strategies of Air Traffic.
S ystems Analysis Laboratory Helsinki University of Technology Near-Optimal Missile Avoidance Trajectories via Receding Horizon Control Janne Karelahti,
Computational Stochastic Optimization:
Simulation Metamodeling using Dynamic Bayesian Networks in Continuous Time Jirka Poropudas (M.Sc.) Aalto University School of Science and Technology Systems.
Applications: Special Case of Security Games. Given a team of robots, how should they plan their patrol paths along time to optimize some objective function?
1 S ystems Analysis Laboratory Helsinki University of Technology A Simulation Model for Aircraft Maintenance in an Uncertain Operational Environment Ville.
A camper awakens to the growl of a hungry bear and sees his friend putting on a pair of running shoes, “You can’t outrun a bear,” scoffs the camper. His.
SPREADSHEETS IN EDUCATION OF LOGISTICS MANAGERS AT FACULTY OF ORGANIZATIONAL SCIENCES: AN EXAMPLE OF INVENTORY DYNAMICS SIMULATION L. Djordjevic, D. Vasiljevic.
© 2003 Warren B. Powell Slide 1 Approximate Dynamic Programming for High Dimensional Resource Allocation NSF Electric Power workshop November 3, 2003 Warren.
XYZ 6/18/2015 MIT Brain and Cognitive Sciences Convergence Analysis of Reinforcement Learning Agents Srinivas Turaga th March, 2004.
And Just Games etc.. EVOLUTION OF COMPUTER GAMES PongOdyssey Beginning of the use of microprocessors ATARI VCS system bit.
Stochastic Models in Planning Complex Engineer-To-Order Products
Commitment without Regrets: Online Learning in Stackelberg Security Games Nika Haghtalab Carnegie Mellon University Joint work with Maria-Florina Balcan,
Aeronautics & Astronautics Autonomous Flight Systems Laboratory All slides and material copyright of University of Washington Autonomous Flight Systems.
Bayesian Networks, Influence Diagrams, and Games in Simulation Metamodeling Jirka Poropudas (M.Sc.) Aalto University School of Science and Technology Systems.
1 S ystems Analysis Laboratory Helsinki University of Technology Numerical methods of optimal control applied to air combat analysis Jukka Ranta Raivio,
S ystems Analysis Laboratory Helsinki University of Technology Games and Bayesian Networks in Air Combat Simulation Analysis M.Sc. Jirka Poropudas and.
1 S ystems Analysis Laboratory Helsinki University of Technology Kai Virtanen, Tuomas Raivio, and Raimo P. Hämäläinen Systems Analysis Laboratory (SAL)
1 S ystems Analysis Laboratory Helsinki University of Technology Multiple Criteria Optimization and Analysis in the Planning of Effects-Based Operations.
Adaptive Critic Design for Aircraft Control Silvia Ferrari Advisor: Prof. Robert F. Stengel Princeton University FAA/NASA Joint University Program on Air.
1 S ystems Analysis Laboratory Helsinki University of Technology Kai Virtanen, Raimo P. Hämäläinen and Ville Mattila Systems Analysis Laboratory Helsinki.
NW Computational Intelligence Laboratory Implementing DHP in Software: Taking Control of the Pole-Cart System Lars Holmstrom.
1 S ystems Analysis Laboratory Helsinki University of Technology Kai Virtanen, Janne Karelahti, Tuomas Raivio, and Raimo P. Hämäläinen Systems Analysis.
1 S ystems Analysis Laboratory Helsinki University of Technology A Simulation Model for Aircraft Maintenance in an Uncertain Operational Environment Ville.
Stochastic Linear Programming by Series of Monte-Carlo Estimators Leonidas SAKALAUSKAS Institute of Mathematics&Informatics Vilnius, Lithuania
Motivation-Based Selection of Negotiation Opponents Steve Munroe and Michael Luck IAM Group University of Southampton.
International Environmental Agreements with Uncertain Environmental Damage and Learning Michèle Breton, HEC Montréal Lucia Sbragia, Durham University Game.
Ville Mattila and Kai Virtanen Systems Analysis Laboratory,
1 Helsinki University of Technology Systems Analysis Laboratory Analyzing Air Combat Simulation Results with Dynamic Bayesian Networks Jirka Poropudas.
1 S ystems Analysis Laboratory Helsinki University of Technology Scheduling Periodic Maintenance of Aircraft through simulation-based optimization Ville.
1 S ystems Analysis Laboratory Helsinki University of Technology Kai Virtanen, Tuomas Raivio and Raimo P. Hämäläinen Systems Analysis Laboratory Helsinki.
1 S ystems Analysis Laboratory Helsinki University of Technology Flight Time Allocation Using Reinforcement Learning Ville Mattila and Kai Virtanen Systems.
1 S ystems Analysis Laboratory Helsinki University of Technology Kai Virtanen, Janne Karelahti, Tuomas Raivio, and Raimo P. Hämäläinen Systems Analysis.
S ystems Analysis Laboratory Helsinki University of Technology Automated Solution of Realistic Near-Optimal Aircraft Trajectories Using Computational Optimal.
Computing and Approximating Equilibria: How… …and What’s the Point? Yevgeniy Vorobeychik Sandia National Laboratories.
Adversarial Search Chapter Games vs. search problems "Unpredictable" opponent  specifying a move for every possible opponent reply Time limits.
Management Science Helps analyze and solve organizational problems. It uses scientific and quantitative methods to set up models that are based on controllable.
1 Systems Analysis and Decision Support Prof. Raimo P. Hämäläinen Group: Dr. Kai Virtanen M.Sc. Sanna Hanhikoski, Juho Kokkala, Ville Mattila, Jirka Poropudas,
Dynamic Programming Discrete time frame Multi-stage decision problem Solves backwards.
Knowledge sharing and creation in a teachers’ professional virtual community Presenter: Che-Yu Lin Advisor: Min-Puu Chen Date: August 5, Lin, F.,
Decision Making Under Uncertainty PI Meeting - June 20, 2001 Distributed Control of Multiple Vehicle Systems Claire Tomlin and Gokhan Inalhan with Inseok.
NATIONAL AVIATION UNIVERSITY Institute of Air navigation Air Navigation Systems Department Graduate work MASTER’S DEGREE THESIS «Modeling of flight using.
S ystems Analysis Laboratory Helsinki University of Technology 1 Decision Analysis Raimo P. Hämäläinen Systems Analysis Laboratory Helsinki University.
S ystems Analysis Laboratory Helsinki University of Technology Game Theoretic Validation of Air Combat Simulation Models Jirka Poropudas and Kai Virtanen.
S ystems Analysis Laboratory Helsinki University of Technology Game Optimal Support Time of a Medium Range Air-to-Air Missile Janne Karelahti, Kai Virtanen,
1 S ystems Analysis Laboratory Helsinki University of Technology Effects-Based Operations as a Multi-Criteria Decision Analysis Problem Jouni Pousi, Kai.
S ystems Analysis Laboratory Helsinki University of Technology 15th MCDM conference - Ankara Mats Lindstedt / 1 Using Intervals for Global.
Learning of Coordination of a Quad-Rotors Team for the Construction of Multiple Structures. Sérgio Ronaldo Barros dos Santos. Supervisor: Cairo Lúcio Nascimento.
A simulation-based decision support system for business process planning Author:Peer Volkner, Brigitte Werners Public: ELSEVIER Fuzzy Sets and Systems.
Chapter 5 Adversarial Search. 5.1 Games Why Study Game Playing? Games allow us to experiment with easier versions of real-world situations Hostile agents.
Use or disclosure of the information contained herein is subject to specific written CIRA approval 1 PURSUIT – EVASION GAMES GAME THEORY AND ANALYSIS OF.
Artificial Intelligence AIMA §5: Adversarial Search
COmbining Probable TRAjectories — COPTRA
CS 460 Spring 2011 Lecture 4.
Analytics and OR DP- summary.
Simulation-based design of aircraft maintenance policies
Artificial Intelligence
Disaster Dynamics The Hurricane Landfall Game
Announcements Homework 3 due today (grace period through Friday)
Artificial Intelligence
Kai Virtanen, Janne Karelahti, Tuomas Raivio, and Raimo P. Hämäläinen
Game Theory Solutions 1 Find the saddle point for the game having the following payoff table. Use the minimax criterion to find the best strategy for.
Games with Incomplete Preferences
Systems Analysis Laboratory Helsinki University of Technology
MSE 606A Engineering Operations Research
Presentation transcript:

1 S ystems Analysis Laboratory Helsinki University of Technology Manuscript “On the Use of Influence Diagrams in a One-on-One Air Combat Game” in Kai Virtanen’s thesis “Optimal Pilot Decisions and Flight Trajectories in Air Combat” Target audience: 1. Air combat analysts, simulator developers 2. Guys working with influence diagrams 3. Dynamic/differential game theorists

2 S ystems Analysis Laboratory Helsinki University of Technology Maneuvering decisions in one-on-one air combat Find the best maneuvering sequence with respect to the goals 1. Avoid being captured by the adversary 2. Capture the adversary by taking into account - Preferences of a pilot - Uncertainties - Behavior of the adversary - Dynamic decision environment t=  t t=0  t=  t 

3 S ystems Analysis Laboratory Helsinki University of Technology Existing modeling approaches Dynamic game theory: –Pursuit-evasion games Fixed roles of the players –Two-target games: - Qualitative and quantitative solutions intractable - Myopic feedback strategies Models emulating the decision making of pilots: –Rule based and heuristic value driven systems –Discrete dynamic games, combinations of AI and games Influence Diagrams (ID): –Single stage (Virtanen et al. 1999), - pilot’s short-term decision making –Multistage (Virtanen et al. 2001), - preference optimal flight paths against given trajectories - a nonlinear programming -based solution approach

4 S ystems Analysis Laboratory Helsinki University of Technology Contributions of the manuscript Two approaches for including the adversary’s behavior in IDs –Stochastically –Deterministically Single stage ID game containing controls for both players, its solution concepts - A good computer guided aircraft - Reasonable feedback strategies Multistage ID game and its solution by nonlinear programming - Planning of fighter maneuvers Simulation procedure - An approximate solution for the one-on-one air combat game - Preference and uncertainty model into two-target games - Utilization of influence diagrams in a dynamic game situation

5 S ystems Analysis Laboratory Helsinki University of Technology Contents of the manuscript Definition of the game, motivation for the use of IDs IDs from the viewpoint of a single player Single stage ID game, its solution concepts Multistage ID game, the corresponding optimization problems The simulation procedure Numerical examples Possible journals: –Priority #1: Systems, Man, and Cybernetics –Priority #1.1: Guidance, Control, and Dynamics