© HVR Consulting Services Ltd AI for OOTW Representing Plausible Behaviour in OOTW Simulators.

Slides:



Advertisements
Similar presentations
Approaches, Tools, and Applications Islam A. El-Shaarawy Shoubra Faculty of Eng.
Advertisements

Seyedehmehrnaz Mireslami, Mohammad Moshirpour, Behrouz H. Far Department of Electrical and Computer Engineering University of Calgary, Canada {smiresla,
The Logic of Intelligence Pei Wang Department of Computer and Information Sciences Temple University.
Chapter Thirteen Conclusion: Where We Go From Here.
Dealing with Complexity Robert Love, Venkat Jayaraman July 24, 2008 SSTP Seminar – Lecture 10.
An Introduction to Artificial Intelligence. Introduction Getting machines to “think”. Imitation game and the Turing test. Chinese room test. Key processes.
Artificial Intelligence in Game Design Intelligent Decision Making and Decision Trees.
Artificial Intelligence in Game Design Introduction to Learning.
T-FLEX DOCs PLM, Document and Workflow Management.
Chapter 4 DECISION SUPPORT AND ARTIFICIAL INTELLIGENCE
Technical Advisor : Mr. Roni Stern Academic Advisor : Dr. Meir Kalech Team members :  Amit Ofer  Liron Katav Project Homepage :
Rutgers Components Phase 2 Principal investigators –Paul Kantor, PI; Design, modelling and analysis –Kwong Bor Ng, Co-PI - Fusion; Experimental design.
And Just Games etc.. EVOLUTION OF COMPUTER GAMES PongOdyssey Beginning of the use of microprocessors ATARI VCS system bit.
1 Hybrid Agent-Based Modeling: Architectures,Analyses and Applications (Stage One) Li, Hailin.
Marakas: Decision Support Systems, 2nd Edition © 2003, Prentice-Hall Chapter Chapter 7: Expert Systems and Artificial Intelligence Decision Support.
1 Chapter 4 Decision Support and Artificial Intelligence Brainpower for Your Business.
Developing an approach for Learning Design Players Patrick McAndrew, Rob Nadolski & Alex Little Open University UK and Open University NL Paper available.
CS Bayesian Learning1 Bayesian Learning. CS Bayesian Learning2 States, causes, hypotheses. Observations, effect, data. We need to reconcile.
Business Driven Technology Unit 3 Streamlining Business Operations Copyright © 2015 McGraw-Hill Education. All rights reserved. No reproduction or distribution.
Games Development 2 Entity / Architecture Review CO3301 Week
1 Using R for consumer psychological research Research Analytics | Strategy & Insight September 2014.
CHAPTER 12 ADVANCED INTELLIGENT SYSTEMS © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang.
Object-Oriented Software Engineering Practical Software Development using UML and Java Chapter 8: Modelling Interactions and Behaviour.
Artificial Intelligence Dr. Paul Wagner Department of Computer Science University of Wisconsin – Eau Claire.
Artificial Intelligence in Game Design Problems and Goals.
Game AI Fundamentals. What is Artificial Intelligence (AI)? Not easy to answer… “Ability of a computer or other machine to perform those activities that.
Leslie Luyt Supervisor: Dr. Karen Bradshaw 2 November 2009.
ZOMBIE MADNESS! Jack Smith Steve Mander-Jones OUTLINE > GAME OVERVIEW > IMPLEMENTATION > AI FEATURES > CONCLUSION.
Survey of AI for games. AI vs. AI for games Traditional AI: – Made to handle unseen inputs, large state space – Too many options possible to compute an.
Robotics Simulation (Skynet) Andrew Townsend Advisor: Professor Grant Braught.
Othello Artificial Intelligence With Machine Learning
Hybrid AI & Machine Learning Systems Using Ne ural Networks and Subsumption Architecture By Logan Kearsley.
Copyright © 2006, The McGraw-Hill Companies, Inc. All rights reserved. Decision Support Systems Chapter 10.
CS 478 – Tools for Machine Learning and Data Mining Backpropagation.
1-1 Copyright © 2015, 2010, 2007 Pearson Education, Inc. Chapter 10, Slide 1 Chapter 10 Understanding Randomness.
Modelling Language Evolution Lecture 1: Introduction to Learning Simon Kirby University of Edinburgh Language Evolution & Computation Research Unit.
Machine Learning for an Artificial Intelligence Playing Tic-Tac-Toe Computer Systems Lab 2005 By Rachel Miller.
Ensembles. Ensemble Methods l Construct a set of classifiers from training data l Predict class label of previously unseen records by aggregating predictions.
Chapter 13 Artificial Intelligence and Expert Systems.
Fundamentals of Information Systems, Sixth Edition1 Natural Language Processing and Voice Recognition Processing that allows the computer to understand.
I Robot.
University of Windsor School of Computer Science Topics in Artificial Intelligence Fall 2008 Sept 11, 2008.
Application of AI techniques for Computer Games BSc Computer Games Programming, 2006 Julien Delezenne GAMES ARTIFICIAL INTELLIGENCE.
Game Theory, Social Interactions and Artificial Intelligence Supervisor: Philip Sterne Supervisee: John Richter.
Chaos and Information Dr. Tom Longshaw SPSI Sector, DERA Malvern
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology 1 Evolving Reactive NPCs for the Real-Time Simulation Game.
Course Overview  What is AI?  What are the Major Challenges?  What are the Main Techniques?  Where are we failing, and why?  Step back and look at.
Dr Nick Mitchell (Room CM 224)
Finite State Machines (FSM) OR Finite State Automation (FSA) - are models of the behaviors of a system or a complex object, with a limited number of defined.
McGraw-Hill/Irwin © The McGraw-Hill Companies, All Rights Reserved CHAPTER 9 Enabling the Organization—Decision Making.
Artificial Intelligence: Research and Collaborative Possibilities a presentation by: Dr. Ernest L. McDuffie, Assistant Professor Department of Computer.
Othello Artificial Intelligence With Machine Learning Computer Systems TJHSST Nick Sidawy.
1 ARTIFICIAL INTELLIGENCE Gilles BÉZARD Version 3.16.
COIT23003 Games Development 8. Elaboration: Behaviour.
1 Pattern Recognition: Statistical and Neural Lonnie C. Ludeman Lecture 2 Nanjing University of Science & Technology.
Finite State Machines Logical and Artificial Intelligence in Games Lecture 3a.
Autonomous Dynamically Simulated Creatures for Virtual Environments Paul Urban Supervisor: Prof. Shaun Bangay Honours Project 2001.
Maestro AI Vision and Design Overview Definitions Maestro: A naïve Sensorimotor Engine prototype. Sensorimotor Engine: Combining sensory and motor functions.
Design for usability E6: Human Factors Design IB Technology.
Design Review.
Case Study -- Weather system
Othello Artificial Intelligence With Machine Learning
Introduction Characteristics Advantages Limitations
Unified Modeling Language
Chapter 7 Psychology: Memory.
Understanding Randomness
Othello Artificial Intelligence With Machine Learning
Finite State Machines Computer theory covers several types of abstract machines, including Finite State Machines.
CO Games Development 2 Week 19 Extensions to Finite State Machines
Games Development 2 Entity / Architecture Review
Presentation transcript:

© HVR Consulting Services Ltd AI for OOTW Representing Plausible Behaviour in OOTW Simulators

© HVR Consulting Services Ltd Steve Curram Mirek Gliniecki Modelling and Analysis Group HVR Consulting Services Ltd Selborne House, Mill Lane Alton, Hampshire GU34 2QJ Mark Cusack Nick Exon Distributed Technologies Group QinetiQ Ltd St Andrews Road Malvern, Worcestershire WR14 3PS

© HVR Consulting Services Ltd Background Purpose of overall study is to create simulators that allow stress testing of Command Information Systems and the people who use them in an OOTW situation Features: Multiple factions and agencies Multiple factions and agencies Highly political environment Highly political environment Restrictive RoE Restrictive RoE Media coverage and public opinion Media coverage and public opinion Multiple information sources Multiple information sources

© HVR Consulting Services Ltd Background (2) Purpose of simulators for use by commanders is to provide a challenging and thought provoking environment Purpose of simulators for use by commanders is to provide a challenging and thought provoking environment The simulators are not designed to be analysis tools The simulators are not designed to be analysis tools They will conform to the High Level Architecture (HLA) using QinetiQ’s BeanXS environment They will conform to the High Level Architecture (HLA) using QinetiQ’s BeanXS environment Use Java and JavaBeans™ technology Use Java and JavaBeans™ technology AI is only one component of the study AI is only one component of the study Quick and cheap to set up Quick and cheap to set up

© HVR Consulting Services Ltd Study Approach Identification of behaviour types and requirements of AI for OOTW simulators Identification of behaviour types and requirements of AI for OOTW simulators Review of technology and case studies to generate shortlist of approaches for further investigation Review of technology and case studies to generate shortlist of approaches for further investigation Develop stand-alone AI objects for analysis Develop stand-alone AI objects for analysis Test AI objects in an integrated environment Test AI objects in an integrated environment Prototype in a small simulation model Prototype in a small simulation model

© HVR Consulting Services Ltd Aims of the AI Provide plausible behaviour in simulation from a player’s perspective Provide plausible behaviour in simulation from a player’s perspective –computer generated actors –occurrence of events Give player something to think about Give player something to think about Be responsive to player’s actions Be responsive to player’s actions Not to be too transparent - player should be immersed in environment rather than trying to beat the AI Not to be too transparent - player should be immersed in environment rather than trying to beat the AI

© HVR Consulting Services Ltd It is more important that behaviour appears plausible to a player rather than for the mechanism to conform to any psychological theories It is more important that behaviour appears plausible to a player rather than for the mechanism to conform to any psychological theories The AI should be reasonably quick and easy to set up The AI should be reasonably quick and easy to set up Probably more akin to the requirements for commercial computer games than traditional military models Probably more akin to the requirements for commercial computer games than traditional military models It’s Artificial Intelligence, BUT

© HVR Consulting Services Ltd Approaches Considered Random Sampling - does not take account of conditions, though not entirely predictable - could be combined with other approaches Random Sampling - does not take account of conditions, though not entirely predictable - could be combined with other approaches Knowledge-Based Systems (& related) - can be too predictable if rules are simple, while ease of setting up falls rapidly as rules become more complex Knowledge-Based Systems (& related) - can be too predictable if rules are simple, while ease of setting up falls rapidly as rules become more complex Fuzzy Logic - rules are generally simpler but more powerful than KBSs, needs some experience in choice of fuzzy regions, linguistic terms can help trainers in tweaking scenarios Fuzzy Logic - rules are generally simpler but more powerful than KBSs, needs some experience in choice of fuzzy regions, linguistic terms can help trainers in tweaking scenarios Case-Based Reasoning - full systems can be time consuming to set up and have overhead of a shell, simpler versions may be useful for recognising when scripted events can occur Case-Based Reasoning - full systems can be time consuming to set up and have overhead of a shell, simpler versions may be useful for recognising when scripted events can occur

© HVR Consulting Services Ltd Approaches Considered (2) Finite State Machines - commonly used in computer games, simple to set up, can get predictable for player Finite State Machines - commonly used in computer games, simple to set up, can get predictable for player Fuzzy State Machines - adaptation of Finite State Machines using fuzzy rules, becoming popular in computer games, membership functions could be used for random sampling Fuzzy State Machines - adaptation of Finite State Machines using fuzzy rules, becoming popular in computer games, membership functions could be used for random sampling Bayesian Belief Networks - powerful representation of factors on behaviour, can be difficult to set up, difficulty of validation Bayesian Belief Networks - powerful representation of factors on behaviour, can be difficult to set up, difficulty of validation Neural Networks (various types) - adaptive, powerful representation but time consuming and difficult to set up and validate Neural Networks (various types) - adaptive, powerful representation but time consuming and difficult to set up and validate Genetic Algorithms - adaptive, but too slow for interactive simulation Genetic Algorithms - adaptive, but too slow for interactive simulation

© HVR Consulting Services Ltd Short-listed Approaches Finite State Machine (FSM) Finite State Machine (FSM) –for simple behaviour –create generic FSM object to which states and transitions are added –easy to set up

© HVR Consulting Services Ltd Short-listed Approaches Fuzzy State Machine (FuSM) Fuzzy State Machine (FuSM) –for more complex behaviour –linguistic or numerical inputs –smoother transitions between states –create generic FuSM to which terms and fuzzy rules can be added –state can be selected from centre of gravity or using random sampling from fuzzy region

© HVR Consulting Services Ltd Implementation Considerations Classes developed in Java and converted to JavaBeans™ Classes developed in Java and converted to JavaBeans™ Will be used in simulations along with other JavaBeans™ Will be used in simulations along with other JavaBeans™ They need to pick up messages and hold their own state They need to pick up messages and hold their own state Need to respond to a request or simulation time Need to respond to a request or simulation time Behaviour should be able to be time-scaleable Behaviour should be able to be time-scaleable

© HVR Consulting Services Ltd Fuzzy State Machine Fuzzy State Machine and test rig (shown) developed Fuzzy State Machine and test rig (shown) developed Allows absolute rules - outcome is state membership values Allows absolute rules - outcome is state membership values Allows change rules - outcome is amount of change to current state value Allows change rules - outcome is amount of change to current state value States and rules can be read- in using a scripting language States and rules can be read- in using a scripting language JavaBean version developed JavaBean version developed Wrapper/Interpreter allows FuSMBean to interact with rest of simulation Wrapper/Interpreter allows FuSMBean to interact with rest of simulation

© HVR Consulting Services Ltd Behaviour Type - Attitude Attitude of an actor towards other actors Attitude of an actor towards other actors –may differ at different levels, e.g. faction leaders towards UN, or faction soldier towards UN –use Finite State Machine or Fuzzy State Machine Neutral Mistrustful Neutral Mistrustful

© HVR Consulting Services Ltd Behaviour Type - Negotiation Negotiation between actors Negotiation between actors –manual: player has role as a mediator, and suggests compromise solutions –automatic: compromise solutions based on global approach to negotiation settings –response of actors depends on the weighted distance from their ideal solution and their attitude towards the negotiations –makes use of Fuzzy State Machines –likely to be iterative process over time (may be short or long periods)

© HVR Consulting Services Ltd Behaviour Type - Negotiation

© HVR Consulting Services Ltd Vignette Development (WIP) Two warring factions Two warring factions Refugees from both population groups Refugees from both population groups Refugee camps for both groups Refugee camps for both groups –populations, food, medicine, death rates UN convoys supplying camps UN convoys supplying camps Road blocks run by militia factions Road blocks run by militia factions Media coverage Media coverage Includes: crowd movement, terrain, path- finding, attitude, negotiation Includes: crowd movement, terrain, path- finding, attitude, negotiation

© HVR Consulting Services Ltd Observations So Far Generic and flexible FSM and FuSMs can be created and converted to JavaBeans ™ Generic and flexible FSM and FuSMs can be created and converted to JavaBeans ™ Wrappers control interaction with other JavaBeans ™ in the simulation Wrappers control interaction with other JavaBeans ™ in the simulation Specific behaviour loaded in from XML Specific behaviour loaded in from XML Types of behaviour can be stored in libraries Types of behaviour can be stored in libraries Experimenting with messaging Experimenting with messaging Refining rules - want sufficient power with simplest set possible Refining rules - want sufficient power with simplest set possible

© HVR Consulting Services Ltd Questions ?