科技英文作業 6 602410054 黃方世 602410087 陳竹軒. Introduction Talking about video games. Training agents for what. Focus on training Non-player-character (NPC).

Slides:

Advertisements

Similar presentations

By Luigi Cardamone, Daniele Loiacono and Pier Luca Lanzi.

Advertisements

Playing Tic Tac Toe with Neural Networks Justin Herbrand CS/ECE/ME 539.

The AGILO Autonomous Robot Soccer Team: Computational Principles, Experiences, and Perspectives Michael Beetz, Sebastian Buck, Robert Hanek, Thorsten Schmitt,

Biologically Inspired AI (mostly GAs). Some Examples of Biologically Inspired Computation Neural networks Evolutionary computation (e.g., genetic algorithms)

Neuro-Evolution of Augmenting Topologies Ben Trewhella.

Genetic Algorithms. Some Examples of Biologically Inspired AI Neural networks Evolutionary computation (e.g., genetic algorithms) Immune-system-inspired.

Evolving Neural Network Agents in the NERO Video Game Author ： Kenneth O. Stanley, Bobby D. Bryant, and Risto Miikkulainen Presented by Yi Cheng Lin.

Reinforcement Learning in Real-Time Strategy Games Nick Imrei Supervisors: Matthew Mitchell & Martin Dick.

Trading optimality for speed…

Design of Autonomous Navigation Controllers for Unmanned Aerial Vehicles using Multi-objective Genetic Programming Gregory J. Barlow March 19, 2004.

1. 2 overview Background on video games Background on video games Neural networks Neural networks NE NE NEAT NEAT rtNEAT rtNEAT NERO NERO.

Chuang-Hue Moh Spring Embodied Intelligence: Final Project.

By Jacob Schrum and Risto Miikkulainen

Computational Intelligence in Games: An Overview Zahid Halim Faculty of Computer Science and Engineering Ghulam Ishaq Khan Institute of Engineering Sciences.

Evolving Multi-modal Behavior in NPCs Jacob Schrum – Risto Miikkulainen –

Evolutionary Robotics NEAT / HyperNEAT Stanley, K.O., Miikkulainen (2001) Evolving Neural Networks through Augmenting Topologies. Competing Conventions:

林偉楷 Taiwan Evolutionary Intelligence Laboratory.

Slides are based on Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems.

Soft Computing Lecture 18 Foundations of genetic algorithms (GA). Using of GA.

CAP6938 Neuroevolution and Developmental Encoding Working with NEAT Dr. Kenneth Stanley September 27, 2006.

Jorge Munoz, German Gutierrez, Araceli Sanchis Presented by: Itay Bittan.

Hybrid AI & Machine Learning Systems Using Ne ural Networks and Subsumption Architecture By Logan Kearsley.

LITERATURE SURVEY 1.EFFICIENT PATH PLANNING IN SEMI- FAULT TOLERANT ROBOTICS 2. Caesar robot.

Gamification of Innovation, Discovery, Research & Development Incentives and Best Practices in Crowd-Sourcing & Crowd-Funding.

Idea1 : Net Aooni Arcade Idea2 : Shooting Arcade Project Brainstorming Computer Game 2011 Fall ♣ Lee Sang Min.

Collaboration Development through Interactive Learning between Human and Robot Tetsuya OGATA, Noritaka MASAGO, Shigeki SUGANO, Jun TANI.

Machine Learning for an Artificial Intelligence Playing Tic-Tac-Toe Computer Systems Lab 2005 By Rachel Miller.

CAP6938 Neuroevolution and Developmental Encoding Real-time NEAT Dr. Kenneth Stanley October 18, 2006.

2 Digit Divisors. 3,521 ÷ 26 = = 26 x = 26 x 3 Click the squirrel for a video on repeated multiplication.

Artificial Life/Agents Creatures: Artificial Life Autonomous Software Agents for Home Entertainment Stephen Grand, 1997 Learning Human-like Opponent Behaviour.

Robotics. What is a robot? Have you seen a robot? Where? – In a photo? – Video? – In real life?

COMP 304: Artificial Intelligence. General Lecturer: Nelishia Pillay Office: Room F3 Telephone:

Evolutionary Robotics The Italian Approach The Khepera robot (1996) Developed at EPFL Lausanne, Switzerland(!) by Francesco Mondada Diameter: 55 mm Could.

Artificial Intelligence for Games Online and local search

Jack Chen TJHSST Computer Systems Lab Abstract The purpose of this project is to explore Artificial Intelligence techniques in the board game.

CAP6938 Neuroevolution and Developmental Encoding Basic Concepts Dr. Kenneth Stanley August 23, 2006.

Mike Taks Bram van de Klundert. About Published 2005 Cited 286 times Kenneth O. Stanley Associate Professor at University of Central Florida Risto Miikkulainen.

ILLINOIS ATTACK TRAVEL BASKETBALL PROGRAM.

Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology 1 Motivated Reinforcement Learning for Non-Player Characters.

Pac-Man AI using GA. Why Machine Learning in Video Games? Better player experience Agents can adapt to player Increased variety of agent behaviors Ever-changing.

Artificial Intelligence Research in Video Games By Jacob Schrum

Design and Implementation of General Purpose Reinforcement Learning Agents Tyler Streeter November 17, 2005.

CAP6938 Neuroevolution and Artificial Embryogeny Competitive Coevolution Dr. Kenneth Stanley February 20, 2006.

Evolving Multimodal Networks for Multitask Games

CAP6938 Neuroevolution and Developmental Encoding Evolving Adaptive Neural Networks Dr. Kenneth Stanley October 23, 2006.

CS 351/ IT 351 Modeling and Simulation Technologies HPC Architectures Dr. Jim Holten.

CAP6938 Neuroevolution and Developmental Encoding Intro to Neuroevolution Dr. Kenneth Stanley September 18, 2006.

CAP6938 Neuroevolution and Artificial Embryogeny Neural Network Weight Optimization Dr. Kenneth Stanley January 18, 2006.

Manager Role. Manager Role - Introduction Flexible approach maintaining preschool learning environment Not role specific – is an assigned task Staff person.

CAP6938 Neuroevolution and Artificial Embryogeny Real-time NEAT Dr. Kenneth Stanley February 22, 2006.

March 1, 2016Introduction to Artificial Intelligence Lecture 11: Machine Evolution 1 Let’s look at… Machine Evolution.

 Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems n Introduction.

CAP6938 Neuroevolution and Artificial Embryogeny Real-time NEAT Dr. Kenneth Stanley February 22, 2006.

Neuro-evolving Maintain-Station Behavior for Realistically Simulated Boats Nathan A. Penrod David Carr Sushil J. Louis Bobby D. Bryant Evolutionary Computing.

TORCS WORKS Jang Su-Hyung.

Dr. Kenneth Stanley January 30, 2006

HyperNetworks Engın denız usta

Dr. Kenneth Stanley September 6, 2006

Evolving Multimodal Networks for Multitask Games

Introduction to CAP6938 Neuroevolution and Developmental Encoding

A Robot mapping a series of hallways

Continous-Action Q-Learning

Topological Ordering Algorithm: Example

Interaction with artificial intelligence in games

ورود اطلاعات بصورت غيربرخط

Introduction to Artificial Intelligence Lecture 11: Machine Evolution

Topological Ordering Algorithm: Example

Russell and Norvig: Chapter 3, Sections 3.1 – 3.3

Topological Ordering Algorithm: Example

Topological Ordering Algorithm: Example

Presentation transcript:

科技英文作業黃方世陳竹軒

Introduction Talking about video games. Training agents for what. Focus on training Non-player-character (NPC). Training agents offline or online.

Real-time NeuroEvolution of Augmenting Topologies (1) Based on NeuroEvolution of Augmenting Topologies (NEAT). Evolving neural networks for reinforcement learning tasks using genetic algorithm. Starting with simple networks; expand the search space only when beneficial.

Real-time NeuroEvolution of Augmenting Topologies (2) The worst individual is removed and replaced with a child of parents chosen from among the best.

Real-time NeuroEvolution of Augmenting Topologies (3)

NeuroEvoluting Robotic Operatives (NERO) The exercises are increasingly difficult; the team can learning basic skills and gradually building on them.

Training Mode Robots have several types of sensors. The standard sensors include enemy radars, object rangefinders. ─ Enemy radar divide 360 degrees around the robot into slices. ─ Rangefinders project rays at several angles from the robot.

Playing NERO Training to run around walls to approach the enemy. Player incrementally add more walls until the robots can navigate an entire maze without any path-planning.