Comparing two different controller designs for evolving robots Ferenc Havasi Vincenzo Giordano Michael Schwarz Gregory Valigiani Stefan Wiegand Thanks.

Slides:



Advertisements
Similar presentations
Improving System Safety through Agent-Supported User/System Interfaces: Effects of Operator Behavior Model Charles SANTONI & Jean-Marc MERCANTINI (LSIS)
Advertisements

Using Parallel Genetic Algorithm in a Predictive Job Scheduling
Effective Reinforcement Learning for Mobile Robots Smart, D.L and Kaelbing, L.P.
Yiannis Demiris and Anthony Dearden By James Gilbert.
Chapter 6: Design of Expert Systems
A Summary of the Article “Intelligence Without Representation” by Rodney A. Brooks (1987) Presented by Dain Finn.
Marakas: Decision Support Systems, 2nd Edition © 2003, Prentice-Hall Chapter Chapter 7: Expert Systems and Artificial Intelligence Decision Support.
Natural Computation: computational models inspired by nature Dr. Daniel Tauritz Department of Computer Science University of Missouri-Rolla CS347 Lecture.
A Robust Layered Control System for a Mobile Robot Rodney A. Brooks Presenter: Michael Vidal.
CS 447 Advanced Topics in Artificial Intelligence Fall 2002.
2 1 Chapter 2 Data Model Database Systems: Design, Implementation, and Management, Sixth Edition, Rob and Coronel.
Introduction to AI Michael J. Watts
Chapter 14: Artificial Intelligence Invitation to Computer Science, C++ Version, Third Edition.
Leslie Luyt Supervisor: Dr. Karen Bradshaw 2 November 2009.
Slides are based on Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems.
Soft Computing Lecture 18 Foundations of genetic algorithms (GA). Using of GA.
11 C H A P T E R Artificial Intelligence and Expert Systems.
Study on Genetic Network Programming (GNP) with Learning and Evolution Hirasawa laboratory, Artificial Intelligence section Information architecture field.
Hybrid Behavior Co-evolution and Structure Learning in Behavior-based Systems Amir massoud Farahmand (a,b,c) (
The Particle Swarm Optimization Algorithm Nebojša Trpković 10 th Dec 2010.
 Architecture and Description Of Module Architecture and Description Of Module  KNOWLEDGE BASE KNOWLEDGE BASE  PRODUCTION RULES PRODUCTION RULES 
Methodology of Simulations n CS/PY 399 Lecture Presentation # 19 n February 21, 2001 n Mount Union College.
Neural and Evolutionary Computing - Lecture 9 1 Evolutionary Neural Networks Design  Motivation  Evolutionary training  Evolutionary design of the architecture.
Bi-directional incremental evolution Dr Tatiana Kalganova Electronic and Computer Engineering Dept. Bio-Inspired Intelligent Systems Group Brunel University.
DARPA ITO/MARS Project Update Vanderbilt University A Software Architecture and Tools for Autonomous Robots that Learn on Mission K. Kawamura, M. Wilkes,
BEHIND THE BRAINBALL Team Leader : Conor RYAN Problem Leader : Michael HERDY Offspring : Andrea TONIOLO STAGGEMEIER Anne AUGER Nicolas GODZIK Jerôme JEAN-CHARLES.
Robotica Lecture Review Reactive control Complete control space Action selection The subsumption architecture –Vertical vs. horizontal decomposition.
Subsumption Architecture and Nouvelle AI Arpit Maheshwari Nihit Gupta Saransh Gupta Swapnil Srivastava.
Distributed Models for Decision Support Jose Cuena & Sascha Ossowski Pesented by: Gal Moshitch & Rica Gonen.
Manufacturing versus Construction. Resiliency: adaptation to constant change.
Artificial Intelligence: Research and Collaborative Possibilities a presentation by: Dr. Ernest L. McDuffie, Assistant Professor Department of Computer.
Evolution and Learning “Exploring Adaptive Agency I/II” Miller & Todd, 1990.
Chapter 15. Cognitive Adequacy in Brain- Like Intelligence in Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning from Humans Cinarel, Ceyda.
The article written by Boyarshinova Vera Scientific adviser: Eltyshev Denis THE USE OF NEURO-FUZZY MODELS FOR INTEGRATED ASSESSMENT OF THE CONDITIONS OF.
Evolving robot brains using vision Lisa Meeden Computer Science Department Swarthmore College.
A Presentation on Adaptive Neuro-Fuzzy Inference System using Particle Swarm Optimization and it’s Application By Sumanta Kundu (En.R.No.
George Yauneridge.  Machine learning basics  Types of learning algorithms  Genetic algorithm basics  Applications and the future of genetic algorithms.
1 Algoritmos Genéticos aplicados em Machine Learning Controle de um Robo (em inglês)
Neuro-evolving Maintain-Station Behavior for Realistically Simulated Boats Nathan A. Penrod David Carr Sushil J. Louis Bobby D. Bryant Evolutionary Computing.
Evolution, Self-organization and Swarm Robotics Minsu Kim.
Robot Intelligence Technology Lab. Evolution of simple navigation Chapter 4 of Evolutionary Robotics Jan. 12, 2007 YongDuk Kim.
When Web 2.0 encounters with iEA hwchen. Outline Motivation Web 2.0 iWeb 2.0 Introduction of iEA Related work of iEA My research project Conclusion.
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology 1 Intelligent Exploration for Genetic Algorithms Using Self-Organizing.
COGNITIVE APPROACH TO ROBOT SPATIAL MAPPING
Information Systems Development
Learning Fast and Slow John E. Laird
Creative Evolution of Flying Objects
Chapter 11: Artificial Intelligence
C.-S. Shieh, EC, KUAS, Taiwan
Chapter 6: Design of Expert Systems
Schedule for next 2 weeks
Knowledge Representation
Build Intelligence from the bottom up!
Build Intelligence from the bottom up!
Results – 100 Independent Trials Results – Single Trial
Business Rule Based Configuration Management and Software System Implementation Using Decision Tables Olegas Vasilecas, Aidas Smaizys VGTU, Vilnius, Lithuania.
Knowledge Representation
Ch 14. Active Vision for Goal-Oriented Humanoid Robot Walking (1/2) Creating Brain-Like Intelligence, Sendhoff et al. (eds), Robots Learning from.
Cognitive Language Comprehension in Rosie
CIS 488/588 Bruce R. Maxim UM-Dearborn
CHAPTER 10 METHODOLOGIES FOR CUSTOM SOFTWARE DEVELOPMENT
Build Intelligence from the bottom up!
CHAPTER I. of EVOLUTIONARY ROBOTICS Stefano Nolfi and Dario Floreano
Evolutionary Algorithms for Hyperparameter Optimization
Lecture 4. Niching and Speciation (1)
Fuzzy Logic Bai Xiao.
Evolutionary Ensembles with Negative Correlation Learning
35.1 – Describe the cognitive strategies that assist our problem solving, and identify the obstacles that hinder it. Problem Solving Strategies: 1) Trial.
Introduction to Neural Networks
Fuzzy Logic Based on a system of non-digital (continuous & fuzzy without crisp boundaries) set theory and rules. Developed by Lotfi Zadeh in 1965 Its advantage.
Presentation transcript:

Comparing two different controller designs for evolving robots Ferenc Havasi Vincenzo Giordano Michael Schwarz Gregory Valigiani Stefan Wiegand Thanks to Marc Schoenauer and Nicolas Godzik

Evolutionary robotics The control system of the robot evolves through ES The fitness function is set according to the task to be performed Explorative evolution, minimal human intervention

Advantages 1.self-organization, no explicit design 2.Exploitation of the interactions between the robot and the environment 3.No decomposition in and integration of (hopefully) simpler tasks 4.No need of many assumptions (not knowledge-rich representation)

Disadvantages The automatic process of adaptation on real-robots is time-consuming Need for heuristic and rules of thumb (trial and error procedures) Lack of formal principles: It’s difficult to compare slightly different experiments

Main point What happens if we add more knowledge in the evolution process? Are we reducing capability of evolution of exploring? Are we reducing capability of evolution of generalizing?

Two different architectures

Experimental set-up Tasks Structure of the neural network (try simple ones before) Structure of the evolutionary strategy: (20,140)-ES with weak elitism Fitness function (as simple as possible)

Experiments Obstacle avoidance fitness= high speed*straight motion*low sensor activation Following a moving object same fitness but if the camera is on then slow down and go straight

Obstacle avoidance

Following the object

Generalization We want to measure the ability to generalize the acquired knowledge to novel circumstances We evaluate the last generation of individual for each run in a different environment

Generalization (obstacle avoidance)

Generalization (following object)

Conclusions 1.The ‘following object experiment’ was successfull with both controllers 2.The second controller seems to perform better and to evolve faster than the first one 3.More specific design doesn’t necessarily lead to better results 4.It’s necessary to test generalization capabilities performing different tasks