Lecture 4. Niching and Speciation (1)

Slides:



Advertisements
Similar presentations
Exploring Change Unity and Diversity. Classification Introduction How many species are there? Why should we be interested in learning about the diversity.
Advertisements

Temi Avanzati di Intelligenza Artificiale - Intro1 Temi Avanzati di Intelligenza Artificiale Prof. Vincenzo Cutello Department of Mathematics and Computer.
Representing Hypothesis Operators Fitness Function Genetic Programming
Genetic Algorithms (Evolutionary Computing) Genetic Algorithms are used to try to “evolve” the solution to a problem Generate prototype solutions called.
Computer Science Genetic Algorithms8/23/20011 Applications Boeing 777 engines designed by GE I2 technologies ERP package uses Gas John Deere – manufacturing.
Biologically Inspired AI (mostly GAs). Some Examples of Biologically Inspired Computation Neural networks Evolutionary computation (e.g., genetic algorithms)
EvoNet Flying Circus Introduction to Evolutionary Computation Brought to you by (insert your name) The EvoNet Training Committee The EvoNet Flying Circus.
Institute of Intelligent Power Electronics – IPE Page1 Introduction to Basics of Genetic Algorithms Docent Xiao-Zhi Gao Department of Electrical Engineering.
EvoNet Flying Circus Introduction to Evolutionary Computation Brought to you by (insert your name) The EvoNet Training Committee The EvoNet Flying Circus.
Evolving Neural Network Agents in the NERO Video Game Author : Kenneth O. Stanley, Bobby D. Bryant, and Risto Miikkulainen Presented by Yi Cheng Lin.
Applications of Evolutionary Computation in the Analysis of Factors Influencing the Evolution of Human Language Alex Decker.
Data classification based on tolerant rough set reporter: yanan yean.
Evolutionary Algorithms Simon M. Lucas. The basic idea Initialise a random population of individuals repeat { evaluate select vary (e.g. mutate or crossover)
Natural Computation: computational models inspired by nature Dr. Daniel Tauritz Department of Computer Science University of Missouri-Rolla CS347 Lecture.
1 MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING By Kaan Tariman M.S. in Computer Science CSCI 8810 Course Project.
Genetic Algorithms (GAs) by Jia-Huei Liao Source: Chapter 9, Machine Learning, Tom M. Mitchell, 1997 The Genetic Programming Tutorial Notebook
Evolutionary Computation Application Peter Andras peter.andras/lectures.
Computer Science Genetic Algorithms10/13/10 1 An Investigation of Niching and Species Formation in Genetic Function Optimization Kalyanmoy Deb David E.
Island Based GA for Optimization University of Guelph School of Engineering Hooman Homayounfar March 2003.
A Genetic Algorithms Approach to Feature Subset Selection Problem by Hasan Doğu TAŞKIRAN CS 550 – Machine Learning Workshop Department of Computer Engineering.
Evolutionary Algorithms BIOL/CMSC 361: Emergence Lecture 4/03/08.
Lecture 2. Co-Evolution (II)
CSI Evolutionary Computation Fall Semester, 2009.
Evolving a Sigma-Pi Network as a Network Simulator by Justin Basilico.
Multimodal Optimization (Niching) A/Prof. Xiaodong Li School of Computer Science and IT, RMIT University Melbourne, Australia
Slides are based on Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems.
Introduction to Genetic Algorithms and Evolutionary Computation
Evolution Strategies Evolutionary Programming Genetic Programming Michael J. Watts
More on coevolution and learning Jing Xiao April, 2008.
Lecture 8: 24/5/1435 Genetic Algorithms Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
Optimization Problems - Optimization: In the real world, there are many problems (e.g. Traveling Salesman Problem, Playing Chess ) that have numerous possible.
Lecture 5. Niching and Speciation (2) 4 학습목표 진화로 얻어진 해의 다양성을 확보하기 위한 대표 적인 방법에 대해 이해한다.
Fuzzy Genetic Algorithm
Genetic Algorithms Introduction Advanced. Simple Genetic Algorithms: Introduction What is it? In a Nutshell References The Pseudo Code Illustrations Applications.
1 Machine Learning: Lecture 12 Genetic Algorithms (Based on Chapter 9 of Mitchell, T., Machine Learning, 1997)
Neural and Evolutionary Computing - Lecture 9 1 Evolutionary Neural Networks Design  Motivation  Evolutionary training  Evolutionary design of the architecture.
Niching Genetic Algorithms Motivation The Idea Ecological Meaning Niching Techniques.
Data Mining BY JEMINI ISLAM. Data Mining Outline: What is data mining? Why use data mining? How does data mining work The process of data mining Tools.
Learning Classifier Systems BRANDEN PAPALIA, MICHAEL STEWART, JAMES PATRICK FACULTY OF ENGINEERING, COMPUTING AND MATHEMATICS.
 Based on observed functioning of human brain.  (Artificial Neural Networks (ANN)  Our view of neural networks is very simplistic.  We view a neural.
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology 1 Evolving Reactive NPCs for the Real-Time Simulation Game.
Learning Classifier Systems (Introduction) Muhammad Iqbal Evolutionary Computation Research Group School of Engineering and Computer Science Victoria University.
CSI Evolutionary Computation Fall Semester, 2011.
Neural and Evolutionary Computing - Lecture 9 1 Evolutionary Multiobjective Optimization  Particularities of multiobjective optimization  Multiobjective.

A field of study that encompasses computational techniques for performing tasks that require intelligence when performed by humans. Simulation of human.
Computer Vision Lecture 7 Classifiers. Computer Vision, Lecture 6 Oleh Tretiak © 2005Slide 1 This Lecture Bayesian decision theory (22.1, 22.2) –General.
An Evolutionary Algorithm for Neural Network Learning using Direct Encoding Paul Batchis Department of Computer Science Rutgers University.
Genetic Algorithm. Outline Motivation Genetic algorithms An illustrative example Hypothesis space search.
March 1, 2016Introduction to Artificial Intelligence Lecture 11: Machine Evolution 1 Let’s look at… Machine Evolution.
 Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems n Introduction.
Deep Learning: What is it good for? R. Burgmann
Evolution Strategies Evolutionary Programming
Kalyanmoy Deb David E. Goldberg
Louise Lawrence Supervisor: Dr Wolfgang Mayer
Prepared by: Mahmoud Rafeek Al-Farra
Co-Evolution and Speciation
رایانش تکاملی evolutionary computing
Bull-Paper Review1 Holland (1986): “Classifier systems … rule-based systems with general mechanisms to process rules in parallel, for the adaptive generation.
Classifying based on Evolution
دانشگاه صنعتی امیرکبیر
Introduction to Artificial Intelligence Lecture 11: Machine Evolution
MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING
MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING
Machine Learning: UNIT-4 CHAPTER-2
A Tutorial (Complete) Yiming
학습목표 공진화의 개념을 이해하고, sorting network에의 응용가능성을 점검한다
Genetic Algorithm Soft Computing: use of inexact t solution to compute hard task problems. Soft computing tolerant of imprecision, uncertainty, partial.
Evolutionary Ensembles with Negative Correlation Learning
A task of induction to find patterns
Presentation transcript:

Lecture 4. Niching and Speciation (1) 학습목표 진화로 얻어진 해의 다양성을 확보하기 위한 대표적인 방법에 대해 이해한다.

Outline Review of the last lecture Different types of co-evolution Different applications Learning (e.g., games, classification, …) Optimization (e.g., sorting networks) Design (e.g., floor plan design, …) A motivating example of niching: co-evolution in classification tasks Why niching Different niching techniques Relationship between niching and speciation Summary

A Motivating Example (1) Task: Design a machine learning system to classify two classes. A training set is given, consisting of 97 examples of class A and 97 examples of class B. Assume that you are going to evolve this machine learning system (which can be a rule-based system or a neural network). How do you develop such an evolutionary system? Representation: Search (Genetic) operators: Fitness evaluation:

Why Niching In evolutionary computation, niching refers to the formation of groups of individuals in a population Individuals within a group are similar to each other Individuals from different groups are dissimilar to each other Niching helps to explore and maintain diversity Niching helps in machine learning, e.g., classification Niching helps multi-objective function optimization Niching helps simulation of complex and adaptive systems Niching helps cooperative co-evolution Niching is fun!

Different Niching Techniques Can be divided roughly into two major categories Sharing, also known as fitness sharing Crowding Other niching methods include sequential niching and parallel hillclimbing

Fitness Sharing: Introduction Fitness sharing transforms the raw fitness of an individual into shared fitness It assumes that there is only limited and fixed “resource” available at each niche. Individuals in a niche must share them Sharing is best explained from a multimodal function optimization perspective raw fitness individual How can we locate multiple peaks in one evolutionary process?