ANNIE EA Papers Sampling the Nature of a Population: Punctuated Anytime Learning for Co- Evolving a Team – Gary Parker, H. Joseph Blumenthal Ants and Evolution:

Slides:



Advertisements
Similar presentations
Population-based metaheuristics Nature-inspired Initialize a population A new population of solutions is generated Integrate the new population into the.
Advertisements

CS6800 Advanced Theory of Computation
O(N 1.5 ) divide-and-conquer technique for Minimum Spanning Tree problem Step 1: Divide the graph into  N sub-graph by clustering. Step 2: Solve each.
1 An Adaptive GA for Multi Objective Flexible Manufacturing Systems A. Younes, H. Ghenniwa, S. Areibi uoguelph.ca.
Using Parallel Genetic Algorithm in a Predictive Job Scheduling
Tuesday, May 14 Genetic Algorithms Handouts: Lecture Notes Question: when should there be an additional review session?
Biologically Inspired AI (mostly GAs). Some Examples of Biologically Inspired Computation Neural networks Evolutionary computation (e.g., genetic algorithms)
Content Based Image Clustering and Image Retrieval Using Multiple Instance Learning Using Multiple Instance Learning Xin Chen Advisor: Chengcui Zhang Department.
Non-Linear Problems General approach. Non-linear Optimization Many objective functions, tend to be non-linear. Design problems for which the objective.
Parallelized Evolution System Onur Soysal, Erkin Bahçeci Erol Şahin Dept. of Computer Engineering Middle East Technical University.
Hybridization of Search Meta-Heuristics Bob Buehler.
Design of Autonomous Navigation Controllers for Unmanned Aerial Vehicles using Multi-objective Genetic Programming Gregory J. Barlow March 19, 2004.
Research Trends in AI Maze Solving using GA Muhammad Younas Hassan Javaid Danish Hussain
Genetic Algorithms Nehaya Tayseer 1.Introduction What is a Genetic algorithm? A search technique used in computer science to find approximate solutions.
Genetic Algorithm What is a genetic algorithm? “Genetic Algorithms are defined as global optimization procedures that use an analogy of genetic evolution.
UNIVERSITY OF JYVÄSKYLÄ Resource Discovery in Unstructured P2P Networks Distributed Systems Research Seminar on Mikko Vapa, research student.
1 Reasons for parallelization Can we make GA faster? One of the most promising choices is to use parallel implementations. The reasons for parallelization.
Development in hardware – Why? Option: array of custom processing nodes Step 1: analyze the application and extract the component tasks Step 2: design.
Ranga Rodrigo April 6, 2014 Most of the sides are from the Matlab tutorial. 1.
A Genetic Algorithms Approach to Feature Subset Selection Problem by Hasan Doğu TAŞKIRAN CS 550 – Machine Learning Workshop Department of Computer Engineering.
Genetic Algorithms and Ant Colony Optimisation
Efficient Model Selection for Support Vector Machines
Adapting Convergent Scheduling Using Machine Learning Diego Puppin*, Mark Stephenson †, Una-May O’Reilly †, Martin Martin †, and Saman Amarasinghe † *
Evolving a Sigma-Pi Network as a Network Simulator by Justin Basilico.
Slides are based on Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems.
Soft Computing Lecture 18 Foundations of genetic algorithms (GA). Using of GA.
SOFT COMPUTING (Optimization Techniques using GA) Dr. N.Uma Maheswari Professor/CSE PSNA CET.
Neural Networks Ellen Walker Hiram College. Connectionist Architectures Characterized by (Rich & Knight) –Large number of very simple neuron-like processing.
Hybrid AI & Machine Learning Systems Using Ne ural Networks and Subsumption Architecture By Logan Kearsley.
1 The Euclidean Non-uniform Steiner Tree Problem by Ian Frommer Bruce Golden Guruprasad Pundoor INFORMS Annual Meeting Denver, Colorado October 2004.
Study on Genetic Network Programming (GNP) with Learning and Evolution Hirasawa laboratory, Artificial Intelligence section Information architecture field.
Lecture 8: 24/5/1435 Genetic Algorithms Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
ANTs PI Meeting, Nov. 29, 2000W. Zhang, Washington University1 Flexible Methods for Multi-agent distributed resource Allocation by Exploiting Phase Transitions.
Chapter 7 Handling Constraints
CS261 – Recitation 5 Fall Outline Assignment 3: Memory and Timing Tests Binary Search Algorithm Binary Search Tree Add/Remove examples 1.
Design of an Evolutionary Algorithm M&F, ch. 7 why I like this textbook and what I don’t like about it!
Evolving Virtual Creatures & Evolving 3D Morphology and Behavior by Competition Papers by Karl Sims Presented by Sarah Waziruddin.
FINAL EXAM SCHEDULER (FES) Department of Computer Engineering Faculty of Engineering & Architecture Yeditepe University By Ersan ERSOY (Engineering Project)
Neural and Evolutionary Computing - Lecture 9 1 Evolutionary Neural Networks Design  Motivation  Evolutionary training  Evolutionary design of the architecture.
GENETIC ALGORITHMS.  Genetic algorithms are a form of local search that use methods based on evolution to make small changes to a popula- tion of chromosomes.
Learning by Simulating Evolution Artificial Intelligence CSMC February 21, 2002.
Evolution Programs (insert catchy subtitle here).
ELeaRNT: Evolutionary Learning of Rich Neural Network Topologies Authors: Slobodan Miletic 3078/2010 Nikola Jovanovic 3077/2010
1 Genetic Algorithms and Ant Colony Optimisation.
Genetic Algorithms Przemyslaw Pawluk CSE 6111 Advanced Algorithm Design and Analysis
Chapter 9 Genetic Algorithms.  Based upon biological evolution  Generate successor hypothesis based upon repeated mutations  Acts as a randomized parallel.
 Based on observed functioning of human brain.  (Artificial Neural Networks (ANN)  Our view of neural networks is very simplistic.  We view a neural.
Edge Assembly Crossover
Genetic Algorithms Genetic algorithms provide an approach to learning that is based loosely on simulated evolution. Hypotheses are often described by bit.
Coevolutionary Automated Software Correction Josh Wilkerson PhD Candidate in Computer Science Missouri S&T.
Solving the Euclidean Non-Uniform Steiner Tree Problem Using a Genetic Algorithm Ian Frommer, Dept. of Mathematics, US Coast Guard Academy Bruce Golden,
Genetic Algorithms. Underlying Concept  Charles Darwin outlined the principle of natural selection.  Natural Selection is the process by which evolution.
The minimum cost flow problem. Solving the minimum cost flow problem.
Genetic Programming Using Simulated Natural Selection to Automatically Write Programs.
Multi-cellular paradigm The molecular level can support self- replication (and self- repair). But we also need cells that can be designed to fit the specific.
An Evolutionary Algorithm for Neural Network Learning using Direct Encoding Paul Batchis Department of Computer Science Rutgers University.
Genetic Algorithms And other approaches for similar applications Optimization Techniques.
Genetic Algorithm(GA)
 Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems n Introduction.
Warehouse Lending Optimization Paul Parker (2016).
Evolutionary Computation Evolving Neural Network Topologies.
Genetic Algorithms.
Neural Networks Dr. Peter Phillips.
Advanced Artificial Intelligence Evolutionary Search Algorithm
Minimum Spanning Tree.
Solving the Minimum Labeling Spanning Tree Problem
Yupei Xiong Bruce Golden Edward Wasil INFORMS Annual Meeting
Genetic Algorithm Soft Computing: use of inexact t solution to compute hard task problems. Soft computing tolerant of imprecision, uncertainty, partial.
Evolutionary Ensembles with Negative Correlation Learning
Coevolutionary Automated Software Correction
Presentation transcript:

ANNIE EA Papers Sampling the Nature of a Population: Punctuated Anytime Learning for Co- Evolving a Team – Gary Parker, H. Joseph Blumenthal Ants and Evolution: The Non-Uniform Steiner Minimal Tree Problem – Chris Coulston, Matt Smith Katrina Werger GAMA: Genetic Algorithm Memory Assignment – Gary Grewal, Thomas C. Wilson Evolving Multiple Neural Networks – Sunghwan Sohn, Cihan Dagli

Sampling the Nature of a Population: Punctuated Anytime Learning for Co-Evolving a Team Training robots to push a box Separate populations for specialization Each gene represents a sub-cycle and a number of times to be repeated Punctuated Anytime Learning – allows learning system to be periodically updated throughout simulated evolution Evaluate individual performance regularly, with punctuated team evaluation Use a sample of high ranked individuals from population a to evaluate population b Results – Population of 64, sampling rate of 8 generations, new alphas selected every 100 generations Good level of success

Ants and Evolution: The Non-Uniform Steiner Minimal Tree Problem Given a set of points G, the Steiner Minimal Tree (SMT) seeks a minimal cost collection of edges spanning G, incorporating extra Steiner points not in G Hexagonally partitioned plane Steiner tree is MST on set of given and Steiner points GA generates Steiner points and uses a MST algorithm for evaluation Mutation adds and removes Steiner points, crossover by merging compatible full components Ant colonies work with preferred direction, scent trail, scent decay, forage and follow Ants find another city or fall off edge, teleporting back home to start again Steiner points added at scent crossing points Result: GA beats Ant Colony

GAMA: Genetic Algorithm Memory Assignment Multi-bank memory assignment for DSPs Operands fetched from same memory must be done sequentially, operands from separate memories in parallel Hard constraints and Soft Constraints Fitness = number of hard constraints satisfied + benefit of satisfied soft constraints Directed mutation applied to eliminate hard constraint violations Runs unsupervised – mutation and crossover rates determined and adjusted automatically Currently used in Cogen, a retargetable, optimizing compiler for DSPs

Evolving Multiple Neural Networks Neural networks have a complex structure that gives power to solve difficult problems, but has ambiguity of how to construct proper architecture GA used to locate optimal architecture GA selects feature subset and evolves topology Binary GA for layer connectivity Fitness function chosen to maximize correct ratio and minimize complexity Networks combined using average method – individual subnetworks make up population of GA Additional GA used to select population members to make up final network Results: experiments show an improvement in performance and topology vs. classical neural network