Chapter 14. Active Vision for Goal-Oriented Humanoid Robot Walking (2/2) in Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning from.

Slides:



Advertisements
Similar presentations
Teaching an Agent by Playing a Multimodal Memory Game: Challenges for Machine Learners and Human Teachers AAAI 2009 Spring Symposium: Agents that Learn.
Advertisements

Artificial Intelligence Chapter 5 State Machines.
Becerra-Fernandez, et al. -- Knowledge Management 1/e -- © 2004 Prentice Hall Chapter 7 Technologies to Manage Knowledge: Artificial Intelligence.
Particle Swarm Optimization (PSO)  Kennedy, J., Eberhart, R. C. (1995). Particle swarm optimization. Proc. IEEE International Conference.
DARPA Mobile Autonomous Robot SoftwareMay Adaptive Intelligent Mobile Robotics William D. Smart, Presenter Leslie Pack Kaelbling, PI Artificial.
4-1 Management Information Systems for the Information Age Copyright 2002 The McGraw-Hill Companies, Inc. All rights reserved Chapter 4 Decision Support.
Genetic Algorithms. Some Examples of Biologically Inspired AI Neural networks Evolutionary computation (e.g., genetic algorithms) Immune-system-inspired.
An EA for Box Pushing with a LEGO Mindstorms Robot By Sara L. Skroh December 5, 2003.
Neural Networks Chapter Feed-Forward Neural Networks.
Artificial Intelligence Genetic Algorithms and Applications of Genetic Algorithms in Compilers Prasad A. Kulkarni.
1 Chapter 4 Decision Support and Artificial Intelligence Brainpower for Your Business.
1 MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING By Kaan Tariman M.S. in Computer Science CSCI 8810 Course Project.
Coordinative Behavior in Evolutionary Multi-agent System by Genetic Algorithm Chuan-Kang Ting – Page: 1 International Graduate School of Dynamic Intelligent.
Biointelligence Laboratory School of Computer Science and Engineering Seoul National University Cognitive Robots © 2014, SNU CSE Biointelligence Lab.,
컴퓨터 그래픽스 분야의 캐릭터 자동생성을 위하여 인공생명의 여러 가지 방법론이 어떻게 적용될 수 있는지 이해
Parallel Genetic Algorithms with Distributed-Environment Multiple Population Scheme M.Miki T.Hiroyasu K.Hatanaka Doshisha University,Kyoto,Japan.
Joint International Master Project Dennis Böck & Dirk C. Aumueller 1.
An Approach of Artificial Intelligence Application for Laboratory Tests Evaluation Ş.l.univ.dr.ing. Corina SĂVULESCU University of Piteşti.
Evolving a Sigma-Pi Network as a Network Simulator by Justin Basilico.
Soft Computing Lecture 18 Foundations of genetic algorithms (GA). Using of GA.
1 6. Feed-forward mapping networks Lecture Notes on Brain and Computation Byoung-Tak Zhang Biointelligence Laboratory School of Computer Science and Engineering.
Hybrid AI & Machine Learning Systems Using Ne ural Networks and Subsumption Architecture By Logan Kearsley.
Towards Cognitive Robotics Biointelligence Laboratory School of Computer Science and Engineering Seoul National University Christian.
Chapter 1. Introduction in Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning from Humans Jo, HwiYeol Biointelligence Laboratory.
Study on Genetic Network Programming (GNP) with Learning and Evolution Hirasawa laboratory, Artificial Intelligence section Information architecture field.
Chapter 16. Basal Ganglia Models for Autonomous Behavior Learning in Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning from Humans.
Neural and Evolutionary Computing - Lecture 9 1 Evolutionary Neural Networks Design  Motivation  Evolutionary training  Evolutionary design of the architecture.
1 5. Application Examples 5.1. Programmable compensation for analog circuits (Optimal tuning) 5.2. Programmable delays in high-speed digital circuits (Clock.
Autonomous Virtual Humans Tyler Streeter April 15, 2004.
Spatio-Temporal Case-Based Reasoning for Behavioral Selection Maxim Likhachev and Ronald Arkin Mobile Robot Laboratory Georgia Tech.
Artificial Intelligence Chapter 4. Machine Evolution.
ELeaRNT: Evolutionary Learning of Rich Neural Network Topologies Authors: Slobodan Miletic 3078/2010 Nikola Jovanovic 3077/2010
1 Genetic Algorithms and Ant Colony Optimisation.
Genetic Algorithms Przemyslaw Pawluk CSE 6111 Advanced Algorithm Design and Analysis
Pac-Man AI using GA. Why Machine Learning in Video Games? Better player experience Agents can adapt to player Increased variety of agent behaviors Ever-changing.
Chapter 4. Formal Tools for the Analysis of Brain-Like Structures and Dynamics (1/2) in Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots.
Chapter 9. PlayMate System (1/2) in Cognitive Systems, Henrik Iskov Chritensen et al. Course: Robots Learning from Humans Kwak, Hanock Biointelligence.
Chapter 10. The Explorer System in Cognitive Systems, Christensen et al. Course: Robots Learning from Humans On, Kyoung-Woon Biointelligence Laboratory.
DARPA Mobile Autonomous Robot SoftwareLeslie Pack Kaelbling; January Adaptive Intelligent Mobile Robotics Leslie Pack Kaelbling Artificial Intelligence.
Chapter 2. From Complex Networks to Intelligent Systems in Creating Brain-like Systems, Sendhoff et al. Course: Robots Learning from Humans Baek, Da Som.
Chapter 8. Learning of Gestures by Imitation in a Humanoid Robot in Imitation and Social Learning in Robots, Calinon and Billard. Course: Robots Learning.
Chapter 3. Stochastic Dynamics in the Brain and Probabilistic Decision-Making in Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning.
Chapter 13. How to build an imitator in Imitation and Social Learning in Robots, Humans and Animals Course: Robots Learning from Humans Park, Susang
Chapter 15. Cognitive Adequacy in Brain- Like Intelligence in Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning from Humans Cinarel, Ceyda.
Ch 20. Parameter Control Ch 21. Self-adaptation Evolutionary Computation vol. 2: Advanced Algorithms and Operators Summarized and presented by Jung-Woo.
Chapter 1. Introduction in Creating Brain-like intelligence, Sendhoff et al. Course: Robots Learning from Humans Bae, Eun-bit Otology Laboratory Seoul.
Chapter 4. Analysis of Brain-Like Structures and Dynamics (2/2) Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning from Humans 09/25.
Robot Intelligence Technology Lab. 10. Complex Hardware Morphologies: Walking Machines Presented by In-Won Park
Biointelligence Lab School of Computer Sci. & Eng. Seoul National University Artificial Intelligence Chapter 8 Uninformed Search.
Evolving robot brains using vision Lisa Meeden Computer Science Department Swarthmore College.
March 1, 2016Introduction to Artificial Intelligence Lecture 11: Machine Evolution 1 Let’s look at… Machine Evolution.
Genetic (Evolutionary) Algorithms CEE 6410 David Rosenberg “Natural Selection or the Survival of the Fittest.” -- Charles Darwin.
Evolutionary Computation Evolving Neural Network Topologies.
Chapter 9. The PlayMate System ( 2/2 ) in Cognitive Systems Monographs. Rüdiger Dillmann et al. Course: Robots Learning from Humans Summarized by Nan Changjun.
Robot Intelligence Technology Lab. Evolution of simple navigation Chapter 4 of Evolutionary Robotics Jan. 12, 2007 YongDuk Kim.
The Relationship between Deep Learning and Brain Function
Ch 14. Active Vision for Goal-Oriented Humanoid Robot Walking (1/2) Creating Brain-Like Intelligence, Sendhoff et al. (eds), Robots Learning from.
Artificial Intelligence Chapter 4. Machine Evolution
Continous-Action Q-Learning
Artificial Intelligence Chapter 2 Stimulus-Response Agents
Evolutionary Computation,
Introduction to Artificial Intelligence Lecture 11: Machine Evolution
MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING
Artificial Intelligence Chapter 4. Machine Evolution
MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING
Evolutionary Algorithms for Hyperparameter Optimization
Review NNs Processing Principles in Neuron / Unit
Dynamics of Training Noh, Yung-kyun Mar. 11, 2003
Image processing and computer vision pipeline for segmentation and cell detection. Image processing and computer vision pipeline for segmentation and cell.
Complexity as Fitness for Evolved Cellular Automata Update Rules
Presentation transcript:

Chapter 14. Active Vision for Goal-Oriented Humanoid Robot Walking (2/2) in Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning from Humans Sangwoong Yoon Interdisciplinary Program in Neuroscience Biointelligence Laboratory Seoul National University

One-Page Summary Neural Architecture Input: Visual image Output: Robot action (vision & motor) Genetic Algorithm For parameter tuning Robot Path-Finding Task After many generations: The robot can reach the goal Active vision behavior is learned © 2015, SNU CSE Biointelligence Lab., 2

Experiment © 2015, SNU CSE Biointelligence Lab., 3 Robot SimulatorNeural Architecture w/ Active Vision

Experiment © 2015, SNU CSE Biointelligence Lab., 4 Generation 1 Generation 100 Use Genetic Algorithm to tune neural connections Goal: To reach the goal beacon (Illustrative examples) Goal Beacon Starting Point

Genetic Algorithm Optimization algorithm that mimics evolution © 2015, SNU CSE Biointelligence Lab., 5 Related words: Evolutionary computation, evolutionary programming, …

Discussion on Genetic Algorithm Good Sides SOUNDS FANCY Versatile Some times, GA is the only choice © 2015, SNU CSE Biointelligence Lab., 6 This Part Intentionally Left Blank

Discussion on Genetic Algorithm Bad Sides No theoretical guarantee So many hyperparameters And their meanings are not clear Many fitness evaluation needed © 2015, SNU CSE Biointelligence Lab., 7

Details of Experiment Fitness Function Numbers 1 Fitness = 4 Trial 147 neural weights 50 chromosomes Best 20% are selected and reproduced © 2015, SNU CSE Biointelligence Lab., 8

Result © 2015, SNU CSE Biointelligence Lab., 9 With active visionWithout active vision Max among pop Mean among pop Active vision component is crucial

Result © 2015, SNU CSE Biointelligence Lab., 10 ◀ Best robot’s trajectory ▼Best robot’s camera movement Robot looks for obstacles (?!)

Paper’s Conclusion We’ve built a self-evolving active vision system (Yay!) Active vision is helpful (Yay!) GA is a bad choice Not scalable, extremely inefficient Backpropagation / Reinforcement Learning Will it work in the different map? © 2015, SNU CSE Biointelligence Lab., 11 My Discussion