Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Neural Robot Control Cornelius Weber Hybrid Intelligent.

Slides:



Advertisements
Similar presentations
Rerun of machine learning Clustering and pattern recognition.
Advertisements

What is the neural code? Puchalla et al., What is the neural code? Encoding: how does a stimulus cause the pattern of responses? what are the responses.
Cognitive Systems, ICANN panel, Q1 What is machine intelligence, as beyond pattern matching, classification and prediction. What is machine intelligence,
Chapter 2.
Sparse Coding in Sparse Winner networks Janusz A. Starzyk 1, Yinyin Liu 1, David Vogel 2 1 School of Electrical Engineering & Computer Science Ohio University,
The Human Brain.
Image Segmentation by Complex-Valued Units Cornelius Weber and Stefan Wermter Hybrid Intelligent Systems School of Computing and Technology University.
Yiannis Demiris and Anthony Dearden By James Gilbert.
1 Lecture 35 Brief Introduction to Main AI Areas (cont’d) Overview  Lecture Objective: Present the General Ideas on the AI Branches Below  Introduction.
Copyright © 2006 by Allyn and Bacon Chapter 8 The Sensorimotor System How You Do What You Do This multimedia product and its contents are protected under.
Soft computing Lecture 6 Introduction to neural networks.
Attention as Information Selection. Early Selection Early Selection model postulated that attention acted as a strict gate at the lowest levels of sensory.
Unsupervised Learning With Neural Nets Deep Learning and Neural Nets Spring 2015.
Journal club Marian Tsanov Reinforcement Learning.
CSE 153 Cognitive ModelingChapter 3 Representations and Network computations In this chapter, we cover: –A bit about cortical architecture –Possible representational.
From Motor Babbling to Planning Cornelius Weber Frankfurt Institute for Advanced Studies Goethe University Frankfurt, Germany ICN Young Investigators’
Studies on Goal-Directed Feature Learning Cornelius Weber, FIAS presented at: “Machine Learning Approaches to Representational Learning and Recognition.
MIRROR Project Review IST Brussels – December 1 st, 2003.
Models of Human Performance Dr. Chris Baber. 2 Objectives Introduce theory-based models for predicting human performance Introduce competence-based models.
From Exploration to Planning Cornelius Weber and Jochen Triesch Frankfurt Institute for Advanced Studies Goethe University Frankfurt, Germany 18 th International.
Outline 1) Goal-Directed Feature Learning (Weber & Triesch, IJCNN 2009)‏ Task 4.1 Visual processing based on feature abstraction 2) Emergence of Disparity.
August 19 th, 2006 Computational Neuroscience Group, LCE Helsinki University of Technology Computational neuroscience group Laboratory of computational.
Self-Organized Recurrent Neural Learning for Language Processing April 1, March 31, 2012 State from June 2009.
Chapter 14: Artificial Intelligence Invitation to Computer Science, C++ Version, Third Edition.
Intrusion Detection Using Hybrid Neural Networks Vishal Sevani ( )
Motor Control and Modeling in Practice prof.dr. Jaap Murre University of Amsterdam University of Maastricht
 The most intelligent device - “Human Brain”.  The machine that revolutionized the whole world – “computer”.  Inefficiencies of the computer has lead.
Chapter 3 Neural Network Xiu-jun GONG (Ph. D) School of Computer Science and Technology, Tianjin University
Interactive Discovery and Semantic Labeling of Patterns in Spatial Data Thomas Funkhouser, Adam Finkelstein, David Blei, and Christiane Fellbaum Princeton.
Neural coding (1) LECTURE 8. I.Introduction − Topographic Maps in Cortex − Synesthesia − Firing rates and tuning curves.
Varieties of Helmholtz Machine Peter Dayan and Geoffrey E. Hinton, Neural Networks, Vol. 9, No. 8, pp , 1996.
Subject wearing a VR helmet immersed in the virtual environment on the right, with obstacles and targets. Subjects follow the path, avoid the obstacels,
Chapter 16. Basal Ganglia Models for Autonomous Behavior Learning in Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning from Humans.
Project ArteSImit Artefact Structural Learning through Imitation (TU München, U Parma, U Tübingen, U Minho, KU Nijmegen) Giorgio Panin - TUM.
Pathways for Motor Control and Learning. Spinal Cord: The stretch reflex Maintain stability.
Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Project funded by the Future and Emerging Technologies.
MSc CogNeuro Lecture 1-2: Intro + Primary Motor Cortex (MI)
MODELING MST OPTIC FLOW RESPONSES USING RECEPTIVE FIELD SEGMENTAL INTERACTIONS Chen-Ping Yu +, William K. Page*, Roger Gaborski +, and Charles J. Duffy.
WEEK INTRODUCTION IT440 ARTIFICIAL INTELLIGENCE.
Model-based learning: Theory and an application to sequence learning P.O. Box 49, 1525, Budapest, Hungary Zoltán Somogyvári.
Image Segmentation by Complex-Valued Units Cornelius Weber Hybrid Intelligent Systems School of Computing and Technology University of Sunderland Presented.
Chapter 3. Stochastic Dynamics in the Brain and Probabilistic Decision-Making in Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning.
Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme IST ~ INPRO (Information Processing by Natural.
WP6 - D6.1 Design of integrated models ISTC-CNR September, 26/27, 2005 ISTC-CNR September, 26/27, 2005.
Chapter 6 Neural Network.
Cognitive Science Overview Introduction, Syllabus
Object and face recognition
Neural Networks (NN) Part 1 1.NN: Basic Ideas 2.Computational Principles 3.Examples of Neural Computation.
How do you get here?
A Presentation on Adaptive Neuro-Fuzzy Inference System using Particle Swarm Optimization and it’s Application By Sumanta Kundu (En.R.No.
Machine Learning 12. Local Models.
Big data classification using neural network
Unsupervised Learning of Video Representations using LSTMs
Deep Learning Amin Sobhani.
Spontaneous activity in V1: a probabilistic framework
fMRI and neural encoding models: Voxel receptive fields (continued)
CSE P573 Applications of Artificial Intelligence Neural Networks
Intelligent Leaning -- A Brief Introduction to Artificial Neural Networks Chiung-Yao Fang.
MODELING MST OPTIC FLOW RESPONSES
Power and limits of reactive intelligence
XOR problem Input 2 Input 1
Gaurav Aggarwal, Mark Shaw, Christian Wolf
Intelligent Leaning -- A Brief Introduction to Artificial Neural Networks Chiung-Yao Fang.
CSE 573 Introduction to Artificial Intelligence Neural Networks
Introduction to Neural Networks And Their Applications - Basics
MODELING MST OPTIC FLOW RESPONSES
Pattern Recognition & Machine Learning
III. Introduction to Neural Networks And Their Applications - Basics
The Network Approach: Mind as a Web
Figure 7-1: Non-Pipelined Instruction Execution vs. 2-stage Pipeline
Presentation transcript:

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Neural Robot Control Cornelius Weber Hybrid Intelligent Systems University of Sunderland Talk at Nottingham Trent University, 8 th December 2004 on the occasion of returning the MI competition trophy Collaborators: Mark Elshaw, Alex Zochios, Chris Rowan and Stefan Wermter

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme ContentsContents Visual cortex & reinforcement network for docking Cortex self-imitation network for docking Imitation networks for multiple actions: 1-stage/2-stage hierarchical network Outlook

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme ContentsContents Visual cortex & reinforcement network for docking Cortex self-imitation network for docking Imitation networks for multiple actions: 1-stage/2-stage hierarchical network Outlook

Example Task: Docking

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Docking Architecture Information Flow

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Docking Architecture Training (1/3) unsupervised training generative model sparse distributed coding

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme V1 Receptive Fields (training result)

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme winner Comparison of Response Characteristics linearsparsecompetitive

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Attractor Network: Competition via Relaxation weight profileactivation profile activation update y(t+1) = f (W lat y(t))

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Docking Architecture Training (2/3) supervised training, attractor network for pattern completion

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Docking Architecture Visual System

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Docking Architecture Training (3/3) reinforcement training actor-critic model

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme ContentsContents Visual cortex & reinforcement network for docking Cortex self-imitation network for docking Imitation networks for multiple actions: 1-stage/2-stage hierarchical network Outlook

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Mirror Neuron Docking Architecture Information Flow

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme unsupervised training generative model distributed coding Mirror Neuron Docking Architecture Training

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme supervised training, attractor network for prediction Mirror Neuron Docking Architecture Training

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Mirror Neuron Self-Imitation Docking Architecture Information Flow

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Basal Ganglia vs. Motor Cortex Basal ganglia units are active during early task acquisition but not at a later stage (rat T maze decision task). early:late: Basal Ganglia ≙ state space? Motor cortex might take over BG function via self-imitation. Jog et al. (1999) Science, 286,

Docking via Mirror Neurons

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme ContentsContents Visual cortex & reinforcement network for docking Cortex self-imitation network for docking Imitation networks for multiple actions: 1-stage/2-stage hierarchical network Outlook

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Simulated Robot Environment

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Imitation Model Choice

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Areas of Motor- and Language Representations forward back left right ‘go’ ‘pick’ ‘lift’ all individual unit’s receptive fields in hidden area motor units language units

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Areas of Task-Specific Activations ‘go’ ‘pick’ ‘lift’ Recognition : Production : Activations agree with the Somatotopy-of-Action-Words Model.

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Language Instructed Imitative Behaviour ‘go’ ‘pick’ ‘lift’

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Imitation Model Choice

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Neuron’s Receptive Fields in HM Area motor units 4 SOM-area units forward backward left right

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Conclusion for Imitation Network A neural network as a generative model for sensory stimuli generates interactive action sequences allows for context dependent interactive action sequences

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme ContentsContents Visual cortex & reinforcement network for docking Cortex self-imitation network for docking Imitation networks for multiple actions: 1-stage/2-stage hierarchical network Outlook

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Outlook (1/2): Object-Background Separation for Enhanced Object Learning

Project funded by the Future and Emerging Technologies arm of the IST Programme FET-Open scheme Outlook (2/2): Docking Range Extension by Neural Coordinate Transformations