Corps & Cognition team meeting, 2014/12/02 A (new) non supervised neural learning algorithm for equilibrium (and homeostasis) Claude Touzet & Michel Dumitrescu.

Slides:

Advertisements

Similar presentations

Introduction to Neural Networks Computing

Advertisements

Neural Network I Week 7 1. Team Homework Assignment #9 Read pp. 327 – 334 and the Week 7 slide. Design a neural network for XOR (Exclusive OR) Explore.

Ming-Feng Yeh1 CHAPTER 13 Associative Learning. Ming-Feng Yeh2 Objectives The neural networks, trained in a supervised manner, require a target signal.

Unsupervised learning. Summary from last week We explained what local minima are, and described ways of escaping them. We investigated how the backpropagation.

Weight, Mass, and the Dreaded Elevator Problem

Pendulums Simple pendulums ignore friction, air resistance, mass of string Physical pendulums take into account mass distribution, friction, air resistance.

Pattern Recognition using Hebbian Learning and Floating-Gates Certain pattern recognition problems have been shown to be easily solved by Artificial neural.

Modeling The Spino- Neuromuscular System Terence Soule, Stanley Gotshall, Richard Wells, Mark DeSantis, Kathy Browder, Eric Wolbrecht.

Artificial neural networks.

Chapter 14 Oscillations Chapter Opener. Caption: An object attached to a coil spring can exhibit oscillatory motion. Many kinds of oscillatory motion are.

Hybrid Controller Reachability Reachability analysis can be useful to determine how the continuous state of a system evolves. Ideally, this process can.

PH 105 Dr. Cecilia Vogel Lecture 2. OUTLINE  Mechanics  Force  Pressure  energy  power  Oscillation  period  frequency  amplitude.

Example: A 20 kg block is fired horizontally across a frictionless surface. The block strikes a platform that is attached to a spring at its equilibrium.

© 2007 Pearson Prentice Hall This work is protected by United States copyright laws and is provided solely for the use of instructors in teaching their.

Oscillations Phys101 Lectures 28, 29 Key points:

The Grandfather Clock: The Pendulum By Pat Ryan and Kindra Fuller.

© Negnevitsky, Pearson Education, Lecture 7 Artificial neural networks: Supervised learning Introduction, or how the brain works Introduction, or.

Introduction to AI Michael J. Watts

Attitude Theory What causes behavior?. Knowledge  Belief  Attitude  Value  Behavior.

Physics Midterm Review Terms - Measurements time elapsed = duration of an event – there is a beginning, a middle, and an end to any event. distance.

Artificial Neural Network Yalong Li Some slides are from _24_2011_ann.pdf.

PERIODIC MOTION occurs when a body moves repeatedly over the same path in equal intervals of time. SIMPLE HARMONIC MOTION is linear periodic motion in.

Simple Harmonic Motion 3

Modeling the Calcium Dysregulation Hypothesis of Alzheimer's Disease Júlio de Lima do Rêgo Monteiro, Marcio Lobo Netto, Diego Andina, Javier Ropero Pelaez.

Introduction to machine learning and data mining 1 iCSC2014, Juan López González, University of Oviedo Introduction to machine learning Juan López González.

PUMPING SCHEMES how to produce a population inversion in a given material? To achieve this an interaction of the material with a sufficiently strong em.

Elements of Neuronal Biophysics The human brain Seat of consciousness and cognition Perhaps the most complex information processing machine in nature.

Chapter 15 Oscillatory Motion. Intro Periodic Motion- the motion of an object that regularly repeats There is special case of periodic motion in which.

Kinetic Energy Conner Middle School 8 th Grade Science.

The Perceptron. Perceptron Pattern Classification One of the purposes that neural networks are used for is pattern classification. Once the neural network.

Applying Neural Networks Michael J. Watts

Copyright © 2010 Pearson Education, Inc. Lecture Outline Chapter 13 Physics, 4 th Edition James S. Walker.

Unit 4 Psychology Learning: Neural Pathways, Synapse Formation & the Role of Neurotransmitters.

Copyright © 2009 Pearson Education, Inc. Chapter 14 Oscillations.

Copyright © 2009 Pearson Education, Inc. Oscillations of a Spring Simple Harmonic Motion Energy in the Simple Harmonic Oscillator The Simple Pendulum Lecture.

Artificial Life/Agents Creatures: Artificial Life Autonomous Software Agents for Home Entertainment Stephen Grand, 1997 Learning Human-like Opponent Behaviour.

Functions of Management Mrs. Nations Introduction to Business and Technology.

THE EFFECTS OF TRAINING ON SPINE-HIP RATIO IN DANCERS DURING A REACHING TASK Erica L. Dickinson, and James S. Thomas School of Physical Therapy, Ohio University,

Neural Network Basics Anns are analytical systems that address problems whose solutions have not been explicitly formulated Structure in which multiple.

U i Modleing SGOMS in ACT-R: Linking Macro- and Microcognition Lee Yong Ho.

Simple Harmonic Motion A pendulum swinging from side to side is an example of both periodic and simple harmonic motion. Periodic motion is when an object.

Copyright © 2010 Pearson Education, Inc. Chapter 13 Oscillations about Equilibrium.

COSC 4426 AJ Boulay Julia Johnson Artificial Neural Networks: Introduction to Soft Computing (Textbook)

Waves. In order to understand Waves, lets think about water waves.

Inv The Efficiency of a Ramp

Oscillation 2.0. Practice Problem:  A mass of 2 kg oscillating on a spring with constant 4 N/m passes through its equilibrium point with a velocity of.

Copyright © 2010 Pearson Education, Inc. Lecture Outline Chapter 13 Physics, 4 th Edition James S. Walker.

PHY 151: Lecture Motion of an Object attached to a Spring 12.2 Particle in Simple Harmonic Motion 12.3 Energy of the Simple Harmonic Oscillator.

What do these objects have in common? LO: Understand how things balance What do these objects have in common? Use moments worksheet.

Chapter 1 Science & Measurement. Time A useful measurement of changes in motion or events; all or parts of the past, present, and future Identifies a.

Simple Harmonic Motion

Spiking Neuron Networks

Applying Neural Networks

Non-Uniform circular motion

Bultfontein Road - Kimberley Slope Stability Evaluation

Period of Simple Harmonic Motion

E. Barbuto, C. Bozza, A. Cioffi, M. Giorgini

HUM 102 Report Writing Skills

Dr. Unnikrishnan P.C. Professor, EEE

Oscillatory Motion.

Changing momentum: curving motion

Higher physical education

Springs & Conservation of Energy pg

What is the motion simple pendulum called?

Lecture Outline Chapter 13 Physics, 4th Edition James S. Walker

Department of Electrical Engineering

(a) Find the PE at A PE = m g h = ( 500 kg )( 9.8 m/s2 )( 30 m )

Simple Harmonic Motion and Wave Interactions

Perceptron Learning Rule

PUBLIC MANAGEMENT Workflow system Michel Gravel , Ph. D.

Presentation transcript:

Corps & Cognition team meeting, 2014/12/02 A (new) non supervised neural learning algorithm for equilibrium (and homeostasis) Claude Touzet & Michel Dumitrescu

1.Obervations: posture experiments 2.Conclusion: the relativity of the equilibrium 3.Hypothesis: Learning without any reference 4.Model: time integration by the synapse efficiency modification 5.Experiment: the inverse pendulum 6.Conclusion: toward homeostasis Summary

1.1 Obervations: posture experiments

1.2 Obervations: posture experiments

1.3 Obervations: posture experiments

2. Conclusion: the relativity of the equilibrium

3. Hypothesis: Learning without any reference « Verticality » is not required in order to stay erect. A subject may learn to stay erect just by experiencing moments of vertical equilibrium (moments during which he does not received any information). How neurons can learn something in absence of events? Informations from instability zones seem irrelevant, those of stability zones are absent. However...

4. Model: time integration by the synapse efficiency modification The equilibrium is defined by the fact that the frequency of changes is particularly low. The last « action » of the neurons will be completely memorised – therefore, it will be easily done again in a similar situation next time. We only need to take into account a time course for the modification of synaptic efficiency.

5.1 Experiment: the inverse pendulum SOM: 7x7 neurons (inputs: angle, speed, action) Learning: 100 events Time required for full synapse modification: 1 s Discretisation: 1/10 s g = 9.8 m/s 2 pendulum = 2 kg (m) cart = 8kg (M) length = 1m (lg) alpha = 1.0/(m+M) a1 = ((g*sin(theta) - alpha*m*lg*speed*speed*sin(2*theta)/2.0 – alpha *cos(theta)*(-action)) / (4*lg/3 - alpha*m*lg*cos(theta)*cos(theta)))

5.2 Experiment: the inverse pendulum (test: 10 seconds) + video

5.3 Experiment: the inverse pendulum 1D, 2D, 3D...

6.1 Conclusion: toward homeostasis Homeostasis: « regulation around an equilibrium position ». Examples of homeostasis: the state of « good » health.

6.2 Evolution of the learning algorithms toward less and less supervision: Supervised learning (Perceptron, 1959) Self-organisation (data base, 1977) Supervised learning (learning base, 1985) Reinforcement learning (evaluation function, 1994) Associative memory programming (targets, 2006) Palimpsest learning (2014)