Metta, Sandini, Natale & Panerai.  Developmental principles based on biological systems.  Time-variant machine learning.  Focus on humanoid robots.

Slides:



Advertisements
Similar presentations
Information and Software Technology
Advertisements

The Development of Tool Use in Infancy. Talk Overview  Background: Understand infant cognitive development  The Problem of Tool Use: What is required.
What are Mirror Neurons? Mirror neurons are cells that fire when a monkey (or person?) performs an action or when it views another animal performing that.
Chapter 4: Physical Development in Infancy
Mirror Neurons.
MOTION PERCEPTION Types of Motion Perception Corollary Discharge Theory Movement Detectors Motion Perception and Object Perception Ecological Perception.
Functional Vision Assessment
Chapter 5: Physical Development in Infants and Toddlers
Psikologi Anak Pertemuan 3 Motor, Sensory, and Perceptual Development.
AAC Assessment 5/13/2015 AAC Assessment 1 “a process whereby data are collected and information is gathered to make intervention and/or management decisions.”
Yiannis Demiris and Anthony Dearden By James Gilbert.
Mirror Neurons.
From Perception to Action And what’s in between?.
Matching brain and body dynamics Daniel Wolpert: – "Why don't plants have brains?" – "Plants don't have to move!" Early phases of embodied artificial intelligence:
Autonomous Machine Learning What kind of a-priori knowledge do we have to provide to our systems for showing such a capability? Edgar Koerner Honda Research.
2/6/01Early Capacities1 Chapter 4 Early Infancy: Initial Capacities and the Process of Change.
Integrating POMDP and RL for a Two Layer Simulated Robot Architecture Presented by Alp Sardağ.
Motor System
MIRROR Project Review IST Brussels – December 1 st, 2003.
Sensory-Motor Primitives as a Basis for Imitation: Linking Perception to Action and Biology to Robotics Presentation by Dan Hartmann 21 Feb 2006.
Fast Walking and Modeling Kicks Purpose: Team Robotics Spring 2005 By: Forest Marie.
REAL ROBOTS. iCub It has a height of 100 cm, weighs 23 Kg, and is able to recognize and manipulate objects. Each hand has 9 DOF and can feel objects almost.
1 Perception, Illusion and VR HNRS 299, Spring 2008 Lecture 9 Visual Development Thanks to website at University of Calgary:
Humanoid Robots Debzani Deb.
Motivating Learners.
Sensing self motion Key points: Why robots need self-sensing Sensors for proprioception in biological systems in robot systems Position sensing Velocity.
REACH AND GRASP USING A NEURALLY CONTROLLED ROBOT MARCOS MALLO LÓPEZ MIND CONTROLLED ROBOTS.
Towards Cognitive Robotics Biointelligence Laboratory School of Computer Science and Engineering Seoul National University Christian.
The iCub humanoid robot: An open-systems platform for research in cognitive development Giorgio Metta et al., Neural networks 2010 윤성재.
Ch 71 Sensation & Perception Ch. 7: Perception and Action © Takashi Yamauchi (Dept. of Psychology, Texas A&M University) Main topics Ecological approach.
Beyond Gazing, Pointing, and Reaching A Survey of Developmental Robotics Authors: Max Lungarella, Giorgio Metta.
Stress Management A variety of interventions aimed to help people deal more effectively with difficult situations Distinct from coping, which encompasses.
CSC 423 ARTIFICIAL INTELLIGENCE Intelligence Agents.
Visuo-Motor Relationships: Plasticity and Development.
Visual Perception, Attention & Action. Anthony J Greene2.
Perceptual Development
Physical Development In Utero: – Zygote: conception-2 weeks – Embryo: 2 weeks-2 months (8 weeks) Cell differentiation – Fetus: 2 months to birth Functioning.
What is it?  Development can be summed up as the changes we go through in life, not just physical changes.  Growth refers to the increase in cell number,
University of Windsor School of Computer Science Topics in Artificial Intelligence Fall 2008 Sept 11, 2008.
Physical Development Endocrine System: group of endocrine glands that secrete chemicals called hormones Pituitary Gland: master endocrine gland that produces.
PAPER BY JONATHAN MUGAN & BENJAMIN KUIPERS PRESENTED BY DANIEL HOUGH Learning Distinctions and Rules in a Continuous World through Active Exploration.
Motor Control. Beyond babbling Three problems with motor babbling: –Random exploration is slow –Error-based learning algorithms are faster but error signals.
Teleoperation In Mixed Initiative Systems. What is teleoperation? Remote operation of robots by humans Can be very difficult for human operator Possible.
Object Lesson: Discovering and Learning to Recognize Objects Object Lesson: Discovering and Learning to Recognize Objects – Paul Fitzpatrick – MIT CSAIL.
Lecture 1: Overview of Motor Control. What is Motor Control?
Introduction of Intelligent Agents
INTELLIGENT AGENTS. Agents  An agent is anything that can be viewed as perceiving its environment through sensors and acting upon that environment through.
Anne Watson Hong Kong  grasp formal structure  think logically in spatial, numerical and symbolic relationships  generalise rapidly and broadly.
Chapter 5: Physical Development in Infants and Toddlers 5.1 Healthy Growth 5.2 The Developing Nervous System 5.3 Motor Development 5.4 Sensory and Perceptual.
Ferdinando A. Mussa-Ivaldi, “Modular features of motor control and learning,” Current opinion in Neurobiology, Vol. 9, 1999, pp The focus on complex.
The Process of Forming Perceptions SHMD219. Perception The ability to see, hear, or become aware of something through the senses. Perception is a series.
Visuo-Motor Relationships: Plasticity and Development.
Starter At what age do children begin to experience stranger anxiety? Not wanting to be left alone with people other than their parents.
6.S196 / PPAT: Principles and Practice of Assistive Technology Wed, 19 Sept Prof. Rob Miller Today: User-Centered Design [C&H Ch. 4]
B6. Brain & Mind The Big Picture! 5. Learning & the Brain 6. Memory 7. Complex Behaviour LO: To understand how memory works(in the brain!) 1. Stimulus.
AN ACTIVE VISION APPROACH TO OBJECT SEGMENTATION – Paul Fitzpatrick – MIT CSAIL.
Mirror neurons and autism Time to be thinking about therapy? Justin H G Williams, University of Aberdeen, Scotland.
Basic Principles of Sensation and Perception
Functionality of objects through observation and Interaction Ruzena Bajcsy based on Luca Bogoni’s Ph.D thesis April 2016.
Prenatal Development to Infancy. Prenatal Development Basically means what develops while in womb Most significantly cells begin to differentiate into.
First-Person Tele- Operation of a Humanoid Robot Lars Fritsche, Felix Unverzagt, Jan Peters and Roberto Calandra.
Copyright © 2005 Pearson Education Canada Inc.5-1 Chapter 5: Physical Development in Infants and Toddlers 5.1 Healthy Growth 5.2 The Developing Nervous.
Physical Development in Infancy Lecture Prepared by Dr. M. Sawhney.
Modeling the development of mirror neurons Problem Solution
Key NLP skills to enhance your professional practice
Developing Goals and Objectives
Reflexes.
Web-Mining Agents Cooperating Agents for Information Retrieval
Hardware and system development:
Motor, Sensory, and Perceptual Development
Presentation transcript:

Metta, Sandini, Natale & Panerai

 Developmental principles based on biological systems.  Time-variant machine learning.  Focus on humanoid robots.

 Some work in machine learning for robotics.  Collect Data -> Train Machine -> Control Robot  Off-line training, tweaked by hand.  Time-invariant

 Physiology problem; explain how something in biology works.  A system is built by adapting from initial simplicity.  Non-adaptive systems often fail in the real world.  Real adaptation is hard to create and harder to control.

 Complex systems decomposed into small parts.  Parts are studied in isolation.  Real world is not modular – newborns are already integrated at birth.  Not all ‘modules’ are functioning or at full capabilities.  All are matched and promote shift to more complex behaviours.

 Example based learning is difficult to get right.  Basically function approximation.  Too many parameters -> Overfitting  Good approximation, bad generalisation.  Too few -> Oversmoothing  Bad approximation, no ‘grasp’ of problem complexity.

 Control the complexity and structure of the learner.  Different from learning which controls parameters of the structure.  Better to start with a simpler system.  Training data has a cost – exploration.  Failure is not an option!

 Initial reflex-like starting conditions bootstrap the system.  Gather data through action, but without incurring penalties.  Quality of data linked to how the system acts.  Perception is derived from action.  Not just sensory processing.

 Mirror Neurons  Found in the frontal cortex.  Activated when an action is performed and seen.  Canonical Neurons  Responsive to actions like grasping.  Also respond to seeing a graspable object.

 Assume a limited set of skills and motor control abilities.  Build new abilities on top of old ones.  Learn -> Act -> Perceive (randomly)

 Actions must have consequences.  Relate movements to sensorial consequences.  Eye and head tracking first develops synchronisation, then tunes the amplitude of the movements.

 Objects are classified by what you can do to them.  Learn affordances by action.  Measure outcome at sensory level.  Grasping is learnt because possession is ‘good’.

 12 degrees of freedom.  Cameras, microphones, inertial sensors.  Orienting and reaching toward objects based on vision or audition.

 Reflex grasping as the robot learns to control gaze direction.  Gradual mapping between sound, vision and grasping.  Performs better with initially restricted vision that develops.