Emulating the Functionality of Rodents’ Neurobiological Navigation and Spatial Cognition Cells in a Mobile Robot Peter J. Zeno Department of Computer Science.

Slides:



Advertisements
Similar presentations
Robotics Where AI meets the real world. Ankit Jain
Advertisements

A Neural Model for Detecting and Labeling Motion Patterns in Image Sequences Marc Pomplun 1 Julio Martinez-Trujillo 2 Yueju Liu 2 Evgueni Simine 2 John.
MICHAEL MILFORD, DAVID PRASSER, AND GORDON WYETH FOLAMI ALAMUDUN GRADUATE STUDENT COMPUTER SCIENCE & ENGINEERING TEXAS A&M UNIVERSITY RatSLAM on the Edge:
Visual Navigation in Modified Environments From Biology to SLAM Sotirios Ch. Diamantas and Richard Crowder.
DMEC Neurons firing Black trace is the rat’s trajectory. Red dots are spikes recorded from one neuron. Eventually a hexagonal activity pattern emerges.
Matching brain and body dynamics Daniel Wolpert: – "Why don't plants have brains?" – "Plants don't have to move!" Early phases of embodied artificial intelligence:
Biologically-inspired robot spatial cognition based on rat neurophysiological studies Alejandra Barrera and Alfredo Weitzenfeld Auton Robot Rakesh.
Both pulse waves from the encoder will be required to determine the direction of the wheel. The two channels return pulses like the ones below. Using a.
Overview 1.The Structure of the Visual Cortex 2.Using Selective Tuning to Model Visual Attention 3.The Motion Hierarchy Model 4.Simulation Results 5.Conclusions.
Behavior- Based Approaches Behavior- Based Approaches.
Cognitive Neuroscience How do we connect cognitive processes in the mind with physical processes in the brain?
Maps in the Brain and their models. Where are things happening in the brain. Is the information represented locally ? The Phrenologists view at the brain.
Sensing self motion Key points: Why robots need self-sensing Sensors for proprioception in biological systems in robot systems Position sensing Velocity.
Program ultrasonic range sensor in autonomous mode
Neural mechanisms of Spatial Learning. Spatial Learning Materials covered in previous lectures Historical development –Tolman and cognitive maps the classic.
The Nervous System and the Brain Information in this presentation is taken from UCCP content.
 The most intelligent device - “Human Brain”.  The machine that revolutionized the whole world – “computer”.  Inefficiencies of the computer has lead.
BUGS Relevant Research Areas: Insects: –Tele-control of insects: Ability to control some motor function of an insect through an external link –Tele-sense.
CBP Comp 3104 The Nature of Computing 1 Nature Inspired Computing Artificial Neural Nets - Symbiosis between computer and cognitive sciences.
NEURAL NETWORKS FOR DATA MINING
LeDoux – Chapt 3 All mammalian brains share same organization Neocortex and particularly telencephalon is larger and more developed in primates and humans.
Legged Robot Locomotion Control  Legged Robot Locomotion Control  CPG-and-reflex based Control of Locomotion.
What is perception/eyesight and how is it processed in the brain? Tamara Mahony.
Receiving information from the environment to coordinate a response Pg
Perception in Motor Development. What is Perception? A multistage process that takes place in the BRAIN. It includes – Selection – Processing – Organization.
Chapter 10. The Explorer System in Cognitive Systems, Christensen et al. 2 nd Part Course: Robots Learning from Humans Park, Seong-Beom Behavioral neurophysiology.
© Kip Smith, 2003 Psychology 110 B Introduction to Neurons and the Brain.
Why Can't A Computer Be More Like A Brain?. Outline Introduction Turning Test HTM ◦ A. Theory ◦ B. Applications & Limits Conclusion.
The Process of Forming Perceptions SHMD219. Perception The ability to see, hear, or become aware of something through the senses. Perception is a series.
Positioning rat using neuronal activity in hippocampus
Introduction to Robots and the Mind - Sensors - Bert Wachsmuth & Michael Vigorito Seton Hall University.
Abstract Neurobiological Based Navigation Map Created During the SLAM Process of a Mobile Robot Peter Zeno Advisors: Prof. Sarosh Patel, Prof. Tarek Sobh.
Introduction to VEX® components
Brain circuits for spatial cognition Nitin Gupta 5 November, 2014 All of this presentation is based on work performed by others.
MEMORY AP PSYCHOLOGY. KEY QUESTIONS FOR THIS UNIT How is a memory formed? How accurate are our memories? Why do we forget? Case Study – Jennifer Thompson.
Self-Navigation Robot Using 360˚ Sensor Array
Computer Science.
Exploring Computer Science Lesson 6-5
COGNITIVE APPROACH TO ROBOT SPATIAL MAPPING
Neural Networks.
The Structures of the Brain
Chemical & Electrical Coordination Systems The Nervous System…….
Sensors For Robotics Robotics Academy All Rights Reserved.
Using an FPGA to Emulate Grid Cell Spatial Cognition in a Mobile Robot
Instrumentation and Control Systems
Dmitriy Aronov, David W. Tank  Neuron 
The Nervous System Peripheral Nervous System Central Nervous System.
Hippocampus and method of loci
Nervous System Overview.
The Nervous System Peripheral Nervous System Central Nervous System.
Nervous System Overview.
Robot Programming Computer Literacy S2.
FeMaidens Programming
Review Session 3: Sensation and Perception
Autonomous Design for PCC’s Robotics Challenge Entry
Neural Odometry: The Discrete Charm of the Entorhinal Cortex
WELCOME TO SEMINAR ZONE.
Chapter 4: Sensation and Perception
Volume 28, Issue 7, Pages e6 (April 2018)
In the land of the blind, the one eyed man is king
Posterior parietal cortex
Neural Odometry: The Discrete Charm of the Entorhinal Cortex
Volume 84, Issue 6, Pages (December 2014)
Computational Models of Grid Cells
Place, space and memory cells
Volume 25, Issue 23, Pages R1116-R1121 (December 2015)
On the Integration of Space, Time, and Memory
Central nervous system
Grid Cells and Neural Coding in High-End Cortices
Introduction to Sensation
Presentation transcript:

Emulating the Functionality of Rodents’ Neurobiological Navigation and Spatial Cognition Cells in a Mobile Robot Peter J. Zeno Department of Computer Science and Engineering University of Bridgeport Bridgeport, CT

Outline Path Integration (PI) As observed in rodents (mammals), other animals and insects. As performed in the “ratbot” Issues Full PI Model Purpose of Using PI in Autonomous Mobile Robot Realizing Spatial Cognition in a Machine Grid Cells Emulated Functionality of Grid Cells in an FPGA

Path Integration (PI) in Rodents Rodents (mammals), some animals and insects: Proprioceptive Stimuli – Feedback from muscle nerves (judgement of distance covered). Vestibular Stimuli – Direction of travel based on feedback from inner ear. Conceptually, the result is a vector in memory, where: magnitude = distance, and direction = relative heading. Return vector to “home” is somehow calculated at each turn the rodent takes.

Path Integration (cont.) PI portion of navigation

Path Integration (cont.) Example of rodent foraging path (black) with mentally calculated return vectors (red).

Path Integration - Ratbot The ratbot/autonomous mobile robot uses input from motor encoders (relative distance traveled, and a MEMS based gyro for heading and delta heading (angle). From the gathered and stored vector data, the return-to-home vector is calculated at each turn using the law of sines and cosines: r1 = sqrt(d12 + d22 – 2*d1*d2*cos Ø1) θ1 = arcsin((d1/r1)*sin Ø1)

Path Integration – Ratbot (cont.) Ratbot’s PI Sensors Internal Stimuli: Proprioceptive Stimuli – Motor encoders for distance traveled for each leg of journey. Vestibular Stimuli – MEMs based gyro for heading data External Stimuli: Forward facing ultrasonic sensor for object detection.

Path Integration - Issues In calculations made by the ratbot, as well as a rodent learning a new environment, having very poor external stimuli (sight, smell, touch, sound, etc.) causes errors in PI calculations to grow without bound. Therefore, learning a new environment with some degree of accuracy requires the existence and knowledge of some unique landmark(s). Examples include: spaced barriers, direction to sun, unique smells, etc.

Purpose Q: How is PI different than what is currently being used on some mobile robots which have limited visual (or other external stimulus detection) capabilities? A: PI is being used as the basis for a more profound capability development for autonomous robots: the realization and use of spatial cognition in a machine.

Full PI Model Spatial Cognition

Spatial Cognition In mammalian brains, as particularly found in the hippocampus and entorhinal cortex, there are specialized neurons for PI and spatial awareness: Place Cells – *John O’Keefe Border Cells Head Direction Cells Grid Cells – *Edvard Moser & *May-Britt Moser * Awarded 2014 Nobel Prize in Physiology or Medicine

Grid Cells Location in Human Source: www.sciencemag.org

Grid Cells (cont.) Hexagonal firing pattern of a single grid cell: Rat Foraging – Single grid cell firing (red dots) Autocorrelated image of grid cell’s firing over local area.

FPGA Field Programmable Gate Array (FPGA) Programmable implementation of highly parallelizable hardware using EDA tools. Program logic blocks and path/signal connections. Simulate the neural network that feeds a grid cell to make it fire. Add storage of key mapping data to neural network logic cells for full spatial awareness/coverage. Traversed & direction, object/blockage & direction, relative location ID Feed real-time PI data from ratbot’s central microcontroller.

Emulated Functionality of Grid Cells in an FPGA – Spatial Cognition Home

Thank You! Any Questions?