Word.

Slides:



Advertisements
Similar presentations
What is the neural code? Puchalla et al., What is the neural code? Encoding: how does a stimulus cause the pattern of responses? what are the responses.
Advertisements

Is Recursion Uniquely Human? Hauser, Chomsky and Fitch (2002) Fitch and Hauser (2004)
I said to myself about the language of men, when they prove God, and see that they themselves are beasts: the case of humans and the case of beasts are.
Encoding of spatiotemporal patterns in SPARSE networks Antonio de Candia*, Silvia Scarpetta** *Department of Physics,University of Napoli, Italy **Department.
A Batch-Language, Vector-Based Neural Network Simulator Motivation: - general computer languages (e.g. C) lead to complex code - neural network simulators.
CSE 153 Cognitive ModelingChapter 3 Representations and Network computations In this chapter, we cover: –A bit about cortical architecture –Possible representational.
Brain-like design of sensory-motor programs for robots G. Palm, Uni-Ulm.
R C Ball, Physics Theory Group and Centre for Complexity Science University of Warwick R S MacKay, Maths M Diakonova, Physics&Complexity Emergence in Quantitative.
Basic Models in Neuroscience Oren Shriki 2010 Associative Memory 1.
Population Codes in the Retina Michael Berry Department of Molecular Biology Princeton University.
Physical Symbol System Hypothesis
Neural Networks Chapter 2 Joost N. Kok Universiteit Leiden.
Biologically Inspired Robotics Group,EPFL Associative memory using coupled non-linear oscillators Semester project Final Presentation Vlad TRIFA.
Knowledge and Memory: How we conceptualize information.
Associative Memory by Recurrent Neural Networks with Delay Elements Seiji MIYOSHI Hiro-Fumi YANAI Masato OKADA Kobe City College of Tech. Ibaraki Univ.
Dynamical network motifs: building blocks of complex dynamics in biological networks Valentin Zhigulin Department of Physics, Caltech, and Institute for.
Burst Synchronization transition in neuronal network of networks Sun Xiaojuan Tsinghua University ICCN2010, Suzhou
The Boltzmann Machine Psych 419/719 March 1, 2001.
Multiple attractors and transient synchrony in a model for an insect's antennal lobe Joint work with B. Smith, W. Just and S. Ahn.
Computing with Defects
Are worms more complex than humans? Rodrigo Quian Quiroga Sloan-Swartz Center for Theoretical Neurobiology. Caltech.
Chapter 2. From Complex Networks to Intelligent Systems in Creating Brain-like Systems, Sendhoff et al. Course: Robots Learning from Humans Baek, Da Som.
Effect of Small-World Connectivity on Sparsely Synchronized Cortical Rhythms W. Lim (DNUE) and S.-Y. KIM (LABASIS)  Fast Sparsely Synchronized Brain Rhythms.
Chapter 3. Stochastic Dynamics in the Brain and Probabilistic Decision-Making in Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning.
Introduction  Conway 1 proposes there are two types of autobiographical event memories (AMs):  Unique, specific events  Repeated, general events  These.
Designing High-Capacity Neural Networks for Storing, Retrieving and Forgetting Patterns in Real-Time Dmitry O. Gorodnichy IMMS, Cybernetics Center of Ukrainian.
Spiking Neural Networks Banafsheh Rekabdar. Biological Neuron: The Elementary Processing Unit of the Brain.
Electrophysiology & fMRI. Neurons Neural computation Neural selectivity Hierarchy of neural processing.
LANGUAGE AND REASONING IN HUMANS AND OTHER ANIMALS Tatiana Chernigovskaya St. Petersburg State University Part VI.
Network Models (2) LECTURE 7. I.Introduction − Basic concepts of neural networks II.Realistic neural networks − Homogeneous excitatory and inhibitory.
Chapter 4. Analysis of Brain-Like Structures and Dynamics (2/2) Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning from Humans 09/25.
CSC2535: Computation in Neural Networks Lecture 8: Hopfield nets Geoffrey Hinton.
An Associative Memory based on a Mixed-Signal Cellular Neural Network Michael Flynn, Daniel Weyer.
Ch 7. Computing with Population Coding Summarized by Kim, Kwonill Bayesian Brain: Probabilistic Approaches to Neural Coding P. Latham & A. Pouget.
Krishnendu ChatterjeeFormal Methods Class1 MARKOV CHAINS.
Latching forward.
Salah A. Aly ,Moustafa Youssef, Hager S. Darwish ,Mahmoud Zidan
New Results of the Color Diversity Problem Jack Raymond (英偉文) and K. Y
SISSA limbo Cortex and language? December 7, ’ 35’ 15’ 15’ to
Richard Dorrance Literature Review: 1/11/13
Statistical and dynamical properties of large cortical network models: insights into semantic memory and language Emilio Kropff Thesis presentation September.

COTS testing Tor Stålhane.
Intermittency and clustering in a system of self-driven particles
How Neurons Do Integrals
Brain States: Top-Down Influences in Sensory Processing
The Hopfield Model - Jonathan Amazon.
CSEP590 – Model Checking and Automated Verification
42.13 Spike Pattern Distributions for Model Cortical Networks P-8
Arealization and Memory in the Cortex
A Computational Approach to Percolation Theory
علم النفس المعرفي (نفس 367)
Corso su Sistemi complessi:
Metaheuristic methods and their applications. Optimization Problems Strategies for Solving NP-hard Optimization Problems What is a Metaheuristic Method?
OCNC Statistical Approach to Neural Learning and Population Coding ---- Introduction to Mathematical.
Boltzmann Machine (BM) (§6.4)
The Prefrontal Cortex—An Update
A measurable definition of Emergence in quantitative systems
Computational model of the brain stem functions
Brain States: Top-Down Influences in Sensory Processing
Computational Models of Grid Cells
Network topology. Network topology. Nodes are linked by edges. Node size represents a quantifiable node property (e.g. fold-change in two different experimental.
Figure 1 Global neuroanatomical correlates of gf and gc
The connected word recognition problem Problem definition: Given a fluently spoken sequence of words, how can we determine the optimum match in terms.
by Khaled Nasr, Pooja Viswanathan, and Andreas Nieder
The Network Approach: Mind as a Web
Computational Mechanics of ECAs, and Machine Metrics
Chapter 8: Recurrent associative networks and episodic memory
SISSA limbo CÉREBRO, VIDA e CULTURA We can easily describe the brain;
Exploring Energy-Latency Tradeoffs for Sensor Network Broadcasts
Presentation transcript:

word

Potts units with dilute connectivity S+1 Potts states Sparse Potts patterns Reduced to a Potts model (Kropff & Treves, 2005) Structured long-range connectivity “0” state included Sparse global patterns updated to remove the ‘memory glass’ problem (Fulvi Mari & Treves, 1998) Cortical modules Local attractor states Global activity patterns A simple semantic network (O’Kane & Treves, 1992) ..but all cortical modules share the same organization… pc  C S 2 !! pc  S ?!?!

Simulations which include a model of neuronal fatigue Simulations show that the Potts semantic network can hop from global attractor to global attractor: Latching dynamics

Hauser, Chomsky & Fitch

if transition probabilities are structured, Latching dynamics, if transition probabilities are structured, might be a neural model for infinite recursion

Monkey recordings by Moshe Abeles et al

How might have a capacity for indefinite latching evolved? semantics  semantics  AM AM C S long-range conn  (local conn ) Storage capacity (max p to allow cued retrieval) pc  C S 2 Latching onset (min p to ensure recursive process) pl  S ? a spontaneous transition to infinite recursion?

G Elston et al

Latching may be a neural basis for infinite recursion only if transition probabilities are structured, so that dynamics are neither random not deterministic determ rand pl  S ? pc  C S 2 ? + we need to confirm the crucial quantitative relationships, e.g. that in a multi-factor coding model (with correlated patterns) Emilio Kropff has taken care of that (J Nat Comput, 2006)

Computer simulations of Frontal Latching Networks with N = 300 Potts units a = 0.25 sparse coding S = 3,4,5,7,10 + 1 states C = 12,17,25,50,100 connections p = 25-400 patterns generated by 20 relevant factors How to quantify retrieval ? and latching ?

Retrieval and latching appear to coexist only above critical values of both C and S Is that to FLNs a percolation phase transition?