A neurocomputational mechanism for parsing:

Slides:



Advertisements
Similar presentations
Sparse Coding in Sparse Winner networks Janusz A. Starzyk 1, Yinyin Liu 1, David Vogel 2 1 School of Electrical Engineering & Computer Science Ohio University,
Advertisements

Red Circle & Green Square or Green Circle and Red Square? The Binding Problem.
Functional Link Network. Support Vector Machines.
1Neural Networks B 2009 Neural Networks B Lecture 1 Wolfgang Maass
Organizational Notes no study guide no review session not sufficient to just read book and glance at lecture material midterm/final is considered hard.
[1].Edward G. Jones, Microcolumns in the Cerebral Cortex, Proc. of National Academy of Science of United States of America, vol. 97(10), 2000, pp
Theories of Mind: An Introduction to Cognitive Science Jay Friedenberg Gordon Silverman.
What is Cognitive Science? … is the interdisciplinary study of mind and intelligence, embracing philosophy, psychology, artificial intelligence, neuroscience,
On Algorithmic Representation of Music Style David Cope Professor of Music, Univ. of California, Santa Cruz.
Baysian Approaches Kun Guo, PhD Reader in Cognitive Neuroscience School of Psychology University of Lincoln Quantitative Methods 2011.
What is Cognitive Science? … is the interdisciplinary study of mind and intelligence, embracing philosophy, psychology, artificial intelligence, neuroscience,
Perception-Based Engineering: Integrating Human Response Into Product Design A collaboration between psychologists and engineers. Mission: To integrate.
Presented By Wanchen Lu 2/25/2013
Self-Organized Recurrent Neural Learning for Language Processing April 1, March 31, 2012 State from June 2009.
CS623: Introduction to Computing with Neural Nets (lecture-20) Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay.
Development and Disintegration of Conceptual Knowledge: A Parallel-Distributed Processing Approach Jay McClelland Department of Psychology and Center for.
The search for organizing principles of brain function Needed at multiple levels: synapse => cell => brain area (cortical maps) => hierarchy of areas.
MICHAELA PORUBANOVA PSY 270 Consciousness. “How it is that anything so remarkable as a state of consciousness comes about as a result of irritating nervous.
Towards Cognitive Robotics Biointelligence Laboratory School of Computer Science and Engineering Seoul National University Christian.
Changju Lee Visual System Neural Network Lab. Department of Bio and Brain Engineering.
Lecture 10: 8/6/1435 Machine Learning Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
Functional Connectivity in an fMRI Working Memory Task in High-functioning Autism (Koshino et al., 2005) Computational Modeling of Intelligence (Fri)
Modelling Language Evolution Lecture 1: Introduction to Learning Simon Kirby University of Edinburgh Language Evolution & Computation Research Unit.
Neuronal Adaptation to Visual Motion in Area MT of the Macaque -Kohn & Movshon 지각 심리 전공 박정애.
Exploring Engineering Chapter 10 Control Systems and Mechatronics.
CogSci 207 Midterm Review Fall 2004 Praveen Paritosh 10/18/04.
The Function of Synchrony Marieke Rohde Reading Group DyStURB (Dynamical Structures to Understand Real Brains)
BASIC PROCESSES The Team: Philip Abrami Denis Cousineau Roberto de Almeida Zohra Mimouni Norm Segalowitz Michael von Grünau Concordia University Psychology.
Metacognition Neil H. Schwartz Psych 605. Three Terms: Organizing the Concept Exogenous Constructivism Endogenous Constructivism Spence Piaget Dialectical.
Generic Tasks by Ihab M. Amer Graduate Student Computer Science Dept. AUC, Cairo, Egypt.
The Time Dimension for Scene Analysis DeLiang Wang Perception & Neurodynamics Lab The Ohio State University, USA.
KNOWLEDGE BASED SYSTEMS
1 Discovery and Neural Computation Paul Thagard University of Waterloo.
Chapter 8. Situated Dialogue Processing for Human-Robot Interaction in Cognitive Systems, Christensen et al. Course: Robots Learning from Humans Sabaleuski.
Minds and Computers Discovering the nature of intelligence by studying intelligence in all its forms: human and machine Artificial intelligence (A.I.)
1 ARTIFICIAL INTELLIGENCE Gilles BÉZARD Version 3.16.
Emergent Semantics: Meaning and Metaphor Jay McClelland Department of Psychology and Center for Mind, Brain, and Computation Stanford University.
Chapter 4. Analysis of Brain-Like Structures and Dynamics (2/2) Creating Brain-Like Intelligence, Sendhoff et al. Course: Robots Learning from Humans 09/25.
1 Introduction to Speech Coding What, Why, Where & How (First Part) By Allam Mousa Department of Telecommunication Engineering An Najah University SP_2_Coding_1of2.
Artificial Intelligence DNA Hypernetworks Biointelligence Lab School of Computer Sci. & Eng. Seoul National University.
National Taiwan Normal A System to Detect Complex Motion of Nearby Vehicles on Freeways C. Y. Fang Department of Information.
Multivariate Pattern Analysis of fMRI data. Goal of this lecture Introduction of basic concepts & a few commonly used approaches to multivariate pattern.
Chapter 9 Knowledge. Some Questions to Consider Why is it difficult to decide if a particular object belongs to a particular category, such as “chair,”
Object-Oriented Programming
Comparison with other Models Exploring Predictive Architectures
Randomness in Neural Networks
Chapter 11: Artificial Intelligence
Visual Computation and Learning Lab
Module: Software Engineering of Web Applications
Paul J. Reber Department of Psychology Northwestern University
Knowledge Representation
How do we realize design? What should we consider? Technical Visual Interaction Search Context of use Information Interacting/ transacting.
HUMAN LANGUAGE TECHNOLOGY: From Bits to Blogs
Deep Learning based Machine Translation
Distributed Representation of Words, Sentences and Paragraphs
Cognitive Brain Dynamics Lab
Module: Software Engineering of Web Applications
Double Dissociation in Radial & Rotational Motion-Defined Temporal Order Judgments Poster # Leslie Welch1, Nestor Matthews2, Elena Festa1, Kendra.
]POST Retrieval cues in language comprehension:
Intelligent Leaning -- A Brief Introduction to Artificial Neural Networks Chiung-Yao Fang.
OCNC Statistical Approach to Neural Learning and Population Coding ---- Introduction to Mathematical.
A neurocomputational mechanism for parsing:
Chapter 1 Introduction.
Module: Software Engineering of Web Applications
Symbolic AI 2.0 Yi Zhou.
]POST Retrieval cues in language comprehension:
Natural Language to SQL(nl2sql)
15. Cortical gamma-band activity during auditory processing: evidence from human magnetoencephalography studies
Modeling Cognition with Neural Networks
William Stallings Computer Organization and Architecture 7th Edition
Presentation transcript:

A neurocomputational mechanism for parsing: Finding hierarchical linguistic structure in a model of relational processing Andrea E. Martin & Leonidas A. A. Doumas School of Philosophy, Psychology, and Language Sciences Department of Psychology, The University of Edinburgh andrea.martin@ed.ac.uk INTRODUCTION Our brains perceive hierarchical linguistic structure at multiple timescales and levels of analysis1,2 Cortical oscillations appear to (at least) track these representations, if not reflect the computation of them1 Linking hypothesis between linguistic representation and cortical oscillations: a computational mechanism that generates hierarchical representations DORAese & PARSING Dry... ...fur... ...skin. ...rubs... HYPOTHESIS Cortical mechanism repurposed when hierarchical representation became an efficient solution2,3 A single mechanism must perform multiple, functionally-related computations while oscillating like the cortical signal e.g. parsing sentences and reasoning about propositional content3 DATA & RESULTS Oscillatory unit firing Grammatical Jabberwocky Stimuli and data from Ding et al. (2016) Activation of existing representations in memory METHODS & STIMULI Word List We used Discovery Of Relations by Analogy3 (DORA) to parse the Grammatical and Word List conditions from Ding et al. (2016), as well as a Jabberwocky condition we created: Grammatical: fun games waste time Word List: hills cents speech tears Jabberwocky: sharp soap scared hats Grammatical Jabberwocky CONCLUSIONS Profound mechanistic synergy between representational structure building and cortical oscillations. First principle of cortical computation: sensitivity to time as information (2) Computational mechanism: temporal asynchrony (desynchronization) (3) Generative representational hierarchy from perceptual features via temporal asynchrony at multiple timescales (4) Mechanism is an “abstraction engine” in the human brain Learning DORA can learn in two ways, with same results: (1) by sampling from a random variable, (2) by processing corpora (e.g., wikipedia). In both cases, DORA generates predicate representations from flat feature vector input. DORA assumes/uses: Hebbian learning The ability to compare: - a network with layers of units - lateral inhibition/ leaky integrators - separate banks of units 3. Sensitivity to time as an informational degree of freedom Funded by ES/K009095/1 to AEM References: [1]Ding, N., Melloni, L., Zhang, H., Tian, X. & Poeppel, D. (2016) [2] Martin, A. E. (2016) [3] Doumas, L. A. A., Hummel, J. E., & Sandhofer, C. M. (2008)