The Neural Basis of Thought and Language Midterm Review Session.

Slides:



Advertisements
Similar presentations
Activity-Dependent Development I April 23, 2007 Mu-ming Poo 1.Development of OD columns 2.Effects of visual deprivation 3. The critical period 4. Hebb’s.
Advertisements

Artificial neural networks:
Cognitive Linguistics Croft&Cruse 4: Categories,concepts, and meanings, pt. 1.
PDP: Motivation, basic approach. Cognitive psychology or “How the Mind Works”
Broca’s area Pars opercularis Motor cortexSomatosensory cortex Sensory associative cortex Primary Auditory cortex Wernicke’s area Visual associative cortex.
Regier Model Lecture Jerome A. Feldman February 28, 2006 With help from Matt Gedigian.
Unified Cognitive Science Neurobiology Psychology Computer Science Linguistics Philosophy Social Sciences Experience Take all the Findings and Constraints.
Mirror Neurons.
From Perception to Action And what’s in between?.
Midterm 1 Wednesday next week!. Your Research Proposal Project A research proposal attempts to persuade the reader that: – The underlying question is.
Language, Mind, and Brain by Ewa Dabrowska Chapter 10: The cognitive enterprise.
Categories and concepts- introduction CS182/Ling109/CogSci110 Spring 2006.
Concepts and Categories. Functions of Concepts By dividing the world into classes of things to decrease the amount of information we need to learn, perceive,
Knowing Semantic memory.
CS 182 Sections Created by Eva Mok Modified by JGM 2/2/05 Q:What did the hippocampus say during its retirement speech? A:“Thanks for the memories”
CS 182 Sections slides created Eva Mok Feb 22, 2006 (
Unified Cognitive Science Neurobiology Psychology Computer Science Linguistics Philosophy Social Sciences Experience Take all the Findings and Constraints.
20 Minute Quiz For each of the questions, you can use text, diagrams, bullet points, etc. 1) Give three processes that keep neural computation from proceeding.
1 Chapter 11 Neural Networks. 2 Chapter 11 Contents (1) l Biological Neurons l Artificial Neurons l Perceptrons l Multilayer Neural Networks l Backpropagation.
COLOR VISION © Stephen E. Palmer, 2002.
Connectionist Models: Lecture 3 Srini Narayanan CS182/CogSci110/Ling109 Spring 2006.
Pattern Recognition using Hebbian Learning and Floating-Gates Certain pattern recognition problems have been shown to be easily solved by Artificial neural.
NTL – Converging Constraints Basic concepts and words derive their meaning from embodied experience. Abstract and theoretical concepts derive their meaning.
COLOR VISION After Stephen E. Palmer, 2002 COLOR VISION “The Color Story” is a prototype for Cognitive Science Contributions from: Physics (Newton) Philosophy.
Chapter Seven The Network Approach: Mind as a Web.
The ICSI/Berkeley Neural Theory of Language Project
CS 182 Sections Eva Mok Feb 11, 2004 ( bad puns alert!
Mind, Brain & Behavior Wednesday February 5, 2003.
Ch 31 Sensation & Perception Ch. 3: Vision © Takashi Yamauchi (Dept. of Psychology, Texas A&M University) Main topics –convergence –Inhibition, lateral.
CS 182 Sections Some languages use an absolute orientation system, e.g. 1.Guugu Yimithirr (Cape York, Queensland, Australia) 2.Hai//om (Khoisan,
Issue #2: Shift Invariance
Critical periods A time period when environmental factors have especially strong influence in a particular behavior. –Language fluency –Birds- Are you.
20 Minute Quiz For each of the two questions, you can use text, diagrams, bullet points, etc. 1) What are the main events in neural firing and transmission?
Roles of Knowledge in Cognition 1 Knowledge is often thought of as constituting particular bodies of facts, techniques, and procedures that cultures develop,
Introduction to Neural Networks. Neural Networks in the Brain Human brain “computes” in an entirely different way from conventional digital computers.
Elements and Principles of Art and Design “ The building blocks and how we use them ”
Machine Learning Dr. Shazzad Hosain Department of EECS North South Universtiy
NEURAL NETWORKS FOR DATA MINING
An informal account of BackProp For each pattern in the training set: Compute the error at the output nodes Compute  w for each wt in 2 nd layer Compute.
Lecture 2b Readings: Kandell Schwartz et al Ch 27 Wolfe et al Chs 3 and 4.
1 Chapter 11 Neural Networks. 2 Chapter 11 Contents (1) l Biological Neurons l Artificial Neurons l Perceptrons l Multilayer Neural Networks l Backpropagation.
PSY 323 – COGNITION Chapter 9: Knowledge.  Categorization ◦ Process by which things are placed into groups  Concept ◦ Mental groupings of similar objects,
Biological Modeling of Neural Networks Week 6 Hebbian LEARNING and ASSOCIATIVE MEMORY Wulfram Gerstner EPFL, Lausanne, Switzerland 6.1 Synaptic Plasticity.
Mind, Brain & Behavior Friday February 21, Types of Cones  Three types of cones respond preferentially to different wavelengths of light: Short.
Bain on Neural Networks and Connectionism Stephanie Rosenthal September 9, 2015.
Announcements a3 is out, due 2/15 11:59pm Please please please start early quiz will be graded in about a week. a1 will be graded shortly—use glookup to.
James L. McClelland Stanford University
Color naming A Computational model of Color Perception and Color Naming, Johann Lammens, Buffalo CS Ph.D. dissertation
Organization of Semantic Memory Typical empirical testing paradigm: propositional verification task – rt to car has four wheels vs. car is a status symbol.
Neural Networks (NN) Part 1 1.NN: Basic Ideas 2.Computational Principles 3.Examples of Neural Computation.
YOUR BRAIN How does your brain work? How can you improve your memory and learning? In what ways can you interfere with your brain’s performance? What’s.
Chapter 2 Cognitive Neuroscience. Some Questions to Consider What is cognitive neuroscience, and why is it necessary? How is information transmitted from.
Chapter 2 Cognitive Neuroscience. Some Questions to Consider What is cognitive neuroscience, and why is it necessary? How is information transmitted from.
Introduction to Connectionism Jaap Murre Universiteit van Amsterdam en Universiteit Utrecht
CS 182 Sections Leon Barrett ( bad puns alert!
slides derived from those of Eva Mok and Joe Makin March 21, 2007
CS 182 Sections Leon Barrett. Status A3-P1 already due A3-P2 due on Thursday This week –Color –Representations and concepts Next week.
CS 182 Sections Leon Barrett (
CS 182 Discussion Section Leon Barrett. Announcements a3 part 2 due tomorrow, Feb. 22, 11:59pm I still have some of your quizzes Homework questions?
Announcements a3 is out, due 2/13 and 2/22 11:59pm Computational: part 1 isn't too hard; part 2 is harder quiz will be graded in about a week.
Chapter 9 Knowledge. Some Questions to Consider Why is it difficult to decide if a particular object belongs to a particular category, such as “chair,”
Real Neurons Cell structures Cell body Dendrites Axon
slides derived from those of Eva Mok and Joe Makin March 21, 2007
The trichromatic hypothesis of color perception:
Categorization Categorization is the basis of structure and meaning in our world. We cannot interact with things in the world until we categorize them.
A forced march through Color theory Anatomy of the retina
A forced march through Color theory Anatomy of the retina
Elements and Principles of Art
The Network Approach: Mind as a Web
The McCullough-Pitts Neuron
Presentation transcript:

The Neural Basis of Thought and Language Midterm Review Session

DISCLAIMER We haven’t seen the test We don’t know what’s on the test What we present today is purely our opinion on what some of the important topics are

Administrivia Midterm in class next Tuesday, March 7 th Be there on time! Format: –closed books, closed notes –short answers, no blue books –up to Feb. 28 th lecture

The format for this evening... Question Work on it Discuss Repeat...

What’s been covered so far... Learning and Memory Connectionist modeling PDP systems Back-propagation Brain imaging Psycholinguistics Mirror Neurons Color Image Schemas Regier System

Details... Neurobiology/ Chemistry –neural firing –axons, synapses –differences from the computer –spreading activation –triangle node –mutual inhibition –reaction time experiments –neural development –learning / memory Computational Bridge –connectionist modeling –learning Hebbian learning supervised learning unsupervised learning recruitment learning reinforcement learning –neural network feedfoward network recurrent networks –backpropagation algorithm E,  W, , ,  gradient descent (local minimum) shift invariance Cognitive Linguistics –color experiment –categories / prototypes –basic level categories –image schemas –force-dynamics –frames Word Learning –Regier model –structured connectionism –no negative examples

Hebbian Learning How do the strengths of the weights change in Hebbian Learning if the following neurons fire?

Hebb’s Rule: neurons that fire together wire together Long Term Potentiation (LTP) is the biological basis of Hebb’s Rule Calcium channels is the key mechanism LTP and Hebb’s Rule strengthenweaken

Long Term Potentiation (LTP) These changes make each of the winning synapses more potent for an intermediate period, lasting from hours to days (LTP). In addition, repetition of a pattern of successful firing triggers additional chemical changes that lead, in time, to an increase in the number of receptor channels associated with successful synapses - the requisite structural change for long term memory. –There are also related processes for weakening synapses and also for strengthening pairs of synapses that are active at about the same time.

Questions?

Learning What type of learning discussed in class solves the problem of assigning blame?

Back-prop Questions?

The Brain What areas of the brain would be active when picking up an object vs. seeing someone pick up an object? How does this play into the embodiment debate?

The Mirror Circuit in Monkeys top: monkey sees experimenter grasp an object bottom: monkey sees experimenter reaches his hand behind a screen to grasp an object this is what we see in a monkey… measuring a neuron in the parietal area

Somatotopy top: humans watching foot, hand and mouth actions without an object bottom: humans watching same actions with an object What can we learn from these two experiments? integrated, multi-modal representation of actions, along with the objects and locations Buccino et al., 2001

Concepts What Concepts Are: Basic Constraints –Concepts are the elements of reason, and –constitute the meanings of words and linguistic expressions.

Concepts: Traditional Theory The Traditional Theory Reason and language are what distinguish human beings from other animals. Concepts therefore use only human-specific brain mechanisms. Reason is separate from perception and action, and does not make direct use of the sensory-motor system. Concepts must be “disembodied” in this sense.

The neural theory Human concepts are embodied. Many concepts make direct use of the sensory-motor capacities of our body-brain system. Many of these capacities are also present in non-human primates. Let us look at concepts that make use of our sensory-motor capacities, ex. Grasp.

Questions?

Color What is the biological basis of basic color terms?

The WCS Color Chips Basic color terms: –Single word (not blue-green) –Frequently used (not mauve) –Refers primarily to colors (not lime) –Applies to any object (not blonde) FYI: English has 11 basic color terms

Results of Kay’s Color Study If you group languages into the number of basic color terms they have, as the number of color terms increases, additional terms specify focal colors Stage IIIIIIa / IIIbIVVVIVII W or R or YWWWWWW Bk or G or BuR or Y RRRR Bk or G or BuG or BuYYYY BkG or BuGGG BkBu WBk RY+Bk (Brown) YR+W (Pink) Bk or G or BuR + Bu (Purple) R+Y (Orange) B+W (Grey)

Color Opponent Cells These cells are found in the LGN Four color channels: Red, Green, Blue, Yellow R/G, B/Y pairs much like center/surround cells We can use these to determine the visual system’s fundamental hue responses Mean Spikes / Sec Wavelength (mμ) R-G G-R Y-B B-Y (Monkey brain)

Questions?

Categories Internal structure (classical, radial, family resemblance, prototype-based, “essentially- contested,” ad-hoc) “External” structure (basic-level, superordinate, subordinate)

Categories What are super- and sub-ordinate types to “red”?

Categories Furniture SofaDesk leather sofa fabric sofa L-shaped desk Reception disk Basic-Level Category Superordinate Subordinate

Basic-Level Category Perception: –similar overall perceived shape –single mental image –(gestalt perception) –fast identification Function: –general motor program Communication: –shortest –most commonly used –contextually neutral –first to be learned by children –first to enter the lexicon Knowledge Organization: –most attributes of category members stored at this level What constitutes a basic-level category? Red? Maroon? yes arguable (expertise)

Categories: Internal Structure Classical Category: –necessary and sufficient conditions Radial Category: –a central member branching out to less-central and non-central cases –degrees of membership, with extendable boundary Family Resemblance: –every family member looks like some other family member(s) –there is no one property common across all members (e.g. polysemy) Prototype-Based Category Essentially-Contested Category (Gallie, 1956) (e.g. democracy) Ad-hoc Category (e.g. things you can fit inside a shopping bag)

Questions?

Image Schemas and Regier

Image Schemas Trajector / Landmark (asymmetric) –The bike is near the house –? The house is near the bike Boundary / Bounded Region –a bounded region has a closed boundary Topological Relations –Separation, Contact, Overlap, Inclusion, Surround Orientation –Vertical (up/down), Horizontal (left/right, front/back) –Absolute (E, S, W, N) LM TR bounded region boundary