Brook's Image Scanning Experiment & Neuropsychological Evidence for Spatial Rehearsal Psychology 355: Cognitive Psychology Instructor: John Miyamoto.

Slides:



Advertisements
Similar presentations
Working Memory Model Baddeley and Hitch (1974) developed an alternative model of short-term memorywhich they called working memory.
Advertisements

Short-term and Working Memory
Working Memory Dr. Claudia J. Stanny EXP 4507 Memory & Cognition Spring 2009.
Sensory memory, Primary memory. Today Sensory memory and its characteristics Working memory--a specific model of primary memory.
Short-Term and Working Memory
Read: Loftus for Tuesday Vokey for April 14 Idea Journals due on the 16th.
Opportunities for extra credit: Keep checking at:
FMRI - What Is It? Then: Example of fMRI in Face Processing Psychology 355: Cognitive Psychology Instructor: John Miyamoto 04/06 /2015: Lecture 02-1 This.
Memory III Working Memory & Brain. Atkinson & Shiffrin (1968) Model of Memory.
Plans: Read About False Memories (Beth Loftus) for Thursday (April 7th) Read About Amnesia (Oliver Sacks) for Tuesday (April 12th) Read about Subliminal.
False Memories (Beth Loftus) Lost Mariner (Oliver Sacks)
Read: Sacks for Thursday Loftus for Tuesday Vokey for Thursday.
BHS Memory and Amnesia Working Memory. Baddeley’s Model Baddeley and Hitch’s (1983) tripartite (three-part) model Central executive Control center.
The Working Memory Model
A Modular Approach to STM Allan Baddeley: Articulatory Loop Central Executive Visuospatial Sketchpad The article by Lee Brooks considers a double-dissociation.
Memory III Working Memory. Atkinson & Shiffrin (1968) Model of Memory.
Sensory Memory and Working Memory. Sensory Memory Brief Iconic/echoic High capacity Pre-attentive Is there a Neural Correlate of Sensory Memory?
I have a photographic memory but once in a while I forget to take off the lens cap. - Milton Berle Forming & Using New Memories.
James B. Brewer, Zuo Zhao, John D Desmond, Gary H. Glover, John D. E. Gabrieli Thomas Pierce.
Working Memory Components Evidence Different codes Dual-task paradigm Dissociations.
THE “WORKING MEMORY” APPROACH Baddeley & Hitch (1974) –Use articulatory suppression to interfere with some tasks, not others B doesn’t precede AB A –Develop.
Information Processing. History In response to Behaviorism, a cognitive model of mind as computer was adopted (1960’s, 70’s) Humans process, store, encode,
Working Memory Model Baddeley and Hitch (1974)
The Working Model of Memory
Coding in STM Clues about coding in STM:. Coding in STM Clues about coding in STM: –# of items stored in STM depends on rate of speech.
Cognitive Processes PSY 334 Chapter 4 – Perception-Based Knowledge Representation.
Method: Reaction Time (RT)
Evidence for a Visuospatial Sketch Pad (VSP) Psychology 355: Cognitive Psychology Instructor: John Miyamoto 4/28 /2015: Lecture 05-2 This Powerpoint presentation.
Gestalt Principles of Perception Psychology 355: Cognitive Psychology Instructor: John Miyamoto 04/08 /2015: Lecture 02-3 This Powerpoint presentation.
Neuropsychological Evidence for Category Structure Then: The Functional Role of Mental Imagery Psychology 355: Cognitive Psychology Instructor: John Miyamoto.
CognitiveViews of Learning Chapter 7. Overview n n The Cognitive Perspective n n Information Processing n n Metacognition n n Becoming Knowledgeable.
Cognitive Processes PSY 334 Chapter 4 – Perception-Based Knowledge Representation July 15, 2003.
Spatial Attention, Object-Based Attention & Unilateral Neglect Psychology 355: Cognitive Psychology Instructor: John Miyamoto 4/15 /2015: Lecture 03-3.
Autobiographical Memories & Flashbulb Memories Psychology 355: Cognitive Psychology Instructor: John Miyamoto 5/11 /2015: Lecture 07-1 This Powerpoint.
1: Brown-Peterson Paradigm 2: Intro to the Working Memory Model Psychology 355: Cognitive Psychology Instructor: John Miyamoto 4/23 /2015: Lecture 04-4.
Phonological Loop, Visuospatial Sketchpad & Articulatory Suppression Psychology 355: Cognitive Psychology Instructor: John Miyamoto 04/25/2016: Lecture.
Memorization is NOT a Good Learning Strategy Then,.... Psychology 355: Cognitive Psychology Instructor: John Miyamoto 05/04/2016: Lecture 06-3 Note: This.
Cognitive Neuroscience (Psychology 460) Summer Quarter Mondays & Wednesdays 12:00 – 2:10pm This course will focus on answering the question, “How are cognitive.
Read: Loftus for April 1 Sacks for April 3 Vokey for April 10 Idea Journals due on the 10th.
Coming Up: Read: The Lost Mariner by Oliver Sachs Repressed Memories by Elizabeth Loftus.
Chapter 5 Short-Term and Working Memory. Some Questions to Consider Why can we remember a telephone number long enough to place a call, but then we forget.
The Working Memory Model Baddeley & Hitch, The Working Memory Model The Diagram:
Representational Hypotheses in Cognitive Psychology
Decay in Short-Term Memory (STM) then: The Working Memory (WM) Model
This course will focus on answering the question,
Brook's Image Scanning Experiment & Neuropsychological Evidence for Spatial Rehearsal Psychology 355: Cognitive Psychology Instructor: John Miyamoto.
Working Memory Model Baddeley and Hitch (1974) developed an alternative model of short-term memory which they called working memory.
Memory Part II Memory Stages and Processes
Typical Person :^) Fall 2002 CS/PSY 6750.
Jian-Zhong Xiang, Malcolm W Brown  Neuron 
“What” and “Where” Pathways in the Brain – A Hypothesis About Localization of Perceptual Functions Psychology 355: Cognitive Psychology Instructor:
Unilateral Neglect, Spatial Attention, Object-Based Attention
Then: Physiological Measures . in Cognitive Neuroscience
Phonological Loop, Visuospatial Sketchpad & Articulatory Suppression
fMRI: What Does It Measure?
Short-Term Memory & Working Memory
First: The Central Executive Then: Intro to Long-Term Memory
Introduction to Attention and Theories of Selective Attention
Early or Late Selective Attention, Attentional Capacity and Spatial Attention Psychology 355: Cognitive Psychology Instructor: John Miyamoto 04/10/2018:
Sensory Memory, Short-Term Memory & Working Memory
How to Improve the Chance of Future Retrieval
Chapter 7: Memory and Training
Brief History of Cognitive Psychology
Evidence for the Working Memory Model.
Chapter 7: Memory.
Typical Person :^) Fall 2002 CS/PSY 6750.
Modality-Independent Coding of Spatial Layout in the Human Brain
Prefrontal Neurons Coding Suppression of Specific Saccades
Christian J. Fiebach, Jesse Rissman, Mark D'Esposito  Neuron 
Cognitive Processes PSY 334
Presentation transcript:

Brook's Image Scanning Experiment & Neuropsychological Evidence for Spatial Rehearsal Psychology 355: Cognitive Psychology Instructor: John Miyamoto 04/24/2018: Lecture 05-2 Note: This Powerpoint presentation may contain macros that I wrote to help me create the slides. The macros aren’t needed to view the slides. You can disable or delete the macros without any change to the presentation.

Outline Brandimonte's Mental Subtraction Experiment Mental Subtraction + Articulatory Suppression Brook's Image Scanning Experiment: Interference between VSP & PL Neuropsychological evidence for spatial rehearsal in the VSP Similarities and differences between PL and VSP Done! Psych 355, Miyamoto, Spr ‘18 Purpose of Brook's Image Scanning Experiment

Next: Brook’s Image Scanning Experiment Brooks, L. R. (1968). Spatial and verbal components of the act of recall. Canadian Journal of Psychology, 22, 349-368. Purpose #1: To show that there are 2 different short-term stores: VSP and PL Purpose #2: To show that ... Performing two different tasks in VSP interfere with each other. Performing two different tasks in PL interfere with each other. Performing one task in VSP and a different task in PL does not cause as much interference Psych 355, Miyamoto, Spr '18 Image Scanning Experiment

Image Scanning (Brooks) Experiment has 4 conditions. 2 types of stimulus: Diagrams or Sentences 2 types of responses: Pointing or Vocal Response* Dependent variable = time to perform a task Next: Explain the different stimulus types and response modes Response Mode Pointing Vocal Diagrams 28.2 11.3 Sentences 9.8 13.8 Stimulus Types * There was actually a third response type, “tapping”, but it will not be discussed here – it turned out not to be very informative. Psych 355, Miyamoto, Spr '18 Point Out that Goldstein Textbook Omits the Sentence Stimuli

Image Scanning (Brooks) Experiment has 4 conditions. 2 types of stimulus: Diagrams or Sentences 2 types of responses: Pointing or Vocal Response* Dependent variable = time to perform a task Next: Explain the different stimulus types and response modes Response Mode Pointing Vocal Diagrams 28.2 11.3 Sentences 9.8 13.8 Stimulus Types Psych 355, Miyamoto, Spr '18 Same Slide with Remark that Goldstein Omits Sentence Stimuli

Image Scanning (Brooks) Experiment has 4 conditions. 2 types of stimulus: Diagrams or Sentences 2 types of responses: Pointing or Vocal Response* Dependent variable = time to perform a task Next: Explain the different stimulus types and response modes Response Mode Pointing Vocal Diagrams 28.2 11.3 Sentences 9.8 13.8 Stimulus Types Goldstein's discussion of this study omits the Sentence stimuli. Only the diagram stimuli are discussed in the textbook. Psych 355, Miyamoto, Spr '18 Explain Diagram Stimulus x Vocal Response

Image Scanning (Brooks) Experiment has 4 conditions. 2 types of stimulus: Diagrams or Sentences 2 types of responses: Pointing or Vocal Response* Dependent variable = time to perform a task Next: Explain the different stimulus types and response modes Response Mode Pointing Vocal Diagrams 28.2 11.3 Sentences 9.8 13.8 Next Slide Stimulus Types Explain Diagram Stimulus x Vocal Response Psych 355, Miyamoto, Spr '18

Image Scanning (Brooks, cont.) Condition: Diagrammatic Stimulus & Vocal Response Memorize the figure. Then it is removed. Start your scan at the star and (mentally) move clockwise around the figure. Say "OUT" when you reach an outside corner.. Say "IN" when you reach an inside corner. Correct response: out, out, out, in, in, out, out, in, out, out, out Dependent variable: Response time (time to complete the task) Psych 355, Miyamoto, Spr '18 2 x 2 Exp Design: Identify Combination of Diagram Stim & Pointing Resp

Image Scanning (cont.) Next: Diagrammatic stimulus combined with pointing response: Response Mode Pointing Vocal Diagrams 28.2 11.3 Sentences 9.8 13.8 Stimulus Type Previous Slide Next Slide Condition: Diagram Stimulus with Pointing Response Psych 355, Miyamoto, Spr '18

Image Scanning (Brooks, cont.) Condition: Diagrammatic Stimulus & Pointing Response Memorize the figure. Then it is removed. Same as before Start your scan at the * and (mentally) move clockwise around the figure. Same as before. Point to "Out" when you reach an outside corner. Point to "In" when you reach an inside corner.. Correct response: (See diagram) out, out, in, in, out, out, in, out, out, out Dependent variable: Response time (time to complete the task) Stimulus * Goldstein textbook shows the words "In" and "Out" lined up in straight columns, but the actual experimental task had irregular columns as shown on this slide. * Irregular columns increase the load on spatial working memory; straight columns would not require as much attention to spatial layout. Respond by pointing to letters on this sheet. Transition to Next Condition: Sentence Stimulus & Vocal Response Psych 355, Miyamoto, Spr '18

Image Scanning (cont.) Explain sentence stimulus combined with vocal response: Response Mode Pointing Vocal Diagrams 28.2 11.3 Sentences 9.8 13.8 Stimulus Type Next Slide Condition: Sentence Stimulus & Vocal Response Psych 355, Miyamoto, Spr '18

Image Scanning (Lee Brooks, cont.) Sentence Stimulus A bird in hand is worth two in the bush. Condition: Sentence Stimulus & Vocal Response Memorize the sentence. Then it is removed. Now work from the beginning to the end of the sentence. Say "yes" each time you encounter a noun; say "no" when you encounter a word that is not a noun. Correct response: Dependent variable: Response time (time to complete the task) no, yes, no, yes, no, no, no, no, no, yes Psych 355, Miyamoto, Spr '18 Transition to Condition with Sentence Stimulus & Pointing Response

Image Scanning (cont.) Condition: Sentence Stimulus & Vocal Response Response Mode Pointing Vocal Diagrams 28.2 11.3 Sentences 9.8 13.8 Stimulus Type Next Slide Sentence Stimulus x Pointing Response Psych 355, Miyamoto, Spr '18

Image Scanning (Lee Brooks, cont.) Condition: Sentence Stimulus & Pointing Response Memorize the sentence. Then it is removed. Work from the beginning to the end of the sentence. Point to "yes" each time you encounter a noun; say "no" when you encounter a word that is not a noun.. Correct response: no, yes, no, yes, no, no, no, no, no, yes Sentence Stimulus: A bird in hand is worth two in the bush. Respond by pointing to letters on this sheet. Image Scanning Results Psych 355, Miyamoto, Spr '18

Results: Image Scanning (Lee Brooks) Stimulus Type Response Mode Pointing Vocal Diagrams 28.2 11.3 Sentences 9.8 13.8 Slower Faster Faster Slower Same Slide: Why is Pointing Slower than Vocal For Diagrams & Opposite for Sentences? Psych 355, Miyamoto, Spr '18

Results: Image Scanning (Lee Brooks) Stimulus Type Response Mode Pointing Vocal Diagrams 28.2 11.3 Sentences 9.8 13.8 Why is diagram/pointing slower than diagram/vocal? Why is sentence/vocal slower than sentence/pointing? Slower Faster Faster Slower Psych 355, Miyamoto, Spr '18 Discussion of Results

Why is Diagram/Pointing Slower than Diagram/Vocal? Stimulus Type Response Mode Pointing Vocal Diagrams 28.2 11.3 Sentences 9.8 13.8 Diagram/Pointing: The stimulus and response compete for a common cognitive resource, representation in VSP. Information processing bottleneck causes slower response. Diagram/Vocal: Stimulus & response use separate cognitive resources. No bottleneck. Slower Faster Psych 355, Miyamoto, Spr '18 Why is sentence/vocal slower than sentence/pointing?

Why is Sentence/Vocal Slower than Sentence/Pointing? Stimulus Type Response Mode Pointing Vocal Diagrams 28.2 11.3 Sentences 9.8 13.8 Sentence/Vocal: Again, stimulus and response compete for a common cognitive resource, representation in PL. Information processing bottleneck causes slower response. Sentence/Pointing: Stimulus & response use separate cognitive resources. No bottleneck. Faster Slower Brook’s Image Scanning Experiment Supports Existence of Visuospatial Component to WM Psych 355, Miyamoto, Spr '18

Brooks' experiment supports the existence of a visuospatial sketch pad (VSP) because .... If there were only one STM store (not separate PL & VSP), then the effect of the pointing response would be the same in the visuospatial task and the verbal task. Similarly for the effect of the verbal response. WM model assumes multiple memory stores – this lets WM predict conflicts between similar mental codes. The preceding experiment illustrates a basic principle: A response in one modality (verbal or spatial) will interfere more with a memory representation in the same modality than with a memory representation in a different modality. Psych 355, Miyamoto, Spr '18 Comment re the Response Sheet for the Pointing Response

Respond by pointing to letters on this sheet. Response Sheet for the Pointing Response in Brooks' Image Scanning Experiment Condition: Diagrammatic Stimulus & Pointing Response Stimulus Response sheet as displayed in Goldstein Table 5.2 (p. 139) * Goldstein textbook shows the words "In" and "Out" lined up in straight columns, but the actual experimental task had irregular columns as shown on this slide. * Irregular columns increase the load on spatial working memory; straight columns would not require as much attention to spatial layout. Respond by pointing to letters on this sheet. Psych 355, Miyamoto, Spr '18 Same Slide with Comment that the Response Sheet on Right is Correct

Respond by pointing to letters on this sheet. Response Sheet for the Pointing Response in Brooks' Image Scanning Experiment Condition: Diagrammatic Stimulus & Pointing Response Stimulus Response sheet as displayed in Goldstein Table 5.2 (p. 139) * Goldstein textbook shows the words "In" and "Out" lined up in straight columns, but the actual experimental task had irregular columns as shown on this slide. * Irregular columns increase the load on spatial working memory; straight columns would not require as much attention to spatial layout. The actual response sheet looked more like this. Why use the irregular display as on the right? Respond by pointing to letters on this sheet. Spatial Rehearsal in Visual Working Memory Psych 355, Miyamoto, Spr '18

Spatial Rehearsal in Working Memory – What Is It? Spatial Rehearsal – maintaining information about a location in working memory Terminology PFC Prefrontal Cortex (the front of the frontal lobe of the brain) DLPFC Dorsolateral Prefrontal Cortex (along the upper outside of the PFC) Psych 355, Miyamoto, Spr '18 Delayed-Match-To-Sample (Monkey Study)

Delayed-Match-To-Sample Paradigm (a) Cue (b) Delay (c) Reward Monkey sees where food is located. 10 second delay without visual input. Monkey reaches for food (or makes a mistake and reaches in the wrong place). Goldstein refers to this experimental task as the "delayed response task." See Figure 5.23, p. 143. Psych 355, Miyamoto, Spr '18 Same Display – Single Cell Recordings Find Neural Correlates of (a), (b) & (c)

Delayed-Match-To-Sample Paradigm (a) Cue (b) Delay (c) Reward These results indicate importance of frontal lobes in maintaining spatial location information in VSP. Single-cell recording in monkey PFC shows a correlation between neural activity & the three stages of this task. Some neurons become active during the initial placement of the food. Some neuron become active only during the delay period (spatial rehearsal). Some neurons become active only when the response is made. Psych 355, Miyamoto, Spr '18 Same Display – Monkeys with PFC Lesions Cannot Do This Task

Delayed-Match-To-Sample Paradigm (a) Cue (b) Delay (c) Reward Right Wrong These results indicate importance of frontal lobes in maintaining spatial location information in VSP. Monkeys with frontal lesions cannot do this task. Human infants cannot do task until about 12 months old. Multiple Location / Eye Movement Version of Delayed Response Task Psych 355, Miyamoto, Spr '18

Monkey Performance on Delayed Eye-Movement Task Same idea as the delayed-match-to-sample task (preceding slide), except that there are multiple locations to remember, and the response is an eye movement. See Goldstein, Figure 5.24 (p. 144). The monkey's task is to see the target, wait until a response is permitted, and then move his eyes to the target position. He gets rewarded with a squirt of apple juice. + Target Stimulus Eye Movement Response Delay Period + + Psych 355, Miyamoto, Spr '18 Single-Cell Recordings When Perceiving the Cue; Maintaining Attention; Responding

These results show that scientist has identified a neurons that are specific to spatial rehearsal. Note that the neuron is only active while the monkey is rehearsing a specific spatial location, not for other spatial locations. Funahashi, S., Bruce, C. J., & Goldman-Rakic, P. S. (1993). Dorsolateral prefrontal lesions and oculomotor delayed- response performance: Evidence for mnemonic "scotomas." Journal of Neuroscience, 13, 1479-1497. Neurons in DLPFC show sustained activity during delay period that is selective of the particular location to be remembered. Errors occur when this sustained activity fails to initiate or decays before end of delay period. Psych 355, Miyamoto, Spr '18 Specific Lesions Cause Location-Specific Inability to Memory Loss

error Lesion Perception for these locations is not impaired. Memory for other locations is not impaired. This shows that a specific brain injury can prevent a monkey from thinking about a location. Lesions introduced into spatial memory areas cause location-specific inability to retain spatial information during the delay period. (Mnemonic scotoma). Perception for these locations is not impaired, i.e., this is not a blind spot. Memory for other locations is not impaired. Psych 355, Miyamoto, Spr '18 Neural Mind Reading

Tuesday, April 24, 2018: The Lecture Ended Here Psych 355, Miyamoto, Spr '18

Neural Mind of Perceptual Processing Neural Mind Reading - guessing what someone was thinking from the neural response. Kamitani, Y., & Tong, F. (2005). Decoding the visual and subjective contents of the human brain. Nature Neuroscience, 8, 679–685. Neural mind reading of perceptual processing: fMRI used to guess which pattern a subject is viewing On each trial, the subject views the pattern on left or the pattern on the right: Researcher tries to guess the stimulus based on fMRI image taken while subject views the stimulus. Psychologists achieve accuracy of 75% - 100% depending on the stimulus pair. Guessing rate would be 50%. Perception study: Subject sees a striped disk. Experimenter who does not know which disk the subject was looking at has to predict the orientation of the stripes based on an fMRI image of the subject's visual cortex. Visual working memory study: Subject sees both striped disks. The disks disappears. The subject is given a cue, 1 or 2, that tells him which disk to hold in memory. After an 11 second delay, the subject is shown a new striped disk Experimenter who does not know which disk the subject was looking at has to predict the orientation of the stripes based on an fMRI image of the subject's visual cortex. OR Psych 355, Miyamoto, Spr '18 Neural Mind Reading of Rehearsal in VSP

Neural Mind Reading of Rehearsal in VSP Harrison, S. A., & Tong, F. (2009). Decoding reveals the contents of visual working memory in early visual areas. Nature, 458, 462–465. On each trial, the subject views a sequence of screens. Researcher tries to guess the image held in WM based on fMRI image taken while subject retains the memory of the cued stimulus. Psychologists achieve accuracy of 80% (average). fMRI successfully detected VSP rehearsal of the target image. 11 seconds 2 Target 1 Target 2 Remember This Target fMRI Recording Test Stimulus Is Test Stimulus Clockwise or Counterclockwise? Visual working memory study: Subject sees both striped disks. The disks disappears. The subject is given a cue, 1 or 2, that tells him which disk to hold in memory. After an 11 second delay, the subject is shown a new striped disk. Subject's task is to say whether the test stimulus (striped disk) is rotated clockwise or counterclockwise relative to the remembered target (either 1 or 2 depending on the memory cue). Note that every trial has the same stimuli up until the cue for the target (1 or 2). The fMRI differences are not caused by stimulus differences. Harrison and Tong had previously identified orientation specific voxels (tiny rectalinear volumes in the brain). Researchers used activity in visual cortex to predict orientation of the target that was being retained during the 11 second retention period. 2 Psych 355, Miyamoto, Spr '18 Graph Showing Brain Activity in Visual Cortex While Retaining Orientation Info

fMRI Measure of Brain Activity During Stimulus Trial Harrison, S. A., & Tong, F. (2009). Decoding reveals the contents of visual working memory in early visual areas. Nature, 458, 462–465. The graph (b) shows brain activity during the retention period (and after the retention period - not relevant to our current topic). BOLD contrast is strong in targeted areas of visual cortex during the retention period (11 seconds), even though there is no visual stimulus. The fact that the activity was in the visual cortex supports interpretation that what we are observing is spatial rehearsal. Stimulus Sequence Brain Activity in Visual Cortex During 11 Second Retention Psych 355, Miyamoto, Spr '18 Summary: Neuropsych Evidence for WM Components

Neuropsychological Evidence for WM Components There is a short-term memory store (VSP) that is specific for visual imagery and spatial representations. Evidence for “spatial rehearsal” in VSP Single-cell recordings in monkey Imaging studies of phonological loop: No one brain locus shows increased activity during rehearsal. Multiple brain areas that are associated with language show increased activity. Evidence from cognitive impairments Psych 355, Miyamoto, Spr '18 Table Comparing PL to VSP - Overview of Layout

Summary: Comparison Between PL & VSP Phonological Loop Common Characteristics Differences Visuospatial Sketchpad Common Characteristics Differences Psych 355, Miyamoto, Win '13 Comparison of PL & VSP - END

Summary: Comparison Between PL & VSP Phonological Loop Limited capacity Information is retained by an active process (verbal rehearsal) Information is highly accessible Multiple verbal tasks interfere with each other. PL processes linguistic information; Visuospatial Sketchpad Limited capacity Information is retained by an active process (manipulation of mental imagery) Information is highly accessible Multiple visual tasks interfere with each other. VSP processes visual imagery and spatial information. Verbal Task + Visual Task produces less interference than Verbal Task + Verbal Task or Visual Task + Visual Task Different areas of the brain show enhanced activity during verbal and visual/spatial rehearsal. Psych 355, Miyamoto, Spr '18 END