1. How are Memory and Attention related in Working Memory? Elke Lange, Christian Starzynski, Ralf Engbert University of Potsdam

2. Memory and Attention Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam Current models of Working Memory include a strong attentional component (e.g., Focus of attention in the WM model of Cowan, 2005, or Oberauer, 2002) Attention serves as a component for a)keeping information available b)selecting information from either the environment (=encoding into memory) or from memory (=memory access) c)manipulation of memory representations Current models of Working Memory include a strong attentional component (e.g., Focus of attention in the WM model of Cowan, 2005, or Oberauer, 2002) Attention serves as a component for a)keeping information available b)selecting information from either the environment (=encoding into memory) or from memory (=memory access) c)manipulation of memory representations

3. Memory Encoding Targets need to be selected Usually: Selection of targets out of non- target information Non-targets = distractors to some extend Investigating selection processes by manipulate and control distraction by irrelevant information Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

4. Why: Distraction? Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

5. Distraction is dangerous Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

6.  Background music instead of narcotic drugs Distraction is helpful Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

7. Distraction can hinder and help Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

8. Classic Paradigm 7 4612835 Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

9. Why are irrelevant stimuli disturbing? 1.Similarity-based interference 2.Problem of limited attentional capacity relevant irrelevant relevant irrelevant e.g., Baddeley, 1986; Neath, 2000 e.g. Page & Norris, 2003 Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

10. Long-term memory The working-memory model of Cowan (1995) Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

11. Long-term memory The working-memory model of Cowan (1995) Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

12. Long-term memory Activated part of long-term memory The working-memory model of Cowan (1995) Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

13. Long-term memory Activated part of long-term memory The working-memory model of Cowan (1995) Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

14. Long-term memory Activated part of long-term memory The working-memory model of Cowan (1995) Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

15. Long-term memory Activated part of long-term memory Focus of attention The working-memory model of Cowan (1995) Focus of attention: Limited to four units (Cowan, 2001) Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

16. Long-term memory Activated part of long-term memory Focus of attention Central Executive The working-memory model of Cowan (1995) Focus of attention: Limited to four units (Cowan, 2001) Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

17. Long-term memory Activated part of long-term memory Focus of attention Central Executive voluntarily Focus of attention: Limited to four units (Cowan, 2001) Voluntary selection The working-memory model of Cowan (1995) Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

18. Long-term memory Activated part of long-term memory Focus of attention Central Executive voluntarily Focus of attention: Limited to four units (Cowan, 2001) Voluntary selection Automatic recruitment: The working-memory model of Cowan (1995) a)Change in physical properties (e.g. loud noise, sudden movement) b)Personal relevance (e.g. own name) automatically Short sensory store Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

19. automatically Central Executive voluntarily Focus of attention: Limited to four units (Cowan, 2001) Voluntary selection Automatic recruitment: The working-memory model of Cowan (1995) a)Change in physical properties (e.g. loud noise, sudden movement) b)Personal relevance (e.g. own name) Short sensory store Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

20. automatically Central Executive voluntarily Focus of attention: Limited to four units (Cowan, 2001) Voluntary selection Automatic recruitment: The working-memory model of Cowan (1995) a)Change in physical properties (e.g. loud noise, sudden movement) b)Personal relevance (e.g. own name) Short sensory store Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

21. Focus of attention: Limited to four units (Cowan, 2001) Voluntary selection Automatic recruitment: The working-memory model of Cowan (1995) a)Change in physical properties (e.g. loud noise, sudden movement) b)Personal relevance (e.g. own name) Central Executive Short sensory store Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

22. Predictions of the Cowan Model change in physical properties items in the focus loose their activation benefitleading to memory impairment for these items deviation of the focus Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

23. Relevant task: verbal or spatial serial recall Irrelevant stimuli (synchronized with the relevant stimuli): – Auditory: Tones – Visual: Color stripes beside the relevant frame Experiment 1: Auditory vs. Visual distractor 5 1 7 3 8 Tone distractorColor distractor Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

24. Results: Experiment 1 Irrelevant colors VerbalSpatial Irrelevant tones VerbalSpatial ♬ ? Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

25. Domain-specific effect of distraction? – Distraction effect in the verbal task with tone change – No distraction effect in the spatial task with color change Possible problems with the choice of the irrelevant visual stimuli: – Maybe similarity plays a role in the visuo-spatial domain (contingent capture: Folk, Remington, & Johnston, 1992)? – Irrelevant stimuli outside of the visual relevant region might be not distractive (Eriksen & Eriksen, 1974; Awh & Pashler, 2000) ? Summary Exp. 1 Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

26. Conditions: Repetition or location change Hypotheses:  Distraction effect spatial task  No distraction effect verbal task 7 Experiment 2: Distraction by irrelevant objects? Relevant task: verbal or spatial Irrelevant stimuli: visual-spatial –Object-like –High perceptual similarity to the relevant stimuli –Inside the relevant visual-spatial region –Change has a spatial dimension demo Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

27. Results: Experiment 2 Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

28. automatically Central Executive Short sensory memory voluntary Focus of attention Criterion for distraction: Change in physical properties?  Not any changes but a)specific changes b)domain-specific effects Distraction of verbal task by tone change Distraction of spatial task by object location change Cowan Model Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

29. Thresholds: Effected by Task Set Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam Time Strength of Discrepancy Signal Threshold A3 Threshold A2 t1 t2t3 Threshold A1

30. Modified Model Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam automatically Central Executive Short sensory memory voluntary Focus of attention

31. Modified Model Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam automatically Central Executive Short sensory memory voluntary Focus of attention

32. Modified Model Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam automatically Central Executive Short sensory memory voluntary Focus of attention Threshold

33. Modified Model Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam automatically Central Executive Short sensory memory voluntary Focus of attention Threshold Modulated by voluntary control

34. Experiment 3: Contingent Capture What is the role of similarity? Visual Search: Target has to be selected top-down, location-changing distractor captures attention bottom-up The more similar a distractor is, the more likely he is attended to Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

35. 4 9 2 7 0 3 Memory Task: Serial Recall

36. Verbal Task: Digit identity 8 items Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam 1 2 3 4 5 6 789 0 Spatial Task: Digit location 5 items

37. Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam 4 Memory Task with Distractors

38. Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam 9 Memory Task with Distractors

39. Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam Memory Task with Distractors

40. Distractors (Exp.3) 2 4 0 3 7 9 Repetition of distractor position Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam 2 4 0 3 7 9 Change of distractor position 36 trials 9 trials 5 K

41. Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam No feature overlap in color/shape Feature overlap in color/shape Different category (object) Same category (verbal) Same category (verbal- numeric) SalientNot salient 5 K Distractors (Exp.3)

42. Repetition versus Change Trials Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam K 5

43. Repetition versus Change (collapsed across tasks) Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam 5 K

44. Results Experiment 3 Distraction of verbal task by object location change, if object is verbal Effect of distractor similarity ➜ Top-down modulated attentional capture ➜ Contingent capture Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

45. Experiment 4 Target needs to be selected from non target items (visual search) Target needs to be encoded into and retrieved from memory ➜Can we dissociate effects due to attentional selection and memory processes? Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

46. Record of Eye Movements Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam EL 1000 from SR Research Sample Rate 1000 Hz

47. Why eye movements? Usually the gaze indicates where attention and information processing is located Information that is more difficult is fixated longer Information that captures attention captures the gaze  Eye movements as indicators for attentional capture and information processing Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

48. Monitoring Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam x y Time x y 1534487

49. Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam Categorization of eye movements Velocity x Velocity y Time / ms saccade Fixational eye movements Fixational eye movements

50. Eye Movements Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam Verbal

51. Example Trial: Verbal Task Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

52. Distractors No overlap of visual features (color/shape) Categorically different Salient 5 High feature overlap (color/shape) Categorically identical Highly similar distractor 2 4 0 3 7 9 Repetition of distractor position Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam 2 4 0 3 7 9 Change of distractor position 40 trials 8 trials

53. Timing of Item Cycle Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam 0 200 7 off 1000 delay 1200 end of cycle

54. Change Locked Positions Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam Change Change - 1 Change + 1 Control - 1 Control Control + 1 5 2 9 3 4 1 Repetition of distractor position 2 4 0 3 7 9 Change of distractor position

55. Memory & Attenion: verbal Distractor Rel. Item Control Change Distractor changes position Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

56. Memory & Attention: verbal Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam 5 Control Change DistractorRel. Item

57. Verbal Task Error Types Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam 1 2 3 4 5 6 789 0 1 2 3 4 5 6 789 0 5 8 correct items Digit 5 Alternative item ➜ Order errors ➜ Item error: distractor intrusion ➜ Item error: control intrusion

58. Verbal Task Error Proportions Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam 5 ControlChange Alternative Intrusion Intrusion of Digit 5 Order errors

59. Verbal Task: Proportion of Answers Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam 5

60. Summary Exp. 4 Change of distractor position affects saccade rate  attentional capture BUT: – Attentional capture does not necessarily affect memory performance (verbal task, triangle, change locked position) – Attentional capture can affect memory for events prior to capture (verbal task, digit 5, pre-change position) – Attentional capture can be controlled for relatively fast (verbal task, triangle, change+1 position) – Control for attentional capture varies for different distractors Dissociation of visual (overt) attention and memory processes Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

61. Summary A location-changing object captures the gaze (=attention) in both tasks But the distraction effect is top-down modulated and contingent on task properties If attention is directed to verbal properties  verbal distractors are effective If attention is directed to spatial properties  spatial information is distractive Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam

62. Thanks for your attention! Elke B. Lange - Christian Starzynski - Ralf Engbert University of Potsdam