1. A neural mechanism of response bias Johan Lauwereyns Laboratory of Sensorimotor Research National Eye Institute, NIH

2. Yoriko TakikawaJuntendo Univ. Reiko KawagoeJuntendo Univ. Masashi KoizumiTamagawa Univ. Shunsuke KobayashiTamagawa Univ. Masamichi SakagamiTamagawa Univ. Brian CoeATR Hiro NakaharaRIKEN Katsumi WatanabeNIH Okihide HikosakaNIH

3. Goal-oriented behavior: Seeking salt (Curt Richter)

4. A Neural Mechanism of Reward-oriented Response Bias in the Basal Ganglia How does the brain incorporate reward value in the process of response selection?

5. A Neural Mechanism of Reward-oriented Response Bias in the Basal Ganglia How does the brain incorporate reward value in the process of response selection? Anticipatory bias toward reward in the activity of monkey caudate neurons

6. A Neural Mechanism of Reward-oriented Response Bias in the Basal Ganglia How does the brain incorporate reward value in the process of response selection? Anticipatory bias toward reward in the activity of monkey caudate neurons Studied using visually and memory-guided saccade tasks with asymmetrical reward schedule

7. Biased Saccade Task (BST)

11. Saccade-related brain areas (macaque monkey) FEF: frontal eye field SEF: supplementary eye field LIP: area LIP of parietal cortex CD: caudate nucleus SNr: substantia nigra pars reticulata SC: superior colliculus Clbm: cerebellum SG: brainstem saccade generators

12. DA neuron responds to Reward & Reward Predictor

13. Inputs to Striatal Medium Spiny Neuron Smith & Bolam (1990)

14. Medium Spiny Neuron in Striatum Preston, Bishop & Kitai (1980)

15. Single unit recording from Caudate Nucleus

16. L-CD neuron: R-reward Reward

17. L-CD neuron: RL-reward Reward

18. L-CD neuron: RLR-reward Reward

19. L-CD neuron: All Reward

20. Population activity of CD neurons (with contra-bias, n=25)

21. Motivational control of Eye Movements by the Basal Ganglia How does the selective anticipatory activity in caudate relate to saccade parameters?

22. Motivational control of Eye Movements by the Basal Ganglia How does the selective anticipatory activity in caudate relate to saccade parameters? Basic association between neuronal activity and response latency

24. Motivational control of Eye Movements by the Basal Ganglia How does the selective anticipatory activity in caudate relate to saccade parameters? Basic association between neuronal activity and response latency. But what’s the relationship for a given combination of saccade and reward direction?

26. Median-split analysis Divide the data in two groups of trials for each combination of saccade and reward direction

27. Median-split analysis Divide the data in two groups of trials for each combination of saccade and reward direction High-activity trials, with pretarget activity above the median for that condition Low-activity trials, with pretarget activity below the median for that condition

29. Discussion The data for contra-bias neurons provide evidence in favor of the hypothesis of selective preparation

30. Discussion The data for contra-bias neurons provide evidence in favor of the hypothesis of selective preparation High pretarget activity leads to short latency for saccades in the contralateral direction

31. Discussion The data for contra-bias neurons provide evidence in favor of the hypothesis of selective preparation High pretarget activity leads to short latency for saccades in the contralateral direction What about the data for ipsi-bias neurons?

34. Discussion (continued) The data for ipsi-bias neurons are a mirror-image of the data for contra-bias neurons

35. Discussion (continued) The data for ipsi-bias neurons are a mirror-image of the data for contra-bias neurons High pretarget activity of ipsi-bias neurons leads to long latency for unrewarded saccades in the contralateral direction

36. Discussion (continued) The data for ipsi-bias neurons are a mirror-image of the data for contra-bias neurons High pretarget activity of ipsi-bias neurons leads to long latency for unrewarded saccades in the contralateral direction Activity of these neurons disrupts contralateral saccades (“negative motivation”)

37. Summary The entire pattern of data suggests that the caudate anticipatory bias influences contralateral saccade latency

38. Summary The entire pattern of data suggests that the caudate anticipatory bias influences contralateral saccade latency Contra-bias neurons facilitate contralateral saccades, Ipsi-bias neurons disrupt contralateral saccades

39. Summary The entire pattern of data suggests that the caudate anticipatory bias influences contralateral saccade latency Contra-bias neurons facilitate contralateral saccades, Ipsi-bias neurons disrupt contralateral saccades These two type of neurons may reflect the physiology of the direct and indirect pathway in the basal ganglia

40. Neural Circuit of the Basal Ganglia

41. CD SNr SC CD SNr SC Direct pathway: Contra-bias neurons

42. CD SNr SC CD SNr SC GPe STN GPe STN Indirect pathway: Ipsi-bias neurons

43. Experiment 2 The data so far show an effect of selective response preparation on the basis of reward value

44. Experiment 2 The data so far show an effect of selective response preparation on the basis of reward value But could this merely reflect a more general type of spatially selective response preparation?

45. Experiment 2 The data so far show an effect of selective response preparation on the basis of reward value But could this merely reflect a more general type of spatially selective response preparation? Test with a “cognitive bias task”…

46. Cognitive Bias Task (delayed position matching)

47. CD activity in Cognitive & Motivational Tasks Cognitive Bias Motivational Bias

48. Cognitive Bias Most CD neurons show higher Motivational Bias than Cognitive Bias

49. Experiment 3 We’ve provided evidence for an effect of spatially selective reward-oriented response preparation

50. Experiment 3 We’ve provided evidence for an effect of spatially selective reward-oriented response preparation But is the reward-oriented bias really related to motor preparation or is it involved in more abstract or perceptual decision making?

51. Experiment 3 We’ve provided evidence for an effect of spatially selective reward-oriented response preparation But is the reward-oriented bias really related to motor preparation or is it involved in more abstract or perceptual decision making? Test with a memory-guided eye movement task with color-based reward association…

56. Discussion (Exp. 3) Color-reward associations do lead to significant effects in both behavior and caudate activity

57. Discussion (Exp. 3) Color-reward associations do lead to significant effects in both behavior and caudate activity The anticipatory activity is aimed at the visual onset, not the start of the eye movement

58. Discussion (Exp. 3) Color-reward associations do lead to significant effects in both behavior and caudate activity The anticipatory activity is aimed at the visual onset, not the start of the eye movement If this is indeed a ‘perceptual’ process, then how does the bias affect the neuronal activity to the visual target?

64. Discussion (Exp. 3; continued) Strong pre-cue activity leads to general increase, not improved discriminability

65. Discussion (Exp. 3; continued) Strong pre-cue activity leads to general increase, not improved discriminability Different from cortical mechanisms of visual attention: here additive, not multiplicative scaling

66. Discussion (Exp. 3; continued) Strong pre-cue activity leads to general increase, not improved discriminability Different from cortical mechanisms of visual attention: here additive, not multiplicative scaling Analogous to a shift of decision criterion?

67. Conclusion Anticipatory activity in caudate nucleus is influenced by the context of stimulus-reward mapping

68. Conclusion Anticipatory activity in caudate nucleus is influenced by the context of stimulus-reward mapping This activity can create a spatially selective bias that prioritizes an action with high reward value

69. Conclusion Anticipatory activity in caudate nucleus is influenced by the context of stimulus-reward mapping This activity can create a spatially selective bias that prioritizes an action with high reward value The bias also affects visual processing; Does this bias incorporate reward value in the process of perceptual decision making?

70. Future directions Motivational control of visual processing in humans:

71. Future directions Motivational control of visual processing in humans: –Response bias, decision bias, perceptual sensitivity

72. Future directions Motivational control of visual processing in humans: –Response bias, decision bias, perceptual sensitivity –Systematic comparison with ‘visual attention’

73. Future directions Motivational control of visual processing in humans: –Response bias, decision bias, perceptual sensitivity –Systematic comparison with ‘visual attention’ –Modeling (LATER, ROC)

74. Future directions Motivational control of visual processing in humans: –Response bias, decision bias, perceptual sensitivity –Systematic comparison with ‘visual attention’ –Modeling (LATER, ROC) –Parkinsonian patients

75. Future directions Motivational control of visual processing in humans: –Response bias, decision bias, perceptual sensitivity –Systematic comparison with ‘visual attention’ –Modeling (LATER, ROC) –Parkinsonian patients –Feedback to monkey studies (design, analysis, modeling)

76. Future directions Motivational control of visual processing in humans: –Response bias, decision bias, perceptual sensitivity –Systematic comparison with ‘visual attention’ –Modeling (LATER, ROC) –Parkinsonian patients –Feedback to monkey studies (design, analysis, modeling) Pharmacological study of motivational control:

77. Future directions Motivational control of visual processing in humans: –Response bias, decision bias, perceptual sensitivity –Systematic comparison with ‘visual attention’ –Modeling (LATER, ROC) –Parkinsonian patients –Feedback to monkey studies (design, analysis, modeling) Pharmacological study of motivational control: –Create a rat model of the Biased Response Task

78. Future directions Motivational control of visual processing in humans: –Response bias, decision bias, perceptual sensitivity –Systematic comparison with ‘visual attention’ –Modeling (LATER, ROC) –Parkinsonian patients –Feedback to monkey studies (design, analysis, modeling) Pharmacological study of motivational control: –Create a rat model of the Biased Response Task –Study the neurochemical make-up of this system