1. When Uncertainty Matters: The Selection of Rapid Goal-Directed Movements Julia Trommershäuser, Laurence T. Maloney, Michael S. Landy Department of Psychology and Center for Neural Science NYU

2. Motor responses have consequences Kassi Price, 2001 US Nationals

3. What? Where? How? target identification, target localization, regions to be avoided selection of trajectory, biomechanical constraints, speed, accuracy Why? motivation, movement goal, target selection Movement planning

4. I.A Maximum Expected Gain Model of Movement under Risk (MEGaMove) II. Experimental test of the model III. Conclusion Outline

5. Experimental task

6.  Start of trial: display of fixation cross (1.5 s) Experimental task

7.  Display of response area, 500 ms before target onset (114.2 mm x 80.6 mm) Experimental task

8.  Target display (700 ms) Experimental task

9. 

10. The green target is hit: +100 points 100  Experimental task

11. 

12. -500  Experimental task The red target is hit: -500 points -500

13.  Experimental task

14. -500 100  Experimental task -500100 Scores add if both targets are hit:

15.  Experimental task

16. You are too slow: -700 The screen is hit later than 700 ms after target display: -700 points. Experimental task

17. Current score: 500 End of trial Experimental task

18. Rapidly touch a point with your fingertip. What should you do? 100-500 00 0 0 00 Responding after the time limit: -700 points 18 mm Experimental task

19. Thought experiment : -500 : 100 points (2.5 ¢) x (mm) y (mm) 100 points  = 4.83 mm

20. Thought experiment x (mm) y (mm) 100 points 200 points  = 4.83 mm : -500 : 100 points (2.5 ¢)

21. Thought experiment x (mm) y (mm) 100 points 300 points 100 points  = 4.83 mm : -500 : 100 points (2.5 ¢)

22. Thought experiment x (mm) y (mm) 100 points -100 points 100 points -400 points  = 4.83 mm : -500 : 100 points (2.5 ¢)

23. Thought experiment x (mm) y (mm) 100 points -32 points 100 points -400 points..  = 4.83 mm : -500 : 100 points (2.5 ¢)

24. Thought experiment x (mm) y (mm) -32 points 3070 points  = 4.83 mm : -500 : 100 points (2.5 ¢)

25. Thought experiment x (mm) y (mm) -32 points 3070 points 2546 points  = 4.83 mm : -500 : 100 points (2.5 ¢)

26. Thought experiment x (mm) y (mm) -32 points 3070 points 2257 points  = 4.83 mm 2546 points : -500 : 100 points (2.5 ¢)

27. Expected gain as function of mean movement end point (x,y): 90 0 60 <-60 -30 30 points per trial x (mm) y (mm)  = 4.83 mm -10-505101520 -10 -5 -0 5 10 target: 100 penalty: -500

28. x [mm] y [mm] 90 0 60 <-60 -30 30 points per trial xyyyxx penalty: 0penalty: 500penalty: 100 x, y: mean movement end point [mm] Thought experiment  = 4.83 mm

29.  100 A M aximum E xpected Ga in Model of Move ment Planning Key assumption: The mover chooses the motor strategy that maximizes the expected gain . -500 Consequence: The choice of motor strategy depends on the reward structure of the environment the mover's own motor variability. Maloney, Trommershäuser, Landy, Poster, VSS 2003, SA46 Trommershäuser, Maloney, Landy (2003) JOSA A, in press.

30. Distribution of movement end points x hit -x mean (mm) y hit -y mean (mm) Subject S4,  = 3.62 mm, 72x15 = 1080 end points cond 1cond 2cond 3cond 4 cond 5cond 6cond 7cond 8 cond 9cond 10cond 11cond 12 010-10010-10010-10010-10 010-10010-10010-10

31. Movement endpoints in response to changes in penalty distance and penalty value Test of the Model: First Results 3 penalty conditions: 0, -100, -500 points (varied between blocks) 6 stimulus configurations: (varied within block) R1.5R2R R = 9 mm Maloney, Trommershäuser, Landy, Poster, VSS 2003, SA46 Trommershäuser, Maloney, Landy (2003) JOSA A, in press.

32. As predicted by the model: Subjects shifted their mean movement endpoint farther from the center of the green target for higher penalty values, for closer penalty regions. More variable subjects won less money. Subjects’ performance did not differ significantly from optimal. Test of the Model: First Results Maloney, Trommershäuser, Landy, Poster, VSS 2003, SA46 Trommershäuser, Maloney, Landy (2003) JOSA A, in press.

33. Movement endpoints in response to novel stimulus configurations. 5 “practiced movers” 1 session: 12 warm-up trials, 6x2x16 trials per session, 24 data points per condition 4 stimulus configurations: (varied within block) 2 penalty conditions: 0 and -500 points (varied between blocks) Test of the model: Experiment 1 1234 R = 9 mm

34. Results: Experiment 1 x (mm) Subject S5,  = 2.99 mm Model prediction: y (mm) model, penalty = 0

35. x (mm) Subject S5,  = 2.99 mm Model prediction: configuration 1 y (mm) model, penalty = 500 x model, penalty = 0 Results: Experiment 1

36. x (mm) Subject S5,  = 2.99 mm Model prediction: configuration 2 y (mm) model, penalty = 500 x model, penalty = 0 Results: Experiment 1

37. x (mm) Subject S5,  = 2.99 mm Model prediction: configuration 3 y (mm) model, penalty = 500 x model, penalty = 0 Results: Experiment 1

38. x (mm) Subject S5,  = 2.99 mm Model prediction: configuration 4 y (mm) model, penalty = 500 x model, penalty = 0 Results: Experiment 1

39. x (mm) Subject S5,  = 2.99 mm y (mm) exp., penalty = 500 model, penalty = 500 x exp., penalty = 0 Comparison with experiment Results: Experiment 1

40. x (mm) y (mm) S1S2S3 S4S5 exp., penalty = 500 model, penalty = 500 x exp., penalty = 0 x (mm) Results: Experiment 1

41. Movement endpoints in response to more complex stimulus configurations. 5 “practiced movers” 1 session: 12 warm-up trials, 6x2x16 trials per session, 24 data points per condition 4 “more complex” configurations: (varied within block) 2 penalty conditions: 0 and -500 points (varied between blocks) Test of the model: Experiment 2 1234 R = 9 mm

42. x (mm) Subject S5,  = 2.99 mm Model prediction: configuration 1 y (mm) model, penalty = 500 x model, penalty = 0 Results: Experiment 2

43. x (mm) Subject S5,  = 2.99 mm Model prediction: configuration 2 y (mm) model, penalty = 500 x model, penalty = 0 Results: Experiment 2

44. x (mm) Subject S5,  = 2.99 mm Model prediction: configuration 3 y (mm) model, penalty = 500 x model, penalty = 0 Results: Experiment 2

45. x (mm) Subject S5,  = 2.99 mm Model prediction: configuration 4 y (mm) model, penalty = 500 x model, penalty = 0 Results: Experiment 2

46. x (mm) Subject S5,  = 2.99 mm y (mm) exp., penalty = 500 model, penalty = 500 x exp., penalty = 0 Comparison with experiment Results: Experiment 2

47. x (mm) y (mm) S1S2S3 S4S5 exp., penalty = 500 model, penalty = 500 x exp., penalty = 0 x (mm) Results: Experiment 2

48. Conclusion Subjects shift their mean movement endpoints in response to changes in penalties and location of the penalty region as predicted by our model. In our model, subjects are ideal movement planners who choose movement strategies to maximize expected gain. Movement planning takes extrinsic costs and the subject’s own motor uncertainty into account. Thank you!

49. Configuration 1Configuration 7 Configuration: Results: Experiment 1 and 2

50. Configuration 1Configuration 7 Configuration: Results: Experiment 1 and 2

51. Q-Q Plot Observed Value Expected Normal Value x hit -x mean (mm) y hit -y mean (mm) x hit -x mean (mm) y hit -y mean (mm) - 20 -10 01020 -20 -10 0 10 20 -20 -10 0 10 20 Subject S4,  = 3.62 mm, 72x15 = 1080 end points Distribution of movement end points 20 10 0 - 10 - 20

52. Distribution of movement end points x hit -x mean (mm) y hit -y mean (mm) Subject S4,  = 3.62 mm, 72x15 = 1080 end points 0, pos 1200, pos 1400, pos 1800, pos 1 0, pos 2200, pos 2400, pos 2800, pos 2 0, pos 3200, pos 3400, pos 3800, pos 3 010-10010-10010-10010-10 010-10010-10010-10

53. Experiment 1: Results

55. Subject  score performance S33.33 mm$15.8097.57% S53.38 mm$15.4099.92% S13.46 mm$15.7398.60% S44.43 mm$14.58107.67% S24.86 mm$13.08104.92% Experiment 1: Results