Anticipations in the control of voluntary behavior Joachim Hoffmann Dept. of Cognition and Behavior University of Würzburg J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Action-induced anticipations are needed for stabilizing perception 1. Action-induced anticipations are needed for stabilizing perception J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Reafference principle von Holst und Mittelstaedt (1950) perception of exafference efference anticipated reafference _ efference-copy + muscles reafference & exafference „The efference copy and the reafference cancel each other.“ (p.145) J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Action-induced anticipations control the execution of voluntary acts 2. Action-induced anticipations control the execution of voluntary acts J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Anticipations serve as a reference signal (Adams, 1971) „Beginning the movement brings an anticipatory arousal of the [perceptual] trace, and the feedback from the ongoing movement is compared with it“ (Adams, 1971, p.123). initial motor commands feedforward perceptual trace motor commands perception muscles J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

anticipations of sensory effects Anticipations serve to substitute missing feedback after Desmurget & Crafton, 2000 anticipations of sensory effects error signal motor commands target location hand location proprioception muscles „During the realization of the movement, a forward model of the dynamics of the arm is generated. In its simplest version, this model receives as input a copy of the motor outflow. Based on this information, the end-point of the movement can be predicted and continously compared to the target location“. (p.426) J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Anticipations even precede voluntary acts for their selection 3. Anticipations even precede voluntary acts for their selection „For the ideo-motor mechanism, a fundamentally different state of affairs is proposed in which a current response is selected on the basis of its own anticipated sensory feedback“ (Greenwald, 1970, p.93). J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

J. F. Herbart (1825, p. 464, rough translation): "Right after the birth of a human being or an animal, certain movements in the joints develop, for merely organic reasons … each of these movements elicits a certain feeling ... In the same instance, the outside senses perceive what change has come about... If, at a later time, a desire for the change observed earlier arises, the feeling associated with the observation reproduces itself. This feeling … corresponds to all the inner and outer states in nerves and muscles through which the intended change in the sphere of sensual perception can be brought about. Hence, what has been desired actually happens; and the success is perceived. Through this, the association is reinforced: the action, once performed, makes the following one easier and so on". J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

2.Reinforcement of action-effect associations A simplified illustration of the formation of bidirectional action-effect associations (according to J.F. Herbart, 1825) 1.Latent formation of bidirectional action-effect associations sensory effects action action intended effects produced 2.Reinforcement of action-effect associations J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Elsner, B., & Hommel, B. (2001). Effect anticipation and action control. Journal of Experimental Psychology: Human Perception and Performance, 27, 229-240. Elsner, B., & Hommel, B. (2004). Contiguity and contingency in action-effect learning. Psychological Research. Hazeltine, E. (2002). The representational nature of sequence learning: evidence for goal-based codes. In W. Prinz & B. Hommel (Eds.), Common mechanisms in perception and action. Attention and Performance XIX: (pp. 673-689). Oxford: Oxford University Press. Hoffmann, J., Sebald, A., & Stoecker, C. (2001). Irrelevant response effects improve serial learning in serial reaction time tasks. Journal of Experimental Psychology: Learning, Memory, and Cognition, 27, 470-482. Hommel, B. (1993). Inverting the Simon effect by intention. Psychological Research, 55, 270-279. Hommel, B. (1996). The cognitive representation of action: Automatic integration of perceived action effects. Psychological Research, 59, 176-186. Hommel, B., Alonso, D., & Fuentes, L. J. (2003). Acquisition and generalization of action effects. Visual cognition, 10, 965-986. Kiesel, A., & Hoffmann, J. (2004). Variable action effects: Response control by context-specific effect anticipations. Psychological Research. Kunde, W. (2001). Response-effect compatibility in manual choice reaction tasks. Journal of Experimental Psychology: Human Perception and Performance, 27, 387-394. Kunde, W. (2003). Temporal response-effect compatibility. Psychological Research, 67, 153-159. Kunde, W., Hoffmann, J, & Zellmann, P. (2002). The impact of anticipated action effects on action planning. Acta Psychologica, 109, 137-155. Kunde, W., Koch, I., & Hoffmann, J. (2004). Anticipated action effects affect the selection, initiation and execution of actions. The Quarterly Journal of Experimental Psychology. Section A: Human Experimental Psychology. Nattkemper, D., & Ziessler, M. (2004). Cognitive control of action: The role of action effects. Psychological Research. Stoecker, C. & Hoffmann, J. (2004). The ideomotor principle and motor sequence acquisition: Tone effects facilitate movement chunking. Psychological Research. Stoecker, C. , Sebald, A., & Hoffmann, J. (2003). The influence of response-effect compatibility in a serial reaction time task. Quarterly Journal of Experimental Psychology, 56A, 685-703. Ziessler, M. (1998). Response-effect learning as a major component of implicit serial learning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 24, 962-978. Ziessler, M. & Nattkemper, D. (2001). Learning of event sequences is based on response-effect learning: Further evidence from serial reaction task. Journal of Experimental Psychology: Learning, Memory, and Cognition, 27, 595-613. Ziessler, M. & Nattkemper, D. (2002). Effect anticipation in action planning. In W. Prinz & B. Hommel (Eds.), Attention and Performance XIX: Common mechanisms in perception and action (pp. 645-673). Oxford: Oxford University Press. J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Wilfried Kunde J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Der Simon Effekt (Simon & Rudel, 1967) compatible incompatible Faster responses if the location of the imperative signal and the location of the response button are compatible l r l r l r l r J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

If there is a dimensional overlap between the stimulus set and the response set in terms of space, time or intensity, compatible S-R assignments are accomplished faster than incompatible assignments. dimensional overlap stimulus set effect set response set stimulus set response set effect set effect anticipations If selecting a response indeed requires the anticipation of its sensory effects, the same compatibility phenomena should appear between effects and responses as between stimuli and responses. dimensional overlap J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Response-Effect Compatibility regarding space Kunde, W. (2001) Response-Effect Compatibility regarding space Kunde, W. (2001). JEP: HPP, Experiment 1 490 ms 511 ms < compatible response-effect mapping non-compatible response-effect mapping 1 4 1 4 2 3 2 3 J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Response-Effect compatibility regarding duration Kunde W. (2003). Psych.Res., Experiment 1 < 376 ms 392 ms compatible response-effect mapping non-compatible response-effect mapping     short keypress (dit) short tone long tone     long keypress (dah) long tone short tone J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Response-Effect compatibility regarding intensity Kunde, W. (2001) Response-Effect compatibility regarding intensity Kunde, W. (2001). JEP:HPP, Exp. 2 349 ms 399 ms < compatible response-effect mapping non-compatible response-effect mapping   Soft keypress quiet tone loud tone   Strong keypress loud tone quiet tone J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Thus, the response-effect compatibility phenomenon is a very robust one. It occurs in the dimensions of space, time, and intensity. As in all these experiments the effects always were presented after the execution of the response, their impact on response latencies (and errors) proves that representations of the effects have to be activated before the responses are finally selected. J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

ABC: Anticipatory Behavioral Control Hoffmann (1993) „Vorhersage und Erkenntnis“ strengthening of reinforced action-effect associations The formation of stimulus-action associations initial conditions intended effect real effect action J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

4. Voluntary acts are also preceded by anticipations of the situation they usually or necessarily have to start from. J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

N. Ach (1913) According to Ach, a voluntary act has an objective moment (gegenständliche Moment) which relates an image of what one strives for (Zielvorstellung) to an image of the situation to which the intention refers (Bezugsvorstellung). J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Wilfried Kunde Andrea Kiesel J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Adaptation of response specific stimulus anticipations Kunde, Kiesel, & Hoffmann (2003). Cognition incongruent trials congruent trials J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Kunde, Kiesel, & Hoffmann (2003). Cognition Experiment 1 congruent incongruent Primes Targets 1 2 3 4 6 7 8 9 J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Kunde, Kiesel, & Hoffmann (2003). Cognition Experiment 3 congruent incongruent Primes Targets 1 2 3 4 6 7 8 9 J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Kunde, Kiesel, & Hoffmann (2003). Cognition Experiment 1 Experiment 3 congruent incongruent congruent incongruent J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006

Kunde, Kiesel, & Hoffmann (2003). Cognition Experiment 1 Experiment 3 Primes Targets 1 2 3 4 6 7 8 9 Primes Targets 1 2 3 4 6 7 8 9 2 3 7 8 J. Hoffmann: ABC Anticipatory Behavioral Control Mind Races Meeting April 2006