1. Operant Conditioning Thomas G. Bowers, Ph.D. Penn State Harrisburg

2. Operant Conditioning n Thought to operate upon the environment n So-called “voluntary behavior” n Thorndike aimed to explain goal directed behavior –Developed Law of Effect

3. Law of Effect n Behavior is sensitive to its consequences n Positive reinforcement - Pleasurable consequences stamp in the behavior n Punishment - Unpleasant events stamp out the behavior

4. Behavior-consequence Relationship n Positive reinforcement acts to increase the probability of behavior n Punishment acts to decrease the probability of behavior

5. Behavior-consequence Relationship n Negative reinforcement (or escape) acts to increase behavior which eliminates or removes the negative stimulus n Omission removal of a positive stimulus decreases behavior

6. Response-consequence Relationships Response Stimulus

7. Conditioning and Extinction n Responses are developed by a shaping process of successive approximations n Extinction refers to the cessation of reinforcement

8. Behavioral Units Time Response/Min Acquisition Extinction

9. Contingency Learning P(Sr/No Res) P(Sr/R) 1.0.0 1.0

10. Operant Contingency Space n Reinforcement has a contingent effect, increasing behavior, while punishment or even non-reinforcement will decrease behavior n When reinforcement and responses are independent, or noncontingent, then learned helplessness results

11. Operant Contingency Space n Learned helplessness resembles depression n Seligman developed the paradigm n Leads to a global failure to initiate behavior n Associated with depletion of monoamine neurotransmitters

12. Operant Conditioning n What is learned? n R - S relationship? n How can something temporally remote (i.e. following) cause an event? n Some theorists emphasize S - R relationships

13. Avoidance Behavior n Much of our day to day behavior may serve to avoid negative or aversive stimuli or consequences n Signaled avoidance trials –Early training does not avoidance, but escapes the stimulus –Latency tends to decrease

14. Avoidance Behavior n Shock postponement procedure –Also called free-operant avoidance –Sidman avoidance n Most animals manage to learn this well, with few actual shocks experienced

15. Theories of Avoidance n Does the animal “know”?

16. Theories of Avoidance n Two factor theory - Mowrer –Initial learning by reinforcement of escape behavior –Classical conditioning also occurring, and CS acquires fear eliciting properties –Response here is reinforced by fear (CS) removal –Avoidance behavior results

17. Theories of Avoidance n Tests to inhibitory procedures appear to confirm predictions n Some problems, though –animals will respond reliably even if only a reduction of shock frequency is the contingency –there is little evidence of conditioned fear in well-trained animals

18. Theories of Avoidance n Some problems, though –avoidance of extinction –avoidance can be extinguished, but by response blocking

19. Cognitive Theories n Expectancy theory –Organism prefers no shock to shock –Organism expects if it responds, no shock will occur –Organism expects if it does not respond, shock will occur –Expectancies are strengthened when confirmed, weakened when disconfirmed

20. Cognitive Theories n Expectancy theory –Probability of avoidance increases as the degree of confirmation increases

21. Biological Theories n Bolles emphasized the adaptive significance to persistent avoidance learning n Described a repertoire of defensive reactions n Species-specific defensive reactions (SSDR)

22. Biological Theories n Hierarchical organization n Some patterns of responses are much easier to acquire than others

23. Conditioned Reinforcement n Neutral stimuli can also become a conditioned reinforcer n Predictiveness, informativeness is important to becoming a secondary reinforcer n Animals will respond for the opportunity to gain informative stimulus conditions

24. Applications of Secondary Reinforcement n Token economies –Common in our environment –Generalized secondary reinforcers –Functions n Provide feedback n Provide information about what to do next n Serve to bridge long gaps in reinforcement –Economies now build in inflation