1. Aversive Conditioning

2. ReinforcementPunishment Positive contingency Negative contingency Chocolate BarElectric Shock Excused from Chores No TV privileges – omission training Effect on Behavior (passive avoidance) (active avoidance)

4. Some potential problems with punishment Moral issues Side effects Only shows subject what NOT to do. Timing of punishment

5. Punishment on a VR schedule Cumulative record of pecking in birds Pecking reinforced on a VI 3-min schedule Pecking punished on a FR schedule

6. When there is a discriminative stimulus for punishment Student #1 Student #2 S reward OnlyS reward & S punishment

7. Negative reinforcement – Active Avoidance

8. Negative Reinforcement - Escape

9. Avoidance: Experimental Paradigm The shuttle box Light = CS Light  Shock Shuttling stops shock

10. Two-Process Theory of Avoidance Light  Shock ( = Pavlovian Conditioning) -Light elicits fear Shuttling  Reduction of Fear (= negative reinforcement)

11. Is the termination of a shock- associated CS reinforcing? Pavlovian Conditioning Tone  Shock Phase 1Phase2 Escape (no shocks) Shuttling turns off Tone

12. Fear in Active Avoidance Phase 1Phase 2 Active avoidance training Does avoidance CS suppress lever pressing? Fear of the CS declines with extensive avoidance training

13. Two-Process Theory of Avoidance Light  Shock ( = Pavlovian Conditioning) -Light elicits fear Shuttling  Reduction of Fear (= negative reinforcement) What should happen with extensive training?

14. Learned Helplessness Paradigm “Triadic” Design Group A: Escapable Shock Group B: Yoked Inescapable Shock Group C: Exposure to apparatus only Phase 1Phase 2 Escape/Avoidance training (For Group A shock can be terminated by rotating a wheel.)

15. Phase 2 Results Inescapable shock escapable shock

16. Possible Explanations Learned Helplessness: Organisms learn that their behavior is ineffectual Poverty of activity: inescapable shock reduces the variability in behavior that is so crucial for operant conditioning Inattention: animals stop attending to their own behavior

17. Effects of Marking Inescapable shock escapable shock Marking group

18. Learned Helplessness in the Spinal Cord? Grau and Colleagues Operant Procedure: Shock administered whenever leg is extended. Spinal cord learns to keep leg flexed to avoid shock. Learned Helplessness: Experience of uncontrollable legshock (yoked group) prevents subsequent avoidance learning with controllable shock

19. LH in Humans LH produced by… insoluble math or logic problems living in a crowded dorm