2. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning – Describe operant conditioning, and explain how operant behavior is reinforced and shaped.
Operant Conditioning
A type of learning in which the frequency of a behavior depends on the consequence that follows the behavior; deals with voluntary behaviors
Frequency increases if the consequence is reinforcing
Frequency decreases if the consequence is not reinforcing

3. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning – Describe operant conditioning, and explain how operant behavior is reinforced and shaped.
The Law of Effect (Edward Thorndike)
Behaviors with favorable consequences will occur more frequently; behaviors with unfavorable consequences will occur less frequently
Hungry cats in puzzle boxes?
Provides the basis for learning voluntary behaviors

4. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning – Describe operant conditioning, and explain how operant behavior is reinforced and shaped.
The cat is placed in the box with the food reward outside
Although learning is NOT immediate, the hungry cat eventually learns that pressing the lever will result in getting out of the box and being able to reach the food
Escape – GOOD!
Food – EVEN BETTER!

5. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning – Describe operant conditioning, and explain how operant behavior is reinforced and shaped.
B.F. Skinner ( )
The “Behaviorist’s Behaviorist”
Developed the fundamental principles &
techniques of operant conditioning
Voluntary behavior is what people &
animals do to operate in the world
Coined the term “operant”

6. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning – Describe operant conditioning, and explain how operant behavior is reinforced and shaped.
Designed the Skinner Box, or operant chamber to study operant conditioning
Has a lever/key that an animal manipulates in order to obtain a reinforcer like food or water
The lever/key is connected to devices that record the animal’s response

7. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.2 – Discuss the difference between positive and negative reinforcement, and identify the basic types of reinforcers.
Reinforcement
Any event or stimulus that, when following a response, increases the probability that the response will occur again
Primary Reinforcer
Naturally reinforces by meeting a basic biological need
Hunger, thirst, touch, etc.
Secondary Reinforcer
Becomes reinforcing when paired with a primary reinforcer (in the past) or when we have learned to value it
Praise, gold stars, tokens, etc.

8. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.2 – Discuss the difference between positive and negative reinforcement, and identify the basic types of reinforcers.
Positive Reinforcement
The reinforcement of a response by the addition or experiencing of a pleasurable stimulus
The subject receives something they want/desire
Called an APPETITIVE STIMULUS
Increases the likelihood of the behavior; strengthens the behavior

9. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.2 – Discuss the difference between positive and negative reinforcement, and identify the basic types of reinforcers.
Negative Reinforcement
The reinforcement of a response by the removal, escape from, or avoidance of an unpleasant stimulus
Something the subject doesn’t like is removed
Called an AVERSIVE STIMULUS
Increases the likelihood of the behavior; strengthens the behavior

10. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior.
Schedules of Reinforcement
The timing of reinforcement can make a HUGE difference in the speed at which learning occurs and the strength of the learned response…
Skinner found that reinforcing each & every response was not necessarily the best schedule of reinforcement for long-lasting learning…

11. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior.
Continuous Reinforcement
The reinforcement of each & every correct response
Behavior is…
Established very quickly
Very likely to be extinguished once reinforcement stops
Examples
Vending machines
Dog training

12. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior.
Partial Reinforcement
The reinforcement of some, but not all, correct responses
Behavior is…
Established more gradually
Very resistant to extinction
Example
Lottery Tickets
Patterns of Partial Reinforcement
Fixed-interval & variable-interval
Fixed-ratio & variable-ratio

13. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior.
Fixed-Interval Schedule
A schedule of reinforcement in which the interval of time that must pass before reinforcement becomes possible is always the same
Examples
Monthly paycheck
Studying hardest just before the test (assuming that you know when the test is going to be given)
“Pre-dentist” teeth cleaning extravaganza

14. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior.
Variable-Interval Schedule
A schedule of reinforcement in which the interval of time that must pass before reinforcement becomes possible is different for each trial or event
Examples
Fishing
Pop quizzes
Calling a radio station

15. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior.
Fixed-Ratio Schedule
A schedule of reinforcement in which the number of responses required for reinforcement is always the same
Examples
Planet Smoothie Punch Cards
A salesperson receives a bonus for every 10th gym membership sold

16. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior.
Variable-Ratio Schedule
A schedule of reinforcement in which the number of responses required for reinforcement is different for each trial or event
Examples
Slot machines
Lottery tickets

17. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior.

18. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior.

19. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.4 – Discuss how punishment and negative reinforcement differ, and explain how punishment behavior.
Punishment
Any event or object that, when following a response, makes that response less likely to happen again
The OPPOSITE of reinforcement
Decreases the likelihood of the behavior; weakens the behavior

20. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.4 – Discuss how punishment and negative reinforcement differ, and explain how punishment behavior.
Punishment by Removal
The punishment of a response by the removal of a pleasurable stimulus
Also known as negative punishment or omission training
Examples
“Grounding,” time-out, fining, etc.

21. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.4 – Discuss how punishment and negative reinforcement differ, and explain how punishment behavior.
Problems with punishment
Severe punishment…
May cause the child to avoid the punisher instead of the
behavior being punished
May encourage lying
Creates fear, anxiety, low self-esteem and emotional responses that do not promote learning
Can lead to increased aggression
Can lead to abuse

22. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.4 – Discuss how punishment and negative reinforcement differ, and explain how punishment behavior.
To make punishment more effective…
Punishment should immediately follow the behavior it is meant to punish
Punishment should be consistent
Follow through with promises of punishment
Same intensity or slight increase, but never decrease
Punishment of the wrong behavior should be paired, whenever possible, with reinforcement of the right behavior

23. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.4 – Discuss how punishment and negative reinforcement differ, and explain how punishment behavior.
Appetitive Aversive
Positive Reinforcement
Presenting an appetitive stimulus
Behavior increases
Example: Every time Jimmy gets an A on his report card, his parents give him $20.
Positive Punishment
Presenting an aversive stimulus
Behavior decreases
Example: Every time Jimmy talks in class, he gets a detention.
Negative Punishment (Omission)
Removing an appetitive stimulus
Behavior decreases
Example: Every time Jimmy stays out past his curfew, his parents take away his car.
Negative Reinforcement
Removing an aversive stimulus
Behavior increases
Example: Every time Jimmy has a headache, he takes an aspirin.

24. Module 27 – Operant Conditioning 27
Module 27 – Operant Conditioning 27.4 – Discuss how punishment and negative reinforcement differ, and explain how punishment behavior.
Positive – the addition of a stimulus.
Negative – the removal of a stimulus.
Appetitive – a desirable/liked stimulus
Aversive – an undesirable/disliked stimulus
Increases in behavior – the exhibited behavior continues.
Decrease in behavior – the exhibited behavior declines.