Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.1 – Describe operant conditioning, and explain how operant behavior is reinforced and shaped. Operant Conditioning A type of learning in which the frequency of a behavior depends on the consequence that follows the behavior; deals with voluntary behaviors Frequency increases if the consequence is reinforcing Frequency decreases if the consequence is not reinforcing

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.1 – Describe operant conditioning, and explain how operant behavior is reinforced and shaped. The Law of Effect (Edward Thorndike) Behaviors with favorable consequences will occur more frequently; behaviors with unfavorable consequences will occur less frequently Hungry cats in puzzle boxes? Provides the basis for learning voluntary behaviors

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.1 – Describe operant conditioning, and explain how operant behavior is reinforced and shaped. The cat is placed in the box with the food reward outside Although learning is NOT immediate, the hungry cat eventually learns that pressing the lever will result in getting out of the box and being able to reach the food Escape – GOOD! Food – EVEN BETTER!

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.1 – Describe operant conditioning, and explain how operant behavior is reinforced and shaped. B.F. Skinner (1904-1990) The “Behaviorist’s Behaviorist” Developed the fundamental principles & techniques of operant conditioning Voluntary behavior is what people & animals do to operate in the world Coined the term “operant”

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.1 – Describe operant conditioning, and explain how operant behavior is reinforced and shaped. Designed the Skinner Box, or operant chamber to study operant conditioning Has a lever/key that an animal manipulates in order to obtain a reinforcer like food or water The lever/key is connected to devices that record the animal’s response

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.2 – Discuss the difference between positive and negative reinforcement, and identify the basic types of reinforcers. Reinforcement Any event or stimulus that, when following a response, increases the probability that the response will occur again Primary Reinforcer Naturally reinforces by meeting a basic biological need Hunger, thirst, touch, etc. Secondary Reinforcer Becomes reinforcing when paired with a primary reinforcer (in the past) or when we have learned to value it Praise, gold stars, tokens, etc.

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.2 – Discuss the difference between positive and negative reinforcement, and identify the basic types of reinforcers. Positive Reinforcement The reinforcement of a response by the addition or experiencing of a pleasurable stimulus The subject receives something they want/desire Called an APPETITIVE STIMULUS Increases the likelihood of the behavior; strengthens the behavior

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.2 – Discuss the difference between positive and negative reinforcement, and identify the basic types of reinforcers. Negative Reinforcement The reinforcement of a response by the removal, escape from, or avoidance of an unpleasant stimulus Something the subject doesn’t like is removed Called an AVERSIVE STIMULUS Increases the likelihood of the behavior; strengthens the behavior

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior. Schedules of Reinforcement The timing of reinforcement can make a HUGE difference in the speed at which learning occurs and the strength of the learned response… Skinner found that reinforcing each & every response was not necessarily the best schedule of reinforcement for long-lasting learning…

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior. Continuous Reinforcement The reinforcement of each & every correct response Behavior is… Established very quickly Very likely to be extinguished once reinforcement stops Examples Vending machines Dog training

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior. Partial Reinforcement The reinforcement of some, but not all, correct responses Behavior is… Established more gradually Very resistant to extinction Example Lottery Tickets Patterns of Partial Reinforcement Fixed-interval & variable-interval Fixed-ratio & variable-ratio

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior. Fixed-Interval Schedule A schedule of reinforcement in which the interval of time that must pass before reinforcement becomes possible is always the same Examples Monthly paycheck Studying hardest just before the test (assuming that you know when the test is going to be given) “Pre-dentist” teeth cleaning extravaganza

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior. Variable-Interval Schedule A schedule of reinforcement in which the interval of time that must pass before reinforcement becomes possible is different for each trial or event Examples Fishing Pop quizzes Calling a radio station

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior. Fixed-Ratio Schedule A schedule of reinforcement in which the number of responses required for reinforcement is always the same Examples Planet Smoothie Punch Cards A salesperson receives a bonus for every 10th gym membership sold

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior. Variable-Ratio Schedule A schedule of reinforcement in which the number of responses required for reinforcement is different for each trial or event Examples Slot machines Lottery tickets

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior.

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.3 – Explain how the different reinforcement schedules affect behavior.

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.4 – Discuss how punishment and negative reinforcement differ, and explain how punishment behavior. Punishment Any event or object that, when following a response, makes that response less likely to happen again The OPPOSITE of reinforcement Decreases the likelihood of the behavior; weakens the behavior

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.4 – Discuss how punishment and negative reinforcement differ, and explain how punishment behavior. Punishment by Removal The punishment of a response by the removal of a pleasurable stimulus Also known as negative punishment or omission training Examples “Grounding,” time-out, fining, etc.

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.4 – Discuss how punishment and negative reinforcement differ, and explain how punishment behavior. Problems with punishment Severe punishment… May cause the child to avoid the punisher instead of the behavior being punished May encourage lying Creates fear, anxiety, low self-esteem and emotional responses that do not promote learning Can lead to increased aggression Can lead to abuse

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.4 – Discuss how punishment and negative reinforcement differ, and explain how punishment behavior. To make punishment more effective… Punishment should immediately follow the behavior it is meant to punish Punishment should be consistent Follow through with promises of punishment Same intensity or slight increase, but never decrease Punishment of the wrong behavior should be paired, whenever possible, with reinforcement of the right behavior

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.4 – Discuss how punishment and negative reinforcement differ, and explain how punishment behavior. Appetitive Aversive Positive Reinforcement Presenting an appetitive stimulus Behavior increases Example: Every time Jimmy gets an A on his report card, his parents give him $20. Positive Punishment Presenting an aversive stimulus Behavior decreases Example: Every time Jimmy talks in class, he gets a detention. Negative Punishment (Omission) Removing an appetitive stimulus Behavior decreases Example: Every time Jimmy stays out past his curfew, his parents take away his car. Negative Reinforcement Removing an aversive stimulus Behavior increases Example: Every time Jimmy has a headache, he takes an aspirin.

Module 27 – Operant Conditioning 27 Module 27 – Operant Conditioning 27.4 – Discuss how punishment and negative reinforcement differ, and explain how punishment behavior. Positive – the addition of a stimulus. Negative – the removal of a stimulus. Appetitive – a desirable/liked stimulus Aversive – an undesirable/disliked stimulus Increases in behavior – the exhibited behavior continues. Decrease in behavior – the exhibited behavior declines.