1. Unit 6: Learning
Classical vs. Operant

2. Comparing Classical Conditioning & Operant Conditioning
Two stimuli (the NS and UCS) are associated
A behavior and a consequence (reinforcement or punishment) is associated
Behavior affected is usually INVOLUNTARY
Behavior affected is usually VOLUNTARY
Key events are PRESENTED to the learner
Key events are PRODUCED by the learner
Events CAUSE the behavior
Events CONTROL the behavior
The learner does not have a choice
The learner has a choice

3. Ivan PAVLOV discovered classical conditioning
key name
Ivan PAVLOV
discovered classical conditioning
conducted the famous salivating dog experiment
Nobel Prize in Physiology in 1904 for his research on digestion

4. Pavlov’s Dog Experiment
NS (neutral stimulus):
tuning fork / bell
UCS (unconditioned stimulus)
sight of food
UCR (unconditioned response)
salivation
CS (conditioned stimulus)
tuning fork / bell
CR (conditioned response)
salivation

5. NS (neutral stimulus):
Every time I go near the cabinet where Rover’s treats are kept, Rover comes and sits, waiting for a treat.
NS (neutral stimulus):
cabinet
UCS (unconditioned stimulus)
treats
UCR (unconditioned response)
come and sit
CS (conditioned stimulus)
cabinet
CR (conditioned response)
come and sit

6. NS (neutral stimulus):
Bobby watched the movie JAWS when he was 4-years-old. Now, every time he hears the song, “da-duh, dah-duh, da-duh…) he gets anxious.
NS (neutral stimulus):
“da-duh”
UCS (unconditioned stimulus)
scary movie
UCR (unconditioned response)
fear / anxiety
CS (conditioned stimulus)
“da-duh”
CR (conditioned response)
fear / anxiety

7. More Classical Conditioning Terminology
extinction
when a CR no longer follows a CS
Reappearance of an extinguished response after a rest period
spontaneous recovery
generalization
similar stimuli elicit similar responses
learned ability to distinguish between a CS and other similar stimuli
discrimination

8. More Classical Conditioning Terminology
extinction
when a CR no longer follows a CS
Remember the example of a person fearing the Jaws song?
CS (conditioned stimulus)
“da-duh”
CR (conditioned response)
fear / anxiety

9. More Classical Conditioning Terminology
Reappearance of an extinguished response after a rest period
spontaneous recovery
CS (conditioned stimulus)
“da-duh”
CR (conditioned response)
fear / anxiety
Time Passes
CS (conditioned stimulus)
“da-duh”
CR (conditioned response)
fear / anxiety

10. More Classical Conditioning Terminology
generalization
similar stimuli elicit similar responses
Remember Pavlov’s dog example?
CS (conditioned stimulus)
tuning fork
Now the dog salivates whenever he hears bells, alarm clocks, or music. The dog has GENERALIZED.
CR (conditioned response)
salivation

11. More Classical Conditioning Terminology
learned ability to distinguish between a CS and other similar stimuli
discrimination
Remember Pavlov’s dog example?
CS (conditioned stimulus)
tuning fork
CR (conditioned response)
salivation
The dog only salivates when he hears that particular tuning fork; never when he hears bells, alarm clocks, or music. The dog has DISCRIMINATED.

12. B.F. = (Burrhus Frederic )
key name
B.F. SKINNER
B.F. = (Burrhus Frederic )
Most significant name in behaviorism (behavior is controlled by reinforcement, not your unconscious)
Research on operant conditioning – external influences control behavior
Creator of the operant chamber (Skinner Box)

13. Reinforcement
All Reinforcement INCREASES THE LIKELYHOOD that a particular behavior will occur.
Positive Reinforcement: encourages a certain behavior by offering a positive stimulus (reward).
Negative Reinforcement also ENCOURAGES a particular behavior by removing an aversive (negative) stimulus.
Negative Reinforcement IS NOT Punishment
Punishment: DISCOURAGES a particular behavior by usually adding an aversive stimulus.

14. Examples of Negative Reinforcement
Prisoners being released early for good behavior. (encouraged to be good so negative environment is removed).
You cannot drive your car UNTIL you get better grades. (encouraged to study harder so negative of not having your car is removed).
The seatbelt alarm in a car buzzes until you put on the seatbelt. (encouraged to put on seatbelt so that annoying sound is removed)

15. Examples of Punishment: DISCOURAGES behavior
You are grounded because you lied.
A child is spanked for cussing.
A person is sent to jail for breaking the law

16. Types of Reinforcement
Continuous Reinforcement: reinforcing the desired behavior every time it occurs.
Learning happens very quickly.
Extinction happens very quickly if reinforcement is stopped.
Partial (Intermittent) Reinforcement: reinforcing a desired behavior only part of the time.
Learning takes longer (slower acquisition)
TAKES LONGER for extinction to occur.

17. Schedules of Reinforcement
Fixed-ratio
Reinforcement always occurs after a fixed number of operant responses
A factory worker may be paid $1 for every 3 T-shirts he makes.
= $1

18. Schedules of Reinforcement
Variable-ratio
Reinforcement usually occurs after a certain number of operant responses
A gambler might win the jackpot after just one pull of the slot machine, or after 52 pulls, or after 2,397 pulls.

19. Schedules of Reinforcement
Fixed-interval
Reinforcement always occurs after a fixed amount of time has passed
A factory worker may be paid $1 for every 3 hours she works.
= $1

20. Schedules of Reinforcement
Variable-interval
Reinforcement usually occurs after a certain amount of time has passed
A person on parole may be given a random drug test. He/she has no idea when they will be asked for a urine specimen. It could be next week, or a month from now, or several months from now.
The next drug test will be:
?????????