Ivan Pavlov (1849-1936)
Classical conditioning procedure
Classical conditioning procedure US UR
Classical conditioning procedure S + US UR R
Classical conditioning procedure CS + US CR UR Stimulus Generalization, stimulus discrimination, extinction
Extinction: how we know it isn’t forgetting 1) Spontaneous Recovery 2) Rapid Reaquisition 3) Disinhibition
Higher Order Learning
Human Applications of Classical Conditioning 1) Money 2) Fear (simple phobias) 3) Drug addiction 4) Advertising
Instrumental Conditioning Foundations
Thorndike’s Puzzle Boxes
Thorndike’s Puzzle Boxes
One cat’s data (all of the others are similar):
Burrhus Frederick Skinner
The Skinner Box
R -- Rfer Some basic terminology Response-reinforcer relationship Positive (presented) Negative (removed) positive reinforcement (reward) negative punishment (omission) Positive Rfer Negative Rfer Consequence: Positive punishment negative reinforcement (escape)
Why you should never use positive punishment: -emotional side-effects -imitation -person delivering punishment becomes an aversive CS (leads to escape or avoidance responses)
How to punish effectively: -should occur for every instance of the behaviour (not caught) -no escape from the punishment (bail) -should occur immediately following behaviour (time to trial) -should not be paired with a positive reinforcer (TV, concerts) -alternative response made available (skill building, education) -should be as intense as possible the first time (first offence leniency)
A fourth element: the discriminative stimulus Instrumental extinction R -- 000 Some initial side-effects with operant extinction: 1) Increase in response frequency 2) Increase in response vigor (force) 3) Increase in response variability A fourth element: the discriminative stimulus SD (S+) S (S-)
Shaping in Four Easy Steps 1) identify the target, current behaviours 2) Construct a list of “successive approximations” to the target 3) Starting with the first item on the list, reinforce until frequency is stable 4) Put the behavior on extinction until next “successive approximation” behavior is performed, return to step 3.
Shaping in Four Easy Steps 1) identify the target, current behaviours 2) Construct a list of “successive approximations” to the target 3) Starting with the first item on the list, reinforce until frequency is stable 4) Put the behavior on extinction until next “successive approximation” behavior is performed, return to step 3.
Partial Reinforcement Schedules Cumulative Recorder
Partial Reinforcement Schedules FR VR VI FI