2. Ivan Pavlov ( )

3. Classical conditioning procedure

4. Classical conditioning procedureUS UR

5. Classical conditioning procedure
S + US UR R

6. Classical conditioning procedure
CS + US
CR UR
Stimulus Generalization, stimulus discrimination, extinction

7. Extinction: how we know it isn’t forgetting
1) Spontaneous Recovery
2) Rapid Reaquisition
3) Disinhibition

8. Higher Order Learning

9. Human Applications of Classical Conditioning
1) Money
2) Fear (simple phobias)
3) Drug addiction
4) Advertising

10. Instrumental Conditioning Foundations

11. Thorndike’s Puzzle Boxes

12. Thorndike’s Puzzle Boxes

13. One cat’s data (all of the others are similar):

14. Burrhus Frederick Skinner

15. The Skinner Box

16. R -- Rfer Some basic terminology Response-reinforcer relationship
Positive (presented) Negative (removed)
positive reinforcement
(reward)
negative punishment
(omission)
Positive Rfer
Negative Rfer
Consequence:
Positive punishment
negative reinforcement
(escape)

17. Why you should never use positive punishment:
-emotional side-effects
-imitation
-person delivering punishment becomes an aversive CS (leads to escape or avoidance responses)

18. How to punish effectively:
-should occur for every instance of the behaviour
(not caught)
-no escape from the punishment
(bail)
-should occur immediately following behaviour
(time to trial)
-should not be paired with a positive reinforcer
(TV, concerts)
-alternative response made available
(skill building, education)
-should be as intense as possible the first time
(first offence leniency)

19. A fourth element: the discriminative stimulus
Instrumental extinction R
Some initial side-effects with operant extinction:
1) Increase in response frequency
2) Increase in response vigor (force)
3) Increase in response variability
A fourth element: the discriminative stimulus
SD (S+)
S (S-)

20. Shaping in Four Easy Steps
1) identify the target, current behaviours
2) Construct a list of “successive approximations” to the target
3) Starting with the first item on the list, reinforce until frequency is stable
4) Put the behavior on extinction until next “successive approximation” behavior is performed, return to step 3.

21. Shaping in Four Easy Steps
1) identify the target, current behaviours
2) Construct a list of “successive approximations” to the target
3) Starting with the first item on the list, reinforce until frequency is stable
4) Put the behavior on extinction until next “successive approximation” behavior is performed, return to step 3.

22. Partial Reinforcement Schedules
Cumulative Recorder

23. Partial Reinforcement SchedulesFR VR VI FI