1. Learning

2. Operant Conditioning

4. Classical Conditioning Review
Reflexive responding that is largely controlled by stimuli that precede the response
Missing what follows certain response--- consequences!

5. Thorndike’s Law of Effect
Instrumental learning (responses are instrumental in obtaining some desired outcome)
Kitty cats!
Law of Effect: if a response in the presence of a stimuli leads to satisfying effects, the association between the stimulus and the response is strengthened

6. BF Skinner Defined “operant conditioning”
An organism “operates” on the environment instead of simply reacting to stimuli
A form of learning in which responses comes to be controlled by their consequences
GOVERNS VOLUNTARY RESPONSES
m/watch?v=I_ctJqjlrHA
“Haterz Gon Hate” –BF Skinner

7. Skinner’s Demonstration
Demonstrated that organisms tend to repeat those are followed by favorable responses
Reinforcement- occurs when an event following a responses increases an organisms tendency to make that response
Response is strengthened when it leads to rewarding consequences

8. Terminology & Procedures
“Operant Chamber”/Skinner Box- a small enclosure in which an animal can make a specific response that is recorded while the consequences of the response are systematically controlled
Main responses are usually pressing a small lever down

9. Skinner Box

10. Operant responses are normally VOLUNTARY and are said to be emitted rather than elicited

11. Reinforcement Contingencies
Circumstances or rules that determine whether responses lead to the presentation of reinforcers
Experimenter manipulates what positive consequences occur when the animal makes the designated response
Normally a small bit of food

12. Cumulative Recorder
Creates a graphic record of responding and reinforcement over time in a Skinner box as a function of time
Response rate is a key dependent variable
A slope represents the line of record of responding
Rapid response rate gives steep slope, slow rate gives shallow slope

14. Basic Processes in Operant Conditioning

15. Acquisition and Shaping
Like in classical conditioning, it refers to the initial stage of learning, however it is a little unique
Skinner and his contemporaries trained animals to do a variety of things!

16. Extinction
Gradual weakening and disappearance of a response tendency because the response is no longer followed by a reinforcer

17. Stimulus Control: Generalization and Discrimination
Operant conditioning is controlled by its consequences, as organisms learn response- outcome (R-O) Associations
Stimuli that precede a response can also exert considerable influence over operant behavior
When a response is consistently followed by a reinforcer in the presence of a particular stimulus that stimulus comes to serve as a “signal” indicating that the response is likely to lead to a reinforcer
A small pigeon may only peck may be reinforced only when a light is blinking….

18. Discriminative Stimuli
Cues that influence operant behavior by indicating the probable consequences (reinforcement or non-reinforcement of a response)
These play an important role in regulation of operant behavior
Kids ask for candy when parents are in a good mood
Drivers slow when the roads are wet
Asking people on dates

19. Stimulus Generalization & Stimulus Discrimination
Works like in classical conditioning
Cat runs to a can opener (discriminative stimulus that it will be fed)
Generalization (Blender)
Discrimination (adjusting response)

20. Reinforcement: Consequences That Strengthen Responses

21. Reinforcement occurs whenever an outcome strengthens a response
The central process in reinforcement is the strengthening of a response tendency
Reinforcement is defined after the fact, in terms of its effect on behavior

22. Primary vs Secondary
Primary reinforcers- inherently reinforcing because they satisfy biological needs
Food, water, sex, and warmth
Secondary/conditioned reinforcers-acquire reinforcing qualities by being associated with primary reinforcers
Good grades, money, attention, flattery, praise, applause

23. Schedules of Reinforcement

24. Schedule of Reinforcement
Determines which occurrences of a specific response result in the presentation of a reinforcer
Continuous Reinforcement- occurs when every instance of a designated response is reinforced
Intermittent/Partial Reinforcement- occurs when a designated response is reinforced only some of the time
More effective/resistant to extinction

25. Types of Intermittent Schedules

26. Fixed Ratio Schedule (FR)
Reinforcer is given after a fixed number of nonreinforced respones
Reward every 10th lever push
Bonus every 10 magazines sold

27. Variable Ratio (VR)
Reinforcer is given after a variable number of non-reinforced responses
Rat rewarded on average every ten times
Casino- averages/variations

28. Fixed Interval Schedule (FI)
First response is rewarded after a fixed time interval has elapsed
First lever press after two minutes
Washer/dryer

29. Variable Interval Schedule (VI)
Reinforcer is given for the first response after a variable time interval has elapsed
Rewarded after lever press after 1 minute, then 2, then 3, etc
Person dialing a busy phone

31. Positive vs Negative Reinforcement

32. Positive Reinforcement
Occurs when a response is strengthened because it is followed by the presentation of a rewarding stimulus
Good grades, tasty meals, nice clothes, etc

33. Negative Reinforcement
Occurs when a response is strengthened because it is followed by the removal of an aversive (negative) stimulus
Strengthens a response tendency
Removing a buzzing noise

34. Escape Learning
Organism acquires a response that decreases or ends some aversive stimulation
Leave a party you were being picked on at

35. Avoidance Learning
Organism acquires a response that prevents some aversive stimulation from occuring

36. Punishment

37. Punishment
Occurs when an event following a response weakens the tendency to make that response
Negative reinforcement= stimulus is removed
Punishment= stimulus is added

38. Positive Punishment
An aversive stimulus is added to decreases the likelihood of a behavior
Petting a cat, cat bites you

39. Negative Punishment
An appetitive (something good) is removed to decrease the likelihood of an event
Texting at dinner, phone taken away

40. Disciplinary Procedures
Not just being spanked
Social punishments
Eating at restaurants/bad service

41. More Effective Punishments
Applied quickly
Just severe enough to be effective
Consistent
Explanations
Noncorporal