1. Operant Conditioning First Hour – How is behaviour shaped by operant conditioning? Paradigms of Operant Conditioning Edward Thorndike The Law of Effect B.F. Skinner Schedules of Reinforcement Shaping The Skinner Box

2. Operant conditioning occurs as a result of stimuli that either strengthen (through reinforcement) or weaken through punishment) the likelihood of a behavioural response.

3. CS US UR CR Classical Conditioning Terminology: Conditioned stimulus Conditioned response Unconditioned stimulus Unconditioned response

4. Operant Conditioning Terminology: S D : R  S Rf Discriminative stimulus response Reinforcing stimulus (reinforcer)

5. Thorndike’s Puzzle Box

6. Of several responses made to the same situation those which are accompanied or closely followed by satisfaction to the animal will…be more firmly connected with the situation, so that, when it recurs, they will be more likely to recur; Those which are accompanied or closely followed by discomfort to the animal will…have their connections to the situation weakened, so that, when it recurs, they will be less likely to occur. The greater the satisfaction or discomfort, the greater the strengthening or weakening of the bond." The Law of Effect

7. Shaping: The first stage in operant conditioning Reinforcing behaviours that are progressively closer to the target behaviour.

8. Schedules of Reinforcement Timelines that specify how often a reward (or punishment) will be presented after the target behaviour Fixed interval schedule Fixed ratio schedule Variable interval schedule Variable ratio schedule

9. Sample Cumulative Records of Responses: etc. FR 5 FI 1min. VR10 VI 1min Time Cumulative Responses etc. reinforcer “ scallop ” etc. “ step function ”