Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects,

Slides:



Advertisements
Similar presentations
Operant Conditioning Skinner, positive & negative reinforcement, response cost, punishment and schedules of reinforcement.
Advertisements

January 26 th, 2010 Psychology 485.  History & Introduction  Three major questions: What is learned? Why learn? How does learning happen?
Instrumental/Operant Conditioning
Lectures 14: Instrumental Conditioning (Basic Issues) Learning, Psychology 5310 Spring, 2015 Professor Delamater.
Instrumental Conditioning Also called Operant Conditioning.
Learning Unit 5. Topics in Learning Unit Defining Learning Classical Conditioning Operant Conditioning Cognitive Learning.
Classical Conditioning Pavlov’s experiment - psychic secretions. Pavlov was a Russian physiologists who studied digestion. He won the Nobel prize in physiology.
Operant or Instrumental Conditioning Psychology 3306.
Myers EXPLORING PSYCHOLOGY (6th Edition in Modules) Module 19 Operant Conditioning James A. McCubbin, PhD Clemson University Worth Publishers.
Chapter 8 Operant Conditioning.  Operant Conditioning  type of learning in which behavior is strengthened if followed by reinforcement or diminished.
More Instrumental (Operant) Conditioning. B.F. Skinner Coined the term ‘Operant conditioning’ Coined the term ‘Operant conditioning’ The animal operates.
PSY 402 Theories of Learning Chapter 7 – Behavior & Its Consequences Instrumental & Operant Learning.
Instrumental Conditioning: Foundations. Name Game Instrumental: subject instrumental in producing outcome Operant: subject operates on environment to.
OPERANT CONDITIONING DEF: a form of learning in which responses come to be controlled by their consequences.
Learning Part II. Overview Habituation Classical conditioning Instrumental/operant conditioning Observational learning.
Operant Conditioning Unit 4 - AoS 2 - Learning. Trial and Error Learning An organism’s attempts to learn or solve a problem by trying alternative possibilities.
Chapter 6: Learning. Classical Conditioning Ivan Pavlov Terminology –Unconditioned Stimulus (UCS): evokes an unconditioned response without previous conditioning.
Learning Prof. Tom Alloway. Definition of Learning l Change in behavior l Due to experience relevant to what is being learned l Relatively durable n Conditioning.
Chapter 6: Learning. Classical Conditioning Ivan Pavlov Terminology –Unconditioned Stimulus (UCS) –Conditioned Stimulus (CS) –Unconditioned Response (UCR)
OPERANT CONDITIONING Changing Behavior Through Reinforcement and Punishment.
Chapter 6 Learning. Table of Contents Classical conditioning Ivan Pavlov Terminology –Unconditioned Stimulus (UCS) –Conditioned Stimulus (CS) –Unconditioned.
B.F. SKINNER - "Skinner box": -many responses -little time and effort -easily recorded -RESPONSE RATE is the Dependent Variable.
Chapter 6 Learning. Table of Contents Learning Learning defined on page –Classical conditioning –Operant/Instrumental conditioning –Observational learning.
© 2013 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution in any manner.
Operant Conditioning Unit 4 - AoS 2 - Learning. Trial and Error Learning An organism’s attempts to learn or solve a problem by trying alternative possibilities.
Operant Conditioning Operant Conditioning A type of learning in which behavior is strengthened if followed by reinforcement or diminished if.
© 2013 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution in any manner.
Chapter 6 Learning.
Operant Conditioning E.L. Thorndike and B.F. Skinner.
Table of Contents CHAPTER 6 Learning. Table of ContentsLEARNING  Learning  Classical conditioning  Operant/Instrumental conditioning  Observational.
PSY402 Theories of Learning Chapter 6 – Appetitive Conditioning.
Copyright McGraw-Hill, Inc Chapter 5 Learning.
Chapter 5 Learning. What is Learning? Learning: experience leads to a relatively permanent change in behavior Learning: experience leads to a relatively.
PRINCIPLES OF APPETITIVE CONDITIONING Chapter 6 1.
Operant Conditioning I
Learning: Operant Conditioning. Operant Conditioning  Suppose your dog is wandering around the neighborhood, sniffing trees, checking out garbage cans,
Instrumental/Operant Conditioning. Thorndike’s Puzzle Box.
Module 10 Operant & Cognitive Approaches. Thorndike’s Law of Effect l Behaviors followed by positive consequences are strengthened while behaviors followed.
B. F. Skinner Radial Behaviorism B.F. Skinner ( ) 1925: Hamilton College (NY): degree in English, no courses in psychology Read about Pavlov’s.
Operant conditioning (Skinner – 1938, 1956)
© 2013 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution in any manner.
Chapter 6 Learning and Behavior Learning n A more or less permanent change in behavior that results from experience.
Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.
Steven I. Dworkin, Ph.D. 1 Basic Principles of Operant Conditioning Chapter 6.

Instrumental Conditioning II. Delay of Reinforcement Start DelayChoice Correct Incorrect Grice (1948) Goal Reward or No Reward.
Operant Conditioning. Learning when an animal or human performs a behavior, and the following consequence increases or decreases the chance that the behavior.
Chapter 6 FLASH CARD CHALLENGE!!!
Learning 7-9% of the AP Psychology exam. Thursday, December 3 Sit with your group from yesterday’s test review!
Operant Conditioning. What is it?  Learning from the consequences of behavior  Depending on the consequences the learner will learn to repeat or eliminate.
Operant Conditioning I. Volunteer? Priscilla the Fastidious Pig
Operant Conditioning Type of learning in which the frequency of a behavior depends on the consequence that follows that behavior. Another form of learning.
Table of Contents Chapter 6 Learning. Table of Contents Learning –Classical conditioning –Operant/Instrumental conditioning –Observational learning Ivan.
Edward Thorndike Acquisition of Goal-directed responses. Law of Effect - behavior occurs in a random, trial-and-error fashion. Consequences of a behavior.
Operant Conditioning Chapter 6.
Operant or Instrumental Conditioning
Chapter 5 Learning © 2013 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution.
Instrumental or Operant Conditioning
Learning.
Learning.
Module 20 Operant Conditioning.
Chapter 6 Learning.
University of Leicester Professor Graham Davies
PSY402 Theories of Learning
Operant Conditioning Unit 4 - AoS 2 - Learning.
UNIT 4 BRAIN, BEHAVIOUR & EXPERIENCE
Operant Conditioning.
Do-Now: Describe the following phenomena of Classical Conditioning:
PSY 402 Theories of Learning Chapter 7 – Behavior & Its Consequences
Conditioning and Learning
Presentation transcript:

Operant vs. Classical Operant responses understood by comprehending the consequences they produce vs. Pavlovian responses may have environmental effects, but this is not what controls them

Edward Thorndike Acquisition of Goal-directed responses. Law of Effect - behavior occurs in a random, trial-and-error fashion. Consequences of a behavior can increase or decrease the future probability of that behavior

Trials Escape Time Cat Puzzle Box

Law of Effect Responses followed by a satisfying outcome will strengthen the association between the situation and the response. Responses followed by a dissatisfying outcome will weaken the association between the situation and the response.

Law of Effect Press lever  Escape from boxTime 1: Time 2: Placed in box  higher probability of pressing lever Strengthens box-lever press association Pull string  Remain in boxTime 1: Time 2: Placed in box  lower probability of pulling string Weakens box-string pulling association

Discrete-Trial Procedures W. S. Small (1900) – used the maze as a tool to study operant learning in rats. “complex” maze; measures = running speed, latency to reach goal.

Hampton Court Palace Maze

T-Maze Start Food No Food

Straight Alley “Maze” StartFood

Operant (Instrumental) Conditioning The Skinner Box:

Lever 2 Stages of training:1. Magazine training 2. Shaping = reinforcement of successive approximations

Lever

Free-Operant Procedures Discrete-trial procedures provide animal with limited opportunities to respond. Free-operant procedures allow the animal to perform the instrumental response repeatedly without constraint.

Discrete-Trial Operant Procedure Lever Light = Discriminative stimulus (S D )

Acquisition and Extinction of Lever Press Response

Fixed Variable RatioInterval

Schedules of Reinforcement Post-reinforcement pause FI scallop time # responses

Size of post-reinforcement pause determined by response-reinforcement ratio

PREE

What can be an operant? Practically any behavior or behavioral parameter! rate of response time of response variability of response pushes and pulls posture study habits athletic performance arts and crafts creativity bad habits and behavioral disorders

Allen et al. (1964) The case of Ann, a nursery school student Problems: asocial behavior, complaining, weird habits. Solution: Stop paying attention to her when she does these things.

Extinction of temper tantrums

Reinforcement without awareness Conditioning in amesics – eyeblink in HM “Memento” Radio static study Subjects told it was an experiment on stress. Twitching of very small thumb muscle actually terminated the aversive stimulus (harsh noise) Students condition professor

Pigeon in a Pelican

Ginger

Does anyone know how google works? google

Marian Breland Bailey – How to train a chicken

The famous dancing chicken

Limits on Operant Conditioning Instinctive drift – “misbehavior.” Belongingness effects – reinforcer/behavior specificity e.g., behavior systems effects. Unintended consequences –Doing one thing precludes doing other things. Some responses cannot be conditioned. –E.g., yawning or sneezing.

Factors that affect O.C. The response –Maze running vs. lever pressing –Running vs. throwing football Temporal contiguity

Delayed reinforcement

Overcoming the effects of delay Secondary reinforcers “Marking” procedure

Factors that affect O.C. The response –Maze running vs. lever pressing –Running vs. throwing football Temporal contiguity Contingency

“Superstitious Behavior” Suggested that temporal contiguity more important than contingency 15-s FT, no response requirement “adventitious reinforcement” “In 6 out of 8 cases the resulting responses were so clearly defined that two observers could agree perfectly in counting instances. One bird was conditioned to turn counter-clockwise about the cage, making 2 or 3 turns between reinforcements. Another repeatedly thrust its head into one of the upper corners of the cage….”

Orienting toward feeder Pecking near feeder Moving along wall ¼ turn

G.V. Thomas (1981) Contiguity pitted against contingency “Free” reinforcers given every 20s Lever press advances delivery of pellet, but cancels pellet for next 20-s interval So if you press at second 2, you get a pellet immediately, but you get no pellet during seconds 3-20 and s40s60s

G.V. Thomas (1981) Contiguity pitted against contingency So if you press at second 2, you get a pellet immediately, but you get no pellet during seconds 3-20 and s40s60s Lever press here Lose this pellet

Degraded Contingency Effect = bar press = food Perfect contingency Degraded contingency Signal extra food = light CS Response Strong Weak

Factors that affect O.C. The response –Maze running vs. lever pressing –Running vs. throwing football Temporal contiguity Contingency The reinforcer –Magnitude, quality –Upshifts and downshifts

Anticipatory Contrast - Crespi (1942) Rats run down maze to find food pellets in goal arm.

Reinforcement of Variability