Operant Conditioning of Canis lupis familiaris That is, clicker training the domestic dog!

Slides:



Advertisements
Similar presentations
Introduction to Psychology
Advertisements

Introduction to Psychology Learning. Learning refers to an enduring change in the way an organism responds based on its experience –Distinct from Drug.
©John Wiley & Sons, Inc Huffman: Psychology in Action (8e) Psychology in Action (8e) by Karen Huffman PowerPoint  Lecture Notes Presentation Chapter.
Learning Unit 5. Topics in Learning Unit Defining Learning Classical Conditioning Operant Conditioning Cognitive Learning.
Classical Conditioning Pavlov’s experiment - psychic secretions. Pavlov was a Russian physiologists who studied digestion. He won the Nobel prize in physiology.
Lecture Overview Classical Conditioning Operant Conditioning Cognitive-Social Learning The Biology of Learning Using Conditioning & Learning Principles.
Classical and Operant Conditioning Pavlov, Skinner, and YOU!
Classical Conditioning, Operant Conditioning, and Observational Learning.
Tuesday, December 10 Return Quiz Discuss Schedules of Reinforcement
Operant Conditioning. I. Operant Conditioning A type of learning that occurs when we receive rewards or punishments for our behavior A type of learning.
Operant Conditioning.
Learning.
Learning.
Operant Conditioning Unit 4 - AoS 2 - Learning. Trial and Error Learning An organism’s attempts to learn or solve a problem by trying alternative possibilities.
Chapter 6: Learning. Classical Conditioning Ivan Pavlov Terminology –Unconditioned Stimulus (UCS): evokes an unconditioned response without previous conditioning.
Learning.
A Brief Introduction to Learning Theory The concept of learning is fundamental to education We can teach. We can re-teach. We can teach alternatives.
© 2013 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution in any manner.
Operant Conditioning Unit 4 - AoS 2 - Learning. Trial and Error Learning An organism’s attempts to learn or solve a problem by trying alternative possibilities.
Chapter 6: Learning 1Ch. 6. – Relatively permanent change in behavior due to experience 1. Classical Conditioning : Pairing 2. Operant Conditioning :
Unit 6 Learning. Classical Conditioning Ivan Pavlov – Russian scientist who did the famous dog experiments – UR: reflexive behavior – US: Stimulus that.
© 2013 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution in any manner.
Principles of Learning: Classical and Operant Conditioning, and Social Learning Psychology I Mrs. Hart.
Classical Conditioning
Learning. A. Introduction to learning 1. Why do psychologists care about learning? 2. What is and isn’t learning? IS: A relatively permanent change in.
Classical Conditioning + Intro to Operant Conditioning Learning Unit Mrs. Craig.
Chapter 6 Learning.
Operant Conditioning E.L. Thorndike and B.F. Skinner.
1 Learning. 2 “A relatively permanent change in behavior due to experience”. This definition has three aspects: 1)It is a change in behavior for better.
Learning Principles and Applications
Table of Contents CHAPTER 6 Learning. Table of ContentsLEARNING  Learning  Classical conditioning  Operant/Instrumental conditioning  Observational.
LEARNING Learning - process leading to relatively permanent behavioral change or potential behavioral change.
4 th Edition Copyright 2004 Prentice Hall5-1 Learning Chapter 5.
Copyright McGraw-Hill, Inc Chapter 5 Learning.
LEARNING  a relatively permanent change in behavior as the result of an experience.  essential process enabling animals and humans to adapt to their.
Learning Experiments and Concepts.  What is learning?
General Psychology (PY110) Chapter 4 Learning. Learning Learning is a relatively permanent change or modification in behavior due to experience or training.
Learning Chapter 5.
Learning Psychology. Bell Activity 3/22/2013 Learning Targets: At the end of class you will be able to- -Define Classical Conditioning -Define and Identify.
© 2013 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution in any manner.
Chapter 5 Learning. Copyright © 1999 by The McGraw-Hill Companies, Inc. 2 Defining Learning Learning –a relatively permanent change in behavior that occurs.
Chapter 9 Principles of Learning. You walk into a kitchen and smell your favorite food. - What physically happens to you? - What happens mentally?
Def: a relatively permanent change in behavior that results from experience Classical Conditioning: learning procedure in which associations are made.
Classical Conditioning. It’s unconditioned because it happens automatically!
Psychology: An Introduction Charles A. Morris & Albert A. Maisto © 2005 Prentice Hall Learning Chapter 5.
Learning 7-9% of the AP Psychology exam. Thursday, December 3 Sit with your group from yesterday’s test review!
Introduction to Psychology
Behavioral Learning Theory : Pavlov, Thorndike & Skinner M. Borland E.P. 500 Dr. Mayton Summer 2007.
Table of Contents Chapter 6 Learning. Table of Contents Learning –Classical conditioning –Operant/Instrumental conditioning –Observational learning Ivan.
Psychology in Action (8e) PowerPoint  Lecture Notes Presentation Chapter 6: Learning 1.
Principles of Learning
CHAPTER 4 Behavioural views of learning Identify three characteristics that distinguish classical from operant conditioning Describe the Premack principle.
Chapter 6 Learning. Chapter Overview Will be some of the first Psychology information you learn in college Will be some of the first Psychology information.
CONDITIONING CLASSICAL AND OPERANT CONDITIONING BSN-II, RLE-II.
Chapter 6 LEARNING. Learning Learning – A process through which experience produces lasting change in behavior or mental processes. Behavioral Learning.
Conditioning and Learning Unit 6 Conditioning and Learning Modules
LEARNING: PRINCIPLES & APPLICATIONS CLASSICAL CONDITIONING.
Operant Conditioning of Canis lupis familiaris
Learning Chapter 9.
Chapter 5 Learning © 2013 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution.
Operant Conditioning.
Module 20 Operant Conditioning.
Chapter 6: Learning Ch. 6.
Chapter 6 Learning.
Operant Conditioning of Canis lupis familiaris
Operant Conditioning Unit 4 - AoS 2 - Learning.
Chapter 6.
Operant Conditioning of Canis lupis familiaris
Agenda To Get: To Do: Guided notes Intro Unit 7: Learning
Operant Conditioning of Canis lupis familiaris
Presentation transcript:

Operant Conditioning of Canis lupis familiaris That is, clicker training the domestic dog!

Defining learning Learning is……. – A relatively permanent change in behavior not due to maturation but to experience and/or practice. – A learned behavior is predictable – For our class we will concentrate on 2 kinds of learning Classical conditioning is pairing a predictive stimulus with a predicted event: – CS  US  UR  CR – you respond because a stimulus signals an upcoming event – Do NOT have to respond Operant conditioning: Pairing a consequence with a behavior – R  C – Can add a predictive stimulus: S+: R  C – Animal MUST engage in the response in order to receive the consequence

Pavlov’s Contribution Ivan Pavlov – Russian physiologist: Studied salivation – 1901: discovered and wrote about classical conditioning – Found that his dogs reacted to both his presence and the time of day for feeding/experimentation Researched this: – Measured amount of salivation during baseline: Present food to dogs Measure slobber – Then added a predictive stimulus: a Bell Presented the Bell  Food Measured slobber to see if dogs would begin to slobber to the bell

Labeled each part of these events: Unconditioned stimulus or US: – The stimulus that automatically elicited the behavior (usually innate) – E.g., the food elicited the slobber Unconditioned response or UR – The behavior that is automatically elicited – Unlearned; often reflexive Conditioned stimulus or CS: – The stimulus that predicts the US – Is a learned (thus conditioned) stimulus Conditioned response or CR: – The behavior that occurs to the CS – Often very similar to the unconditioned response – Occurs because the CS predicts the US

Classical Conditioning Procedure

Order of presentation is very important!

The CR does not just suddenly Appear, rather it takes several trials Or sessions to learn the connection Between the CS and the US

Characteristics or Parameters of Classical Conditioning Relationship between UR and CR – The UR and CR are not always identical! – Often are similar, or in similar family of behavior – Can be opposite: compensatory response If predicted to go up, you respond by going down! See this with drugs: – Morphine = lower BP, heart rate, feeling of cold, less pain – CR to morphine= higher BP, HR, feel hot, more pain – What could be predictive CS for morphine?

Characteristics or Parameters of Classical Conditioning Strength of CR – Gradually increases with trials E.g., slobber more after each CS-US pairing – Monotonically increasing curve: levels off – Reaches an asymptote: some maximum amount of CR – Why?

Characteristics or Parameters of Classical Conditioning Extinction and Spontaneous recovery – Extinction: If stop CS-US pairing (CS  nothing), then the CR will also fade away – Again, must be unlearned, or habituated! Spontaneous recovery – Sometimes, when conditions are similar to CS, the animal shows the CR – Unpredictable; almost as if they “suddenly remembered” – More likely to occur when animal is stressed, tired, hungry, etc.

Characteristics or Parameters of Classical Conditioning Relearning: – Relearning is faster than original learning True if extinction occurred AND if just haven’t had the experience for a while – Important for drug, fear reactions! Generalization and discrimination: – Generalization: CR will occur to stimuli that are similar to the original CS – Discrimination: Can train the animal so the CR only occurs to very specific CSs

The Law of Effect Thorndike (1911): Animal Intelligence – Experimented with cats in a puzzle box Put cats in the box Cats had to figure out how to pull/push/move lever to get out; when out got reward The cats got faster and faster with each trial Law of Effect emerged from this research: – When a response is followed by a satisfying state of affairs, that response will increase in frequency.

Skinner’s version of Law of Effect Had two problems with Thorndike’s law: – Defining “satisfying state of affairs” – Defining “increase” in behavior Rewrote the law to be more specific: – Used words reinforcer and punisher – Idea of reinforcer is strengthening of relation between a R and Sr Now defined reinforcement and punishment: – A reinforcer is any stimulus which increases the probability of a response when delivered contingently – A punisher is any stimulus which decreases the probability of a response when delivered contingently – Also noted could deliver reinforcers and punishers in TWO ways: Add something: positive Take away something: negative

Reinforcers vs. Punishers Positive vs. Negative Reinforcer = rate of response INCREASES Punisher = rate of response DECREASES Positive: something is ADDED to environment Negative: something is TAKEN AWAY from environment Can make a 4x4 contingency table

More parameters: Generalization can occur: – Operant response may occur in situations similar to the one in which originally trained – Can learn to behavior in many similar settings Discrimination can occur – Operant response can be trained to very specific stimuli – Only exhibit response under specific situations Can use a cue to teach animal: – S+ or S D : contingency in place – S- or S : contingency not in place – Thus: S D : R  Sr

Schedules of Reinforcement: Continuous reinforcement: – Reinforce every single time the animal performs the response – Use for teaching the animal the contingency – Problem: Satiation Solution: only reinforce occasionally – Partial reinforcement – Can reinforce occasionally based on time – Can reinforce occasionally based on amount – Can make it predictable or unpredictable

Partial Reinforcement Schedules Fixed Ratio: every nth response is reinforced Fixed interval: the first response after x amount of time is reinforced Variable ratio: on average of every nth response is reinforced Variable interval: the first response after an average of x amount of time is reinforced

Variable ratio and variable interval Cumulative records

What is Clicker Training Popular term for training/teaching method of operant conditioning – Can be used with any living organism Gold fish Dogs Humans! Very simple process: – S +  R  S rc  S r – Cue  response  marker  reinforcement

Clicker training System of training/teaching that uses positive reinforcement in combination with an event marker The event marker (click) “marks” the response as correct

An Atypical way to train You WATCH for the behavior to occur – Wait for the behavior or approximation of that behavior – Don’t lure or force MARK the behavior: click when the behavior is occurring to signal to the animal “yes, do THAT!” After marking the behavior, REINFORCE the response!! Clicker = Precise tool: an event marker – The “click” pinpoints a behavioral instance – Informs the animal that that was the correct targeted response

Why not just use your voice? Clicker is unique and distinct; your voice is not. Is a novel unconditioned signal thus can be quickly paired as an event marker Used to teach NEW behaviors But: we WILL fade the clicker and replace it with cue for the response: – This could be a vocal cue, sign, etc.

Why should you use a clicker? Very powerful teaching tool According to Karen Pryor, clicker training – Accelerates learning – Strengthens the human-animal bond – Produces long term recall – Produces creativity and initiative – Forgives your mistakes – Generates enthusiastic learners

Examples of learning vs. environmental manipulation Want to keep dog out of kitchen: – Put up a gate: dog can’t get in, so behavior decreases – Does not alter the contingency of going into the kitchen – The dog has learned nothing Want you to sit in a chair – I poke you behind the knees and you fall into the chair – You increased “chair sitting” but didn’t learn chair sitting! – Your behavior is not predictable when presented with the chair – or worse yet, you are now afraid of the chair and avoid it!

Clicker training is based on the science of operant conditioning Emerged from area of psychology called Behavior Analysis – Experimental Analysis of Behavior – Applied Behavior Analysis Both study how living organisms learn about contingencies. – Antecedents: what is/are the setting condition(s)? – Behavior: what behavior is emitted? – Consequences: what consequences maintain the response?

ABC’s of Operant Conditioning Antecedents: as behavior analysts we – Identify the setting conditions – Alter the setting conditions to give us environmental control – Allows us to control what happens prior to the behavior – Can introduce cues: Learned Antecedents Behavior: Behavior Analysts target which response to increase or decrease – Must shape and control behavior within physical limits of the organism – Whether you increase or decrease a response depends on the results of that response Consequences: Behavior Analysts decide the consequence of the behavior – No consequence (ignore the response) – Reinforcer the response – Punish the response – Consequences are the Behavior Analyst’s most important tool!

Which consequence should we use? Punish the behavior? – Decreases the probability of the behavior – Can result in unstable responding, particularly with negative reinforcement – Can result in learned helplessness, avoidance and aggression! – Often are ethical limitations

Which consequence should we use? Ignore the behavior? – Decreases the probability of the behavior – Process of extinction – Two problems: Extinction burst Extinction-induced aggression

Which consequence should we use? Positively Reinforce a behavior: – Increases the probability of the behavior – Can reinforce the opposite of the response you are trying to decrease! – Creates a “fun” learning environment – Data suggest that organisms trained with positive reinforcement WANT to work!

Which consequence should we use? But wait: won’t positive reinforcement make greedy organisms? – Initially, we use continuous reinforcement – Gradually we thin out the rate of reinforcement using partial schedules of reinforcement – More and more responding or chains of behavior required to get a reward When you were kindergarten, you needed lots of reinforcers every day Now in college you can work all semester for that final reinforcer of an “A”.

What skills are necessary to become a good clicker trainer? Must be an excellent observer of behavior – Must be able to identify the response or component of the response Must be precise with your clicker – Must be quick and “catch” and “mark” that response – May introduce a “keep going” signal, too! Must be generous with reinforcement – When learning a new response, the animal needs lots of feedback – Reinforcement variety improves the learning process – Reinforcers must be of value to the learner (what THEY like, not what YOU like). – Barney stickers or Beer? Must use the clicker as a conditioned reinforcer: – The clicker derives value from it being tightly paired with the primary reinforcer – Use as a bridge or a “yes, keep going” signal – We will call the clicker an event marker Must be consistent! – The animal is learning the rule, so the rule must be consistent – Only when the response is solid will you move to partial reinforcement

Three important class components: During Monday lectures we will: – Learn the theory of operant conditioning – Learn about our organism: the domestic dog During our labs we will apply our information that we learn in the classroom with each other and with the dogs. – Deaf and deaf/blind dogs as our stable models – Rescue dogs to apply our skills Are you ready to do this?