The Rescorla-Wagner Model

Slides:



Advertisements
Similar presentations
Classical Conditioning II
Advertisements

Theories of Learning Chapter 4 – Theories of Conditioning
Facebook Group: The group is called: Psych281 Spring08 Available only to University of Alberta network Sorry to be rude but… Please don’t add me as a friend.
PSY 402 Theories of Learning Chapter 4 – Theories of Conditioning.
Theories of Classical Conditioning. Critical CS-US relationship Important (critical) things to note about classical conditioning: – the CS MUST precede.
Inhibitory Pavlovian Conditioning Stimuli can become conditioned to signal the absence of a US— such learning is called Inhibitory Conditioning CS+ = excitatory.
Lecture 18&19: Stimulus Control (Pavlovian & Instrumental) Learning, Psychology 5310 Spring, 2015 Professor Delamater.
Lectures 7&8: Pavlovian Conditioning (Determining Conditions) Learning, Psychology 5310 Spring, 2015 Professor Delamater.
Avoidance Conditioning Combining Classical and Operant Conditioning Classical and operant conditioning often take place in the same situation. We saw this.
Rescorla-Wagner (1972) Theory of Classical Conditioning.
Rescorla's Correlation *Experiments * Note that Rescorla referred to his experiments as contingency experiments, however since a true contingency (cause-effect.
PSY 402 Theories of Learning Chapter 4 – Theories of Conditioning.
Learning What is Learning? –Relatively permanent change in behavior that results from experience (behaviorist tradition) –Can there be learning that does.
PSY402 Theories of Learning Chapter 4 (Cont.) Indirect Conditioning Applications of Conditioning.
PSY402 Theories of Learning Wednesday January 15, 2003.
The Learned Dog Class 4: Pavlovian Conditioning. Agenda Quick review of Single-Event Learning Pavlovian Conditioning Chicken Camp, Part 1.
Chapter 4 Classical Conditioning: Mechanisms
Classical Conditioning: Mechanisms and Theory. Eyeblink Class Study 60 conditioning trials (blocks of 20) 7 blocks of 4 probe trials C1, P1, C2, P2, C3,
Theoretical Analysis of Classical Conditioning Thomas G. Bowers, Ph.D. Penn State Harrisburg.
Chapter 10 Aversive Control: Avoidance and Punishment.
An Information Processing Perspective on Conditioning C. R. Gallistel Rutgers Center for Cognitive Science.
CHAPTER 4 Pavlovian Conditioning: Causal Factors.
Psychology 2250 Last Class Characteristics of Habituation and Sensitization -time course -stimulus-specificity -effects of strong extraneous stimuli (dishabituation)
Current Theoretical Approaches and Issues in Classical Conditioning Psychology 3306.
Innate Behavior Patterns Reflex Tropism –kinesis (undirected) –taxis (directed) Fixed Action Pattern –species-specific; unlearned; goes to completion Reaction.
Experimental Evidence  Rats drink little saccharin water at first but increase over time.  Loud tones (110 db) produce different responses depending.
Acquisition curve of Eyeblink CR
Lectures 9&10: Pavlovian Conditioning (Major Theories)
Learning Part I Learning Classical Conditioning
Blocking The phenomenon of blocking tells us that what happens to one CS depends not only on its relationship to the US but also on the strength of other.
Unit 1 Review 1. To say that learning has taken place, we must observe a change in a subject’s behavior. What two requirements must this behavioral change.
Current Theoretical Approaches and Issues in Classical Conditioning Psychology 3306.
PSY402 Theories of Learning Friday January 17, 2003.
Learning & Memory JEOPARDY. The Field CC Basics Important Variables Theories Grab Bag $100 $200$200 $300 $500 $400 $300 $400 $300 $400 $500 $400.
Becoming Extinct. Extinction of Conditioned behavior Extinction is a typical part of the learning process – Pavlovian or Instrumental contingency can.
Pavlov’s original experiment is an example of Excitatory classical conditioning. Common Pavlovian Excitatory Procedures – Dog salivates to a (CS)tone ;
What determines the nature of the CR? When a neutral CS is paired with a US what determines the specific characteristics of the CR? Look at why particular.
Memory Mechanisms One. Spatial Memory The ability to remember the position or location of objects and places. – important in foraging for food in the.
Learning Factors in Stimulus Control. Learning Factors Why does stimulus generalization occur? – CS transfers to other stimuli with similar physical properties.
Rescorla-Wagner Model  US-processing model  Can account for some Pavlovian Conditioning phenomena: acquisition blocking unblocking with an upshift conditioned.
What makes effective Conditioned and Unconditioned Stimuli? Classical conditioning procedures do not always result in learning Just pairing two stimuli.
Stimulus Control of Behavior
More Extinction.
Concepts of Habituation and Sensitization
Consequences for Avoiding Bad Things
Theories of Classical Conditioning
PSY402 Theories of Learning
Context Cues and Conditional Relations
Response-Reinforcer Relation
Schedules and more Schedules
Mechanisms of Extinction
Choice Behavior One.
Conditional learning Charlotte Bonardi
Choice Behavior Two.
PSY 402 Theories of Learning
CLASSICAL CONDITIONING
Theories of Classical Conditioning
Classical Conditioning and prediction
Comparative Models of Classical Conditioning
Pavlovian Conditioning: Mechanisms and Theories
PSY402 Theories of Learning
An Introduction to Correlational Research
PSY402 Theories of Learning
Volume 80, Issue 2, Pages (October 2013)
James M. Jeanne, Tatyana O. Sharpee, Timothy Q. Gentner  Neuron 
PSY402 Theories of Learning
Making Use of Associations Tests
Introduction to Regression
Theories of Classical Conditioning
Presentation transcript:

The Rescorla-Wagner Model Associative model of conditioning You are not responsible for the math model (4.1) Concept of surprise in a mathematical model Surprise increases associative strength This is the typical learning curve With repeated experience surprise goes down With repeated experience growth of associative strength slows down see Figure 4.17

This figure will not be covered on the exam The Principles of Learning and Behavior, 7e by Michael Domjan Copyright © 2015 Wadsworth Publishing, a division of Cengage Learning. All rights reserved.

Evaluation of the Rescorla-Wagner Model Effective in explaining the blocking effect Able to predict Overexpectation of a US effect Not adequate to explain negative conditioning

The Blocking Effect Kamin (1968) demonstrates that just temporal contiguity is not sufficient for learning Procedure see Figure 4.15 Phase 1: Pair CSa (tone) with US (footshock) Phase 2: Pair CSa (tone) and CSb (light) with US (footshock) Phase 3: Test CSa (tone) only and CSb (light) only Conditioning to tone is strong, but conditioning to light is weak Tone blocked the acquisition of an association between light and the footshock Kamin – US has to be surprising to be effective – the US was not surprising because it was well predicted by the tone Interesting example using geometric cues see figure 4.16

tone shock tone + light Figure 4.15 – Diagram of the blocking procedure. The Principles of Learning and Behavior, 7e by Michael Domjan Copyright © 2015 Wadsworth Publishing, a division of Cengage Learning. All rights reserved.

FIGURE 4.16 Blocking in human learning about geometric cues. Human participants had to move a cursor to the correct geometric location (indicated by + in each triangle) on conditioning trials in Phase 1 (for the blocking group) and Phase 2 (for all groups). Percent correct during the test trials is indicated in the third column (based on Prados, 2011). The Principles of Learning and Behavior, 7e by Michael Domjan Copyright © 2015 Wadsworth Publishing, a division of Cengage Learning. All rights reserved.

Evaluation of the Rescorla-Wagner Model Novel Prediction: Overexpectation of a US Overexpectation of a US results in the loss of associative value despite pairings with US Phase 1:    CSa -> US, and CSb -> US Each independently perfectly predicts the US Phase 2:    CSa + CSb -> US Summation of associative strength is greater than the US can support Both CSa and CSb will loose associative strength until the sum of their associative strengths is equal See Figure 4.18

Figure 4.18 – Diagram of the overexpectation experiment The Principles of Learning and Behavior, 7e by Michael Domjan Copyright © 2015 Wadsworth Publishing, a division of Cengage Learning. All rights reserved.

Evaluation of the Rescorla-Wagner Model Conditioned Inhibition: see figure 4.19 CS+ --- US; and CS+/CS- --- no US Initial overexpectation of the US on CS+/CS- trials Associative value of CS+/CS- must sum to zero to accurately predict the absence of the US This can be accomplished by making the associative value of the CS- negative. Extinction of conditioned inhibition does not occur as predicted Because extinction is not simply the reverse of acquisition Can not produce negative associative conditioning

The Principles of Learning and Behavior, 7e by Michael Domjan Copyright © 2015 Wadsworth Publishing, a division of Cengage Learning. All rights reserved.

Attentional Models of Conditioning Pearce-Hall (1980) CS-processing model Pay attention to a CS that could become predictors of US Pay attention to the CS when US is surprising With experience the CS is a good predictor of US If the US was predicted, then attention to the CS declines If the US was not predicted, then attention to the CS increases

Timing and Information Theory Models Temporal coding Hypothesis In addition to forming a CS-US association Learn the temporal CS – US pattern and US - US pattern For example timing of conditioned eyeblink see fig 3.9 Sexual condition where CS-US interval influences conditioned see fig 4.9 Can also learn the inter trial interval (ITI) which indicates frequency of US Relative waiting time hypothesis Knowledge of both CS-US interval and US-US interval predicts the ratio of the ISI to ITI ISI also called trial duration or just “T “ how long you wait for US during CS ITI : is shortened to just “I” how long you wait from US to US ITI / ISI is the I/T ratio I/T ratio Low ratios provide less information about timing of CS-US High ratios provide good predictions of the CS-US relationship See figure 4.21

FIGURE 4.21 T is CS – US interval I = 120 sec T = 20 sec I = 60 sec Percentage of time rats spent nosing the food cup during an auditory CS in conditioning with either a 10-second or a 20-second trial duration (T) and various intertrial intervals (I) that created I/T ratios ranging from 1.5 to 48.0. Data are shown in relation to responding during baseline periods when the CS was absent. (Based on “Trial and Intertribal Durations in Appetitive Conditioning in Rats,” by P. C. Holland, 2000, Animal Learning & Behavior, Vol. 28, Figure 2, p. 125.) T is CS – US interval I = 120 sec T = 20 sec I = 60 sec T = 10 sec I is US – US interval The Principles of Learning and Behavior, 7e by Michael Domjan Copyright © 2015 Wadsworth Publishing, a division of Cengage Learning. All rights reserved.