CHAPTER 4 Pavlovian Conditioning: Causal Factors.

Slides:



Advertisements
Similar presentations
Classical Conditioning II
Advertisements

Facebook Group: The group is called: Psych281 Spring08 Available only to University of Alberta network Sorry to be rude but… Please don’t add me as a friend.
PSY 402 Theories of Learning Chapter 4 – Theories of Conditioning.
The basic design: CS > US > UR bell food salivation \ | ----> CR: salivation important variables: –CS = conditioned stimulus: arbitrary.
Lectures 5&6: Pavlovian Conditioning (Basic Concepts & Generality)
Theories of Classical Conditioning
Factors Influencing Respondent & Operant Learning: Part 2 Lesson 10.
Chapter 3: Pavlovian Conditioning: Foundations Pavlovian Conditioning or Classical Conditioning Ivan Pavlov –Early 1900s –A Russian physiologist digestive.
Classical Conditioning Pavlov’s experiment - psychic secretions. Pavlov was a Russian physiologists who studied digestion. He won the Nobel prize in physiology.
Conditioned Inhibition
Chapter 3: Pavlovian Conditioning: Foundations
Neurobiology of Learning and Memory Prof. Stephan Anagnostaras Lecture 2: Learning Theory.
Inhibitory Pavlovian Conditioning Stimuli can become conditioned to signal the absence of a US— such learning is called Inhibitory Conditioning CS+ = excitatory.
Lecture 20: Extinction (Pavlovian & Instrumental) Learning, Psychology 5310 Spring, 2015 Professor Delamater.
Factors Influencing Conditioning Intensity Attention Contiguity (aka “when”) Relevance Surprise Contingency (aka “whether”) Next.
Lecture 18&19: Stimulus Control (Pavlovian & Instrumental) Learning, Psychology 5310 Spring, 2015 Professor Delamater.
Lecture 21: Avoidance Learning & Punishment Learning, Psychology 5310 Spring, 2015 Professor Delamater.
Lectures 7&8: Pavlovian Conditioning (Determining Conditions) Learning, Psychology 5310 Spring, 2015 Professor Delamater.
PSY402 Theories of Learning
Time, Rate and Conditioning or “A model with no free parameters that explains everything in behaviour” C.R. Gallistel John Gibbon Psych. Review 2000, 107(2):
PSY 402 Theories of Learning
Rescorla's Correlation *Experiments * Note that Rescorla referred to his experiments as contingency experiments, however since a true contingency (cause-effect.
PSY 402 Theories of Learning Chapter 4 – Theories of Conditioning.
Contingency Theory of Classical Conditioning
PSY 402 Theories of Learning Chapter 4 – Theories of Conditioning.
Learning What is Learning? –Relatively permanent change in behavior that results from experience (behaviorist tradition) –Can there be learning that does.
PSY402 Theories of Learning Chapter 4 (Cont.) Indirect Conditioning Applications of Conditioning.
Negative Reinforcement
PSY 402 Theories of Learning Chapter 3 – Nuts and Bolts of Conditioning (Mechanisms of Classical Conditioning)
Innate Knowledge (what an organism is born with) Experience leads to changes in knowledge and behavior Learning refers to the process of adaptation Of.
Principles of Behavior Change Classical Conditioning.
Chapter 4 Classical Conditioning: Mechanisms
Stimulus Control of Operant Behavior Discrimination Generalization Generalization Gradients Peak Shift Concepts Overview of stimulus control of operant.
Theoretical Analysis of Classical Conditioning Thomas G. Bowers, Ph.D. Penn State Harrisburg.
Chapter 10 Aversive Control: Avoidance and Punishment.
Lectures 12 & 13: Pavlovian Conditioning (Learning-Performance) Learning, Psychology 5310 Spring, 2015 Professor Delamater.
4 th Edition Copyright 2004 Prentice Hall5-1 Learning Chapter 5.
Classical Conditioning
Conditioned Inhibition CS B CS C clicks Conditioned inhibition is an internal state that prevents an organism from making some response, like salivation.
Learning. A. Introduction to learning 1. Why do psychologists care about learning? 2. What is and isn’t learning? IS: A relatively permanent change in.
Psychology 2250 Last Class Characteristics of Habituation and Sensitization -time course -stimulus-specificity -effects of strong extraneous stimuli (dishabituation)
Innate Behavior Patterns Reflex Tropism –kinesis (undirected) –taxis (directed) Fixed Action Pattern –species-specific; unlearned; goes to completion Reaction.
Classical Conditioning Underlying Processes and Practical Application.
Learning Experiments and Concepts.  What is learning?
Pavlovian Conditioning Basic Principles Thomas G. Bowers, Ph.D. Penn State Harrisburg.
SKINNER’S “THEORY” OF INSTRUMENTAL CONDITIONING
Innate Knowledge (what an organism is born with) Experience leads to changes in knowledge and behavior Learning refers to the process of adaptation Of.
Factors Influencing Conditioning  CS and US Intensity, and Attention to the CS  Temporal relationship  Predictiveness  Preparedness  Redundancy 1.
Extinction of Conditioned Behavior Effects of Extinction  the rate of responding decreases  response variability increases  experiment by Neuringer,
Blocking The phenomenon of blocking tells us that what happens to one CS depends not only on its relationship to the US but also on the strength of other.
Operant Conditioning – Chapter 9 Theories of Learning October 19, 2005 Class #25.
Thought Process: Watson and Skinner thought learning was from environment. Cognitive theorist interpreted learning as a thinking process.
Unit 1 Review 1. To say that learning has taken place, we must observe a change in a subject’s behavior. What two requirements must this behavioral change.
PSY402 Theories of Learning Friday January 17, 2003.
Extinction of Conditioned Behavior Chapter 9 Effects of Extinction Extinction and Original Learning What is learned during Extinction.
Chapter 7 The Associative Structure of Instrumental Conditioning.
Principles of Learning
Basic Learning Processes Robert C. Kennedy, PhD University of Central Florida
PSY 402 Theories of Learning Chapter 3 – Nuts and Bolts of Conditioning (Mechanisms of Classical Conditioning)
Rescorla-Wagner Model  US-processing model  Can account for some Pavlovian Conditioning phenomena: acquisition blocking unblocking with an upshift conditioned.
PSY402 Theories of Learning
PSY 402 Theories of Learning
Classical Conditioning and prediction
PSY402 Theories of Learning
PSY402 Theories of Learning
PSY 402 Theories of Learning
PSY402 Theories of Learning
PSY402 Theories of Learning
Presentation transcript:

CHAPTER 4 Pavlovian Conditioning: Causal Factors

NECESSARY CONDITIONS FOR PAVLOVIAN CONDITIONING Contiguity –For Pavlov, conditioning involved simple, mechanical associations between events that occurred closely together in time. –Contiguity between CS and US automatically stamped in a connection between them.

NECESSARY CONDITIONS FOR PAVLOVIAN CONDITIONING Contingency –But, in 1967, Robert Rescorla suggested that although contiguity between CS and US might be necessary for conditioning to occur, it might not be sufficient. –What might also be necessary is that there be a differential contingency between CS and US. –Only then would CS convey information about occurrence of US.

NECESSARY CONDITIONS FOR PAVLOVIAN CONDITIONING It now appears that information is critical for Pavlovian conditioning. –Does CS provide reliable information as to whether US is forthcoming? –Just when is US likely to occur? –Such information appears to be taken into account in production of CRs.

Information and Conditional Probability Imagine two hats: one large, one small. Imagine 10 red balls and 10 green balls in large hat. Imagine 10 blue balls and 10 yellow balls in small hat.

Information and Conditional Probability Without knowing hat size, what is P of picking a red ball from either hat? 10/40 =.25. If hat is large, then what is P of picking a red ball? 10/20 =.50. If hat is small, then what is P of picking a red ball? 0/20 =.00. Clearly, P of picking a red ball depends on hat size. We thus say that P of picking a red ball is conditional on hat size.

Information and Conditional Probability This analysis suggests that hat size conveys information about ball color. Information may be critical for conditioning. If CS provides information about occurrence and timing of US, then organisms should attend to and learn about it. Such learning might involve: –Positive relations or contingencies –Negative relations or contingencies –Random relations--no contingency whatsoever

Information and Conditional Probability Positive Relation –P(US|CS) > P(US|No CS): Excitation Negative Relation –P(US|CS) < P(US|No CS): Inhibition Random Relation –P(US|CS) = P(US|No CS): Learned irrelevance or learned helplessness

Information and Conditional Probability Experimental evidence is consistent with informational theory. Yet, informational theory is incomplete without considering role of time in conditioning: –CS-US Interval (ISI) –Intertrial Interval (ITI) –ISI/ITI Ratio

Informativeness, Redundancy, and Blocking Organisms may not only be sensitive to whether a CS predicts a US, but whether it better predicts the US than other CSs. In other words, conditioning may involve the selective association of a US with the most predictive CS. If two or more CSs predict the US, then each is said to be redundant.

Selective Associations Two prime examples of selective associations: –Overshadowing –Blocking

Overshadowing If a CS is a compound of two stimuli and one is more salient or noticeable than the other, then nearly all of the conditioning occurs to the more salient stimulus--overshadowing. The less salient one may be completely overshadowed, even though it alone could have been an effective CS.

Overshadowing Training Test Strong Test Weak Group SW SW+High RespLow Resp Group S S+High Resp -- Group W W+ --Med Resp

Blocking An overshadowing effect can occur even if both stimuli are quite salient. This kind of overshadowing results from organism’s past experience with stimuli. It further shows selective association based on informativeness of stimuli.

Blocking Phase 1 Phase 2 Test X Group B A+ AX+ Low Resp Group C -- AX+High Resp

PREDICTIVENESS, FEAR, AND ANXIETY One hallmark of a successful science is that it yields a technology that can be used to improve human life. In Pavlovian conditioning, attempts have been made to use Pavlovian principles to explain emotional disorders. Those attempts have relied on importance of predictiveness to Pavlovian conditioning. One case is fear versus anxiety.

Fear Versus Anxiety Fear is said to be objective: focused on particular objects or situations. Anxiety is said to be subjective: unfocused or diffuse. Anxiety is thought to be main component of many types of psychopathology. People with anxiety disorders are emotionally paralyzed and unable to identify source of paralysis. They become withdrawn, unable to act, and miserable.

Fear Versus Anxiety There is much evidence for conditioned fear. –Using shocks as USs and tones or lights as CSs reliably produces fear to light or tone. Evidence for conditioned anxiety comes from randomly presenting CSs and USs. –This procedure does not produce conditioned fear to tone. –Rats behave no differently in presence of tone than in its absence. –Rats suppress lever pressing at all times. –They also huddle, seemingly frozen with terror.

Fear Versus Anxiety These rats develop stomach ulcers. These ulcers are not produced by shock itself, but by its unpredictability. Animals exposed to tone-shock pairings do not develop ulcers. Key here is that predictable shock means there is a safety signal (no CS). There is no safety signal with unpredictable shock.

PAVLOVIAN CONDITIONING AND INHIBITION Through pairing of CS and US, CS comes to excite a CR. But, what happens if--after excitatory conditioning--subject receives presentations of CS without US? Answer: Extinction and (perhaps) Pavlovian conditioned inhibition.

PAVLOVIAN CONDITIONING AND INHIBITION What is inhibition? Active suppression of behavior that would occur under other circumstances. External inhibition is unconditioned. Internal inhibition is conditioned.

PAVLOVIAN CONDITIONING AND INHIBITION Study of conditioned inhibition poses special methodological problems. A sign of conditioned excitation is presence of a response that did not occur before conditioning. But, a sign of conditioned inhibition is absence of a response that might otherwise occur. Mere absence of that response does not guarantee that conditioned inhibition is present. Response could be absent for many other reasons--most obviously lack of excitation.

PAVLOVIAN CONDITIONING AND INHIBITION Methods to observe inhibition: –Disinhibition –Summation –Resistance to reinforcement –Retardation –Approach-withdrawal

Disinhibition According to Pavlov, presentation of a novel stimulus will inhibit inhibition. Suppose that salivation to CS has been extinguished and that extinction produces inhibition. CS is presented and dog does not salivate. If novel stimulus is given with CS, then dog will resume salivating.

Summation Phase 1Phase 2Testing Control Group Light Alone Tone  Food T (High) T+L (High) Inhibition Group Light and Food Unpaired Tone  Food T (High) T+L (Low)

Resistance to Reinforcement Phase 1Phase 2 Control Group Light Alone T+L  Food (Fast learning) Inhibition Group Light and Food Unpaired T+L  Food (Slow learning)

Retardation Phase 1Phase 2 Control Group Light Alone L  Food (Fast learning) Inhibition Group Light and Food Unpaired L  Food (Slow learning)

Approach-Withdrawal CS+  Food CS-  No Food Animals approach CS+ Animals avoid CS-

CONDITIONS PRODUCING INHIBITION Extinction Conditioned Inhibition Training Negative Contingency Training Inhibition of Delay Discrimination and Generalization –Excitatory and inhibitory gradients Backward Conditioning

NECESSARY CONDITIONS FOR INHIBITION Inhibitory stimulus must signal absence of otherwise expected US. It is not sufficient to present a cue in absence of a US for inhibition to develop. In fact, nonreinforced pre-exposure of CS retards its ability to become a conditioned excitatory stimulus and it reduces its ability to become a conditioned inhibitor--latent inhibition of excitation and inhibition.

Pavlovian Conditioning: Causal Factors Contiguity and contingency play strong roles in Pavlovian conditioning. Stimuli seem to compete with one another for control of Pavlovian CRs. Excitation and inhibition both seem to regulate Pavlovian CRs. Explanations of Pavlovian conditioning must take these findings into account.