1. Psych 301 Exam Lecture 5 – Chapter 4

2. Learning Spanish in High School… Did you use flashcards? …learning the La Calavera means skull Let's say it took 10 trials to learn this association When did the bulk of the learning actually take place? In the first or last trials? In the middle?

3. Most of the associative learning occurs during the first few trials During the last trials, very little is added to the strength of the association Rescorla/Wagner Model attempted to explain the growth of association mathematically with the equation

4. What is a model?..should be able to: Explain behavior & also Predict it! Rescorla-Wagner Model Extinction Simple mathematical account of how associative strength – conditioning builds up over the course of a learning experiment  learning curve blocking conditioning

5. During Conditioning – CS/UCS Learning Curves

6. Rescorla-Wagner Model Mathematical Equation V n = c (V max – V n ) = Delta (change) V = Strength of Association n = trial c = constant (speed of conditioning - 0-1) Vmax = asymptote (no more trials- max strength of association) V n = the strength of association at the beginning of the trial Predicts the precise associative strength in each trial

7. V n = c(V max – V n ) V = Strength of Association n = trial c = constant (speed of conditioning – 0-1) Vmax = asymptote (no more trials- max learning) V n = the strength of association at the beginning of the trial Amount of conditioning for 1 st trial Add

9. V n = c(V max – V n ) V = Strength of Association n = trial C = constant (maximal performance) Vmax = asymptote (best learning – if a CS with UCS is paired) V n = the strength of association at the beginning the trial Can also account for extinction 5 ?? V 5 = 0.30 (0-0.76) = -0.21 …no more pairing of UCS with CS

10. First Conditioning Trial Trial c (V max - V n ) = ∆V n 1.5 (100 - 0) = 50 VnVn

11. Second Conditioning Trial Trial c (V max - V n ) = ∆V n 2.5 (100 - 50) = 25 VnVn

12. Third Conditioning Trial Trial c (V max - V n ) = ∆V n 3.5 (100 - 75) = 12.5 VnVn

13. 4th Conditioning Trial Trial c (V max - V n ) = ∆V n 4.5 (100 – 87.5) = 6.25 VnVn

14. 5th Conditioning Trial Trial c (V max - V n ) = ∆V n 5.5 (100 - 93.75) = 3.125 VnVn

15. 6th Conditioning Trial Trial c (V max - V n ) = ∆V n 6.5 (100 - 96.88) = 1.56 VnVn

16. 1st Extinction Trial Trial c (V max - V n ) = ∆V n 1.5 (0 - 99.61) = -49.8 99.61 – 49.8 = 49.8 VnVn VnVn

17. 2nd Extinction Trial Trial c (V max - V n ) = ∆V n 2.5 (0 - 49.8) = -24.9 VnVn VnVn

18. Importance of Model Only mathematical model of behavior Best Theory of Classical Conditioning Early trials more “learning occurs” Kamin (1969)… The amount of conditioning on any trial is determined not only by the UCS (shock) but also the expectation that the CS will occur…no surprise less learning (Kamin)…expect a shock…no learning PS: this model only works when the CS precedes the UCS It does not work so well for the backward sequencing of stimuli

19. S ------ S Classical Conditioning Association between CS & UCS UCS CSUCR Why not this instead? UCS CSUCR

20. Test the hypothesis that the association is between CS & UCS vs CS & UCR UCS CSUCR Try and affect association between CS & UCS then measure conditioning Post Conditioning Devaluation: alter value of UCS after conditioning tone food

21. Test the hypothesis that the association is between CS & UCS vs CS & UCR UCS CSUCR Holland & Straub (1979) 1. Noise + Food  activity (CS) (UCS) (UCR) Noise  activity 2. Post Cond. Devaluation Food + Rotation 3. Noise  ??…. noise food Activity PCD No Activity Significant decrease in movement!

22. Pavlov: CS becomes the UCS  Stimulus Substitution “Substitution Theory”

23. Jenkins & Moore (1973) Pigeons & autoshaping (Key LT + food) food: open beak/closed eyes H20: closed beak/eyes open Key Light + Food Key Light + Water Just Key Light (water) …”drink key light” Just Key Light (Food) … eat the Key Light”

24. S ------ S Classical Conditioning Operant Conditioning (instrumental learning) S ------ R Association between CS & UCS Direct link between CS & Response types of associative learning

25. Operant Conditioning vs Classical Conditioning In Classical Conditioning, the dog’s response has no consequences; it produces no change in the environment. The dog gets the food after the bell is rung whether or not he salivates to the bell. His behavior …response doesn’t matter. In Operant Conditioning, the dog has to pull the latch to get the food. His behavior does matter.

26. Operant Conditioning The nature of behavior is determined by its consequences whether positive or negative So, in CC the reinforcer is paired with a stimulus Learning occurs through reinforcements S--------R + So, in OC the reinforcer is contingent of the response =

27. Classical Conditioning: A theory that attempts to explain how organisms develop involuntary responses to particular stimuli in the environment B.F.Skinner: (respondent behavior  elicited by a known stimulus  UCS) Operant Conditioning: A theory that explains how people develop voluntary behavior B.F.Skinner: (operant behavior  not elicited by a stimulus)

28. Edward Lee Thorndike ( 1874-1949) VH1 “Behind the Science” -born Willamsburg, MA - mental telepathy in children - studied at Harvard (James) - hatched chicks in bedroom then James’ basement - Ph. D. Colombia University “Animal Intelligence” - Cats - ”Puzzle Box” - The Law of Effect - First experimental study of rewards -1912 Prez of APA Do animals posses intelligence? 507 pubs Applied animal to human education Intelligence tests

29. Romanes: Animal learn just like we do…. Naturalistic Observation - Anecdotal Evidence Thorndike did not buy this!..just coincidence “ How long would it take an animal to discover how to get out of a box?” Would this time decrease with exposure to task? Large box (crate) Place hungry cat in Placed food just outside box Cat could see out Could get out by pulling string attached to latch Anthropomorphizing

30. Some of Thorndike’s actual cat puzzle boxes

31. Puzzle Box - Scramble -Claw & bite -Stumble on string -Latency shorter -2 nd trial… again scramble…

33. Thorndikes Conclusions 1.Behavior is highly variable 2. Course of learning is erratic 3. Gradual improvement over trials 4. No suggestions of “sudden insight” 5. No suggestion of any “mental process” 6. Not a rational understanding but an association with the escape with the food reward

34. theory of connectionism: Through experience neural bonds (connections) are formed between stimuli & responses Intellect facilitated neural bonds higher intellect = forms more bonds lower intellect = forms less bonds Thorndike Genetic Content of intellect (f) experience

35. Law of Effect (1911) The presentation of a reward strengthens the connection between the response that precedes it and the stimuli presented at the time Behavior that produces satisfying consequences will be repeated, and behavior that produces dissatisfying consequences will not be repeated

38. Burrhus Fredric Skinner (1904-1990) - BA in English -Wanted to be a writer -Master’s In Psych – 1930 -Ph.D – 1931 – Harvard -Dept. Chair, Indiana 1945 -Harvard, 1948 -Father of Operant Conditioning -Radical Behaviorism Skinner strongly championed Thorndikes Law of Effect Invented a number of devices for studying OC (“operating on the environment”)– Skinner Box, Teaching Machine VH1 “Behind the Science”

39. Radical Behavorism: Not a science but a philosophy… Did not rule out mentation, introspection, self-knowledge “…things that take place in the private world of the skin…” are observable…but cannot infer causes of behavior “The organism becomes a person [i.e., a unique individual] as it acquires a repertoire of behavior under the contingencies of reinforcement to which it is exposed in its lifetime. The behavior it exhibits at any moment is under the control of a current setting. It is able to acquire such a repertoire because of processes of conditioning, to which it is susceptible because of its genetic endowment. “ (Skinner, 1974)