Neurosciences John Evenden Varieties of Impulsivity: Evidence from Animal Studies John Evenden Dept of Neurosciences AstraZeneca R & D Wilmington Wilmington,

Slides:



Advertisements
Similar presentations
ATP: PAID, Lecture 8: Imposing personalities Tom Farsides (SOC) Imposing personalities.
Advertisements

Chapter 4 Using Reinforcement to Increase Operant Behavior
Operant Conditioning Skinner, positive & negative reinforcement, response cost, punishment and schedules of reinforcement.
Operant & Cognitive Approaches
January 26 th, 2010 Psychology 485.  History & Introduction  Three major questions: What is learned? Why learn? How does learning happen?
Steven I. Dworkin, Ph.D. 1 Choice and Matching Chapter 10.
Instrumental Conditioning Also called Operant Conditioning.
Overview of Conditioning. Need to Examine Behavior Look at the behavior of an organism’s interaction with its environment Displacements in space through.
Learning Unit 5. Topics in Learning Unit Defining Learning Classical Conditioning Operant Conditioning Cognitive Learning.
Operant Conditioning B.F. Skinner began his research with the principle that rewarded behavior is likely to occur again. Operant Conditioning is a form.
More Instrumental (Operant) Conditioning. B.F. Skinner Coined the term ‘Operant conditioning’ Coined the term ‘Operant conditioning’ The animal operates.
Copyright © 2005 Pearson Education Canada Inc. Learning Chapter 5.
OPERANT CONDITIONING DEF: a form of learning in which responses come to be controlled by their consequences.
Learning the Consequences of Behavior
Chapter 10 Aversive Control: Avoidance and Punishment.
Operant Conditioning Unit 4 - AoS 2 - Learning. Trial and Error Learning An organism’s attempts to learn or solve a problem by trying alternative possibilities.
Ninth Edition 5 Burrhus Frederic Skinner.
EXPLORING PSYCHOLOGY EIGHTH EDITION IN MODULES David Myers PowerPoint Slides Aneeq Ahmad Henderson State University Worth Publishers, © 2011.
Chapter 5: Learning Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.
© 2013 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution in any manner.
Operant Conditioning Unit 4 - AoS 2 - Learning. Trial and Error Learning An organism’s attempts to learn or solve a problem by trying alternative possibilities.
OPERANT CONDITIONING.  Many of the behaviours in animals and humans cannot be explained in terms of classical conditioning.  Many complex behaviours.
© 2013 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution in any manner.
Learning. This is happening when you respond to a second stimulus that is similar to a conditioned stimulus without additional training Generalization.
CHAPTER 4 Pavlovian Conditioning: Causal Factors.
Chapter 6 Learning.
Chapter 6 Introduction to Operant Conditioning.  What is it?  How does it differ from Classical Conditioning?  Major concepts –Operant Behaviors –
Motivation Motivation: The desire to exert effort to perform a particular task. Motivation: The desire to exert effort to perform a particular task. Some.
PSY402 Theories of Learning Chapter 6 – Appetitive Conditioning.
Copyright McGraw-Hill, Inc Chapter 5 Learning.
Learning Experiments and Concepts.  What is learning?
Assignment #2 Deadline changed to JUNE 4 th Will mostly focus on Ch 7 Talk about that after the midterm on Monday Topics will be announced on Monday.
OPERANT CONDITIONING. Learning in which a certain action is reinforced or punished, resulting in corresponding increases or decreases in behavior.
Operant Conditioning A learning process by which the likelihood of a particular behaviour occurring is determined by the consequences of that behaviour.
Operant Conditioning. Operant Conditioning – A form of learning in which voluntary responses come to be controlled by their consequences. What does this.
Module 10 Operant & Cognitive Approaches. Thorndike’s Law of Effect l Behaviors followed by positive consequences are strengthened while behaviors followed.
Operant conditioning (Skinner – 1938, 1956)
SKINNER'S OPERANT ANALYSIS
Module 10 Operant & Cognitive Approaches. OPERANT CONDITIONING Operant conditioning –Also called _________________________________ –Kind of learning in.
Module 10 Operant & Cognitive Approaches. OPERANT CONDITIONING Operant Conditioning –also called instrumental conditioning –kind of learning in which.
© 2013 by McGraw-Hill Education. This is proprietary material solely for authorized instructor use. Not authorized for sale or distribution in any manner.
Chapter 6 Learning and Behavior Learning n A more or less permanent change in behavior that results from experience.
Operant Conditioning: Skinner’s Radical Behaviorism.
Steven I. Dworkin, Ph.D. 1 Basic Principles of Operant Conditioning Chapter 6.
William G. Huitt Educational Psychology Interactive William G. Huitt Educational Psychology Interactive Last rev: June 2012.
Instrumental Conditioning II. Delay of Reinforcement Start DelayChoice Correct Incorrect Grice (1948) Goal Reward or No Reward.
Operant Conditioning. Learning when an animal or human performs a behavior, and the following consequence increases or decreases the chance that the behavior.
PSY402 Theories of Learning Chapter 4 – Appetitive Conditioning.
Unit 1 Review 1. To say that learning has taken place, we must observe a change in a subject’s behavior. What two requirements must this behavioral change.
PSY402 Theories of Learning
Kick Off Choose a partner. Designate one person as the experimenter and one as the subject. Each person take (1) a Soar Card and (2) a black spot of death.
Principles of Learning
Operant conditioning Learning by consequences. Ratatouille Ratatouille is hungry and performs various exploratory behaviours By chance he presses the.
CONDITIONING CLASSICAL AND OPERANT CONDITIONING BSN-II, RLE-II.
>>0 >>1 >> 2 >> 3 >> 4 >> CONDITIONING CLASSICAL AND OPERANT CONDITIONING Renée Camille L. Laguda, BSN III.
Schedules of Reinforcement
Chapter 6 LEARNING. Learning Learning – A process through which experience produces lasting change in behavior or mental processes. Behavioral Learning.
 A theoretical perspective that attempt to understand behavior by focusing on:  the external contingencies of reinforcement (any consequence of an.
Introduction to Approaches in Psychology Learning & Conditioning
Operant Conditioning A form of learning in which a specific action (an operant response) is made to occur either more frequently or less frequently by.
PSY402 Theories of Learning
Principles of Learning
Operant Conditioning Unit 4 - AoS 2 - Learning.
UNIT 4 BRAIN, BEHAVIOUR & EXPERIENCE
Operant Conditioning Preamble: Skinner believed that we both predict & control behaviour. Thus by manipulating the environment, you can manipulate behaviour.
Chapter 5 Learning.
Wallis, JD Helen Wills Neuroscience Institute UC, Berkeley
The N tional Dog Training Academy
Learning.
Introduction to Approaches in Psychology Learning & Conditioning
Presentation transcript:

Neurosciences John Evenden Varieties of Impulsivity: Evidence from Animal Studies John Evenden Dept of Neurosciences AstraZeneca R & D Wilmington Wilmington, DE, USA

Neurosciences John Evenden What’s in this talk Four Questions What is Meant by Different Varieties of Impulsivity? Do Biologically Important Factors Influence the Different Varieties of Impulsivity in Different Ways? How does “personality” (or trait impulsivity) interact with state impulsivity? Does it make a difference whether impulsive behaviour leads to loss of rewards or punishment?

Neurosciences John Evenden Question 1 What is Meant by Different Varieties of Impulsivity?

Neurosciences John Evenden

Neurosciences John Evenden Impulsive Decision Making and the 3-term Contingency StimulusUCS/Reinforcer Response What are the CONSEQUENCES of different contingencies? What do I need to know in PREPARATION to act? Classical Conditioning Instrumental Conditioning How should I EXECUTE my act to ensure predicted outcome?

Neurosciences John Evenden Three types of impulsive decision making PREPARATIONNot all relevant informationUncertain is taken into account before Discrimination making a decision EXECUTIONThe necessary behaviour is Fixed Consecutive ended before the goal is Number Test attained CONSEQUENCES A quick, but less valuable Delayed outcome is chosen rather Reinforcement Test than a later but more valuable

Neurosciences John Evenden Three tests of impulsive decision making PREPARATIONNot all relevant informationUncertain is taken into account before Discrimination making a decision EXECUTIONThe necessary behaviour is Fixed Consecutive ended before the goal is Number Test attained CONSEQUENCES A quick, but less valuable Delayed outcome is chosen rather Reinforcement Test than a later but more valuable

Neurosciences John Evenden Question 2 Do Biologically Important Factors Influence the Different Varieties of Impulsivity in Different Ways?

Neurosciences John Evenden Fixed Consecutive Number Schedule n L.L.L.R = 3 No Food n L.L.L.L.L.L.L.R = 7 No Food n L.L.L.L.L.L.L.L.R = 8 Food n L.L.L.L.L.L.L.L.L.L.R = 10 Food Count up how many times each length occurs and plot it in a histogram (distribution analysis)

Neurosciences John Evenden Paced Fixed Consecutive Number Test n Trained to press left and right lever to obtain small food pellets n After this the levers are retracted for either 2 or 5 seconds every time the rats presses n Trained press first the left lever then the right lever to get food n Trained to press the left lever several times before pressing the right lever to get food. n This way the experimenter has control over how fast the rat can press the lever and the minimum time to complete a chain of responses Lever Food

Neurosciences John Evenden Paced Fixed Consecutive Number Schedule - 8-OH-DPAT, DOI - survival plot 8-OH-DPAT reduces impulsivity, DOI increases impulsivity

Neurosciences John Evenden Uncertain Discrimination Rats are first trained that a lit lamp signals lever which gives food When they have been trained to % correct the test procedure is started in which the signal is made uncertain. First one of the levers is chosen as “correct”. Then one of the three lights is turned on at random. After 0.1 s that light is turned of, and again one of the lights is turned on at random...and so on... Each time one of the lights is chosen, the probability that it is the one over the correct lever increases by a small amount until after about 5 s it is on nearly all the time. Lamps

Neurosciences John Evenden Uncertain Discrimination - 8-OH-DPAT, DOI

Neurosciences John Evenden Impulsivity - Trait and State We usually think of impulsivity as an aspect of personality DSM personality disorders are essentially lifelong Most personality questionnaires are designed to look for the personality trait of impulsivity But Drugs change the state of the subject, not his/her underlying personality

Neurosciences John Evenden Question 3 How does “personality” (or trait impulsivity) interact with state impulsivity?

Neurosciences John Evenden State and Trait interactions Acutely administered drugs are a model of “state” Different strains of rats are models of different patterns of “traits” Question Do the drugs have the same effects in different rat strains with different levels of “trait impulsivity”?

Neurosciences John Evenden Paced Fixed Consecutive Number Schedule - amphetamine, haloperidol - AA/ANA rats

Neurosciences John Evenden Question 4 Does it make a difference whether impulsive behaviour leads to loss of rewards or threat of punishment?

Neurosciences John Evenden Motivation and impulsivity Most non-human impulsive behaviour results in loss of positive reinforcers Much human impulsive behaviour results in delivery of punishers Question Is it possible to model self control using avoidance of punishment in rats?

Neurosciences John Evenden Fixed Consecutive Number Shock Avoidance Basic schedule is two-lever paced fixed consecutive number (FCN6) Option 1: make 6 or more consecutive responses on left lever and then press right lever for delivery of one food pellet Option 2: make less than 6 consecutive responses on left lever and then press right lever for delivery of one food pellet + 0.5s footshock ( mA)

Neurosciences John Evenden Paced FCN Shock Avoidance Amphetamine increases impulsivity if the outcome is loss of reward, but reduces impulsivity is the outcome is punishment

Neurosciences John Evenden Summary Different aspects of impulsivity are differentially sensitive to the various drugs – dopaminergic drugs primarily seem to affect EXECUTION of behaviour – “traditional” serotonergic deficit may fit best with a deficit in PREPARATION Effects of the drugs don’t always fit with expectations The effects of the drugs depend (in part) on the strain of rat used. Impulsive behaviour is modulated by trait factors (genetics, “personality”), and state factors (in this case, drug treatment). These factors interact with one another. This interaction is complex and not obvious Positive reinforcement schedule and punishment schedule can maintain the same pattern of self control/impulsivity The effects of drugs can be dramatically different if self-control is brought about by negative reinforcement (loss of reward) or punishment.