Operant Conditioning

Shaping shaping = successive approximations toward a goal a process whereby reinforcements are given for behavior directed toward a goal reinforcement is given for approximations toward a desired goal

Types of Shaping 1) topographical shaping the individual or organism did not engage in the behavior previously, but then is reinforced for successive approximations toward a goal

Types of Shaping 2) quantitative shaping: here reinforcement is dependent on either increasing or decreasing the quantity of some behavior an adjusting schedule of reinforcement a new response is not learned the individual already is engaging in the behavior and you either want to increase or decrease it via shaping

Making Shaping Effective 1) Define the goal 2) Determine a starting point 3) Pick a reinforcer 4) Determine the steps

Dissociative Identity Disorder What is DID? - replace MPD two or more distinct identities at least two of these personalities take control of behavior unable to recall important information not due to medical or substance

Dissociative Identity Disorder some alters are aware of others, some are not the host is the primary identity (the person) the alters can be the exact opposite of the host e.g., host = passive, alters = aggressive handwriting and drawing is different

Dissociative Identity recognized since 1800s Benjamin Rush described DID Included in DSM-III for first time, set stage for clinical research

Explanations for DID? True disorder Another disorder Possession Iatrogenically induced disorder

Shaping and DID Condition 1 (C1) Increased attention (e.g., media, research) to DID. Condition 2 (C2) Therapist strongly believes in the existence of DID. Therapist is fascinated by the dissociative experience. Condition 3 (C3) Patient is psychologically fragile. Patient believes the therapist is competent. Patient is highly suggestible and or personality disordered. DID symptoms = C1 * C2 * C3

Schedules of reinforcement 1. Continuous (CRF) good to start with when shaping behavior 2. Non continuous (intermittent, partial) is one in which only some responses are reinforced four basic types

Intermittent Reinforcement 1. Fixed Ratio (FR): reinforcement delivered after fixed number of correct responses. e.g., FR 3 = 3 responses to get reinforcer period of steady, rapid rate of responding until reinforcement, then a brief pause before starting again low resistance to extinction

Post reinforcement pause (PRP) PRP longer with lean reinforcement (i.e., FR 100 v FR 3) Ratio strain = too much responding required, behavior stops.

Fixed Ratio

Intermittent Reinforcement 2. Fixed Interval: Reinforcement for next correct response after a fixed amount of time since last reinforcement. initially, a slow rate of responding, gradually increasing to rapid responding pause after reinforcement low resistance to extinction

Fixed Interval

Intermittent Reinforcement 3. Variable Ratio: reinforcement after varying number of correct responses moderate levels of responding with little or no pause. high resistance to extinction

Variable Ratio

Abusive Relationships interaction “good behavior”lots of positive reinforcement victim victimizer interaction Lots of good behavior Little positive reinforcement victim victimizer Later… Initially… stretching the ratio

Intermittent Reinforcement 4. Variable Interval: reinforcement after varying time since the last reinforcement. moderate levels of responding with little or no pause high resistance to extinction

Variable Interval

Mixed Schedules Fixed Duration (FD) The behavior must be performed continuously for a fixed predictable amount of time. Variable Duration (VD) The behavior must be performed continuously for a varying, unpredictable amount of time.

DRL Differential Reinforcement of Low Rate Behaviour Reinforcement is delivered after individual behaves undesirably to a lower rate than their normal rate for that behaviour

DRL Example

DRH Differential Reinforcement of High Rate of Behaviour Reinforcement for responding above a specified level.

DRH Examples

DRP Differential Reinforcement of Paced Responding Reinforced for an amount below and above a certain range.

DRP Example

Intermittent Reinforcement Can you come up with examples of each type of intermittent reinforcement (FR, VR, FI, VI) DRP, DRL, and DRH? Get together in groups and come up with some examples.

DRO Differential Reinforcement of Zero Behavior Delivery of a reinforcer for not engaging in a specific behavior for a period of time.

DRO Application Define behavior to be changed. Count frequency of behaviors in specified time frame. The average is the interval for reinforcement. If there are no behaviors during the period, reinforce. If there are behaviors during the period, start the timer again.

DRO Example Temper Tantrums

DRI Differential Reinforcement of Incompatible Behaviour An undesirable behaviour is weakened, while a desirable behaviour is reinforced

DRI Example

Extinction 1) B  C 2) B  nothing Result: decrease in B

Extinction B (tantrum)  C (being picked up/ attention) Problem: Positive reinforcement for the child: to continue having tantrums. Negative reinforcement for the parent: pick up child: avoid tantrum Called a Reinforcement Trap

Types of Extinction 1. Social: B  C (social reinforcement) e.g: telling jokes  no reinforcement = no telling jokes 2. Non Social: B  C (non social reinforcement) e.g: looking at broken watch  no time info. = stop looking at broken watch.

Side Effects of Extinction 1. increase in variability 2. emotional behavior – frustration 3. aggression 4. resurgence 5. depression

A practical example of an extinction burst. 6. Behaviour that is being extinguished will get worse (extinction burst) before it gets better

Resistance to Extinction 1. Schedule of reinforcement Continuous versus intermittent 2. History of reinforcement More reinforcement over time, the harder to extinguish behavior 3. Magnitude of reinforcer Larger hard to extinguish

Resistance to Extinction 4. Degree of Deprivation More deprived, greater resistance to extinction 5. Previous experience With experience, extinction is quicker