Is brain-behavior behavior? zIf so, it can be conditioned just like other behaviors

Definition of Learning zLearning is an adaptive 1 permanent change 2 in behavior or behavior potential 3 that is produced as a result of prior experience 4 z1 occasionally maladaptive such as depressed mental set, obsessions z2 not due to fatigue, injury z3 includes tendencies to respond that might not have been tested z4 excludes maturation, disease, instinct

Two forms of conditioning zClassical conditioning yHard-wired linkage between stimulus and response (e.g., food and saliva) yAnything acting as signal of food can produce response zOperant conditioning yTraining linkage between stimulus and response through reinforcement ybehavior strengthened if followed by reinforcement ybehavior weakened if followed by punishment yLaw of Effect (Thorndike) Rewarded behavior is repeated

Components of conditioning zAcquisition yinitial stage of learning, during which a response is established and gradually strengthened zEffective pairing of reinforcement

Extinction ydiminishing a conditioned response yoccurs when an response is not followed by a reward

Extinction and spontaneous recovery Strength of CR Pause Acquisition (response + reward) Extinction (no reward) Extinction (no reward) Spontaneous recovery of response Weak Strong Time

Operant Conditioning zSpontaneous recovery yreappearance, after a rest period, of an extinguished conditioned response zGeneralization ytendency for stimuli similar to the conditioned stimulus to evoke similar responses zDiscrimination yIdentify specific stimulus from set of similar stimuli to evoke similar reinforced responses

Operant Conditioning zB.F. Skinner ( ) yBuilt on Thorndike’s Law of Effect yDiscovered schedules of reinforcement

Operant Conditioning zOperant Chamber (“Skinner Box”) ychamber with a bar that an animal can press to obtain a food reinforcer yFrequency of responses are recorded

Operant Conditioning zReinforcer y any event that follows a behavior AND strengthens the behavior zShaping y procedure in which reinforcers guide behavior toward a desired goal

Principles of Reinforcement zPrimary Reinforcer yan innate reinforcer ysatisfies a biological need zSecondary Reinforcer ya conditioned reinforcer yan event that gains its reinforcing power through its association with a primary reinforcer

Schedules of Reinforcement zContinuous Reinforcement yreinforce desired response every occurrence xlearning occurs rapidly xextinction occurs rapidly zPartial Reinforcement yReinforce response only part of the time xlearning occurs slowly xBut connection resists extinction

Extinction curves due to continuous and partial reinforcement

ADHD and responding to partial reinforcement

Different Partial Reinforcement schedules Variable Interval Number of responses Time (minutes) Fixed Ratio Variable Ratio Fixed Interval Steady responding Rapid responding near time for reinforcement 80

Schedules of Reinforcement zFixed Ratio (FR) ybehavior is reinforced only after behavior occurs a specified number of times (e.g., 1 in 3) ythe faster you respond, the more rewards you get! ydifferent ratios yvery high rate of responding ylike piecework pay zVariable Ratio (VR) ybehavior is reinforced ON AVERAGE after behavior occurs a specified number of times (e.g., 1 in 3 on average) ylike gambling, fishing yvery hard to extinguish because of unpredictability zFixed Interval (FI) ybehavior is reinforced only after a specified time has elapsed yfrequency of behavior increases when the time for reward draws near zVariable Interval (VI) ybehavior is reinforced at unpredictable time intervals yproduces slow, steady responding ylike pop quiz!

Reinforcement Schedule examples Buying a lottery ticket and winning VR Watching & seeing a shooting star VI Receiving allowance Saturday for having clean room FI Hotel maid gets 15-min break after cleaning four rooms FR

Shaping zCan leave lab once rat touches lever three times in 10 seconds

Shaping zSuccessive approximations to goal behavior

Punishment An aversive event that decreases the behavior that it follows

Operant Conditioning

Problems with Punishment zPunished behavior is not forgotten, it's suppressed--behavior returns when punishment is no longer present zCauses increased aggression- shows that aggression is a way to cope with problems zCreates fear that can generalize to undesirable behaviors, e.g., fear of school zDoes not necessarily guide toward desired behavior--reinforcement tells you what to do, punishment only tells you what not to do zPunishment teaches how to avoid it

Biofeedback

When one becomes aware of: zBreathing zHand or foot temperature zHeart rate zMuscle Tension - You can change it. This is the essence of biofeedback.

When you become aware of your own brain activity –you can change it also.

Feedback Screen Therapist Monitor EEG Sensors Therapist and client/game screen