1. Is brain-behavior behavior? zIf so, it can be conditioned just like other behaviors

2. Definition of Learning zLearning is an adaptive 1 permanent change 2 in behavior or behavior potential 3 that is produced as a result of prior experience 4 z1 occasionally maladaptive such as depressed mental set, obsessions z2 not due to fatigue, injury z3 includes tendencies to respond that might not have been tested z4 excludes maturation, disease, instinct

3. Two forms of conditioning zClassical conditioning yHard-wired linkage between stimulus and response (e.g., food and saliva) yAnything acting as signal of food can produce response zOperant conditioning yTraining linkage between stimulus and response through reinforcement ybehavior strengthened if followed by reinforcement ybehavior weakened if followed by punishment yLaw of Effect (Thorndike) Rewarded behavior is repeated

4. Components of conditioning zAcquisition yinitial stage of learning, during which a response is established and gradually strengthened zEffective pairing of reinforcement

5. Extinction ydiminishing a conditioned response yoccurs when an response is not followed by a reward

6. Extinction and spontaneous recovery Strength of CR Pause Acquisition (response + reward) Extinction (no reward) Extinction (no reward) Spontaneous recovery of response Weak Strong Time

7. Operant Conditioning zSpontaneous recovery yreappearance, after a rest period, of an extinguished conditioned response zGeneralization ytendency for stimuli similar to the conditioned stimulus to evoke similar responses zDiscrimination yIdentify specific stimulus from set of similar stimuli to evoke similar reinforced responses

11. Operant Conditioning zB.F. Skinner (1904- 1990) yBuilt on Thorndike’s Law of Effect yDiscovered schedules of reinforcement

12. Operant Conditioning zOperant Chamber (“Skinner Box”) ychamber with a bar that an animal can press to obtain a food reinforcer yFrequency of responses are recorded

13. Operant Conditioning zReinforcer y any event that follows a behavior AND strengthens the behavior zShaping y procedure in which reinforcers guide behavior toward a desired goal

14. Principles of Reinforcement zPrimary Reinforcer yan innate reinforcer ysatisfies a biological need zSecondary Reinforcer ya conditioned reinforcer yan event that gains its reinforcing power through its association with a primary reinforcer

15. Schedules of Reinforcement zContinuous Reinforcement yreinforce desired response every occurrence xlearning occurs rapidly xextinction occurs rapidly zPartial Reinforcement yReinforce response only part of the time xlearning occurs slowly xBut connection resists extinction

16. Extinction curves due to continuous and partial reinforcement

33. ADHD and responding to partial reinforcement

34. Different Partial Reinforcement schedules Variable Interval Number of responses 1000 750 500 250 0 10203040506070 Time (minutes) Fixed Ratio Variable Ratio Fixed Interval Steady responding Rapid responding near time for reinforcement 80

35. Schedules of Reinforcement zFixed Ratio (FR) ybehavior is reinforced only after behavior occurs a specified number of times (e.g., 1 in 3) ythe faster you respond, the more rewards you get! ydifferent ratios yvery high rate of responding ylike piecework pay zVariable Ratio (VR) ybehavior is reinforced ON AVERAGE after behavior occurs a specified number of times (e.g., 1 in 3 on average) ylike gambling, fishing yvery hard to extinguish because of unpredictability zFixed Interval (FI) ybehavior is reinforced only after a specified time has elapsed yfrequency of behavior increases when the time for reward draws near zVariable Interval (VI) ybehavior is reinforced at unpredictable time intervals yproduces slow, steady responding ylike pop quiz!

36. Reinforcement Schedule examples Buying a lottery ticket and winning VR Watching & seeing a shooting star VI Receiving allowance Saturday for having clean room FI Hotel maid gets 15-min break after cleaning four rooms FR

37. Shaping zCan leave lab once rat touches lever three times in 10 seconds

39. Shaping zSuccessive approximations to goal behavior

40. Punishment An aversive event that decreases the behavior that it follows

41. Operant Conditioning

42. Problems with Punishment zPunished behavior is not forgotten, it's suppressed--behavior returns when punishment is no longer present zCauses increased aggression- shows that aggression is a way to cope with problems zCreates fear that can generalize to undesirable behaviors, e.g., fear of school zDoes not necessarily guide toward desired behavior--reinforcement tells you what to do, punishment only tells you what not to do zPunishment teaches how to avoid it

44. Biofeedback

45. When one becomes aware of: zBreathing zHand or foot temperature zHeart rate zMuscle Tension - You can change it. This is the essence of biofeedback.

46. When you become aware of your own brain activity –you can change it also.

47. Feedback Screen Therapist Monitor EEG Sensors Therapist and client/game screen