1. Agenda  Q and As on last week’s lecture and readings  20-min in-class quiz 3  Application HW 1 revisit  Lecture  SD and MO  Positive and Negative Reinforcement  Schedules of Reinforcement ESSPED 5742

2. Schedules of Reinforcement ZIWEI XU ESSPED 5742

3. ESSPED 5742  Compare and contrast definitions, applications, and advantages of 1) continuous schedule of reinforcement, 2) intermittent schedule of reinforcement, 3) extinction and generate novel examples of each  Define four basic intermittent schedules of reinforcement and describe examples and effects of each  Given a scenario, describe how to use schedules of reinforcement to produce behavior change Objectives

4. Schedule and Schedule of Reinforcement ESSPED 5742

5. ESSPED 5742

6. Schedule and Schedule of Reinforcement ESSPED 5742 Ahhhhhhhhh …

7. Schedule and Schedule of Reinforcement Schedule of Reinforcement  A rule that describes a contingency of reinforcement  Contingency: environmental arrangements that determine conditions by which behaviors will produce reinforcement  A rule that establishes the probability that a specific occurrence of a behavior will produce reinforcement ESSPED 5742 https://www.youtube.com/ watch?v=LK8XOTQ01Mo

8. A Continuum of Schedule of Reinforcement Continuous Schedule of Reinforcement Extinction ESSPED 5742 Intermittent Schedule of Reinforcement (Every response is reinforced.) (Some, selected responses are reinforced.) (No responses are reinforced.)

9. A Continuum of Schedule of Reinforcement Continuous Schedule of Reinforcement Extinction ESSPED 5742 Intermittent Schedule of Reinforcement (Some, selected responses are reinforced.) (No responses are reinforced.)

10. A Continuum of Schedule of Reinforcement Continuous Schedule of Reinforcement Extinction ESSPED 5742 Intermittent Schedule of Reinforcement (No responses are reinforced.)

11. A Continuum of Schedule of Reinforcement Continuous Schedule of Reinforcement Extinction ESSPED 5742 Intermittent Schedule of Reinforcement

12. Continuous Schedule of Reinforcement Application  Strengthen behavior, primarily during the initial stages of learning new behaviors The World’s Deepest Bin https://www.youtube.com/watch?v=qRgWttqFKu8 Teaching Matching https://www.youtube.com/watch?v=lUDSrX1HbJYhttps://www.youtube.com/watch?v=lUDSrX1HbJY (0:12-1:06) ESSPED 5742

13. Limitations  Behavior quickly degrades when the reinforcer is absent  Behavior is unable to maintain or generalize in natural settings  The reinforcer may lose its value (vulnerable to satiation) Continuous Schedule of Reinforcement ESSPED 5742

14. Limitations  Behavior quickly degrades when the reinforcer is absent  Behavior is unable to maintain or generalize in natural settings  The reinforcer may lose its value (vulnerable to satiation)  It may be difficult to detect and reinforce every response  What if you are working with ten students at the same time? Continuous Schedule of Reinforcement ESSPED 5742 You are here!

15. Limitations  Behavior quickly degrades when the reinforcer is absent  Behavior is unable to maintain or generalize in natural settings  The reinforcer may lose its value (vulnerable to satiation)  It may be difficult to detect and reinforce every response  You may be broke… Continuous Schedule of Reinforcement ESSPED 5742

16. Application  Maintain established behavior Intermittent Schedule of Reinforcement ESSPED 5742

17. Application  Maintain established behavior  Progress to naturally occurring reinforcement Intermittent Schedule of Reinforcement ESSPED 5742

18. Application  Maintain established behavior  Progress to naturally occurring reinforcement Teaching Matching https://www.youtube.com/watch?v=lUDSrX1HbJYhttps://www.youtube.com/watch?v=lUDSrX1HbJY (1:10-1:56) Intermittent Schedule of Reinforcement ESSPED 5742

19. Advantages  Behavior may persist for an extended period of time  Facilitates maintenance  The reinforcer may maintain its value (resistant to satiation)  Some schedules can produce high levels of responding  Instructors can use resources (i.e., attention, tangibles) efficiently Successful administration requires programming and planning!! Intermittent Schedule of Reinforcement ESSPED 5742

20. Application  Decrease the frequency of behavior until it reaches a prereinforced level or ultimately ceases to occur  To administer an extinction procedure, you have to know the function of the behavior  Will be discussed in details next week Extinction ESSPED 5742

21. Question Time! A B C D ESSPED 5742

22. Question 1  Watch the video “Funny Bridge” https://www.youtube.com/watch?v=sWYFaPDHCqs https://www.youtube.com/watch?v=sWYFaPDHCqs The pedestrian’ response, taking a step on the bridge, was under which schedule of reinforcement? ESSPED 5742 A. Continuous B. Intermittent C. Extinction D. I don’t know

23. Question 2  Watch the video “Knocking on the Door” https://www.youtube.com/watch?v=rKrh5uytRKY (0:08-0:21) https://www.youtube.com/watch?v=rKrh5uytRKY The girl’s behavior, knocking on the door, was under which schedule of reinforcement? ESSPED 5742 A. Continuous B. Intermittent C. I don’t know D. Extinction

24. Question 3  Watch the video “Knocking on the Door” https://www.youtube.com/watch?v=rKrh5uytRKY (0:31-0:45) https://www.youtube.com/watch?v=rKrh5uytRKY The girl’s behavior, knocking on the door, was under which schedule of reinforcement? ESSPED 5742 A. Continuous B. Intermittent C. I don’t know D. Extinction

25. Question 4  __________ schedule may lead to satiation. ESSPED 5742 A. Continuous B. Intermittent C. I don’t know D. Extinction

26. Question 5  When we start teaching a new skill, we should use __________ schedule of reinforcement. ESSPED 5742 A. Continuous B. Intermittent C. I don’t know D. Extinction

27. Question 6  When we start teaching a new skill, we should use continuous schedule of reinforcement. To maintain a new skill, we should use __________ schedule of reinforcement. ESSPED 5742 A. Continuous B. Intermittent C. I don’t know D. Extinction

28. Basic Intermittent Schedules of Reinforcement Ratio and Interval Schedules  Ratio schedules: requiring a number of responses before one response produces reinforcement ESSPED 5742

29. Basic Intermittent Schedules of Reinforcement Ratio and Interval Schedules  Ratio schedules: requiring a number of responses before one response produces reinforcement ESSPED 5742 The individual’s response rate determines the rate of reinforcement.

30. Basic Intermittent Schedules of Reinforcement Ratio and Interval Schedules  Ratio schedules: requiring a number of responses before one response produces reinforcement  Interval schedules: requiring an elapse of time before a response produces reinforcement ESSPED 5742 The individual’s response rate determines the rate of reinforcement.

31. Basic Intermittent Schedules of Reinforcement Ratio and Interval Schedules  Ratio schedules: requiring a number of responses before one response produces reinforcement  Interval schedules: requiring an elapse of time before a response produces reinforcement ESSPED 5742 The individual’s response rate determines the rate of reinforcement. The individual’s response rate does NOT determine the rate of reinforcement; the availability of reinforcement is time-controlled.

32. Basic Intermittent Schedules of Reinforcement Fixed and Variable Schedules  Fixed schedules: the response requirement or the time requirement remains constant. ESSPED 5742

33. Basic Intermittent Schedules of Reinforcement Fixed and Variable Schedules  Fixed schedules: the response requirement or the time requirement remains constant. ESSPED 5742

34. Basic Intermittent Schedules of Reinforcement Fixed and Variable Schedules  Fixed schedules: the response requirement or the time requirement remains constant.  Variable schedules: the response requirement or the time requirement varies. ESSPED 5742

35. Basic Intermittent Schedules of Reinforcement Fixed and Variable Schedules  Fixed schedules: the response requirement or the time requirement remains constant.  Variable schedules: the response requirement or the time requirement varies. ESSPED 5742

36. Basic Intermittent Schedules of Reinforcement ESSPED 5742 Fixed Ratio Reinforcement requires the completion of a constant number of responses Variable Interval Reinforcement is provided upon the first response following a variable duration of time Fixed Interval Reinforcement is provided upon the first response following a fixed duration of time Variable Ratio Reinforcement requires the completion of a variable number of responses Ratio Interval FixedVariable

37. Basic Intermittent Schedules of Reinforcement: Fixed-Ratio ESSPED 5742 Definition  The completion of a constant number of responses produces a reinforcer  The elapse of time does NOT influence reinforcement. 7 pages 15-min break FR 7

38. Basic Intermittent Schedules of Reinforcement: Fixed-Ratio ESSPED 5742 Definition  The completion of a constant number of responses produces a reinforce  The elapse of time does NOT influence reinforcement. FR ? 3 phone calls

39. Basic Intermittent Schedules of Reinforcement: Fixed-Ratio ESSPED 5742 Effects

40. Basic Intermittent Schedules of Reinforcement: Fixed-Ratio ESSPED 5742 Effects The first response is emitted

41. Basic Intermittent Schedules of Reinforcement: Fixed-Ratio ESSPED 5742 Effects The first response is emitted High rates of responses

42. Basic Intermittent Schedules of Reinforcement: Fixed-Ratio ESSPED 5742 Effects The first response is emitted High rates of responses Delivery of reinforcement

43. Basic Intermittent Schedules of Reinforcement: Fixed-Ratio ESSPED 5742 Effects The first response is emitted High rates of responses Delivery of reinforcement Postreinforcement pause

44. Basic Intermittent Schedules of Reinforcement: Fixed-Ratio ESSPED 5742 Effects The first response is emitted High rates of responses Delivery of reinforcement Postreinforcement pause

45. Basic Intermittent Schedules of Reinforcement: Fixed-Ratio ESSPED 5742 Larger ratio Higher responding rate Effects Size of the ratio influences rate of response  To a degree, larger ratio is likely to produce high rates of responses, however, the rate of response may decrease if the ratio requirements are too large. Size of the ratio influences duration of post reinforcement pause  Large ratio produces long pauses.

46. Basic Intermittent Schedules of Reinforcement: Variable-Ratio Definition  The completion of a variable number of responses produces a reinforcer  The elapse of time does NOT influence reinforcement. ESSPED 5742

47. Basic Intermittent Schedules of Reinforcement: Variable-Ratio Starting my 2003, 133000 miles, Dodge Neon DAY-1 DAY-2 DAY-3 ESSPED 5742

48. Basic Intermittent Schedules of Reinforcement: Variable-Ratio Starting my 2003, 133000 miles, Dodge Neon DAY-1 DAY-2 DAY-3 ESSPED 5742 VR?

49. Basic Intermittent Schedules of Reinforcement: Variable-Ratio Starting my 2003, 133000 miles, Dodge Neon DAY-1 DAY-2 DAY-3 ESSPED 5742 VR2 (2+1+3)/3 = 2 Every 2 nd key-turning on the average produces reinforcement.

50. Marnie & Ziwei in Atlantic City, NJ 1 st Win 2 nd Win 3 rd Win 4 th Win Basic Intermittent Schedules of Reinforcement: Variable-Ratio ESSPED 5742 X 3 X 5 X 10 X 20+ Never happened…

51. X 20+ Marnie & Ziwei in Atlantic City, NJ 1 st Win 2 nd Win 3 rd Win 4 th Win Basic Intermittent Schedules of Reinforcement: Variable-Ratio ESSPED 5742 X 3 X 5 X 10 Never happened… VR?

52. Marnie & Ziwei in Atlantic City, NJ 1 st Win 2 nd Win 3 rd Win Basic Intermittent Schedules of Reinforcement: Variable-Ratio ESSPED 5742 X 3 X 5 X 10 VR?

53. Marnie & Ziwei in Atlantic City, NJ 1 st Win 2 nd Win 3 rd Win Basic Intermittent Schedules of Reinforcement: Variable-Ratio ESSPED 5742 X 3 X 5 X 10 VR6 (3+5+10)/3 = 6 Every 6 th lever-pulling on the average produces reinforcement.

54. Basic Intermittent Schedules of Reinforcement: Variable-Ratio Effects High, steady rates of response No postreinforcement pause Size of the ratio influences rate of response  To a degree, larger ratio is likely to produce higher rates of responses, however, the rate of response may decrease if the ratio requirements are too large. ESSPED 5742

55. Basic Intermittent Schedules of Reinforcement: Fixed-Interval Definition  The first correct response after a designated, constant amount of time produces the reinforcer  Responses emitted during the interval do NOT influence reinforcement ESSPED 5742 Mails are delivered at 7AM every Friday morning. The response “checking the mailbox” emitted before 7AM is NOT reinforced. The first response “checking the mailbox” after 7AM on Friday morning produces reinforcement (i.e., getting the mails). 1 week passes before the next scheduled reinforcer (i.e., mails) is available – Fixed Interval. FI 1-week

56. Basic Intermittent Schedules of Reinforcement: Fixed-Interval: In-class Application How to use to improve Marnie’s behavior “taking notes” ? ESSPED 5742 FI 2-min; Limited Hold 30 sec Limited Hold: reinforcement remains available for a finite time following the elapse of the interval.

57. Basic Intermittent Schedules of Reinforcement: Fixed-Interval: In-class Application How to use to improve Marnie’s behavior “taking notes” ? ESSPED 5742 FI 2-min; Limited Hold 30 sec 2’8’ 6’ 4’ Reinforcer Response Time elapsed Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. 0’

58. Basic Intermittent Schedules of Reinforcement: Fixed-Interval: In-class Application How to use to improve Marnie’s behavior “taking notes” ? ESSPED 5742 FI 2-min; Limited Hold 30 sec 2’8’ 6’ 4’ Reinforcer Response Time elapsed Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. 0’

59. Basic Intermittent Schedules of Reinforcement: Fixed-Interval: In-class Application How to use to improve Marnie’s behavior “taking notes” ? ESSPED 5742 FI 2-min; Limited Hold 30 sec 2’8’ 6’ 4’ Reinforcer Response Time elapsed Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. 0’ 4’30’’

60. Basic Intermittent Schedules of Reinforcement: Fixed-Interval: In-class Application How to use to improve Marnie’s behavior “taking notes” ? ESSPED 5742 FI 2-min; Limited Hold 30 sec 2’8’ 6’ 4’ Reinforcer Response Time elapsed Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. 0’

61. Basic Intermittent Schedules of Reinforcement: Fixed-Interval: In-class Application How to use to improve Marnie’s behavior “taking notes” ? ESSPED 5742 FI 2-min; Limited Hold 30 sec 2’8’ 6’ 4’ Reinforcer Response Time elapsed Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. 0’ 30 sec limited hold

62. Basic Intermittent Schedules of Reinforcement: Fixed-Interval: In-class Application How to use to improve Marnie’s behavior “taking notes” ? ESSPED 5742 FI 2-min; Limited Hold 30 sec 2’8’ 6’ 4’ Reinforcer Response Time elapsed Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. 0’

63. Basic Intermittent Schedules of Reinforcement: Fixed-Interval: In-class Application How to use to improve Marnie’s behavior “taking notes” ? ESSPED 5742 FI 2-min; Limited Hold 30 sec 2’8’ 6’ 4’ Reinforcer Response Time elapsed Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. 0’

64. Basic Intermittent Schedules of Reinforcement: Fixed-Interval Effects Slow to moderate rates of response Scallop effect ESSPED 5742

65. Basic Intermittent Schedules of Reinforcement: Fixed-Interval Effects Slow to moderate rates of response Scallop effect Postreinforcement pause ESSPED 5742

66. Basic Intermittent Schedules of Reinforcement: Fixed-Interval Effects Length of interval influences rate of response  To a degree, larger interval is likely to produce lower rates of responses. Length of interval influences duration of post reinforcement pause  Larger interval produces longer pauses. ESSPED 5742

67. Basic Intermittent Schedules of Reinforcement: Variable-Interval Definition  The first correct response following varying intervals of time produces the reinforcer  Responses emitted during the interval do NOT influence reinforcement ESSPED 5742 The response “checking the phone” emitted before a text message arrives is NOT reinforced. The first response “checking the phone” after a text message arrives produces reinforcement (i.e., getting the text). The intervals of time between two incoming text messages is unpredictable– Variable Interval.

68. Basic Intermittent Schedules of Reinforcement: Variable-Interval: In-class Application How to use to improve Marnie’s behavior “taking notes” ? ESSPED 5742 VI 2-min (2, 1, 3 min); Limited Hold 30 sec Limited Hold: reinforcement remains available for a finite time following the elapse of the interval.

69. Basic Intermittent Schedules of Reinforcement: Variable-Interval: In-class Application How to use to improve Marnie’s behavior “taking notes” ? ESSPED 5742 VI 2-min (2, 1, 3 min); Limited Hold 30 sec 2’8’ 6’ 4’ Reinforcer Response Time elapsed Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. 0’

70. Basic Intermittent Schedules of Reinforcement: Variable-Interval: In-class Application How to use to improve Marnie’s behavior “taking notes” ? ESSPED 5742 VI 2-min (2, 1, 3 min); Limited Hold 30 sec 2’8’ 6’ 4’ Reinforcer Response Time elapsed Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. 0’

71. Basic Intermittent Schedules of Reinforcement: Variable-Interval: In-class Application How to use to improve Marnie’s behavior “taking notes” ? ESSPED 5742 VI 2-min (2, 1, 3 min); Limited Hold 30 sec 2’8’ 6’ 4’ Reinforcer Response Time elapsed Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. 0’

72. Basic Intermittent Schedules of Reinforcement: Variable-Interval: In-class Application How to use to improve Marnie’s behavior “taking notes” ? ESSPED 5742 VI 2-min (2, 1, 3 min); Limited Hold 30 sec 2’8’ 6’ 4’ Reinforcer Response Time elapsed Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. 0’

73. Basic Intermittent Schedules of Reinforcement: Variable-Interval: In-class Application How to use to improve Marnie’s behavior “taking notes” ? ESSPED 5742 VI 2-min (2, 1, 3 min); Limited Hold 30 sec 2’8’ 6’ 4’ Reinforcer Response Time elapsed Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. 0’ 30 sec limited hold

74. Basic Intermittent Schedules of Reinforcement: Variable-Interval: In-class Application How to use to improve Marnie’s behavior “taking notes” ? ESSPED 5742 VI 2-min (2, 1, 3 min); Limited Hold 30 sec 2’8’ 6’ 4’ Reinforcer Response Time elapsed Limited Hold: reinforcement remains available for a finite time following the elapse of the interval. 0’

75. Basic Intermittent Schedules of Reinforcement: Variable-Interval Effects Slow to moderate rates of response No postreinforcement pause Length of interval influences rate of response  To a degree, larger interval is likely to produce lower rates of responses. ESSPED 5742

76. Basic Intermittent Schedules of Reinforcement ESSPED 5742 Ratio Interval FixedVariable High Rates of Response

77. Basic Intermittent Schedules of Reinforcement ESSPED 5742 Ratio Interval FixedVariable Moderate-Slow Rates of Response

78. Basic Intermittent Schedules of Reinforcement ESSPED 5742 Ratio Interval FixedVariable Postreinforcement Pause

79. Basic Intermittent Schedules of Reinforcement ESSPED 5742 Ratio Interval FixedVariable No Pause

80. Question Time Again! A B C D ESSPED 5742

81. Question 1 Which schedule of reinforcement?  Doing piecework in factories: Holly makes 5 dollars on every twenty aprons she has sewed. ESSPED 5742 A. FR B. VR C. FI D. VI

82. Question 2 Which schedule of reinforcement?  Surfers look around on a surfing board, expecting a big wave. ESSPED 5742 A. FR B. VR C. FI D. VI

83. Question 3 Which schedule of reinforcement?  Ziwei checks her bank account for monthly stipend paid by OSU. ESSPED 5742 A. FR B. VR C. FI D. VI

84. Question 4 Which schedule of reinforcement?  It is hunting season. Hunters look around in the forest, searching for bucks. ESSPED 5742 A. FR B. VR C. FI D. VI

85. Question 5 Which schedule of reinforcement?  Jenny is fundraising to try to raise money so she can go on the annual band trip. She goes door to door in her neighborhood trying to sell popcorn tins. She eventually sells some. ESSPED 5742 A. FR B. VR C. FI D. VI

86. Applying Intermittent Schedules of Reinforcement: Thinning Intermittent Schedules ESSPED 5742 Schedule Thinning  Gradually increasing the response ratio or the duration of the time interval  Assessing the student’s current performance level

87. Applying Intermittent Schedules of Reinforcement: Thinning Intermittent Schedules ESSPED 5742 Schedule Thinning  Gradually increasing the response ratio or the duration of the time interval  Assessing the student’s current performance level  Setting the ratio/interval requirements close to the current performance level

88. Applying Intermittent Schedules of Reinforcement: Thinning Intermittent Schedules ESSPED 5742 Schedule Thinning  Gradually increasing the response ratio or the duration of the time interval  Assessing the student’s current performance level  Setting the ratio/interval requirements close to the current performance level  Setting schedule-change criterion and using small increments of schedule changes

89. Applying Intermittent Schedules of Reinforcement: Thinning Intermittent Schedules ESSPED 5742 Schedule Thinning  Gradually increasing the response ratio or the duration of the time interval  Assessing the student’s current performance level  Setting the ratio/interval requirements close to the current performance level  Setting schedule-change criterion and using small increments of schedule changes  Guided by the student’s performance (ABA is a data-driven science/practice)

90. Applying Intermittent Schedules of Reinforcement: Thinning Intermittent Schedules ESSPED 5742 Schedule Thinning  Gradually increasing the response ratio or the duration of the time interval  Assessing the student’s current performance level  Setting the ratio/interval requirements close to the current performance level  Setting schedule-change criterion and using small increments of schedule changes  Guided by the student’s performance (ABA is a data-driven science/practice)  Using instructions to clearly communicate the schedule of reinforcement

91. Application Question ESSPED 5742 If you are using gummy bear as a reinforcer to teach eye-contact to a 3 years old with autism. The kid responds well to VR 2 and meets the schedule-change criterion you set. Then you move to VR 5… What will you do if the rate of eye contact decreases? What will you do if the rate of eye contact maintains or increases?

92. After-Class Tasks  Reading assignment  Chapter 13 (305-314)  Don’t Shoot the Dog (20-29)  SAFMEDS practice  Application HW 2  Hardcopy will be due on next class ESSPED 5742

93. References Cooper, J. O., Heron, T. E., & Heward, W. L. (2007). Applied behavior analysis (2nd ed.). Upper Saddle River, NJ: Pearson. ESSPED 5742