Grace Eckojojo and Isabel Leon Celina Trend: No trend in baseline. Increase during intervention for procedural integrity and verbal behavior on the PSI Variability: Low variability in baseline and intervention Level: Moderately high during baseline. High level during intervention, posttest and maintenance probe. Paul Trend: Flat trend in baseline. Increasing trend during intervention for both procedural integrity and verbal behavior. Variability: Low variability in baseline and during the implementation of the treatment package. Level: Moderately high level during baseline. High level during intervention and posttest Using Competency-Based Training to Remotely Train Therapists on Discrete Trial Training Grace Eckojojo and Isabel Leon Abstract Method Results Results Figure #3 Behavioral objective and performance criteria for nonverbal behavior Establish attention Present correct Sd Provide correct reinforcement or error correction Provide correct prompting level as described in curriculum Mastery criteria: at least 85% procedural integrity within 2 sessions. If mastery criteria was not reached after 2 sessions, the curriculum provided was analyzed and revised to include more explicit instruction as to the prompting procedure and direct modeling was implemented in order to demonstrate how to correctly perform the procedure with the trainee present. Assessment and measure of Dependent variable Procedural integrity the extent to which procedures are implemented as described in the provided curriculum Composed of four component: Establishing attention: Presentation of Sd Consequence: reinforcement or error correction Prompting:  at specified level Measured as accuracy in percentage correct responses/(correct + incorrect responses) x 100% (Cooper, Heron & Heward, 2007) Independent variable/Components of CBT Competency-based training package PSI and video modeling PSI: slideshow about discrete trial training. Details the components of a discrete trial, the steps to implement it, how to establish attention and types of prompts commonly used during DT, one errorless learning method (stimulus fading), and measurement used, percent correct. 7 learning objectives Instructions and guidelines Answer sheet to complete guided notes End of unit quiz administered on socrative.com and created by researchers to test specific verbal behavior from PSI Video modeling: series of videos of the researchers performing the discrete trial components and prompts PowerPoint presentation 4 videos: Learning objectives: 1.Implement a complete discrete trial 2.Establish the attention of a child 3.Use prompts 4.Use an errorless learning procedure: stimulus fading 5.Record data during the trial Experimental design Multiple baseline across participants (Baer, Wolf & Risley, 1968) 5 sessions for each participant Paul: 2 baseline sessions, 3 intervention sessions, 1 maintenance probe. Celina: 1 baseline session, 4 intervention sessions, 1 maintenance probe.     IOA Recorded for 33% of sessions Observer watched sessions by video and used the same procedural integrity data-sheet Trial-by-trial IOA was calculated (Cooper, Heron & Heward, 2007). IOA was 85.6% (range 70%-97.5%) Procedure Pretest . End of unit quiz for assessment of verbal behavior was administered on the computer. After the test was administered and completed, the participants completed each of the three types of discrete trials in order to have a baseline for procedural integrity. Intervention. PSI, then quiz, video modeling, discrete trials implementation Posttest. Post-test sessions were conducted at the center following each training session. Maintenance Probe. Post-test session consisting of the discrete trial intervention on the 3 different types of discrete trials. For Paul, the probe was 3 months after the last posttest. For Celina, the probe was 6 months after the last posttest. Celina – Figure 1 Trend: No trend in baseline. Increase during intervention for procedural integrity and verbal behavior on the PSI Variability: Low variability in baseline and intervention Level: Moderately high during baseline. High level during intervention, posttest and maintenance probe. Paul – Figure 1 Trend: Flat trend in baseline. Increasing trend during intervention for both procedural integrity and verbal behavior. Variability: Low variability in baseline and during the implementation of the treatment package. Level: Moderately high level during baseline. High level during intervention and posttest. Training therapists to accurately conduct discrete trials may be a challenge, especially with time and resource constraints. Often, training models based on continuous in-person modeling and feedback between the trainer and staff is inefficient and time-consuming. A remote, computer-based training module followed by a single in-person test for fluency may be a more efficient way to reduce the time and resources needed for staff training in special education. In the current study, the components of Discrete Trial Training (DTT) is taught to two individuals through a CBT package involving an electronic PSI, a quiz, and video modeling. Mock discrete trials were conducted before and after introduction of the training package to measure its effects on performance accuracy. Limitations to remote CBT training and suggestions for future research are discussed. Figure 3. Paul's results for the pretest, posttest and maintenance session-conducted 6 months after the posttest- for 3 types of discrete trial. Pretest measures procedural integrity before implementation of competency based training-composed of PSI and video modeling- and posttest measures procedural integrity after 3 training sessions. Introduction Figure #1 Training therapists to accurately conduct DTT with limited time and resources is a challenge (Morgan, Forbush, & Nelson, 2004) Time Resources Finding/ hiring individuals with experience in DTT, such as Registered Behavior Technicians Competency-based definition: “the practice of continuing training until trainees competently demonstrate the skills of concern (i.e., meet established mastery criteria).” (Parsons, Rollyson & Reid, 2012). Keller (1968) Personal system of instruction (PSI) "Method of instruction focused on self-paced mastery learning" Features: self-pacing, Unit mastery, Lectures for motivation/ on demand course content, Emphasis on the written word/Immediate Feedback, use of proctors/ peer tutoring. Purpose: Implement a computer-based CBT package involving a PSI, quiz, and video modelling and measure its effects on procedural integrity in discrete trial teaching. Pretest Posttest CBT Package Percent Correct (%) Figure 1. Compentency Based Training package composed of PSI and video modeling effect on procedural integrity across three discrete trial tasks on two participants. PSI Quiz- measure for verbal behavior- measuring verbal behavior also depicted. Maintenance Paul Celina Discussion Outcome Training package of PSI and video modeling effective Treatment package increased procedural integrity to above criterion Criteria for verbal and nonverbal achieved in 3 sessions Strength of functional relation Treatment package increased average procedural integrity for the 3 types of discrete trials Limitations: Irreversibility due to learning/acquisition Addressed by having trainee do training session immediately before testing, time between training components, different types of discrete trial for testing Controlled setting did not include variables from naturalistic environment (i.e. internet) Discrete trials were not performed with actual children Stimulus control of researchers No pretest for evaluating verbal behavior Feedback for verbal and nonverbal behavior was not immediate. During maintenance probe, Celina did not take data during the trials. Also, during 2 discrete trials, she was either short on trials or did more than the required number. Future research Component Analysis of PSI and video modeling PSI should provide immediate feedback for optimal learning Possible ABC design, with four conditions: 2 with PSI, 2 with video modeling Method Participants and Setting Participant 1: Celina, age 25 School BT Experience in DTT: 1 year Previous training method: shadowing Participant 2: Paul, age 25 Home ABA therapist Experience in DTT: 2 months Previous training method: Shadowing and feedback Sessions conducted at a therapy center Material Modeling videos: tripod, iPhone Data sheets: TPRA, data collection Computer (provided in the center) Behavioral objective and performance criteria for verbal behavior Identify the components of a discrete trial Define positive reinforcement Implement a discrete trial Identify the steps to establishing attention Define/identify the different prompting strategies Define errorless learning Use percentage Mastery criteria: at least 90% on the quiz at the end of the unit and 90% on the guided notes. Assessment and measurement of verbal behavior Guided notes with 26 fill-in-the-blank Quiz on online platform (socrative.com) composed of 12 questions; 8 short answers, 4 multiple choice questions Feedback provided on an answer sheet within 24 hours Figure #2 Figure 2. Celina's results for the pretest, posttest and maintenance session-conducted 6 months after the posttest- for 3 types of discrete trial. Pretest measures procedural integrity before implementation of competency based training-composed of PSI and video modeling- and posttest measures procedural integrity after 3 training sessions. References Baer, D. M., Wolf, M. M., & Risley, T. R. (1968). Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 1(1), 91-97. doi: 10.1901/jaba.1968.1-91 Cooper, J. O., Heron, T. E., & Heward, W. L. (2007). Applied behavior analysis (2nd ed.). Upper saddle River, NJ: Pearson Education Inc. Keller, F. S. (1968). “Good-bye teacher…” 1. Journal of applied behavior analysis, 1(1), 79-89.      doi: 10.1901/jaba.1968.1-79 Parsons, M. B., Rollyson, J. H., & Reid, D. H. (2012). Evidence-Based Staff Training: A Guide    for Practitioners. Behavior Analysis in Practice, 5(2), 2–11. Morgan, R.L., Forbush, D.E., & Nelson, J. (2004). Live, Interactive Paraprofessional Training    Using Internet Technology: Description and Evaluation. Journal of Special Education Technology, 19(3), 25-33.