College students planning to apply for graduate school often prepare to take the Graduate Record Examination (GRE). The advanced vocabulary questions on.

Slides:



Advertisements
Similar presentations
The E-Chug: A Randomized, Controlled Study of a Web-Based Binge Drinking Intervention with College Freshman John Steiner, M.P.H., W. Gill Woodall, Ph.
Advertisements

Project VIABLE: Behavioral Specificity and Wording Impact on DBR Accuracy Teresa J. LeBel 1, Amy M. Briesch 1, Stephen P. Kilgus 1, T. Chris Riley-Tillman.
Amber Zank, M.S.E. Michael Axelrod, Ph.D. University of Wisconsin- Eau Claire NASP Conference 2011 Training Individuals to Implement a Brief Experimental.
Is College Success Associated With High School Performance? Elizabeth Fisk, Dr. Kathryn Hamilton (Advisor), University of Wisconsin - Stout Introduction.
Using Rubrics for Evaluating Student Learning. Purpose To review the development of rubrics for the purpose of assessment To share an example of how a.
Direct Behavior Rating: An Assessment and Intervention Tool for Improving Student Engagement Class-wide Rose Jaffery, Lindsay M. Fallon, Sandra M. Chafouleas,
An Assessment Primer Fall 2007 Click here to begin.
Assessing the Social Acceptability of Brief Experimental Analysis in the Context of a Complete Reading Intervention Program Greta Fenske, Erin Liffrig,
Weber State University Master of Education in Curriculum and Instruction Candidate Assessment Plan.
Using Rubrics for Evaluating Student Learning Office of Assessment and Accreditation Indiana State University.
GRADUATE SCHOOL ADMISSIONS TESTING Rosemarie Sena Center Career Development Services.
V v Multiple-Choice Testing to Teach Scientific Reasoning and Prepare Psychology Students for MCAT2015 Kathryn Becker-Blease 1, Courtney Stevens 2, Melissa.
 New communication technologies are being developed and these changes affect not only literacy instruction but also our definition of literacy itself.
Evaluation of Math-Science Partnership Projects (or how to find out if you’re really getting your money’s worth)
AET/515 Spanish 101 Instructional Plan SofiaDiaz
Pilot: Customizing a Commercially Available Digital Game to Assess Cognitive Function William C. M. Grenhart, John F. Sprufera, Jason C. Allaire, & Anne.
Ismaila Odogba Department of Geography and Geology The Impact of Collaborative Testing on Student Learning in an Introductory Level Geography Course INTRODUCTION.
Direct vs Indirect Assessment of Student Learning: An Introduction Dr. Sheila Handy, Chair Business Management and Co-Chair University Assessment Committee.
Pearson Copyright Tier Reading Model 3/26/08.
The Effect of Prompting Procedures on the Acquisition, Maintenance and Generalization of Intraverbal Behavior Jennifer L. Jorandby, Stephany K. Reetz,
 Increasing the amount of hours spent studying and doing homework on a daily basis  Increasing the amount of work completed while studying on a daily.
DEVELOPING ART LESSONS WITH AT-RISK YOUTH AND ELLS IN MIND Delanie Holton Art Teacher Fletcher Primary and Intermediate Aurora, CO.
Lecture 8A Designing and Conducting Formative Evaluations English Study Program FKIP _ UNSRI
Second Language Acquisition.  A principle goal of any secondary language learning class is to improve oral skills of the students in the target language.
Printed by INTRODUCTION PARTICIPANTS AND SETTING Ann F. Filer, M/Ed., BCBA John Ward-Horner, Ph.D., BCBA-D Robert K Ross, EdD., BCBA-D.
Ms. Carmelitano RESEARCH METHODS EXPERIMENTAL STUDIES.
Becoming Familiar with the GRE General Test GRE Test Preparation Workshop for Campus Educators.
Observation & Analysis. Observation Field Research In the fields of social science, psychology and medicine, amongst others, observational study is an.
STEVEN MALM, B.S. Reading Intervention: Incremental Rehearsal.
Christine Harrington Ph.D. Middlesex County College Cengage Learning.
Programme Information Incredible Years (IY)Triple P (TP) – Level 4 GroupPromoting Alternative Thinking Strategies (PATHS) IY consists of 12 weekly (2-hour)
Training Interventionists to Implement a Brief Experimental Analysis of Reading Protocol to Elementary Students: An Evaluation of Three Training Packages.
Method Participants and Setting Three second grade students from two different elementary schools in Eau Claire, WI participated in this study. Teachers.
Investigating the Consistency of Results Obtained from a Brief Experimental Analysis of Oral Reading Fluency Christine A. Schounard, Maddie J. Sutton,
Information commitments, evaluative standards and information searching strategies in web-based learning evnironments Ying-Tien Wu & Chin-Chung Tsai Institute.
Investigating the Step Size in a Progressive-Ratio Schedule of Reinforcement for Young Children Diagnosed with Autism Kathryn R. Glodowski, Chelsea B.
Training Individuals to Implement a Brief Experimental Analysis of Oral Reading Fluency Amber Zank, M.S.E & Michael Axelrod, Ph.D. Human Development Center.
Introduction The authors of this research would like to thank the University of Wisconsin-Eau Claire’s Office of Research and Sponsored Programs for financial.
Investigating the Step Size in a Progressive-Ratio Schedule of Reinforcement for Young Children Diagnosed with Autism Kathryn R. Haugle, Stephany Reetz,
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
BY LINDA CASTILLO If I have a pencil sharpening procedure will the classroom have fewer distractions?
Reading Recovery—Does it work?-Staff Presentation Patti Lapham January 15, 2011 Classroom Reading and Writing-
Outcomes Assessment in the Biology Classroom: A comparison of oral versus written testing Miranda Bacon, Department of Biology, York College Introduction.
Results Table 1 Table 1 displays means and standard deviations of scores on the retention test. Higher scores indicate better recall of material from the.
The Use of Formative Evaluations in the Online Course Setting JENNIFER PETERSON, MS, RHIA, CTR DEPARTMENT OF HEALTH SCIENCES.
Early Identification of Introductory Major's Biology Students for Inclusion in an Academic Support Program BETHANY V. BOWLING and E. DAVID THOMPSON Department.
Math Assessments Math Journals When students write in journals, they examine, they express, and they keep track of their reasoning. Reading their journals.
Use of a Modified Changeover Delay Procedure to Decrease Scrolled Responses by a Child With Autism Nicholas K. Reetz, Shantel R. Mullins, Sara L. Daugherty,
GRE OVERVIEW. PREPARATION RESOURCES 1.KAPLAN GRE BOOK (1-800-kap-test)  Detailed instruction for Verbal Reasoning, Quantitative Reasoning, and Analytical.
Prospective school psychology graduate students must take the GRE. Test takers often prioritize studying for the verbal section (Loken, et al., 2004).
Crystal Reinhart, PhD & Beth Welbes, MSPH Center for Prevention Research and Development, University of Illinois at Urbana-Champaign Social Norms Theory.
DECISION-MAKING FOR RESULTS HSES- Data Team Training.
Project VIABLE - Direct Behavior Rating: Evaluating Behaviors with Positive and Negative Definitions Rose Jaffery 1, Albee T. Ongusco 3, Amy M. Briesch.
Unit 7 Research Designs. What is a Research Design?? Researcher’s strategy: Describes how the researcher(s) will answer their questions/test hypotheses.
Tier III Preparing for First Meeting. Making the Decision  When making the decision to move to Tier III, all those involve with the implementation of.
Academic Intervention Stephen Matteson EDPS 688, School Psychology Practicum Stephen Matteson EDPS 688, School Psychology Practicum.
Reading is a fundamental skill for success in school. Thus, providing effective intervention to children underperforming in a standard classroom is critical.
Understanding Standards: Advanced Higher Event
Using BEA to Select Skill and/or Performance Interventions
Direct vs Indirect Assessment of Student Learning: An Introduction
Academic Writing Skills
First-Year Experience Seminars: A Benchmark Study of Targeted Courses for Developmental Education Students.
The Continuum of Interventions in a 3 Tier Model
Single Subject Research
MUHC Innovation Model.
Effects of Targeted Troubleshooting Activities on
Facilitating Higher-Order Learning Mnemonically: Additional Evidence Russell N. Carney, Rebecca E. Knoph, and Julie A. Baumann, Missouri State University.
Using BEA to Modify Packaged Reading Interventions for
Derek Herrmann & Ryan Smith University Assessment Services
This presentation will include:
Presentation transcript:

College students planning to apply for graduate school often prepare to take the Graduate Record Examination (GRE). The advanced vocabulary questions on the GRE verbal are often a high priority for students studying for the GRE (Loken, et al., 2004). We plan to explore whether Brief Experimental Analysis (BEA) procedures can be applied to select an effective intervention for university students preparing for the GRE. Once an effective intervention is identified through BEA, an extended analysis using a cumulative acquisition single-case experimental design, will be conducted. In this design, the most effective and second most effective intervention will be implemented on alternating days to see which results in a higher number of corrected defined words across time. Data will be analyzed using visual analysis procedures. We hypothesize that BEA can be used to select an effective intervention and that applying that intervention over time will result in greater gains in vocabulary compared to the second most effective intervention. The GRE is the most common entrance examination for a diverse array of graduate schools. Approximately 800,000 college students take the GRE each year (Educational Testing Services, 2013). Performance on the GRE has a large impact on the ability to obtain an advanced degree. The GRE is composed of three sections: Verbal Reasoning, Quantitative Reasoning, and Analytical Writing (Educational Testing Services, 2013). Thus, language skills are fundamental for overall success on the GRE. Despite this, there is a lack of research on effective study strategies. An analysis of study behaviors indicated that students emphasized the vocabulary-based questions within the verbal section while studying (Loken, Radlinsky, Crespi, Millet, & Cushing, 2004). Research indicates that for school-aged children Brief Experimental Analysis (BEA) can be used to select effective academic interventions, especially in oral reading fluency (Burns & Wagner, 2008). BEA is a way to “test drive” different interventions, delivered in succession, to select a promising intervention for each participant. That promising intervention can be implemented, and its effects measure, over time. We selected three interventions commonly used to teach word definitions: interspersal, incremental rehearsal, and traditional flashcard drill. Although traditional flashcard drill procedures have been used for vocabulary instruction (e.g., MacQuarrie, Tucker, Burns, & Hartman, 2002), research suggests that interspersal procedures yield better results than traditional flashcard drill procedures for definitional knowledge and retention of knowledge over time (Petersen-Brown & Burns, 2011). In our study, we aimed to extend BEA beyond its conventional use to select an effective vocabulary intervention for college students. We then measured the effectiveness of this intervention across time in an extended analysis. If we assume data collection continues on the trend we are seeing with Helga’s results thus far, our results may accord with other findings—that BEA can be used to select an effective intervention. However, our results could add to the literature by providing evidence that BEA’s effectiveness for selecting effective interventions can be extended to higher education, which has never been done. Potential limitations to our study include selection bias—only students who were highly motivated to increase their advanced vocabulary knowledge may have volunteered to participate. Additionally, we cannot be sure that participants did not study vocabulary words outside of the sessions, although we discouraged them from doing so. Another possible limitation is our small sample (n = 2). In single-case designs, small sample size is always considered a possible limitation. Implications for our study include possibly incorporating BEA into the study practices of higher-education students to maximize to choose the optimum study strategies for individual students, thus making the most of their time spent studying. For the GRE specifically, our results could indicate that BEA can be used to increase vocabulary knowledge for all students preparing to take the GRE, not just students who struggle with vocabulary. Future research could investigate similar questions on other GRE sections. Burns, M.K., & Wagner, D. (2008). Determining an effective intervention within a brief experimental analysis for reading: A meta- analytic review. School Psychology Review, 37, Graduate Record Exam. (2013). Educational Testing Service. Retrieved from Kennedy, C.H. (2005). Single Case Designs for Educational Research. Boston: Pearson Education, Inc. Loken, E., Radlinski, F., Crespi, V.H., Millett, J. & Cushing, L. (2004). Journal of Computing Research, 30, MacQuarrie, L.L., Tucker, J.A., Burns, M.K., & Hartman, B. (2002). Comparison of retention rates using traditional, drill sandwich, and incremental rehearsal flash card methods. School Psychology Review, 31, Petersen-Brown & Burns, M.K. (2011). Adding a vocabulary component to incremental rehearsal to enhance retention and generalization. School Psychology Quarterly, 26, Funding for this project was provided by the Office of Research and Sponsored Programs. Participants. 2 (1 male, 1 female) undergraduates preparing to take the GRE participated in the study. Helga was a freshman psychology major, and Leonard was a junior psychology major. Participants were offered extra credit for their time. Interventions Traditional Flashcard Drill: 6 unknown vocabulary words are presented to participants, who must then orally state and define the word. Once the participant has attempted to define each word, the procedure is repeated for 8 more trials. Interspersal: 6 unknown words and 2 known words are presented to the participant in the following order: K1-U1-U2-U3-K2-U4-U5-U6 (K= known word, U= unknown word) in a drill format. Once the participant has attempted to define each word, the unknowns are shuffled and the trial is repeated for 8 more trials. Incremental Rehearsal: 6 unknown words and 9 known words are presented such that unknown words are interspersed between known words in a ratio that increases by one known word as each unknown word is introduced (U1-K1-U1-K1-K2-U1-K1-K2-K3-U1-K1- K2-K3-K4-U1, and so on). After the participant has attempted to define each word, the procedure is repeated for 5 more trials. Procedure. Participants completed a 336-word pre-test to determine known and unknown vocabulary words. Words included in the test were selected from commercially available GRE test preparation materials and were identified by the publishers as commonly occurring words on the GRE (e.g., Kaplan, Princeton Review). This test required participants to select the correct definition for a given word from an array of five options. The test was administered online. There was no time limit for completing the test and participants could take breaks throughout if they chose to do so. For each participant, a pool of unknown and known words was randomly identified. These words were then randomly assigned to conditions for the BEA and extended analysis such that 6 unknown words were assigned to each condition. A different number of known words was assigned based on the condition as described above. The BEAs were conducted in quiet rooms on campus and took place across two sessions, each lasting approximately minutes. During the first session, the three interventions were delivered in a predetermined random order. After each intervention was delivered, a five-minute break was taken. After the delay, each unknown word was presented orally in turn and the participant was asked to state the definition of that word. The experimenter tracked the number of words defined correctly and this served as an outcome measure for the BEA. Approximately 24 hours after the BEA session was completed, the participant was either contacted via phone, or during the next session, and again asked to define the 6 words targeted in each of the BEA sessions. The experimenter tracked the number of words correctly defined and this served as the delayed recall outcome measure. For Helga, the top two interventions were selected to be used in the extended analysis based on the total number of words recalled in the immediate and delayed recall test (i.e., IR and interspersal respectively). For Leonard, because all conditions resulted in 100% accuracy in recall, the two interventions deemed easiest to implement by the researcher were selected for the extended analysis (i.e., traditional flash card drill and interspersal). Once two promising interventions were identified for each participant, we administered the extended analysis sessions in a quiet testing room on campus. The interventions were counterbalanced such they were delivered during alternating sessions (e.g. interspersal in session 1, incremental rehearsal in session 2, interspersal rehearsal in session 3, and so on). Five minutes after the intervention was administered, we tested the participant’s immediate recall of the words used for that session. During each session, but prior to administering the intervention, we tested the participant’s delayed recall for all the unknown words they had learned during all prior sessions and graphed their cumulative retention as part of a cumulative acquisition design. The extended analysis was carried out for approximately 3 weeks with 4 sessions per week—approximately 72 unknown words total were introduced to each participant. Procedural integrity and inter-rater reliability were evaluated by audio recordings of sessions or in-person by assessing the researcher’s adherence to intervention protocols. Outcomes. Participants retook the pretest to assess their gains in vocabulary knowledge by comparing their post-intervention scores to their pre-intervention scores.