V v Adaptive Quizzing Associated with an Increase in Overall Learning Keiko Bostwick, Kathryn Becker-Blease, PhD Oregon State University School of Psychological.

Slides:



Advertisements
Similar presentations
Online Course Development Techniques and Best Practices Online Academic Services W.P. Carey School of Business.
Advertisements

Cumulative Final Exams and Pop Quizzes Practical Ways to Integrate Repeated Testing into Courses Maya M. Khanna.
Just what you need to know and do NOW!
Briefing: NYU Education Policy Breakfast on Teacher Quality November 4, 2011 Dennis M. Walcott Chancellor NYC Department of Education.
The Complexities of Grading: What’s fair? What’s worth grading? Kay M. Sagmiller Oregon State University Center for Teaching and Learning.
Getting the Most Out of Online Homework Session S158 George Woodbury College of the Sequoias Visalia, CA.
COLLECTING AND ANALYZING DATA: MEASURING STUDENT SUCCESS Rebecca Orr, Ph.D. Professor of Biology.
Evaluating the Preparation-Guide as a Tool for Increasing Students’ Accountability for Reading the Textbook Etty Vandsburger, Ph.D., LCSW, Rana Daston-Duncan,
Christine Bastedo Robert Magyar Spring,  Determine if students are meeting learning objectives across all sections of PSY 121, Methods and Tools.
V v Multiple-Choice Testing to Teach Scientific Reasoning and Prepare Psychology Students for MCAT2015 Kathryn Becker-Blease 1, Courtney Stevens 2, Melissa.
Techniques for Improving Student Learning Outcomes Lynn M. Forsythe Ida M. Jones Deborah J. Kemp Craig School of Business California State University,
© Arizona State University Data Based Decision Making November 2013.
Introduction to the Periodic Table
…improves student performance! “I use the LearnSmart modules within Connect Management to get students familiar with the material and engaged with the.
METHODS Study Population Study Population: 224 students enrolled in a 3-credit hour, undergraduate, clinical pharmacology course in Fall 2005 and Spring.
Teacher Evaluation Training June 30, 2014
By Richard Schutt For Colorado Christian University Management of Web Based Classes EDU543 Professor Andrew Roob.
J. Martin EDIT 6900 A “PresentationQuest” Designing a Collaborative Learning Lesson Plan.
Effectiveness of Using Interactive Technology in a Programming Course Shyamal Mitra Department of Computer Sciences University of Texas at Austin.
Developmental Mathematics Redesign …. David Atwood, Sarah Endel April 16, 2014 RAMSP.
4/16/07 Assessment of the Core – Science Charlyne L. Walker Director of Educational Research and Evaluation, Arts and Sciences.
Robert W. Arts, Ph.D. Professor of Education & Physics University of Pikeville Pikeville, KY The Mini-Zam: Formative Assessment for the Physics Classroom.
The Genetics Concept Assessment: a new concept inventory for genetics Michelle K. Smith, William B. Wood, and Jennifer K. Knight Science Education Initiative.
College Algebra: An Overview of Program Change Dr. Laura J. Pyzdrowski Dr. Anthony S. Pyzdrowski Dr. Melanie Butler Vennessa Walker.
Research Problem In one sentence, describe the problem that is the focus of your classroom research project about student learning: Students are not adequately.
Researchers of homework are Harris Cooper, Herbert Walberg, and Joyce Epstein. Epstein found that homework is important because learning is extended into.
Andrea Ocegueda SHSU Methods Student Alexis Lenington SHSU Student Teacher Michael Robinson Pre-AP World History Teacher.
Presented at the MCRI Workshop May 30, 2008 Redesigning General Frostburg State University MCRI Workshop May 30, 2008 Primary FSU NCAT Team:
Improving Course Completion and Success Rates Easily: Leverage Summative Assessment for Formative Purposes Robert E. Vaden-Goad, PhD Southern Connecticut.
1 Self-Regulation and Ability Predictors of Academic Success during College Anastasia Kitsantas, Faye Huie, and Adam Winsler George Mason University.
Implications of Mediated Instruction to Remote Learning in Mathematics Joy L. Matthews-López Educational Testing Service Sergio R. López-Permouth David.
Utilizing Peer Tutoring to Minimize Deficiencies in Students Dr Eddie Thompson University of Memphis 2012 Martin Institute
Presented at the MCRI Workshop May 2009 by Dr. Megan E. Bradley Full Implementation Results for General Frostburg State University MCRI Workshop.
Redesign Alliance Conference Orlando, FL, March 19th, 2007 © 2007 by Gordon Hodge General Psychology is the largest of UNM’s 20 “killer”
AET/515 American Music 1920’s to the Present Shaundra Gutierrez.
Fair and Appropriate Grading
National Research Conference on Strengthening School- Based Management
Gamification in Composition I USING GAMING CONCEPTS TO CREATE ENHANCED LEARNING BY STEPHEN T. HOLLAND, PHD.
Standards Based Grading. How is it different? Traditional Grade for each assignment Grade may accidentally be focused more on one concept than another,
M RS. D ANIELLE H OLSEY Welcome to Honors Analysis Please sign in.
Comparison of Student Learning in Challenge-based and Traditional Instruction in Biomedical Engineering Others: Taylor Martin, Stephanie D. Rivale, and.
Math Study Skills: Introduction
Louisiana State University at Alexandria. Background Students Introductory Biology for majors 2 laboratory sections of ~ 25 students combined into 1 lecture.
PRESENTED BY: GORDON MILLER CHRISTY RYBISKI GINA WORLEY Assessing the Student.
INLS 151 retrieving & analyzing information rachael clemens spring 2016.
Wendy Heck Grillo North Carolina Central University Dept. of Biology Biology Scholars 2009.
Recent Exam Connections to Study Techniques Biology.
1 Teacher Evaluation Institute July 23, 2013 Roanoke Virginia Department of Education Division of Teacher Education and Licensure.
Innovative Applications of Formative Assessments in Higher Education Beyond Exams Dan Thompson M.S. & Brandy Close M.S. Oklahoma State University Center.
Introduction to AP Psychology Mr. Debes. About AP Psychology The Advanced Placement test for AP Psychology: Monday, May 1, 2017 Students will have the.
Using a Strategy Project to Promote Self-Regulated Learning
Welcome to Accelerated Geometry Please sign in.
Three Efficient Ways to Conduct Experimental Research in Large, Online, Hybrid, and Face-to-Face Classes Kathryn A. Becker-Blease, PhD1, Keiko C. P. Bostwick,
Instructor Made Videos Enhance Student Learning
Standards Based Grading
Are You Connected? Education companies can no longer ignore that you, the students, are demanding a more effective, more efficient, less expensive education.
Welcome to Analysis Please sign in.
Partial Credit Scoring for Technology Enhanced Items
The purposes of grading student work
GTECH 709 Criteria for evaluation
MathXL® Student Overview QRB/501
Standards Based Grading
Utilizing Academic Status Reports (ASR)
MyMathLab® Student Overview QRB/501
Are You Connected? Education companies can no longer ignore that you, the students, are demanding a more effective, more efficient, less expensive education.
Are You Connected? Education companies can no longer ignore that you, the students, are demanding a more effective, more efficient, less expensive education.
Are You Connected? Education companies can no longer ignore that you, the students, are demanding a more effective, more efficient, less expensive education.
MyStatLab Student Overview QNT/561
Evaluation Measures, Ongoing Improvements and Enhancement
Mastery Based Learning and Grading 101
Presentation transcript:

v v Adaptive Quizzing Associated with an Increase in Overall Learning Keiko Bostwick, Kathryn Becker-Blease, PhD Oregon State University School of Psychological Science What is Adaptive Quizzing? Computerized adaptive quizzes present students with a series of questions, altering the difficulty and/or content of future questions based on student performance (EdGrowth Advisors, 2013). Typically, students who answer more questions correctly are required to complete less questions overall in order to get the same final score. This should motivate students to attempt to answer the questions correctly, rather than simply clicking through the assignment. Adaptive quizzing is designed to increase meta-cognition through continuous feedback. Ideally, the software is used after a student has already read the material so that it can be used as a method to improve retention through retrieval practice. This allows students to identify what they already know in addition to gaining more experience in areas that they struggle with. Does it work? Limited research is positive. Unpublished reports from textbook publishers have found, compared to sections without adaptive quizzing: Higher pass rates in sections with adaptive learning quizzes Higher percentage earning A or B, and same percentage earning D and F. Higher exam scores on module exams. Frequent, non-adaptive quizzing associated with higher exam scores on midterms, but lower scores on the final exam. (McGraw-Hill, n.d. & Pearson, n.d) Methodological problems are common: No/weak controls, varying dependent measures, etc. (Bowen & Lack, 2012). However, Becker-Blease (2013) found a positive correlation between adaptive learning completion rates and improvement using a pre/post design. We replicate these findings with two recent sections of an introductory psychology course. Example Adaptive Quizzing Question Results Total adaptive quiz scores ranged from 0 to 100% (M = 90%, SD = 17). Pre-test scores ranged from 17% to 87%. Post-test scores ranged from 27% to 97%. Adaptive quiz scores were positively associated with post-test scores (r =.23, p=.006, Mean Change = 5.536), and remained significant after controlling for pre-test scores (r =.221, p =.009). When students were separated dichotomously into those who completed all of the adaptive quizzes and those who did not, there was a significant difference in mean change from pre to post test (t= 2.207, df=140, p=0.029). Students who completed all of the quizzes gained an average of 1.24 (4%) points more than students who did not. Keiko Bostwick Kathryn Becker-Blease Future Research Endeavors: 1.Is the goal academic success or learning? Academic success: Grades or fail rate in current course. Grades or fail rate in higher level course. Learning: Higher exam scores on final exam or standardized test. Grades may be influenced by a high percentage of points shifted from exams to online quizzing, boosting success but not necessarily learning. 2. Is the goal to close an achievement gap or benefit all students? Does adaptive quizzing differentially benefit struggling students? High achieving students? Higher achieving students, who may be more conscientious, use better strategies or have more time to complete quizzes may well benefit as much or more than struggling students (Ceci & Papierno, 2005). 3. Are there unintended downsides? Do frequent quiz scores lead to over-confidence? Does it encourage poor study habits? Quizzing can lead to higher midterm scores, and lower final exam scores, possibly because students cram for midterms using online quizzes, obtain higher scores and feel over-confident going into a cumulative final (Pearson, n.d.) 4. What’s the effect size? Is adaptive quizzing worth the cost? How does it compare to other study techniques? Method Students in one section of an Introductory Psychology course at a medium-sized university were invited to participate. One hundred and fifty students chose to participate. All were assigned the same, weekly adaptive quizzing assignments. Students were assigned 3 or 4 adaptive quizzes each week using LearningCurve, an adaptive quizzing tool available with the textbook. Students who reached a predetermined level of mastery were awarded full credit for that quiz. Each quiz was worth the same number of points. Students completed the pretest on the first day of class, and the same test as post-test at the final exam for extra credit. The pre-/post-test questions were drawn from a variety of sources (e.g. practice AP Psychology test questions), but not the textbook testbank. The instructor was not the experimenter and he was blind to the pre-/post- test questions. Discussion Students who completed more adaptive quizzing assignments earned higher scores on a test of standard Introductory Psychology concepts. This result was not influenced by the instructors’ choice of exam questions, or the similarity of quiz questions to testbank questions. The result remained significant after controlling for pre-test scores that measured prior psychology knowledge, and served as a proxy for motivation and general test-taking ability. Researchers should continue to test adaptive quizzing in classrooms using strong research designs. Future research could focus the other benefits of adaptive quizzing (e.g. is it more time efficient, are student’s using it correctly, etc.). References Becker-Blease, K. A. (May, 2013). Adaptive Quizzing Associated with Higher Exam Score in Introductory Psychology. Poster presented at annual APS-STP Teaching Institute. Washington, D. C. Bowen and Lack (2012). Current Status of Research on Online Learning in Postsecondary Education. Available: online-learning-postsecondary-education. Ceci, S. & Papierno, P. (2005). The rhetoric and reality of gap closing: When the “have-nots” gain but the “haves” gain even more. American Psychologist, 60, 149 – 160. Education Growth Advisors (2013). Learning to Adapt: A Case for Accelerating Adaptive Learning in Higher Education. Available: McGraw-Hill (n.d.) LearnSmart Effectiveness Study. Available: Pearson (n.d.). Learning in Action: A Report on MyLab Efficacy. Available: Hypotheses: 1.Adaptive quiz scores will be positively associated with learning, as measured by a final post-test. 2.Adaptive quiz scores will remain positively associated with post-test scores after controlling for pre-test scores. 3.Students who complete all of their adaptive learning quizzes verses those who did not would receive higher post test scores Poster Presented at the Association for Psychological Science’s 26 th Annual Convention San Francisco, California;