Domain-Specific Prior Knowledge and Learning: A Meta-Analysis

Slides:



Advertisements
Similar presentations
Childhood exposure to domestic violence predicts relationship violence: A meta-analysis Markus Kemmelmeier and Kerry Kleyman.
Advertisements

The Research Consumer Evaluates Measurement Reliability and Validity
Tradeoffs Between Immediate and Future Learning: Feedback in a Fraction Addition Tutor Eliane Stampfer EARLI SIG 6&7 September 13,
Critiquing Research Articles For important and highly relevant articles: 1. Introduce the study, say how it exemplifies the point you are discussing 2.
The Campbell Collaborationwww.campbellcollaboration.org Education Panel Session Comments and Points for Discussion Sandra Jo Wilson Vanderbilt University.
Introduction to Meta-Analysis Joseph Stevens, Ph.D., University of Oregon (541) , © Stevens 2006.
Reliability and Validity
Multivariate Data Analysis Chapter 4 – Multiple Regression.
The Influence of Parent Education on Child Outcomes: The Mediating Role of Parents Beliefs and Behaviors Pamela E. Davis-Kean University of Michigan This.
Contrasting Examples in Mathematics Lessons Support Flexible and Transferable Knowledge Bethany Rittle-Johnson Vanderbilt University Jon Star Michigan.
Meta-analysis & psychotherapy outcome research
Correlational Designs
Validity Lecture Overview Overview of the concept Different types of validity Threats to validity and strategies for handling them Examples of validity.
1 Maximizing Learning in Online Training Courses: Meta-Analytic Evidence Traci Sitzmann Advanced Distributed Learning.
The Characteristics of an Experimental Hypothesis
9.0 A taste of the Importance of Effect Size The Basics of Effect Size Extraction and Statistical Applications for Meta- Analysis Robert M. Bernard Philip.
Chapter 3 An Overview of Quantitative Research
Advanced Statistics for Researchers Meta-analysis and Systematic Review Avoiding bias in literature review and calculating effect sizes Dr. Chris Rakes.
Program Evaluation. Program evaluation Methodological techniques of the social sciences social policy public welfare administration.
The Effect of Computers on Student Writing: A Meta-Analysis of Studies from 1992 to 2002 Amie Goldberg, Michael Russell, & Abigail Cook Technology and.
L 1 Chapter 12 Correlational Designs EDUC 640 Dr. William M. Bauer.
Aptitude by Treatment Interactions and Gagné’s Nine Events of Instruction Dr. K. A. Korb University of Jos.
1. Transformationa l Leadership M 1 :Affective Commitment OCB M 2 :Calculative Commitment.
Conceptualizing Intervention Fidelity: Implications for Measurement, Design, and Analysis Implementation Research Methods Meeting September 20-21, 2010.
Conceptualizing Intervention Fidelity: Implications for Measurement, Design, and Analysis Implementation: What to Consider At Different Stages in the Research.
Reliability & Validity
Assessing Learners with Special Needs: An Applied Approach, 6e © 2009 Pearson Education, Inc. All rights reserved. Chapter 4:Reliability and Validity.
Seminar on Theories in Child Development: Overview Dr. K. A. Korb University of Jos.
An Examination of Science. What is Science Is a systematic approach for analyzing and organizing knowledge. Used by all scientists regardless of the field.
CHAPTER 12 Descriptive, Program Evaluation, and Advanced Methods.
Developing a Review Protocol. 1. Title Registration 2. Protocol 3. Complete Review Components of the C2 Review Process.
META-ANALYSIS, RESEARCH SYNTHESES AND SYSTEMATIC REVIEWS © LOUIS COHEN, LAWRENCE MANION & KEITH MORRISON.
Validity Validity is an overall evaluation that supports the intended interpretations, use, in consequences of the obtained scores. (McMillan 17)
Working Memory and Learning Underlying Website Structure
Individual differences in response to intervention: An application of Integrative Data Analysis in Project KIDS Sara A. Hart Florida State University
Management development programs Providing recommendations based on scientific evidence Presented to Altria October 2, 2014.
Strategy Flexibility Matters for Student Mathematics Achievement: A Meta-Analysis Kelley Durkin Bethany Rittle-Johnson Vanderbilt University, United States.
LECTURE 3 EPSY 642 FALL CODING STUDIES Dependent variable(s) Construct(s) represented Measure name and related characteristics Effect size and associated.
2. Main Test Theories: The Classical Test Theory (CTT) Psychometrics. 2011/12. Group A (English)
1. 2 Issues in the Design and Testing of Business Survey Questionnaires: Diane K. Willimack U.S. Census Bureau Economic Census The International.
Lesson 3 Measurement and Scaling. Case: “What is performance?” brandesign.co.za.
Consistency and Meaningfulness Ensuring all efforts have been made to establish the internal validity of an experiment is an important task, but it is.
Week Seven.  The systematic and rigorous integration and synthesis of evidence is a cornerstone of EBP  Impossible to develop “best practice” guidelines,
1 Negative Results and Publication Bias in Single- Case Research Applications of the WWC Standards in Literature Reviews.
Meta-analysis Overview
Presenter: Chen-Yo Chi Advisor: Dr. Chin-Ling Lee Date: June 1, 2009
Writing a Research Report (Adapted from “Engineering Your Report: From Start to Finish” by Krishnan, L.A. et. al., 2003) Writing a Research Write the introduction.
1University of Oklahoma 2Shaker Consulting
Data Mining in Higher Education
NURS3030H NURSING RESEARCH IN PRACTICE MODULE 7 ‘Systematic Reviews’’
Oleh: Beni Setiawan, Wahyu Budi Sabtiawan
Intergenerational Transmission of Work Values: A Meta-Analytic Review Ekin Seçinti, Zeynep Cemalcılar, Nebi Sümer, Murat Kezer INTRODUCTION Recent statistics.
Supplementary Table 1. PRISMA checklist
RESTORATIVE JUSTICE EVALUATIONS: WHAT WORKS?
Direct Instruction & Differentiation
Research design I: Experimental design and quasi-experimental research
Statistics 200 Objectives:
Reliability & Validity
Instructional Coaching in the Elementary Mathematics Classroom
Exam 2 Review Chapters 9-13.
H676 Meta-Analysis Brian Flay WEEK 1 Fall 2016 Thursdays 4-6:50
Gestalt Theory.
How Do Testing Conditions Affect Creative Performance?
Quantitative Research
Bianca A. Simonsmeier Maja Flaig Michael Schneider
Some Further Considerations in Combining Single Case and Group Designs
Meta-analysis, systematic reviews and research syntheses
Driven by Data to Empower Instruction and Learning
Advisor: Dr.vahidipour Zahra salimian Shaghayegh jalali Dec 2017
Presentation transcript:

Domain-Specific Prior Knowledge and Learning: A Meta-Analysis Bianca A. Simonsmeier Maja Flaig Anne Deiglmayr Lennart Schalk Michael Schneider

Prior Knowledge “the most important single factor influencing learning is what the learner knows already” Ausubel, 1968

Effects of Prior Knowledge on Learning Positive Guides attention Helps interpreting and understanding Aids encoding in memory … Negative Misconceptions Einstellung effect Interference Negative transfer

Prior Achievement & Learning Outcomes Relationship Correlations School readiness – later school achievement (Duncan et al., 2007; La Paro & Pianta, 2000) .10 - .48 Prior school grade – later school grade (Trapmann et al., 2007) .19 - .31 GPA/GRE – GPA (Kuncel, Hezlett, & Ones, 2001; Schuler, Funke, & Baron-Boldt, 1990) .25 - .46 GPA – adult/occupational achievement (Schuler et al., 1990; Samson et al. 1990; Bretz 1989; Cohen 1984) .16 - .41

Constructs Domain-specific prior knowledge (T1) Dependent variables CK Information in long-term memory at the onset of a learning phase Relating to the key principles in a domain (e.g., mathematical equivalence) Dependent variables Knowledge & achievement Individual differences in learning outcomes at T2 Individual differences in learning gains from T2 to T1

Moderators Time 1 Learning phase Time 2 Environment Learner Similarity Prior Knowledge Learning Outcome Time 1 Learning phase Time 2

Research Questions Effects of prior knowledge on later learning outcomes (T2)? Effects of prior knowledge on learning gains (T2-T1)? Moderators? Knowledge characteristics Learner characteristics Environmental characteristics Methodological study characteristics

Literature Search All age groups All content domains Two time points Knowledge at T1 K or achievement at T2 Screened ≈ 5000 titles/abstracts Screened ≈ 500 full texts Included 240 studies

Included Data Data 4327 effect sizes 240 articles 62,129 participants

Method Inter-coder agreement 90% All effects sizes transformed into correlations Corrected for measurement error and dichotomization Random-effects meta-analysis Robust Variance Estimation (RVE; e.g., Tanner-Smith & Tipton, 2014) Robumeta package in R

Results: Learning Outcomes Effect Studies Effect sizes r+ 95% CI Overall learning gains 14 33 -.08 [-.48, .34] Overall learning outcomes 235 4223 .53 [.50, .55] Randomized controlled experiments No 226 4279 [.50, .56] Yes 9 44 .31 [.19, .42] Controlling for intelligence Before controlling 28 1305 .52 [0.46, 0.57] After controlling .48 [0.42, 0.54] Normalized learning gains reported

Results: Significant Moderators Knowledge characteristics Similarity of prior knowledge and learning outcome .021 Knowledge type .037 Learner characteristics Educational level .059 Environmental characteristics Cognitive demands of intervention .056 Instructional method: Problem based learning .012 Methodological characteristics Number of items in prior knowledge measure .036 Number of items learning outcome measure .025

Results: Funnel Plots Learning Outcomes Learning Gains

Limitations Quantity vs. quality of knowledge? Some moderator levels underrepresented (e.g. chemistry, medicine, procedural knowledge) Limited research on knowledge gains Few experiments

Open questions/ current revision Literature Search Keywords to identify gain studies Include unpublished studies vs. possibility to screen results (+3000 dissertations only) Meta-analytic integration Combine different effect sizes (e.g. from independent and dependent designs) Combine data from growth models

Conclusion and implications Prior knowledge has high predictive validity for learning outcomes Conceptual and statistical differences between learning outcomes and learning gains Limited amount of studies examining learning gains Effect of prior knowledge depend on a variety of moderators Use formative assessment, activate prior knowledge, and adapt instruction to students prior knowledge

Thank You!