EVAL 6970: Meta-Analysis Fixed-Effect and Random- Effects Models Dr. Chris L. S. Coryn Spring 2011.

Slides:



Advertisements
Similar presentations
SADC Course in Statistics Estimating population characteristics with simple random sampling (Session 06)
Advertisements

EVAL 6970: Meta-Analysis Effect Sizes and Precision: Part II Dr. Chris L. S. Coryn Spring 2011.
Comparing Two Means Dr. Andy Field.
EVAL 6970: Meta-Analysis Vote Counting, The Sign Test, Power, Publication Bias, and Outliers Dr. Chris L. S. Coryn Spring 2011.
CHAPTER 21 Inferential Statistical Analysis. Understanding probability The idea of probability is central to inferential statistics. It means the chance.
Sampling: Final and Initial Sample Size Determination
1 Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved. Section 7.5 Estimation of a Population Variance This section presents methods.
Objectives (BPS chapter 24)
1 Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved. Section 7.3 Estimating a Population mean µ (σ known) Objective Find the confidence.
EVAL 6970: Meta-Analysis Subgroup Analysis Dr. Chris L. S. Coryn Kristin A. Hobson Fall 2013.
Université d’Ottawa / University of Ottawa 2001 Bio 4118 Applied Biostatistics L10.1 CorrelationCorrelation The underlying principle of correlation analysis.
EVAL 6970: Meta-Analysis Fixed-Effect and Random- Effects Models Dr. Chris L. S. Coryn Spring 2011.
EVAL 6970: Meta-Analysis Effect Sizes and Precision: Part I Dr. Chris L. S. Coryn Spring 2011.
EVAL 6970: Meta-Analysis Meta-Regression and Complex Data Structures Dr. Chris L. S. Coryn Spring 2011.
EVAL 6970: Meta-Analysis Heterogeneity and Prediction Intervals Dr. Chris L. S. Coryn Spring 2011.
PSY 307 – Statistics for the Behavioral Sciences
Dr. Chris L. S. Coryn Spring 2012
Statistics for the Social Sciences Psychology 340 Spring 2005 Statistics & Research Methods.
Selecting Research Participant 1. Sample & Population A population is the entire set of individuals of interest to a researcher. A sample is a set of.
Statistics for the Social Sciences
Overview of Meta-Analytic Data Analysis. Transformations Some effect size types are not analyzed in their “raw” form. Standardized Mean Difference Effect.
Heterogeneity in Hedges. Fixed Effects Borenstein et al., 2009, pp
Christopher Dougherty EC220 - Introduction to econometrics (chapter 3) Slideshow: prediction Original citation: Dougherty, C. (2012) EC220 - Introduction.
Standard error of estimate & Confidence interval.
1 PREDICTION In the previous sequence, we saw how to predict the price of a good or asset given the composition of its characteristics. In this sequence,
Review of normal distribution. Exercise Solution.
Chapter 9 Two-Sample Tests Part II: Introduction to Hypothesis Testing Renee R. Ha, Ph.D. James C. Ha, Ph.D Integrative Statistics for the Social & Behavioral.
AM Recitation 2/10/11.
Review of Statistical Inference Prepared by Vera Tabakova, East Carolina University ECON 4550 Econometrics Memorial University of Newfoundland.
Education 793 Class Notes T-tests 29 October 2003.
EVAL 6970: Cost Analysis for Evaluation Dr. Chris L. S. Coryn Nick Saxton Fall 2014.
Advanced Statistics for Researchers Meta-analysis and Systematic Review Avoiding bias in literature review and calculating effect sizes Dr. Chris Rakes.
Stats for Engineers Lecture 9. Summary From Last Time Confidence Intervals for the mean t-tables Q Student t-distribution.
1 ICEBOH Split-mouth studies and systematic reviews Ian Needleman 1 & Helen Worthington 2 1 Unit of Periodontology UCL Eastman Dental Institute International.
Comparing Two Means Prof. Andy Field.
Statistical Applications for Meta-Analysis Robert M. Bernard Centre for the Study of Learning and Performance and CanKnow Concordia University December.
EXAMPLE 3 Find the inverse of a 3 × 3 matrix Use a graphing calculator to find the inverse of A. Then use the calculator to verify your result. 2 1 – 2.
Funded through the ESRC’s Researcher Development Initiative Prof. Herb MarshMs. Alison O’MaraDr. Lars-Erik Malmberg Department of Education, University.
Tips and tricks for performing standard meta-regression analysis with SPSS Giuseppe Biondi Zoccai Division of Cardiology, Department of Internal Medicine,
Meta-analysis 統合分析 蔡崇弘. EBM ( evidence based medicine) Ask Acquire Appraising Apply Audit.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
The Campbell Collaborationwww.campbellcollaboration.org C2 Training: May 9 – 10, 2011 Introduction to meta-analysis.
On teaching statistical inference: What do p values (not) mean? Bruce Blaine, PhD, PStat® Department of Mathematical and Computing Sciences St. John Fisher.
Dependencies Complex Data in Meta-analysis. Common Dependencies Independent subgroups within a study (nested in lab?) Multiple outcomes on the same people.
1 Introduction Description of the video series Meta-analysis in R with Metafor.
Schmidt & Hunter Approach to r Bare Bones. Statistical Artifacts Extraneous factors that influence observed effect Sampling error* Reliability Range restriction.
Recall What was Required in the Rationale Assignment? 1.What is the phenomenon? 2.How is it different & similar to another phenomenon? 3.When/where/how.
1 Overview of Experimental Design. 2 3 Examples of Experimental Designs.
1 Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved. Section 7.4 Estimation of a Population Mean  is unknown  This section presents.
Fixed- v. Random-Effects. Fixed and Random Effects 1 All conditions of interest – Fixed. Sample of interest – Random. Both fixed and random-effects meta-analyses.
1 Estimation of Population Mean Dr. T. T. Kachwala.
Systematic Reviews and Meta-analyses. Introduction A systematic review (also called an overview) attempts to summarize the scientific evidence related.
INFERENCE Farrokh Alemi Ph.D.. Point Estimates Point Estimates Vary.
Example A population has a mean of 200 and a standard deviation of 50. A random sample of size 100 will be taken and the sample mean x̄ will be used to.
HYPOTHESIS TESTING FOR DIFFERENCES BETWEEN MEANS AND BETWEEN PROPORTIONS.
Date of download: 6/21/2016 Copyright © 2016 American Medical Association. All rights reserved. From: Association of Episodic Physical and Sexual Activity.
Statistical issues in the validation of surrogate endpoints Stuart G. Baker, Sc.D.
Class Six Turn In: Chapter 15: 30, 32, 38, 44, 48, 50 Chapter 17: 28, 38, 44 For Class Seven: Chapter 18: 32, 34, 36 Chapter 19: 26, 34, 44 Quiz 3 Read.
1 One goal in most meta-analyses is to examine overall, or typical effects We might wish to estimate and test the value of an overall (general) parameter.
1 Consider the k studies as coming from a population of effects we want to understand. One way to model effects in meta-analysis is using random effects.
Analysis for Designs with Assignment of Both Clusters and Individuals
Sampling Distributions
Comparing Two Means t-tests: Rationale for the tests t-tests as a GLM
Meta-analysis statistical models: Fixed-effect vs. random-effects
Chapter 7 Sampling Distributions.
Gerald Dyer, Jr., MPH October 20, 2016
Chapter 7 Sampling Distributions.
LESSON 18: CONFIDENCE INTERVAL ESTIMATION
Chapter 7 Sampling Distributions.
Chapter 7 Sampling Distributions.
Presentation transcript:

EVAL 6970: Meta-Analysis Fixed-Effect and Random- Effects Models Dr. Chris L. S. Coryn Spring 2011

Agenda Fixed-effect models for meta- analysis Random-effects models for meta- analysis Review questions In-class activity

Fixed-Effect Models

Fixed-effect model: True effect

Fixed-Effect Models Given that all studies share the same true effect, the observed effect size varies from study to study only because of random (sampling) error Although error is random, the sampling distribution of the errors can be estimated

Fixed-Effect Models Fixed-effect model: True effects and sampling error

Fixed-Effect Models To obtain an estimate of the population effect (to minimize variance) a weighted mean is computed using the inverse of each study’s variance as the study’s weight in computing the mean effect

Fixed-Effect Models

With And

Random-Effects Models Does not assume that the true effect is identical across studies Because study characteristics vary (e.g., participant characteristics, treatment intensity, outcome measurement) there may be different effect sizes underlying different studies

Random-Effects Models Random-effects model: True effects

Random-Effects Models

Random-effects model: True effect and observed effect

Random-Effects Models

Random-Effects Model

Random-Effects Models

With And

Review Questions 1.When is it appropriate to use a fixed-effect model? 2.When is it appropriate to use a random-effects model? 3.How do the study weights differ for fixed-effect and random-effects models?

Today’s In-Class Activity Extracting effect size information from primary studies Individually, using the study provided – Code the study design – Calculate the OR for ‘recidivism’ – Calculate d for ‘recidivism’ – Compare your estimates to those of others in the course

Today’s In-Class Activity From “Data Sets 1-6 XLSX” – Calculate the fixed-effect and random- effects model weighted means for Data Sets 3 and 5 – Calculate the 95% confidence intervals (i.e., LL and UL) for the weighted means from Data Sets 3 and 5

Today’s In-Class Activity Download “Meta-Analysis with Means, Binary Data, and Correlations XLSX” from the course Website – Verify your results from the prior exercise Enter Data Sets 3 and 5 (as separate files) into Comprehensive Meta- Analysis 2.0 – Again, verify your results

Today’s In-Class Activity Compare the results of the fixed- effect and random-effects meta- analyses – How similar or different are the results for the two models? – How might you explain these similarities or differences?