EVAL 6970: Meta-Analysis Fixed-Effect and Random- Effects Models Dr. Chris L. S. Coryn Spring 2011.

Slides:



Advertisements
Similar presentations
Aron, Aron, & Coups, Statistics for the Behavioral and Social Sciences: A Brief Course (3e), © 2005 Prentice Hall Chapter 6 Hypothesis Tests with Means.
Advertisements

EVAL 6970: Meta-Analysis Effect Sizes and Precision: Part II Dr. Chris L. S. Coryn Spring 2011.
II. Potential Errors In Epidemiologic Studies Random Error Dr. Sherine Shawky.
Topics Today: Case I: t-test single mean: Does a particular sample belong to a hypothesized population? Thursday: Case II: t-test independent means: Are.
EVAL 6970: Meta-Analysis Vote Counting, The Sign Test, Power, Publication Bias, and Outliers Dr. Chris L. S. Coryn Spring 2011.
Sampling: Final and Initial Sample Size Determination
Statistics and Quantitative Analysis U4320
1 Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved. Section 7.5 Estimation of a Population Variance This section presents methods.
EVAL 6970: Meta-Analysis Subgroup Analysis Dr. Chris L. S. Coryn Kristin A. Hobson Fall 2013.
Université d’Ottawa / University of Ottawa 2001 Bio 4118 Applied Biostatistics L10.1 CorrelationCorrelation The underlying principle of correlation analysis.
EVAL 6970: Meta-Analysis Effect Sizes and Precision: Part I Dr. Chris L. S. Coryn Spring 2011.
EVAL 6970: Meta-Analysis Fixed-Effect and Random- Effects Models Dr. Chris L. S. Coryn Spring 2011.
EVAL 6970: Meta-Analysis Meta-Regression and Complex Data Structures Dr. Chris L. S. Coryn Spring 2011.
EVAL 6970: Meta-Analysis Heterogeneity and Prediction Intervals Dr. Chris L. S. Coryn Spring 2011.
PSY 307 – Statistics for the Behavioral Sciences
1 Confidence Interval for a Mean. 2 Given A random sample of size n from a Normal population or a non Normal population where n is sufficiently large.
Selecting Research Participant 1. Sample & Population A population is the entire set of individuals of interest to a researcher. A sample is a set of.
Horng-Chyi HorngStatistics II_Five43 Inference on the Variances of Two Normal Population &5-5 (&9-5)
Chap 9-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 9 Estimation: Additional Topics Statistics for Business and Economics.
Chapter Topics Confidence Interval Estimation for the Mean (s Known)
Heterogeneity in Hedges. Fixed Effects Borenstein et al., 2009, pp
Chapter 9 Hypothesis Testing II. Chapter Outline  Introduction  Hypothesis Testing with Sample Means (Large Samples)  Hypothesis Testing with Sample.
BA 275 Quantitative Business Methods
1 Confidence Intervals for Means. 2 When the sample size n< 30 case1-1. the underlying distribution is normal with known variance case1-2. the underlying.
Understanding sample survey data
Business Statistics, A First Course (4e) © 2006 Prentice-Hall, Inc. Chap 8-1 Chapter 8 Confidence Interval Estimation Business Statistics, A First Course.
1/49 EF 507 QUANTITATIVE METHODS FOR ECONOMICS AND FINANCE FALL 2008 Chapter 9 Estimation: Additional Topics.
Standard error of estimate & Confidence interval.
Review of normal distribution. Exercise Solution.
AM Recitation 2/10/11.
Review of Statistical Inference Prepared by Vera Tabakova, East Carolina University ECON 4550 Econometrics Memorial University of Newfoundland.
EVAL 6970: Cost Analysis for Evaluation Dr. Chris L. S. Coryn Nick Saxton Fall 2014.
Advanced Statistics for Researchers Meta-analysis and Systematic Review Avoiding bias in literature review and calculating effect sizes Dr. Chris Rakes.
Stats for Engineers Lecture 9. Summary From Last Time Confidence Intervals for the mean t-tables Q Student t-distribution.
1 Introduction to Estimation Chapter Concepts of Estimation The objective of estimation is to determine the value of a population parameter on the.
Statistical Fundamentals: Using Microsoft Excel for Univariate and Bivariate Analysis Alfred P. Rovai Estimation PowerPoint Prepared by Alfred P. Rovai.
Chapter 9 Hypothesis Testing II: two samples Test of significance for sample means (large samples) The difference between “statistical significance” and.
Maximum Likelihood Estimator of Proportion Let {s 1,s 2,…,s n } be a set of independent outcomes from a Bernoulli experiment with unknown probability.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
The Campbell Collaborationwww.campbellcollaboration.org C2 Training: May 9 – 10, 2011 Introduction to meta-analysis.
Dependencies Complex Data in Meta-analysis. Common Dependencies Independent subgroups within a study (nested in lab?) Multiple outcomes on the same people.
1 Introduction Description of the video series Meta-analysis in R with Metafor.
Statistical Fundamentals: Using Microsoft Excel for Univariate and Bivariate Analysis Alfred P. Rovai Estimation PowerPoint Prepared by Alfred P. Rovai.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 7-1 4th Lesson Estimating Population Values part 2.
© Copyright McGraw-Hill 2000
Inference for 2 Proportions Mean and Standard Deviation.
ANOVA Assumptions 1.Normality (sampling distribution of the mean) 2.Homogeneity of Variance 3.Independence of Observations - reason for random assignment.
Schmidt & Hunter Approach to r Bare Bones. Statistical Artifacts Extraneous factors that influence observed effect Sampling error* Reliability Range restriction.
Aron, Aron, & Coups, Statistics for the Behavioral and Social Sciences: A Brief Course (3e), © 2005 Prentice Hall Chapter 6 Hypothesis Tests with Means.
: An alternative representation of level of significance. - normal distribution applies. - α level of significance (e.g. 5% in two tails) determines the.
Summarizing Risk Analysis Results To quantify the risk of an output variable, 3 properties must be estimated: A measure of central tendency (e.g. µ ) A.
Statistics for Business and Economics 8 th Edition Chapter 7 Estimation: Single Population Copyright © 2013 Pearson Education, Inc. Publishing as Prentice.
Statistical Inference Statistical inference is concerned with the use of sample data to make inferences about unknown population parameters. For example,
Systematic Reviews and Meta-analyses. Introduction A systematic review (also called an overview) attempts to summarize the scientific evidence related.
INFERENCE Farrokh Alemi Ph.D.. Point Estimates Point Estimates Vary.
Chapter 13 Understanding research results: statistical inference.
Example A population has a mean of 200 and a standard deviation of 50. A random sample of size 100 will be taken and the sample mean x̄ will be used to.
Lab Chapter 9: Confidence Interval E370 Spring 2013.
Chapter 7: The Distribution of Sample Means
Statistical issues in the validation of surrogate endpoints Stuart G. Baker, Sc.D.
CHAPTER 8 ESTIMATING WITH CONFIDENCE 8.2 Estimating a Population Proportion Outcome: I will state and check all necessary conditions for constructing a.
1 One goal in most meta-analyses is to examine overall, or typical effects We might wish to estimate and test the value of an overall (general) parameter.
1 Consider the k studies as coming from a population of effects we want to understand. One way to model effects in meta-analysis is using random effects.
Université d’Ottawa / University of Ottawa 2003 Bio 8102A Applied Multivariate Biostatistics L4.1 Lecture 4: Multivariate distance measures l The concept.
ESTIMATION.
Meta-analysis statistical models: Fixed-effect vs. random-effects
Selecting Research Participant
Statistical Inference for the Mean Confidence Interval
1-Way Random Effects Model
Presentation transcript:

EVAL 6970: Meta-Analysis Fixed-Effect and Random- Effects Models Dr. Chris L. S. Coryn Spring 2011

Agenda Fixed-effect models for meta- analysis Random-effects models for meta- analysis Review questions In-class activity

Fixed-Effect Models

Fixed-effect model: True effect

Fixed-Effect Models Given that all studies share the same true effect, the observed effect size varies from study to study only because of random (sampling) error Although error is random, the sampling distribution of the errors can be estimated

Fixed-Effect Models Fixed-effect model: True effects and sampling error

Fixed-Effect Models To obtain an estimate of the population effect (to minimize variance) a weighted mean is computed using the inverse of each study’s variance as the study’s weight in computing the mean effect

Fixed-Effect Models

With And

Random-Effects Models Does not assume that the true effect is identical across studies Because study characteristics vary (e.g., participant characteristics, treatment intensity, outcome measurement) there may be different effect sizes underlying different studies

Random-Effects Models Random-effects model: True effects

Random-Effects Models

Random-effects model: True effect and observed effect

Random-Effects Models

Random-Effects Model

Random-Effects Models

With And

Review Questions 1.When is it appropriate to use a fixed-effect model? 2.When is it appropriate to use a random-effects model? 3.How do the study weights differ for fixed-effect and random-effects models?

Today’s In-Class Activity Individually, or in your working groups, download “Data Sets 1-6 XLSX” from the course Website – Calculate the fixed-effect and random- effects model weighted means for Data Sets 1, 2, 3, 4, 5, and 6 – Calculate the 95% confidence intervals (i.e., LL and UL) for the weighted means from Data Sets 1, 2, 3, 4, 5, and 6 – Use “Meta-Analysis with Means, Binary Data, and Correlations XLSX” to assist with the calculations