7: Fixed & Random Summaries in r and d with Preferred Input Fixed and random-effects overall or summary effects for correlations and mean differences Meta-analysis.

Slides:



Advertisements
Similar presentations
Introduction Describe what panel data is and the reasons for using it in this format Assess the importance of fixed and random effects Examine the Hausman.
Advertisements

I OWA S TATE U NIVERSITY Department of Animal Science Using Basic Graphical and Statistical Procedures (Chapter in the 8 Little SAS Book) Animal Science.
Effect Size Overheads1 The Effect Size The effect size (ES) makes meta-analysis possible. The ES encodes the selected research findings on a numeric scale.
Effect Size Joseph Stevens, Ph.D., University of Oregon (541) , © Stevens 2006.
Statistical Models in Meta- Analysis T i ~ N(  i  i 2 )  i ~ N(  2 )
Comparing r and b How to Choose, Moving From One to the Other, and Sampling Distributions.
EVAL 6970: Meta-Analysis Fixed-Effect and Random- Effects Models Dr. Chris L. S. Coryn Spring 2011.
EVAL 6970: Meta-Analysis Fixed-Effect and Random- Effects Models Dr. Chris L. S. Coryn Spring 2011.
Linear Regression Models Based on Chapter 3 of Hastie, Tibshirani and Friedman Slides by David Madigan.
Meta Analysis An Introduction. What… is… it? A “study of studies,” i.e., averaging results across studies in a given domain to get a better estimate of.
Chap 9-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 9 Estimation: Additional Topics Statistics for Business and Economics.
Practical Meta-Analysis -- D. B. Wilson
Overview of Meta-Analytic Data Analysis. Transformations Some effect size types are not analyzed in their “raw” form. Standardized Mean Difference Effect.
Heterogeneity in Hedges. Fixed Effects Borenstein et al., 2009, pp
Meta-Analysis and Meta- Regression Airport Noise and Home Values J.P. Nelson (2004). “Meta-Analysis of Airport Noise and Hedonic Property Values: Problems.
Hashed Samples Selectivity Estimators for Set Similarity Selection Queries.
EFFECT SIZE Parameter used to compare results of different studies on the same scale in which a common effect of interest (response variable) has been.
The Campbell Collaborationwww.campbellcollaboration.org C2 Training: May 9 – 10, 2011 Data Analysis and Interpretation: Computing effect sizes.
Overview of Meta-Analytic Data Analysis
Sampling : Error and bias. Sampling definitions  Sampling universe  Sampling frame  Sampling unit  Basic sampling unit or elementary unit  Sampling.
8: Fixed & Random Summaries with Preferred Binary Input Fixed and random-effects overall or summary effects for odds and risk Meta-analysis in R with Metafor.
Data Collection & Processing Hand Grip Strength P textbook.
The Campbell Collaborationwww.campbellcollaboration.org Introduction to Robust Standard Errors Emily E. Tanner-Smith Associate Editor, Methods Coordinating.
Practical Meta-Analysis -- The Effect Size -- D. B. Wilson 1 The Effect Size The effect size (ES) makes meta-analysis possible The ES encodes the selected.
Moderators. Definition Moderator - A third variable that conditions the relations of two other variables Example: SAT-Quant and math grades in school.
Model Building III – Remedial Measures KNNL – Chapter 11.
Guide to Handling Missing Information Contacting researchers Algebraic recalculations, conversions and approximations Imputation method (substituting missing.
Implications for Meta-analysis Literature Comparison of Weights in Meta-analysis Under Realistic Conditions Michael T. Brannick Liu-Qin Yang Guy Cafri.
Error Component Models Methods of Economic Investigation Lecture 8 1.
Statistics for the Behavioral Sciences Second Edition Chapter 11: The Independent-Samples t Test iClicker Questions Copyright © 2012 by Worth Publishers.
6: Fixed & Random Summaries with Generic Input Fixed and random-effects overall or summary effects for any kind of effect size Meta-analysis in R with.
Meta-Analysis using HLM 6.0 Yaacov Petscher Florida Center for Reading Research.
Statistical analysis Outline that error bars are a graphical representation of the variability of data. The knowledge that any individual measurement.
The Campbell Collaborationwww.campbellcollaboration.org C2 Training: May 9 – 10, 2011 Introduction to meta-analysis.
Effect Size Calculation for Meta-Analysis Robert M. Bernard Centre for the Study of Learning and Performance Concordia University February 24, 2010 February.
Dependencies Complex Data in Meta-analysis. Common Dependencies Independent subgroups within a study (nested in lab?) Multiple outcomes on the same people.
Models with categorical covariates, continuous covariates, or both
1 Introduction Description of the video series Meta-analysis in R with Metafor.
Schmidt & Hunter Approach to r Bare Bones. Statistical Artifacts Extraneous factors that influence observed effect Sampling error* Reliability Range restriction.
STA Lecture 171 STA 291 Lecture 17 Chap. 10 Estimation – Estimating the Population Proportion p –We are not predicting the next outcome (which is.
5: Preferred Upload Formats Getting Excel files to Metafor for correlations, standardized mean differences, and binary studies Meta-analysis in R with.
Fixed- v. Random-Effects. Fixed and Random Effects 1 All conditions of interest – Fixed. Sample of interest – Random. Both fixed and random-effects meta-analyses.
Tutorial I: Missing Value Analysis
Younghun Han Department of Epidemiology UT MD Anderson Cancer Center
Hunter & Schmidt in Metafor. Input Bare-bones - metafor.
3: Uploading Data Get datasets into R or use a Metafor library dataset Meta-analysis in R with Metafor.
Week Seven.  The systematic and rigorous integration and synthesis of evidence is a cornerstone of EBP  Impossible to develop “best practice” guidelines,
1 One goal in most meta-analyses is to examine overall, or typical effects We might wish to estimate and test the value of an overall (general) parameter.
Meta-analysis Overview
I-squared Conceptually, I-squared is the proportion of total variation due to ‘true’ differences between studies. Proportion of total variance due to.
The Conditional Random-Effects Variance Component in Meta-regression
Regression Models for Linkage: Merlin Regress
Analysis for Designs with Assignment of Both Clusters and Individuals
Data Sciences Unit, School of Psychology, Deakin University
H676 Week 3 – Effect Sizes Additional week for coding?
Intro to Single Paper Meta-Analyses
Meta-analysis: Conceptual and Methodological Introduction
Improved Weights for Estimating the Meta-analytic Mean
Meta-analysis statistical models: Fixed-effect vs. random-effects
9: Basic Confidence and Prediction Intervals
Combining Effect Sizes
Hedges’ Approach.
Ratio and regression estimation STAT262, Fall 2017
Random and Mixed Effects ANOVA
الأستاذ المساعد بقسم المناهج وطرق التدريس
The t distribution and the independent sample t-test
Measuring Change in Two-Wave Studies
Random and Mixed Effects ANOVA
1-Way Random Effects Model
Determining Which Method to use
Presentation transcript:

7: Fixed & Random Summaries in r and d with Preferred Input Fixed and random-effects overall or summary effects for correlations and mean differences Meta-analysis in R with Metafor

Overall Summary The Metafor program uses inverse variance weights to combine study ES into an overall or summary effect size You can specify Fixed (common) effects analysis or Random (varying) effects analysis If RE, you can choose from several methods for estimating the random effects variance component (REVC). Different REVC, weight, summary. The method statement specifies both fixed or random and which REVC estimator you want The effect sizes input to metafor may be transformed in various ways The measure option tells metafor what transformation you want

Correlation Measures If you input r and N, you can choose either the raw correlations or one of two transformations for the analysis using measure = “ choice ” command : “COR” – Pearson correlation and associated variance Vtype = “LS” is the default. The large sample approximation is used for the variance. Vtype = “UB” provides and unbiased estimate of the sampling variance. “UCOR” – correction for slight bias in Pearson correlation Vtype = “LS” is the default. The large sample approximation is used for the variance. Vtype = “UB” provides and unbiased estimate of the sampling variance. “ZCOR” Fisher’s z transformation and associated variance

R code: LMX & AC Rockstuhl, T., Dulebohn, J. H., Ang, S., & Shore, L. M. (2012). Leader–member exchange (LMX) and culture: A meta-analysis of correlates of LMX across 23 countries. Journal of Applied Psychology, 97, doi: /a Measure=“COR” and method =“HS” Note that choosing the Hunter-Schmidt estimator, Metafor still uses the inverse variance method, and does not produce the same analysis as would following the method in Hunter and Schmidt’s 2004 book. Measure =“ZCOR” and method=“DL” Note that analysis is in Z and is not transformed back to r. You must do that, and the variance cannot be transformed directly, but the confidence and credibility limits can. Show R code and results

Mean Differences If you use the preferred format (M, SD, N for each group), you can choose measure = “choice” : “MD” mean difference (no standardizing for pooled SD) This is not usually feasible because you need exactly the same measurement or scale across all the studies (e.g., if every study compared men to women on the Beck Depression Index) “SMD” for standardized mean difference The usual choice (e.g., all studies compared men and women on depression, but they used different scales to measure depression)

R code: Appetite study – manufactured data Measure=“MD”, method = “DL” Measure=“SMD”, method=“DL” Measure=“SMD”, method=“REML” Show R code and results