How to Evaluate the Effects of Potential Bias in Meta-analysis in R.

Slides:

Advertisements

Similar presentations

Qualitative predictor variables

Advertisements

Likelihood & Hierarchical Models  ij  j,  j 2   j ,  2 

Chapter 12 Inference for Linear Regression

EVAL 6970: Meta-Analysis Vote Counting, The Sign Test, Power, Publication Bias, and Outliers Dr. Chris L. S. Coryn Spring 2011.

Change in schedule… Website currently says…  August 5 th – first draft  August 19 th – second draft Lets have instead…  August 19 th – first draft.

Economics 105: Statistics GH 24 due Wednesday. Hypothesis Tests on Several Regression Coefficients Consider the model (expanding on GH 22) Is “race” as.

Estimation  Samples are collected to estimate characteristics of the population of particular interest. Parameter – numerical characteristic of the population.

Significance and effect sizes What is the problem with just using p-levels to determine whether one variable has an effect on another? Don’t EVER just.

Funded through the ESRC’s Researcher Development Initiative Department of Education, University of Oxford Session 2.3 – Publication bias.

Statistical Models in Meta- Analysis T i ~ N(  i  i 2 )  i ~ N(  2 )

1 Structural Reform and Growth in Transition: A Meta-Analysis Jan Babecký Czech National Bank Tomáš Havránek Czech National Bank Charles University, Prague.

EVAL 6970: Meta-Analysis Fixed-Effect and Random- Effects Models Dr. Chris L. S. Coryn Spring 2011.

EVAL 6970: Meta-Analysis Fixed-Effect and Random- Effects Models Dr. Chris L. S. Coryn Spring 2011.

Measures of Variability or Dispersion Range - high and lows. –Limitations: Based on only two extreme observations Interquartile range - measures variablility.

These slides are additional material for TIES4451 Data Mining: Data Lecture 3 TIES445 Data mining Nov-Dec 2007 Sami Äyrämö.

Independent Sample T-test Often used with experimental designs N subjects are randomly assigned to two groups (Control * Treatment). After treatment, the.

1 Chapter 17: Introduction to Regression. 2 Introduction to Linear Regression The Pearson correlation measures the degree to which a set of data points.

Standard error of estimate & Confidence interval.

Chapter 11 Simple Regression

1/2555 สมศักดิ์ ศิวดำรงพงศ์

  Meta-Analysis of Correlated Data. Common Forms of Dependence Multiple effects per study –Or per research group! Multiple effect sizes using same.

Daniel Acuña Outline What is it? Statistical significance, sample size, hypothesis support and publication Evidence for publication bias: Due.

How to Calculate Effect Sizes for Meta-analysis in R.

Understanding Multivariate Research Berry & Sanders.

MATH 3359 Introduction to Mathematical Modeling Project Multiple Linear Regression Multiple Logistic Regression.

Guide to Handling Missing Information Contacting researchers Algebraic recalculations, conversions and approximations Imputation method (substituting missing.

6: Fixed & Random Summaries with Generic Input Fixed and random-effects overall or summary effects for any kind of effect size Meta-analysis in R with.

Statistical Analysis Regression & Correlation Psyc 250 Winter, 2008.

Kirsten Fiest, PhD June 23, CONDUCTING META-ANALYSES IN HEALTH RESEARCH.

Analysis of Residuals Data = Fit + Residual. Residual means left over Vertical distance of Y i from the regression hyper-plane An error of “prediction”

Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.

The Campbell Collaborationwww.campbellcollaboration.org C2 Training: May 9 – 10, 2011 Introduction to meta-analysis.

A Process Control Screen for Multiple Stream Processes An Operator Friendly Approach Richard E. Clark Process & Product Analysis.

Models with categorical covariates, continuous covariates, or both

DATA PREPARATION: PROCESSING & MANAGEMENT Lu Ann Aday, Ph.D. The University of Texas School of Public Health.

Regression & Correlation. Review: Types of Variables & Steps in Analysis.

CROSS-VALIDATION AND MODEL SELECTION Many Slides are from: Dr. Thomas Jensen -Expedia.com and Prof. Olga Veksler - CS Learning and Computer Vision.

Schmidt & Hunter Approach to r Bare Bones. Statistical Artifacts Extraneous factors that influence observed effect Sampling error* Reliability Range restriction.

Week 5Slide #1 Adjusted R 2, Residuals, and Review Adjusted R 2 Residual Analysis Stata Regression Output revisited –The Overall Model –Analyzing Residuals.

Environmental Modeling Basic Testing Methods - Statistics III.

Development and the Role of Meta- analysis on the Topic of Inflammation Donald S. Likosky, Ph.D.

A first order model with one binary and one quantitative predictor variable.

6.1 - One Sample One Sample  Mean μ, Variance σ 2, Proportion π Two Samples Two Samples  Means, Variances, Proportions μ 1 vs. μ 2.

LESSON 6: REGRESSION 2/21/12 EDUC 502: Introduction to Statistics.

Fixed- v. Random-Effects. Fixed and Random Effects 1 All conditions of interest – Fixed. Sample of interest – Random. Both fixed and random-effects meta-analyses.

1 SPSS MACROS FOR COMPUTING STANDARD ERRORS WITH PLAUSIBLE VALUES.

A Synthesis of Annual Estimates of TIR and D for Wild Populations Presenter: Paul Wilson CSS Annual Meeting Apr 2 nd 2010.

G Lecture 71 Revisiting Hierarchical Mixed Models A General Version of the Model Variance/Covariances of Two Kinds of Random Effects Parameter Estimation.

Data handling Sabine Beulke, Central Science Laboratory, York, UK Kinetic Evaluation according to Recommendations by the FOCUS Work Group on Degradation.

R. Kass/W03 P416 Lecture 5 l Suppose we are trying to measure the true value of some quantity (x T ). u We make repeated measurements of this quantity.

The Instrumental Variables Estimator The instrumental variables (IV) estimator is an alternative to Ordinary Least Squares (OLS) which generates consistent.

Chapter 22 Inferential Data Analysis: Part 2 PowerPoint presentation developed by: Jennifer L. Bellamy & Sarah E. Bledsoe.

Quantitative Methods Residual Analysis Multiple Linear Regression C.W. Jackson/B. K. Gordor.

Variability Mechanics. The Average Deviation Another approach to estimating variance is to directly measure the degree to which individual data points.

Random Variable.

Testing for moderators

Corticosteroids in the Management of Hyponatremia, Hypovolemia, and Vasospasm in Subarachnoid Hemorrhage: A Meta-Analysis Cerebrovasc Dis 2016;42:

Analysis of Variance (ANOVA)

Inferences and Conclusions from Data

Marathon Miles per Hour at NAPA Valley 2015 Marathon by Age and Gender

HS 167 Test Prep Wednesday 5/23/07; 9:45 – 12:00

Random Variable.

Evaluating Hypotheses

A Meta-analysis of the Survival Processing Advantage in Memory

Chapter 13 Group Differences

Write the agenda Start your warm-up Warm-up …,-2, -1, 0, 1, 2,…

MetaForest Using random forests to explore heterogeneity in meta-analysis Caspar J. van Lissa, Utrecht University NL

Statistical Power.

Fig. 6. Begg's funnel plot for publication bias in the selection of studies. The horizontal axis represents the log risk ratio (RR) and the vertical axis.

Presentation transcript:

How to Evaluate the Effects of Potential Bias in Meta-analysis in R

Load, Prep, and Check library(ggplot2) library(metafor) #load the data marine <- read.csv("marine_meta_short.csv", na.strings=c("NA", ".", "")) #check variable types summary(marine)

Calculating Effect Sizes by Hand #Log Ratio marine$LR <- log(marine$Y_Poly) – log(marine$Y_Avg_Mono) marine$VLR <- with(marine, { SD_Poly^2 / (N_Poly * Y_Poly^2) + SD_Avg_Mono^2 / (N_Avg_Mono * Y_Avg_Mono^2) })

Fit a Model (we’ll talk about this soon) mod <- rma(LR, VLR, data=marine) Warning message: In rma(LR, VLR, data = marine) : Studies with NAs omitted from model fitting.

What did we find? Random-Effects Model (k = 168; tau^2 estimator: REML) … Model Results: estimate se zval pval ci.lb ci.ub ** --- Signif. codes: 0 ‘***’ ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

funnel(mod)

Many funnel types funnel(mod, main="Standard Error") funnel(mod, yaxis="vi", main="Sampling Variance") funnel(mod, yaxis="seinv", main="Inverse Standard Error") funnel(mod, yaxis="vinv", main="Inverse Sampling Variance")

Many funnel types

trimfill(mod, side="right") Model Results: estimate se zval pval ci.lb ci.ub < *** --- Signif. codes: 0 ‘***’ ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1

What is Trim and Fill Doing? par(mfrow=c(1,2)) funnel(mod) funnel(trimfill(mod, side="right")) par(mfrow=c(1,1))

What is Trim and Fill Doing?

Fail-Safe: fsn(LR, VLR, data=marine) Fail-safe N Calculation Using the Rosenthal Approach Observed Significance Level: <.0001 Target Significance Level: 0.05 Fail-safe N: 12681

Other Types of Fail-Safe Numbers > fsn(LR, VLR, data=marine, type="Rosenberg") #based on weighted analysis Fail-safe N Calculation Using the Rosenberg Approach Average Effect Size: Observed Significance Level: <.0001 Target Significance Level: 0.05 Fail-safe N: 3733

Other Types of Fail-Safe Numbers > fsn(LR, VLR, data=marine, type="Orwin") #based on unweighted analysis and target effect size Fail-safe N Calculation Using the Orwin Approach Average Effect Size: Target Effect Size: Fail-safe N: 168

Influence: inf(mod)