Quantitative Synthesis II Interactive Quiz Prepared for: The Agency for Healthcare Research and Quality (AHRQ) Training Modules for Systematic Reviews Methods Guide

Assume that you are performing a meta-analysis of randomized controlled trials on vitamin D supplementation and mortality in elderly people who are institutionalized. You want to explore whether or not the treatment effect differs across trials according to their maximum followup. The maximum length of followup is: A.A patient-level covariate B.A study-level covariate Covariates

You should perform only the subgroup analyses that are specified a priori and not perform post- hoc subgroup analyses. A.False B.True Subgroup Analysis

Because of the risk of ecological fallacy, meta- regressions on patient-level covariates should never be performed. A.True B.False Meta-Regressions and the Risk of Ecological Fallacy

Mean 25-hydroxy-D Concentration Assessing Study Conclusions Based on this example, which of the following statements is more likely to be true? A. These conclusions are based on a well constructed meta-regression (see on the right) and are definitely valid. B. The analyses and conclusions are suspect.

 Meta-analyses require understanding of covariates and how to analyze them.  Patient-level covariates differ across patients in the same study or in the same study arm.  Study-level covariates pertain to the whole study and do not vary across patients in the same study.  Results of subgroup analyses should be viewed with skepticism, especially when adjustments for multiple testing have not been performed.  If an association from a meta-regression on the mean of a patient-level covariate is biologically plausible, it merits further study. Summary

 This quiz was prepared by Joseph Lau, M.D., and Thomas Trikalinos, M.D., Ph.D., members of the Tufts Medical Center Evidence-based Practice Center.  The information in this module is based on Chapter 9 in Version 1.0 of the Methods Guide for Comparative Effectiveness Reviews (available at: es/2007_10DraftMethodsGuide.pdf). Authors