1. Searching for Relevant Studies Interactive Quiz Prepared for: The Agency for Healthcare Research and Quality (AHRQ) Training Modules for Systematic Reviews Methods Guide www.ahrq.gov

2. You are interested in evaluating the benefits and harms associated with the use of thrombectomy devices in acute coronary syndromes. You need to determine what literature is available to conduct your review. Overview

3. A comprehensive search is required. When conducting this search, what do you need to assure? A.You balance precision and recall. B.You have gotten every possible relevant citation, regardless of the workload involved. C.You limit the search so that only relevant citations are found. A Comprehensive Search

4. Given the need to balance precision and recall, what should you do before initiating a search on the use of thrombectomy in patients with acute coronary syndromes? A.Enter the search as “thrombectomy AND acute coronary syndromes.” B.Enter the search as “thrombectomy OR acute coronary syndromes.” C.Understand the topic, devise an analytic framework, pose clearly defined key questions, and understand the scope of the review before devising your strategy. The First Step

5. Your due diligence pays off. You now realize that your initial search “thrombectomy AND acute coronary syndrome” would compromise the recall. Using “((Thrombectomy OR MerciClot.mp OR “other devices names”) AND (acute coronary syndromes OR myocardial infarction OR angina, unstable))” would assure better recall without appreciably impacting precision. The Power of Due Diligence

6. You try to decide whether to perform one search or two searches (one for “benefits” and another for “harms”). Which of the following would cause you to perform two searches? A.Performing two searches is redundant and should be avoided. B.You decide a priori to allow only data from randomized controlled trials (RCTs) when evaluating benefits but allow RCTs and observational trials for harms. C.The available literature base on the topic is small. More Than One Search May Be Needed

7. You need to decide which databases to use. The minimum requirement for a thorough search of the literature would include which two databases? A.MEDLINE + TOXNET B.MEDLINE + CINAHL C.MEDLINE + Cochrane Central Database Selection

8. Why would you decide to use hand searching of references from identified systematic reviews, studies, and abstract booklets from prominent meetings within the field of interest? A.Hand searching can capture citations that are not indexed or are improperly indexed. B.Limiting hand searching to these sources can target this time-intensive activity to areas where the yield will be the greatest. C.Both are correct. Hand Searching

9. You decide to search the U.S. Food and Drug Administration Web site and ClinicalTrials.gov to identify studies that might be appropriate for your systematic review. These Web sites are sources of what kind of documents? A.Black literature B.Grey literature C.SIPs Other Documents

10. You conduct a thorough search of MEDLINE and Cochrane Central, use two searches (one for “benefits” and another for “harms”), and employ targeted hand searching and grey literature evaluation. What is the last thing you need to remember to do that is germane to searching? A.Choose only citations that agree with your preconceived notions. B.Selectively report aspects of your search strategy. C.Provide transparent reporting of search strategies and the citations you identified. The Final Task

11.  Literature searching can have many pitfalls.  Readers will have confidence in the results of your systematic review if you:  demonstrate a comprehensive understanding of the topic,  use multiple searches and databases,  use hedges,  use hand searching and grey literature, and  develop a transparent reporting structure. Summary

12.  This quiz was prepared by C. Michael White, Pharm.D., FCP, FCCP, a member of the University of Connecticut/Hartford Hospital Evidence-based Practice Center.  This module is based on chapter 5 in version 1.0 of the Methods Reference Guide for Effectiveness and Comparative Effectiveness Reviews (available at: http://effectivehealthcare.ahrq.gov/repFiles/ 2007_10Draft MethodsGuide.pdf). Author