List of Methodological Limitations (Pollock, 2017)

Slides:



Advertisements
Similar presentations
What is a review? An article which looks at a question or subject and seeks to summarise and bring together evidence on a health topic.
Advertisements

Protocol Development.
Introducing... Reproduced and modified from a presentation produced by Zoë Debenham from the original presentation created by Kate Light, Cochrane Trainer.
What do I do with the literature when I’ve found it? Alison Brettle, Lecturer (Information Specialist) School of Nursing and Midwifery University of Salford.
Undertaking Systematic Literature Reviews By Dr. Luke Pittaway Institute for Entrepreneurship and Enterprise Development.
Information Retrieval for High-Quality Systematic Reviews: The Basics 6.0.
Assessing and summarizing research Nilusha Kapugama and Rohan Samarajiva, PhD 29 March 2015, Nagarkot, Nepal This work was carried out with the aid of.
THE COCHRANE LIBRARY ON WILEY INTERSCIENCE. Presentation Agenda Brief introduction of Evidence-Based Medicine theories The Cochrane Collaboration – origins,
Systematic Reviews.
Division of Population Health Sciences Royal College of Surgeons in Ireland Coláiste Ríoga na Máinleá in Éirinn Diagnostic accuracy of the STRATIFY clinical.
Evidence Based Medicine Meta-analysis and systematic reviews Ross Lawrenson.
Zoe G. Davies Centre for Evidence-Based Conservation University of Birmingham, UK Systematic Review Methodology: a brief summary.
Plymouth Health Community NICE Guidance Implementation Group Workshop Two: Debriding agents and specialist wound care clinics. Pressure ulcer risk assessment.
Systematic reviews to support public policy: An overview Jeff Valentine University of Louisville AfrEA – NONIE – 3ie Cairo.
Meta-analysis and “statistical aggregation” Dave Thompson Dept. of Biostatistics and Epidemiology College of Public Health, OUHSC Learning to Practice.
Community wide interventions for physical activity Clinical
This material was developed by Oregon Health & Science University, funded by the Department of Health and Human Services, Office of the National Coordinator.
Doing a Systematic Review Jo Hunter Linda Atkinson Oxford University Health Care Libraries 1 March 2006 Workshops in Information Skills and Electronic.
Module 3 Finding the Evidence: Pre-appraised Literature.
Sifting through the evidence Sarah Fradsham. Types of Evidence Primary Literature Observational studies Case Report Case Series Case Control Study Cohort.
Copyright © 2011 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 18 Systematic Review and Meta-Analysis.
Systematic reviews and meta-analyses: when and how to do them Andrew Smith Royal Lancaster Infirmary 18 May 2015.
Evidence Based Practice (EBP) Riphah College of Rehabilitation Sciences(RCRS) Riphah International University Islamabad.
Sources of systematic reviews Arash Etemadi, MD PhD Department of Epidemiology and Biostatistics, Tehran University of Medical Sciences.
Contact: Patrick Phillips,
Tim Friede Department of Medical Statistics
FIGURE 3. FOREST PLOT AFTER CONTROLLING FOR NETWORK INCONSISTENCY
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov March 23, 2011.
Evidence Synthesis/Systematic Reviews of Eyewitness Accuracy
NURS3030H NURSING RESEARCH IN PRACTICE MODULE 7 ‘Systematic Reviews’’
TJTS505: Master's Thesis Seminar
The Research Design Continuum
Sign critical appraisal course: exercise 1
Assessing Students' Understanding of the Scientific Process Amy Marion, Department of Biology, New Mexico State University Abstract The primary goal of.
Concept of a Review Article
Rachel Morell1, Simon Rosenbaum1,2 and Belinda J Parmenter1
People vs. Thing Intelligences. Victoria M. Bryan and John D
Supplementary Table 1. PRISMA checklist
Contact: Patrick Phillips,
Prospective Comparison between Rapid and Systematic Reviews on the Same Topics: A Feasibility Study Junqiao Chen1, Jon Brassey2, Yanfang Ma3, Qi Wang4,
Effective evidence-based occupational therapy
9/17/2018 Meeting local HTA requirements Challenges for the Pharma HTA Statistician Marie-Ange PAGET Project Statistician – Lilly France EFSPI meeting.
The Steps into creation of research
STROBE Statement revision
H676 Meta-Analysis Brian Flay WEEK 1 Fall 2016 Thursdays 4-6:50
PSYCH 610 Competitive Success/snaptutorial.com
PSYCH 610 Education for Service/snaptutorial.com.
The Evidence-Based Practice Cycle
کارگاه کشوری آموزش نقد و داوری مقالات علمی‌
WHO Guideline development
HOW TO WRITE A SYSTEMATIC/NARRATIVE REVIEW
Systematic Review (Advanced_Course_Module_6_Appendix)
Scientific Inquiry Standard B – 1.7.
Systematic reviews and meta-analysis
Information Pyramid UpToDate, Dynamed, FIRSTConsult, ACP PIER
School of Dentistry Education Research Fund (SDERF)
MECIR: the bits that reviewers keep getting wrong!
Sabine Wollscheid, Senior Researcher, Dr. phil.
Is performing a scoping review useful after recent Cochrane review?
Dr. Maryam Tajvar Department of Health Management and Economics
Project Title Subtitle: make sure you specify it is a research project
Developing Research Proposal Writing a Literature Review
Overview of different types of reviews : Scoping Reviews, Rapid Reviews, Systematic Reviews Housne
What are systematic reviews and why do we need them?
What is a review? An article which looks at a question or subject and seeks to summarise and bring together evidence on a health topic. Ask What is a review?
Meta-analysis, systematic reviews and research syntheses
Lack of Confidence Interval Reporting in Dermatology: A Call to Action
Systematic Review (Advanced Course: Module 6 Appendix)
Introduction to Systematic Reviews
Presentation transcript:

List of Methodological Limitations (Pollock, 2017) Development of workable solutions to overcome known limitations of Overview Methodology Broderick J11, Irving C22, Shokraneh F22, Ostinelli EG3, Walshe M1, Mockler D1, Adams C22 1 Trinity College Dublin, University of Dublin, Ireland, 2 University of Nottingham, UK,  3Department of Health Sciences, Università degli Studi di Milano, Italy Proposed solution List of Methodological Limitations (Pollock, 2017) Include other evidence in absence of updated Cochrane review. Highest form of evidence in hierarchy (Fig. 1) to be included in overview. 1. Is the overview to be limited to Cochrane reviews? Conduct wider electronic database search, search strategy for each form of evidence has been developed 2. Is the search strategy to be limited to databases of reviews? Quality assess each and include review scoring highest in quality assessment (AMSTAR as per point 5 below) 3. What action will be taken if there are overlapping reviews? Consider new primary studies generated from evidence search, if necessary conduct and harmonize subsidiary reviews 4. What action will be taken if included reviews are out of date? Appears to be most evidence for AMSTAR so this would be the tool of choice 5. What tool will be used to assess the quality of included reviews? Accept GRADE conducted a priori in Cochrane reviews, apply GRADE to other included reviews, no quality assessment for other forms of evidence 6. How will the quality of evidence within reviews be assessed? Present overall effect estimates without statistical analysis, only consider network meta-analytic methodology when pre-defined criteria met 7. Is there any statistical analysis to be carried out, using the data extracted from the reviews? New ways to combine data visually using infographic style where possible have been suggested 8. How will the evidence be brought together into an accessible summary? BACKROUND Overviews are a relatively new form of evidence synthesis. Even though great strides have been made in terms of overview development, a lack of consensus pertains to key methodological areas. We propose workable solutions to these and other known limitations of overview methodology. OBJECTIVE To generate workable solutions to known limitations of overview methodology.  METHODS Eight pre-determined methodological limitations or challenges (Pollock, 2017) of overview methodology were used as a focus for this work. Sensible, workable solutions for each were proposed from a systematic literature search pertaining to overview methodology and sound reasoning based on the hands-on experience of conducting an overview. RESULTS 6. Other forms of evidence relevant to review e.g. within grey literature 5. Controlled trials 4. Randomized controlled trials 3. Non-systematic or narrative reviews 2. Non-Cochrane reviews 1. Cochrane reviews Fig. 1 This work has generated criteria that will aid in the decision-making process around when to progress towards a network meta-analysis versus an overview. We have discussed how harmonization of subsidiary reviews may need to take place before an overview can be undertaken. Our work outlines how Cochrane systematic reviews can be included preferentially, but have suggested how lower hierarchical forms of evidence can be searched and presented for hypothesis formation and identification of evidence gaps to produce a true 'bird's-eye' view of the topic area (Fig. 1). We have developed a search strategy to source all hierarchical forms of evidence CONCLUSION Overview methodology lacks consistency. We have developed workable solutions which will be tested through the 'hands on' experience of conducting an overview (Yoga for Schizophrenia Overview). We hope some solutions may be applied generically to future overviews, or, at the very least, may stimulate discussion around standardization of overview methodology.  References: Pollock A, Campbell P, Brunton G, Hunt H, Estcourt L. Selecting and implementing overview methods: implications from five exemplar overviews, Syst Rev 2017, Jul 18;6(1):14