Planning Your Review. Process of Qualitative Evidence Synthesis (Major & Savin-Baden 2010) Identify Studies related to research question ↓ Collate Qualitative.

Slides:



Advertisements
Similar presentations
The Robert Gordon University School of Engineering Dr. Mohamed Amish
Advertisements

Mixing different types of research in systematic reviews Methodological Challenges for the Twenty First Century Manchester, November 2007 James Thomas.
Narrative Synthesis in Systematic Reviews
Mixed methods synthesis ESRC Methods Festival 2006 James Thomas Institute of Education, University of London.
What is a review? An article which looks at a question or subject and seeks to summarise and bring together evidence on a health topic.
Protocol Development.
An Approach to Reviewing Mixed Methods Literature Dr Gail Boniface Dr Jill Riley School of Healthcare Studies Dr G. Boniface & Dr J Riley 04/12.
Secondary Data Analysis: Systematic Reviews & Associated Databases
9.30am Choosing a Method of Qualitative Synthesis Mr Andrew Booth, Reader in Evidence Based Information Practice, ScHARR, University of Sheffield.
Evidence Synthesis for Quality Improvement Purposes Davina Allen Nursing & Midwifery Studies.
Student Learning Development, TCD1 Systematic Approaches to Literature Reviewing Dr Tamara O’Connor Student Learning Development Trinity College Dublin.
8. Evidence-based management Step 3: Critical appraisal of studies
Choosing a Method of Qualitative Synthesis Dr Andrew Booth.
Inspire. Lead. Engage. Laura Banfield, Nursing Librarian Health Sciences Library September 2010 Introduction to Evidence- Informed Decision Making (EIDM)
Reviewing and Critiquing Research
Publishing qualitative studies H Maisonneuve April 2015 Edinburgh, Scotland.
Conducting a literature review Basics on writing a literature review in the health and medical sciences.
Reporting and Evaluating Research
Issues and Challenges around Appraising Qualitative Research
Dr Kate Flemming Department of Health Sciences University of York, UK
Introduction to evidence based medicine
1. Critical appraisal and qualitative research: exploring sensitivity analysis Angela Harden Methods for Research Synthesis Node, ESRC National Centre.
The Campbell Collaborationwww.campbellcollaboration.org C2 Training: May 9 – 10, 2011 Introduction to Systematic Reviews.
Workshop: Framework Synthesis, Meta-Ethnography and Realist Synthesis
Funded through the ESRC’s Researcher Development Initiative
Systematic Approaches to Literature Reviewing. The Literature Review ? “Literature reviews …… introduce a topic, summarise the main issues and provide.
Systematic Review of the Literature: A Novel Research Approach.
Teaching the Science Base of MCH Donna Strobino, PhD.
How to Write a Critical Review of Research Articles
Systematic Reviews.
Follow How to integrate evidence into practice and policy: Knowledge translation resources for practitioners with limited.
The Process of Conducting Research
Identifying the evidence Laura Macdonald Health Protection Scotland
The Literature Search and Background of the Problem.
The University of Sydney Sydney School of Public Health Qualitative Health Research Collaboration (QHeRC) 23 rd Feb 2010 Sian Smith Research Fellow, Screening.
9.45 am Introducing Three QES Methods – Framework Synthesis, Meta-Ethnography and Realist Synthesis Drs Andrew Booth and Chris Carroll.
Introduction and Overview. Evidence Synthesis of Qualitative Research in Europe (ESQUIRE) To provide participants with state-of-the art perspective on.
FOR 500 PRINCIPLES OF RESEARCH: PROPOSAL WRITING PROCESS
Quantitative and Qualitative Approaches
Workshop: Thematic Synthesis and Framework Synthesis Parts 1-4 – Data Extraction, Quality Assessment, Synthesising Across Studies, Completing the Analysis.
Literature Review. Outline of the lesson Learning objective Definition Components of literature review Elements of LR Citation in the text Learning Activity.
Workshop: Thematic Synthesis and Framework Synthesis Parts 1-4 – Data Extraction, Quality Assessment, Synthesising Across Studies, Completing the Analysis.
Project Thesis 2006 Adapted from Flor Siperstein Lecture 2004 Class CLASS Project Thesis (Fundamental Research Tools)
META-ANALYSIS, RESEARCH SYNTHESES AND SYSTEMATIC REVIEWS © LOUIS COHEN, LAWRENCE MANION & KEITH MORRISON.
Introducing QES Methods – the Basics: Thematic Synthesis & Framework Synthesis.
Christopher Manacci, MSN, ACNP, CCRN Acute Care Nurse Practitioner Critical Care Transport Services The Cleveland Clinic Director, ACNP Flight Nursing.
Question-led mixed methods research synthesis Centre launch 21 June 2005 David Gough and Sandy Oliver Institute of Education, University of London.
Doing a Systematic Review Jo Hunter Linda Atkinson Oxford University Health Care Libraries 1 March 2006 Workshops in Information Skills and Electronic.
Sifting through the evidence Sarah Fradsham. Types of Evidence Primary Literature Observational studies Case Report Case Series Case Control Study Cohort.
Introduction to meta-ethnography ESQUIRE Sheffield 4 th September :30-10am Ruth Garside Senior Lecturer in Evidence Synthesis.
Workshop A. Development of complex interventions Rob Anderson, PCMD Nicky Britten, PCMD.
Quality in qualitative research ESRC research methods festival July 2008 Jane Lewis, NCB.
How to Carry Out Research & Write it Up: An Introduction (b) Dr Dimitris Evripidou.
13-00 Introduction and Overview Andrew Booth, Reader in Evidence Based Information Practice, Co-Convenor – Cochrane Collaboration Qualitative Methods Group.
Evidence Based Practice (EBP) Riphah College of Rehabilitation Sciences(RCRS) Riphah International University Islamabad.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 27 Systematic Reviews of Research Evidence: Meta-Analysis, Metasynthesis,
Introducing framework synthesis and thematic synthesis Series of doctoral lectures on behalf of the Cochrane Qualitative and Implementation Methods Group.
Systematic Reviews of Evidence Introduction & Applications AEA 2014 Claire Morgan Senior Research Associate, WestEd.
A1 & A2 The aim: (separate) Critique a Qualitative study on “Telemonitoring of blood glucose and blood pressure in type 2 diabetes.” Critique a Quantitative.
Evidence Synthesis/Systematic Reviews of Eyewitness Accuracy
15-10 Planning Your Review Andrew Booth, Reader in Evidence Based Information Practice, Co-Convenor – Cochrane Collaboration Qualitative Methods Group.
Literature review Methods
Supplementary Table 1. PRISMA checklist
Literature review Lit. review is an account of what has been published on a topic by accredited scholars and researchers. Mostly it is part of a thesis.
3. Practical screen Theory development with systematic literature reviews Chitu Okoli for ICT University, Fall 2015.
Things to Remember… PubMed
Research Methodology BE-5305
What are systematic reviews and why do we need them?
Meta-analysis, systematic reviews and research syntheses
Presentation transcript:

Planning Your Review

Process of Qualitative Evidence Synthesis (Major & Savin-Baden 2010) Identify Studies related to research question ↓ Collate Qualitative Studies across chosen topic ↓ Examine theories and methods used in each study in-depth ↓ Compare and Analyse findings for Each Study ↓ Synthesise findings for each study ↓ Undertake interpretation of findings across studies ↓ Present interpretive narrative about synthesis of findings ↓ Provide series of recommendations

Stages of a Qualitative Evidence Synthesis? Formulating the review question Conducting a systematic literature search Screening and selecting appropriate research articles Analyzing and synthesizing qualitative findings Maintaining quality control Presenting findings (Sandelowski & Barroso, 2007)

Garside, 2010, PhD Thesis

Eight Key Questions 1.THE QUESTION: Starting Point or Early Outcome of Review? 2.THE QUESTION: Comprehensive Searching versus Sampling 3.THE DATA: Participants’ Comments and/or Authors’ Interpretations 4.THE DATA: Qualitative Data Versus Qualitative Research 5.STUDY QUALITY: Rich and Thick? 6.STUDY QUALITY: Appraisal for Exclusion or Moderation 7.ROLE OF THEORY: Theory Secure or Evolving 8.ROLE OF THEORY: Theory Generating/Theory Validating/Other

THE QUESTION

Is Your Question…… Fixed? – Pre-defined as a PICO (Population- Intervention-Comparison- Outcome) or SPICE (Setting-Perspective- Interest, Phenomenon of – Comparison- Evaluation) – Question is an “Anchor” (e.g. attached to an Effectiveness review) Negotiable? – To be explored as part of initial review process – Becomes clearer as you examine data (cp. Grounded theory approaches) – Question is a “Compass” NB. Even answering a fixed PICO question for HTAs may require exploration of phenomenon of untreated/pretreated condition (Lorenc et al, 2012)

Will You Describe or Interpret? All Reviews figure on continuum between Description and Interpretation Description – What does the data say? – factual reporting of “epidemiology” of studies, themes etc… Reader does work of interpretation Interpretation – What does the data mean? – “diagnosis” – subjective interpretation of “signs and symptoms” from data and themes etc… Reviewer does work of interpretation – may be contested

THE DATA/STUDY QUALITY

A Caution! “it was found to be necessary…to include evidence not relating directly to interventions. In this respect, these reviews appear to be generally representative of the field of public health, where relatively little substantive qualitative evidence on specific interventions is available…..this is probably the case in many areas of social and health research. If so, limiting inclusion to qualitative studies of interventions alone will not be a practicable course of action, due to the lack of data (cf. Garside et al., 2009a)” (Lorenc et al, 2012).

Data/Study Quality How Rich (“Thick”) is Your Data? – Qualitative data from “thin” studies (or textual responses to surveys) will not sustain interpretive approaches – Rich/“Thick” reports will sustain interpretive approaches – may allow selective sampling/ theoretical saturation How Will You Use Quality Assessment? – To Exclude Studies? (May be a luxury you cannot afford) – To Moderate Study Findings? (Will you examine which findings are supported by which quality studies? – Qualitative Sensitivity Analysis)

ROLE OF THEORY

Will You Generate, Explore, Test Theory (Gough et al, 2012)? Generate – may require “suspension of disbelief” – quality assessment/value judgement may come later (cp. Brainstorming)- Explore – looking for patterns Test – quality assessment differentiates well- supported and unsupported data NB. We (Carroll & Booth) are currently conducting empirical work on systematic identification of Theories Pragmatic outputs e.g. HTAs or Clinical Guidelines may not require theory Other outputs may have theory generation as a major objective

What Are Your Choices? Dixon Woods et al, 2004 Booth et al 2011 Hannes & Lockwood, 2011 Ring et al, 2011 Gough et al, 2012 Pope et al, 2007

Toolbox Texts Popay J, Roberts H, Sowden A et al. (2006) Guidance on the Conduct of Narrative Synthesis in Systematic Reviews: a Product from the ESRC Methods Programme. Barnett-Page E, Thomas J. Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol Aug 11;9: Barnett-Page, E and Thomas, J (2009) Methods for the synthesis of qualitative research: a critical review. NCRM Working Paper. NCRM. (Unpublished) methods%2520paper%2520NCRM.pdf methods%2520paper%2520NCRM.pdf Dixon-Woods M, Agarwal S, Young B et al (2006). Integrative approaches to qualitative and quantitative evidence. Health Development Agency Pope C, Mays N & Popay J. Synthesizing Qualitative and Quantitative Health Evidence: A Guide to Methods. ISBN: ISBN: X Open University Press. Thomas J, Harden A (2008) Methods for the thematic synthesis of qualitative research in systematic reviews BMC Medical Research Methodology 8:45http://

Decisions? Decisions! Hannes, K., & Lockwood, C. (2011). Synthesizing qualitative research: choosing the right approach. BMJ Books.

Non-Epistemological/Non- Methododological Considerations Available Expertise – In Reviewing and In Qualitative Research Available Time Relationship with Quantitative Syntheses – Pre-existing Review – Sequentially – In Parallel – [Iteratively] – [Combined Methods versus Separate Methods] To include: Any Qualitative Research? OR Specific methods? OR only well-described methods and thick detail of findings?

What does the Field look like? Some Tools – PubMed Health Services Research Special Queries – PubMed Reminer – genetics/pubreminer/ genetics/pubreminer/

Similar Reviews? qes-register/ qes-register/

Some Practicalities Use of/Selection of Methodological Filters Key studies for Citation Searching Examples of Data Extraction Forms Selection of Critical Appraisal Checklist Innovative Ways of Presentation

Conclusions Question may involve experience of Condition as well as Intervention studies Scoping is Time Well-Spent Searching will be more challenging Sifting will be more time-consuming Allow extra time for Interpretation (Synthesis is not an End but a Means!)

References - 1 Barnett-Page E, Thomas J. Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol Aug 11;9:59. Booth, A, Papaioannou, D and Sutton, A J (2011). Systematic Approaches to a Successful Literature Review. SAGE publications Candy B, King M, Jones L, Oliver S. Using qualitative synthesis to explore heterogeneity of complex interventions. BMC Med Res Methodol Aug 26;11:124. Dixon-Woods M, Agarwal S, Young B, Jones D, Sutton A. (2004) Integrative approaches to qualitative and quantitative evidence. London: Health Development Agency Gough, D, Oliver, S, Thomas J (2012) An Introduction to Systematic Reviews. London: Sage Publications. Lorenc, T., Pearson, M., Jamal, F., Cooper, C. and Garside, R. (2012), The role of systematic reviews of qualitative evidence in evaluating interventions: a case study. Res. Synth. Method, 3: 1–10.

References - 2 Popay J, Roberts H, Sowden A, Pettticrew M, Arai L, Rodgers M, Britten N: Guidance on the conduct of narrative synthesis in systematic reviews. ects/nssr/ ects/nssr/2007 Pope C, Mays N, Popay J: Synthesizing Qualitative and Quantitative Health Evidence: a Guide to Methods. Maidenhead: Open University Press; Ring N., Ritchie K, Mandava L, Jepson R. (2011) A guide to synthesising qualitative research for researchers undertaking health technology assessment and systematic reviews. NHS Quality Improvement Scotland and University of Stirling, Edinburgh. Snilstveit, B., Oliver, S., & Vojtkova, M. (2012). Narrative approaches to systematic review and synthesis of evidence for international development policy and practice. Journal of development effectiveness, 4(3), Thomas J, Harden A (2009) Methods for the thematic synthesis of qualitative research in systematic reviews, BMC Medical Research Methodology 8:45