Issues and challenges to scoping and focusing the question ESQUIRE Qualitative Systematic Review Workshop University of Sheffield 8 September 2011 Janet.

Slides:



Advertisements
Similar presentations
Protocol Development.
Advertisements

Animal, Plant & Soil Science
Morag Ferguson and Susan Shandley Educational Projects Managers
Project Monitoring Evaluation and Assessment
8. Evidence-based management Step 3: Critical appraisal of studies
K U Leuven Systematic Review Workshop 4-6 June 2012
Publishing qualitative studies H Maisonneuve April 2015 Edinburgh, Scotland.
Making Sense of Assessments in HE Modules (Demystifying Module Specification) Jan Anderson University Teaching Fellow L&T Coordinator SSSL
Educational Psychology revision session
WAGGGS Policy & Guidelines: Adult Training, Learning and Development
How to Develop the Right Research Questions for Program Evaluation
Quality Assurance in the Bologna Process Fiona Crozier QAA
Empowerment Approach to Diabetes Education: Promises and Challenges
DR. AHMAD SHAHRUL NIZAM ISHA
The following slides were presented at a meeting of potential editors and methods advisors for the proposed Cochrane review group in February The.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Academic Essays & Report Writing
Systematic Reviews.
NURSING THE OLDEST OF ARTS.
1 Copyright © 2011 by Saunders, an imprint of Elsevier Inc. Chapter 13 Building an Evidence-Based Nursing Practice.
Module 2 Stakeholder analysis. What’s in Module 2  Why do stakeholder analysis ?  Identifying the stakeholders  Assessing stakeholders importance and.
Identifying the evidence Laura Macdonald Health Protection Scotland
Session I: Unit 2 Types of Reviews September 26, 2007 NCDDR training course for NIDRR grantees: Developing Evidence-Based Products Using the Systematic.
1 Analysing the contributions of fellowships to industrial development November 2010 Johannes Dobinger, UNIDO Evaluation Group.
Introduction to Case Management. Why Case Management ?  The context of care is changing; we now have an ageing population and an increase in chronic.
Curriculum planning Proposed Collaborative working modules.
Graduate studies - Master of Pharmacy (MPharm) 1 st and 2 nd cycle integrated, 5 yrs, 10 semesters, 300 ECTS-credits 1 Integrated master's degrees qualifications.
Professional Learning and Development: Best Evidence Synthesis Helen Timperley, Aaron Wilson and Heather Barrar Learning Languages March 2008.
Focusing the question Janet Harris Cochrane Qualitative Research Methods Group ESQUIRE Qualitative Systematic Review Workshop University of Sheffield 6.
Nursing Research as the Basis of Nursing. Importance of Nursing Research Nurses ask questions aimed at gaining new knowledge to improve pt. care Nurses.
Developing a Review Protocol. 1. Title Registration 2. Protocol 3. Complete Review Components of the C2 Review Process.
Evidence Based Practice RCS /9/05. Definitions  Rosenthal and Donald (1996) defined evidence-based medicine as a process of turning clinical problems.
Clinical Practice Guidelines By Dr. Hanan Said Ali.
Christopher Manacci, MSN, ACNP, CCRN Acute Care Nurse Practitioner Critical Care Transport Services The Cleveland Clinic Director, ACNP Flight Nursing.
Developing a Framework In Support of a Community of Practice in ABI Jason Newberry, Research Director Tanya Darisi, Senior Researcher
EBM --- Journal Reading Presenter :呂宥達 Date : 2005/10/27.
Focusing the question Janet Harris
Is the conscientious explicit and judicious use of current best evidence in making decision about the care of the individual patient (Dr. David Sackett)
Adult Autism Services in Westminster
Secondary Curriculum Review Implications for teacher trainers.
Proposal Writing. # 1:The title Choose a title that conveys information about your project. Avoid acronyms that have negative connotations. Make it Brief.
Conducting Research in the Social Sciences (From: Individuals and Families: A Diverse Perspective (2010))
Overview of nursing research Nursing research 471 Rawhia salah Assistant Prof. Of Nursing 2015/2016.
Evidence Based Practice (EBP) Riphah College of Rehabilitation Sciences(RCRS) Riphah International University Islamabad.
All health care professionals must understand and use the EBP approach to practice Incorporates expertise of clinician and patient’s values and preferences.
Assessing Competence in a Clinical Setting GRACE Session 12.
Step One: Research Problem, Question & Hypothesis.
Conducting a research project. Clarify Aims and Research Questions Conduct Literature Review Describe methodology Design Research Collect DataAnalyse.
Chapter 23: Overview of the Occupational Therapy Process and Outcomes
Dr. Aidah Abu Elsoud Alkaissi An-Najah National University Employ evidence-based practice: key elements.
Manaiakalani Evaluation Programme 2012 –2013 LCN Regional Networking Day | March 2014.
Dr.Ali K Al-mesrawi. RESEARCH word is originated from the word “Researche”. Research = ‘Re’+ search’. Re means once again,anew, or a fresh. Search means.
Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 10. Evaluation.
Nursing Research Week Two Research Problem Definition: a perplexing or troubling condition. Sources – Clinical experience – Nursing literature – Social.
The Invited Review Mechanism. Overview Introduction to the Invited Review Mechanism (IRM) What can the IRM tell us about Trusts and surgeons and problems.
Overview of Intervention Mapping
Fitness and Conditioning
MUHC Innovation Model.
Implementation of Clinical Guidelines Author: dr. Martin Rusnák
World of work How do tasks bring the WoW into the classroom?
THEORY IN EDUCATIONAL RESEARCH
AXIS critical Appraisal of cross sectional Studies
Supervision and creating culture of reflective practice
Research Methods in Education Session 1
Understanding a Skills-Based Approach
RESEARCH BASICS What is research?.
World of work How do tasks bring the WoW into the classroom?
Enhancing Learning in Practice
Presentation transcript:

Issues and challenges to scoping and focusing the question ESQUIRE Qualitative Systematic Review Workshop University of Sheffield 8 September 2011 Janet Harris Cochrane Qualitative Research Methods Group

Session aims To identify the issues and challenges in formulating different types of qualitative questions for qualitative evidence synthesis

The issue: What question? The challenges Utility Relevance Timeliness Explanatory value

How effectiveness questions are developed Refine definition of problem Identify possible causes and effects Identify problem Test solutions Margerunm-Leys personal.umich.edu/~jmargeru/conceptmap/types.htm personal.umich.edu/~jmargeru/conceptmap/types.htm Clinical expertise + research evidence are used to:

Effectiveness question: In adults with Low Back Pain does provision of individual education reduce pain, improve functioning and promote return to work? P: Adults with back pain (BP) O: Reduce pain, improve functioning, return to work I: Information on how to self-manage BP Assumed solution : Patients need written and/or verbal education delivered by a health professional Problem and solution (as defined by the researchers)

Possible results from a search using an informing question Problem Definition(s) Effects Causes Informing question (Background question) Single studies / evidence syntheses identifying factors that might make us rethink assumptions

Explore assumptions with informing questions P: Important characteristics relating to I and O O: Factors that may dilute potential effectiveness I: Factors that affect implementation Informing question (Background question) Refine P Consider subgroup analysis Consistency of implementation Such as participants’ views

Back pain patients’ experiences of receiving education for self management

Informing questions may identify theories Theories are explanations for a phenomenon or an event e.g. Why something happens in relation to another event They can be grand theories, they can be middle range theories, or they can be single-case theories Middle range theory goes beyond individual studies, providing a cross cutting explanation for patterns that are seen across settings and different types of people Whenever possible, interventions testing effectiveness should be based on theory

Issues raised from informing questions There may be ‘essential ingredients’ that need to be included in interventions For example, the search on back pain education identified an issue with appropriateness and relevance of information Informing questions need to produce convincing evidence about these ingredients to justify changing an effectiveness question. How much evidence is needed to change the original effectiveness question?

Revising the effectiveness question: An example In adults with Back Pain does provision of individual education by a health professional reduce pain, improve functioning and promote return to work? Revised effectiveness question: P = adults with Low Back Pain I = information explained by health professional C= information explained by a health professional with additional peer support O = reduce pain, improve functioning and promote return to work Additional ingredients that theoretically increase relevance

Issues with the refined question Is the quality of reporting for effectiveness studies adequate? For example, do the interventions describe how information is explained by the health professionals? Is the amount of time for the explanation documented? Does the comparison describe the type of peer support offered? Qualitative evidence can indicate how a question should be refined, but if effectiveness studies do not report the relevant information then the end product could be an empty review

Enhancing questions to explain the results of effectiveness reviews Monitors pathway from intervention to outcomes May highlight problems with Quan studies Enhancing question Within-study data Parallel- study data Similar- study data

Enhancing questions: Issues and challenges Adequate data within the study about PICO characteristics? Adequate data in embedded qualitative studies? Adequate data in parallel sibling studies? Can ‘similar’ qualitative studies be found? What does ‘similar’ mean – across embedded, sibling, and independently conducted studies? Comparability of data - how to synthesize data across studies?

Utility of findings: Used to critique design and PICO in included studies; subgroup analysis of theory-based interventions.. Extending question: Can explore an issue related to population, intervention, comparison or outcome Cause: Low awareness of educational approaches for behaviour change Extending question: How do people make sense of and use Back Pain information? What educational theories promote better use of BP information? Problem noted: Lack of theory-based education on how to self-manage BP Negative effect: Increased utilization of services and absenteeism

Extending questions: Issues and challenges Extending questions require a separate qualitative evidence synthesis, either conducted within or alongside an effectiveness review. Funding needs to be justified by considering: Timeliness: Is the information perceived to be critical to using the results of the effectiveness review? Relevance: Is the issue important to funders, policymakers and effectiveness reviewers ? Utility: did the scoping process specifically note issues that need to be informed by qualitative research? Explanatory value: Will the qualitative synthesis contribute to explaining the outcomes of effectiveness studies and/or the broader context that influences effectiveness?

Extending questions: Issues and challenges Extending questions require coordination of a team including qualitative evidence synthesis (QES) members working alongside effectiveness review (ER) members The parallel processes need to be considered because Findings from the QES may identify quality issues in the effectiveness studies. At what point are these quality issues brought into the effectiveness review – at abstract review? Development of inclusion criteria? Critical appraisal? Metaanalysis? Reporting QES process and findings: Approaches are still being developed. At the same time, the software for Cochrane ERs – RevMan – does not yet have the facility for including Extending reviews.

Effectiveness review Supplementing questions Supplementing review: Conducted independently Before or after an ER On a wider issue than effectiveness Effectiveness review

Supplementing question issues Supplementing questions: Used in stand alone reviews to produce information on a wider issue Does peer support help people with chronic conditions? Does peer support promote health literacy (help people to understand and use health information) Issues Timeliness: Will the theory be used over time? Relevance: Does the theory address issues noted by ER authors and those trying to implement review results (External validity) Utility: will the theory enable development of better effectiveness studies? Explanatory value: Can the theory be used to explain some of the differences in effect within and across existing ERs? Can the theory be used to inform development of future ERs?

Summary: What guides qualitative question formulation The need to ensure that effectiveness questions are informed by existing theory on what works (Informing questions) The need to provide real-time explanations for effectiveness studies (Enhancing questions) The need to further explore issues identified in the review by reviewing a broader range of research on effectiveness (Extending question) The need to explore the context surrounding a condition or an intervention, including situations and experiences that may not be directly related to effectiveness (Supplementing question)

Is it worth it? When scoping and focusing the question, we need to ask: Does this question pass the TRUE test? Timely: Will the question still be relevant when the review is finally completed? Relevant: How will this question contribute information that is relevant to health services policymakers? Useful: Which of (the many) findings from the qualitative scoping will be useful in focusing the review and/or explaining the results? Explanatory value: Does the synthesis contribute to explaining the outcomes of effectiveness studies and/or the broader context that influences effectiveness?

Further challenges Team skills Team coordination Informed and transparent decisions about when and how to useQES/ER data