Introducing framework synthesis and thematic synthesis Series of doctoral lectures on behalf of the Cochrane Qualitative and Implementation Methods Group.

Slides:



Advertisements
Similar presentations
Critical Reading Strategies: Overview of Research Process
Advertisements

Mixed methods synthesis ESRC Methods Festival 2006 James Thomas Institute of Education, University of London.
Definitions of EBP Popular in SW
Introduction to the unit and mixed methods approaches to research Kerry Hood.
Michelle O’Reilly. Quantitative research is outcomes driven Qualitative research is process driven Please offer up your definitions.
Student Learning Development, TCD1 Systematic Approaches to Literature Reviewing Dr Tamara O’Connor Student Learning Development Trinity College Dublin.
CHAPTER 1 Practical Business Research. A working definition: Any systematic attempt at collecting and interpreting data and evidence in order to inform.
Evidence for ‘excellence in care’
Reviewing and Critiquing Research
Critical Appraisal Dr Samira Alsenany Dr SA 2012 Dr Samira alsenany.
Evidence Based Nursing Process to Practice Bracken Health Sciences Library (adapted from a presentation of Dr. Norma MacIntyre, School of Rehabilitation.
Action Research Professor Julienne Meyer Institute of Health Science Action Research Professor Julienne Meyer Institute of Health Science St Bartholomew.
Framework for systematic reviews of qualitative research (Garside, 2010)
Critical Appraisal of an Article by Dr. I. Selvaraj B. SC. ,M. B. B. S
1. Thematic synthesis Sub-brand to go here ESRC Research Methods Festival, St Catherine’s College Oxford, 30 th June to 3 rd July Session 55: Interpretive.
 Humanistic Perspective – 1970s  Individuals have the ability to › Be self-directed › Make wise choices › Develop themselves through leisure  The approach.
1. Critical appraisal and qualitative research: exploring sensitivity analysis Angela Harden Methods for Research Synthesis Node, ESRC National Centre.
Systematic reviews in the social sciences Sarah Whitehead, Cardiff Institute of Society and Health.
Workshop: Framework Synthesis, Meta-Ethnography and Realist Synthesis
An overview of the Revalidated BSc (Hons) Occupational Therapy Course.
Working with Qualitative Data Christine Maidl Pribbenow Wisconsin Center for Education Research
Results  81 papers were reviewed 55 papers psychoeducational interventions 19 papers educational interventions 14 papers multicomponent interventions.
Presenter-Dr. L.Karthiyayini Moderator- Dr. Abhishek Raut
Applying theory to designing A&F interventions and evaluations in head to head trials Susan Michie Department of Psychology, UCL Ottawa December 2012.
South East Asia - Optimising Reproductive & Child Health Outcomes in Developing Countries SEA-ORCHID Project Centre for Perinatal Health Services Research,
Individuals with Lower Literacy Levels: Accessing and Navigating Healthcare Herbert, H. 1, Adams, J. 1, Lowe, W. 1, Leuddeke, J Faculty of Health.
CRITICAL APPRAISAL OF SCIENTIFIC LITERATURE
OUR MODULES A Virtual On-line Institute of Interprofessional Education P. Solomon 1, S. Baptiste 1, P. Hall 2, R. Luke 3, C. Orchard 4, E. Rukholm 5, L.Carter.
Evidence-based policymaking: Seeking to do more good than harm Helen Jones Professional Adviser.
Why Theory Matters Jackie Green
Experimental Research Methods in Language Learning Chapter 1 Introduction and Overview.
9.45 am Introducing Three QES Methods – Framework Synthesis, Meta-Ethnography and Realist Synthesis Drs Andrew Booth and Chris Carroll.
Excellence in Teaching and Learning 2nd June 2009 Seeking to inquire: the interplay of reflection, learning and research Dr Pauline Griffiths, Senior Lecturer.
Planning Your Review. Process of Qualitative Evidence Synthesis (Major & Savin-Baden 2010) Identify Studies related to research question ↓ Collate Qualitative.
Overview of Chapter The issues of evidence-based medicine reflect the question of how to apply clinical research literature: Why do disease and injury.
Introduction and Overview. Evidence Synthesis of Qualitative Research in Europe (ESQUIRE) To provide participants with state-of-the art perspective on.
RHS 303. TRANSITION OF THEORY AND TREATMENT nature of existence and gives meaning to and guides the action Philosophical Base: Philosophy of occupational.
(1) Systematic reviews that configure and aggregate data to answer all research questions David Gough Systematic Reviews for Complicated and Complex Questions,
Results Student Engagement : Students generally found logbooks easy to use and practical in the hospital setting. Purpose : There appeared to be a perceived.
Workshop: Thematic Synthesis and Framework Synthesis Parts 1-4 – Data Extraction, Quality Assessment, Synthesising Across Studies, Completing the Analysis.
1 This resource contains example(s) of linking theory, research policy, and practice in Education-related disciplines. Follow the steps below to customise.
Chapter 10 Dr. Wajed Hatamleh Critical Thinking and Nursing Practice.
Intro to Critiquing Research Your tutorial task is for you to critique several articles so that you develop skills for your Assignment.
Dr Anna Tarrant School of Sociology and Social A methodological strategy for working effectively across qualitative.
Workshop: Thematic Synthesis and Framework Synthesis Parts 1-4 – Data Extraction, Quality Assessment, Synthesising Across Studies, Completing the Analysis.
Copyright © 2011 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 5 Theory, Research, and Evidence-Based Practice.
From description to analysis
Introducing QES Methods – the Basics: Thematic Synthesis & Framework Synthesis.
Focusing the question Janet Harris
Introduction to meta-ethnography ESQUIRE Sheffield 4 th September :30-10am Ruth Garside Senior Lecturer in Evidence Synthesis.
Issues and Challenges with synthesis of qualitative evidence Professor Jane Noyes Director, Centre for Health-Related Research Bangor University Convenor.
CRITICAL THINKING AND THE NURSING PROCESS Entry Into Professional Nursing NRS 101.
Using the first nation medicine wheel as an aid to ethical decision-making in medical care Brunton N; Kakekagumick K; Cromarty H, RN; Linkewich B, HBScN;
Introduction to research
A framework to improve evidence-informed decision-making in health service management Ph.D Candidate in Health Care Management Tabriz University of Medical.
Aim To synthesize the best available evidence on shared decision-making (SDM) resulting in the development of a comprehensive model to be used as a guide.
Critiquing Quantitative Research.  A critical appraisal is careful evaluation of all aspects of a research study in order to assess the merits, limitations,
Basic Concepts in Research According to : Jacinta Karen Juin P71697 For GGGB6013 KAEDAH PENYELIDIKAN 1 (TASK 1)
Dr. Aidah Abu Elsoud Alkaissi An-Najah National University Employ evidence-based practice: key elements.
A1 & A2 The aim: (separate) Critique a Qualitative study on “Telemonitoring of blood glucose and blood pressure in type 2 diabetes.” Critique a Quantitative.
Writing a Research Report (Adapted from “Engineering Your Report: From Start to Finish” by Krishnan, L.A. et. al., 2003) Writing a Research Write the introduction.
Phenomenology.
DATA COLLECTION METHODS IN NURSING RESEARCH
Role of The Physical Therapist in Critical Inquiry
15-10 Planning Your Review Andrew Booth, Reader in Evidence Based Information Practice, Co-Convenor – Cochrane Collaboration Qualitative Methods Group.
MUHC Innovation Model.
Lecturer in MH Nursing, RGU
Dr Annegret Schneider Research interest:
Role of The Physical Therapist in Critical Inquiry
Primary care healthcare professionals’ knowledge, attitudes and practices towards promoting the reduction of children’s secondhand smoke exposure Jaidev.
Presentation transcript:

Introducing framework synthesis and thematic synthesis Series of doctoral lectures on behalf of the Cochrane Qualitative and Implementation Methods Group Systematic Reviews in social sciences. Mixed methods and qualitative research reviewed. Doctoral course, Ughent, March 21-22, 2016 Prof. Dr. Karin Hannes Centre for Sociological Research Social Research Methodology Group, KU Leuven Dr. Chris Carroll and Prof. Dr. Andrew Booth Scharr, University of Sheffield, UK

 (Thematic synthesis); Critical Interpretive Synthesis; Meta-ethnography 1.Only include “good” qualitative studies (?) 2.Constant comparison; iterative; interpretations generated from the data by reviewers 3.Create a theory Inductive (theory-generating)  Examples:  Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Medical Research Methodology 2008; 8.  Campbell R et al. Evaluating meta-ethnography: a synthesis of qualitative research on lay experiences of diabetes and diabetes care. Social Science & Medicine 2003; 65: Methods of qualitative evidence synthesis

 Framework synthesis: 1.Only include “good” qualitative studies (?) 2.Map data from included studies onto an existing framework to test the framework/theory (a role for theory) 3.Test the “fit” of the theory to the question Deductive (theory-testing)  Examples:  Oliver S et al: A multidimensional conceptual framework for analysing public involvement in health services research. Health Expectations 2008, 11:  Brunton G, Oliver S, Oliver K, Lorenc T. A Synthesis of Research Addressing Children’s, Young People’s and Parents’ Views of Walking and Cycling for Transport London. London, EPPI-Centre, Social Science Research Unit, Institute of Education, University of London; Methods of qualitative evidence synthesis

 “Best-fit” framework synthesis 1.Identify relevant pre-existing conceptual models or frameworks 2.Identify and extract all relevant qualitative studies satisfying review’s inclusion criteria (no exclusion based on quality) 3.Code data from included studies against framework 4.Use secondary thematic analysis/synthesis to generate completely new themes to supplement the framework’s themes 5.Create new framework and conceptual model or theory  Deductive and Inductive  Framework and Thematic/interpretive synthesis  Carroll C, Booth A, Cooper K. A worked example of “best-fit” framework synthesis: A systematic review of views concerning the taking of potential chemopreventive agents, BMC Medical Research Methodology 2011; 11: 29 Methods of qualitative evidence synthesis

 “the output of some methods of synthesis (Thematic Synthesis, textual Narrative Synthesis, Meta-aggregation, Framework Synthesis, and ecological triangulation) is more directly relevant to policymakers and designers of interventions”  Barnett-Page E, Thomas J. Methods for the synthesis of qualitative research: a critical review. BMC Med Res Methodol. 2009; 11;9:59.  Framework and thematic synthesis:  Methods for qualitative evidence synthesis recognised to be of particular value to policy-makers; for solving or addressing service problems (rather than simply generating concepts and theories)  Thorne S. Toward Methodological Emancipation in Applied Health Research, QHR 2010; 21(4): Methods of qualitative evidence synthesis

Framework synthesis Thematic synthesis

The case study The question: What are the barriers and facilitators of patient autonomy post stroke ? The studies: 1.Proot I et al, Patient autonomy during rehabilitation: the experiences of stroke patients in nursing homes, International Journal of Nursing Studies, 2000; 37: Mangset M et al, ‘We’re just sick people, nothing else’:... Factors contributing to elderly stroke patients satisfaction with rehabilitation, Clinical Rehabilitation, 2008; 22:

Data extraction  What is it?  An attempt to reduce a mass of material (your included papers) to a much smaller body of text and numbers, amenable to analysis and the interpretation of findings

Data extraction form  Location  Setting  Sample (n)  Age  Gender  Ethnicity and other relevant variables (e.g. Marital status)  Socio-economic status  Study design  Intervention (if any)  Quality assessment criteria  Results?  Further citations  Format?????

Example form

What results do you extract?  What is your question?  Question: What are the barriers and facilitators of patient autonomy post-stroke? Keep the question in mind as you read: Are the data relevant to this question? Is the question answered by the data?

Extraction of results  Results/findings sections of included studies:  Verbatim quotations and/or  Authors’ statements clearly-supported by data  “... It was often difficult to distinguish [Schutz’s] first- from second-order constructs” Atkins et al. Conducting a meta-ethnography of qualitative literature: Lessons learnt, BMC Med Res Methodol 2008; 8: 21 Schutz A. Collected Papers 1971; vol.1: 361.

From: Mangset p.829

Extracting data for thematic analysis

Extracting or “coding” data using framework analysis  Identify or create a thematic framework or conceptual model  Develop own framework or themes or concepts for coding  Kirkevold M et al. Promoting psychosocial well- being following a stroke: developing a theoretically and empirically sound complex intervention, International Journal of Nursing Studies, 2012; 49:

Extracting or “coding” data using framework analysis Code numberThemeDefinition 1DignityA self-concept characterised by self-valuing, self- acceptance, usefulness and belief in oneself 2Well-beingA basic mood of joy, pleasure and wellbeing; the absence of feelings of emptiness or sadness 3CopingAbility to adapt and cope within home and hospital settings 4Family SupportRelations with immediate family 5Support for patient’s coping efforts Patients take responsibility and are supported by others in this 6Bodily changes and impairments Difficulties generated by residual or post-stroke conditions Handout 1

Extracting or “coding” data using framework analysis

What now?  You have extracted your data  You may have coded your data against your framework (framework analysis)  You may have only extracted relevant data (without using a framework) (the first stage of secondary thematic analysis)  You may have coded some of your data but not others (“best fit” framework synthesis)  You now need to assign themes to those data without themes, i.e. Using secondary thematic analysis (data reduction, display, conclusion)  How do you do it?

Generating new themes  “Evidence does not speak for itself. It requires interpretation.... on the basis of our personal experience and a range of ideas that we use to make sense of our observations”  Kelly M et al. Evidence-based public health: A review of the experience of NICE developing public health guidance in England, Social Science and Medicine, 2010; 71:

Developing new themes C. “…“I will take that paper when P. is finished with it. I want to study it. Then I'll take my shoes off, and practise as I see it in the picture” (p04b, p. 11), Proot, p.271 Other / New theme?  Interpret and reflect  Create  Revisit and revise  Discuss  Agree... = Learning self-help skills / guided self-determination

Synthesis

A new framework Code numberThemeDefinition 1Dignity A self-concept characterised by self-valuing, self- acceptance, usefulness and belief in oneself 2Well-being A basic mood of joy, pleasure and wellbeing; the absence of feelings of emptiness or sadness 3Coping Ability to adapt and cope within home and hospital settings 4Family Support Relations with immediate family 5Support for patient’s coping efforts Patients take responsibility and are supported by others in this 6Bodily changes and impairments Difficulties generated by residual or post-stroke conditions 7Self-determination Define theme as a concept, based on data 8Need for information Define theme as a concept, based on data 9Lack of shared decision- making Define theme as a concept, based on data 10Acceptance of therapy Define theme as a concept, based on data

A new framework and synthesis ThemeCategories Dignity Psychological factors Well-being Self-determination Coping Physical factors Bodily changes and impairments Need for information Interaction with professionals and family Lack of shared decision-making Family Support Support for patient’s coping efforts Acceptance of therapy

Synthesis  Alternatively, go beyond the framework to create a new conceptual model or theory...  Revisit data to explore the relationships between the themes or findings of your framework  The “richer” or “thicker” the data, the deeper the resulting model or theory  Narrative and diagrammatic representations

Do you stop there?  Test your synthesis?  Disconfirming cases  Booth A, Carroll C, Illott I. Desperately Seeking Dissonance: Identifying the “Disconfirming Case”, Qualitative Evidence Synthesis, Qualitative Health Research 2012 (in press).  Morse, J. M. The significance of saturation. Qualitative Health Research 1995; 5,  Sensitivity analysis  By quality, population, location, setting etc.  By frequency and “thickness”  Carroll C, Booth A, Lloyd-Jones M. Should we Exclude Inadequately-reported Studies from Qualitative Systematic Reviews? An Evaluation of Sensitivity Analyses in Two Case Study Reviews, Qualitative Health Research 2012; 22(10)  Boeije et al (2011) Making a difference: towards a method for weighing the evidence in a qualitative synthesis, Journal of Evaluation in Clinical Practice (4):657-63

What is the purpose of your review and synthesis?  To illuminate experiences of clients, professionals, policy makers,… and to develop theory  To be useful  To answer questions and to solve problems that cannot be addressed by quantitative research

Conclusions  Different methods for qualitative evidence synthesis  Choose an appropriate method  Extract and interpret data  Synthesis  Test your synthesis  Integrating and writing-up...