NUHS Evidence Based Practice I Journal Club

Slides:



Advertisements
Similar presentations
Appraisal of an RCT using a critical appraisal checklist
Advertisements

Evidence into Practice: how to read a paper Rob Sneyd (with help from...Andrew F. Smith, Lancaster, UK)
Katrina Abuabara, MD, MA1 Esther E Freeman MD, PhD2;
Critical Reading Strategies: Overview of Research Process
Introduction to Medical Editing Build a freelance business or start a career as a professional medical editor  Medical & Biomedical Manuscripts  Editing.
Protocol Development.
8. Evidence-based management Step 3: Critical appraisal of studies
The material was supported by an educational grant from Ferring How to Write a Scientific Article Nikolaos P. Polyzos M.D. PhD.
Estimation and Reporting of Heterogeneity of Treatment Effects in Observational Comparative Effectiveness Research Prepared for: Agency for Healthcare.
Research Proposal Development of research question
By Dr. Ahmed Mostafa Assist. Prof. of anesthesia & I.C.U. Evidence-based medicine.
Developing Research Proposal Systematic Review Mohammed TA, Omar Ph.D. PT Rehabilitation Health Science.
How to Write a Scientific Paper Hann-Chorng Kuo Department of Urology Buddhist Tzu Chi General Hospital.
Are the results valid? Was the validity of the included studies appraised?
Reading Scientific Papers Shimae Soheilipour
CRITICAL APPRAISAL OF SCIENTIFIC LITERATURE
How to Write a Critical Review of Research Articles
Systematic Reviews.
Evaluating a Research Report
Evidence-Based Journal Article Presentation [Insert your name here] [Insert your designation here] [Insert your institutional affiliation here] Department.
EBC course 10 April 2003 Critical Appraisal of the Clinical Literature: The Big Picture Cynthia R. Long, PhD Associate Professor Palmer Center for Chiropractic.
Appraising Randomized Clinical Trials and Systematic Reviews October 12, 2012 Mary H. Palmer, PhD, RN, C, FAAN, AGSF University of North Carolina at Chapel.
Evidence-Based Medicine Presentation [Insert your name here] [Insert your designation here] [Insert your institutional affiliation here] Department of.
Clinical Writing for Interventional Cardiologists.
How to write a scientific article Nikolaos P. Polyzos M.D. PhD.
Objectives  Identify the key elements of a good randomised controlled study  To clarify the process of meta analysis and developing a systematic review.
Sifting through the evidence Sarah Fradsham. Types of Evidence Primary Literature Observational studies Case Report Case Series Case Control Study Cohort.
EBM --- Journal Reading Presenter :呂宥達 Date : 2005/10/27.
Is the conscientious explicit and judicious use of current best evidence in making decision about the care of the individual patient (Dr. David Sackett)
EVALUATING u After retrieving the literature, you have to evaluate or critically appraise the evidence for its validity and applicability to your patient.
LITERATURE REVIEW ARCHELLE JANE C. CALLEJO, PTRP,MSPH.
How to Read a Journal Article. Basics Always question: – Does this apply to my clinical practice? – Will this change how I treat patients? – How could.
“Reading and commenting papers” (Scientific English) Alexis Descatha INSERM, UMS UVSQ- Unité de pathologie professionnelle, Garches.
VILLA TORRI HOSPITAL, Bologna, Italy
A quick reference to literature searches
Sample Journal Club Your Name Here.
How To Design a Clinical Trial
Critically Appraising a Medical Journal Article
Brady Et Al., "sequential compression device compliance in postoperative obstetrics and gynecology patients", obstetrics and gynecology, vol. 125, no.
Role of The Physical Therapist in Critical Inquiry
Types of Research Studies Architecture of Clinical Research
NURS3030H NURSING RESEARCH IN PRACTICE MODULE 7 ‘Systematic Reviews’’
The Research Design Continuum
Experimental Psychology
How to read a paper D. Singh-Ranger.
Evidence-Based Practice I: Definition – What is it?
Criteria For Critiquing A Research Report
Supplementary Table 1. PRISMA checklist
Randomized Trials: A Brief Overview
Clinical Study Results Publication
CHAPTER 2 Research Methods in Industrial/Organizational Psychology
Chapter 7 The Hierarchy of Evidence
STROBE Statement revision
Critical Reading of Clinical Study Results
Reading Research Papers-A Basic Guide to Critical Analysis
Chapter Eight: Quantitative Methods
Strength of Evidence; Empirically Supported Treatments
Evidence Based Practice 3
HOW TO WRITE A SYSTEMATIC/NARRATIVE REVIEW
Diagnosis General Guidelines:
Sign critical appraisal course: exercise 2
Information Pyramid UpToDate, Dynamed, FIRSTConsult, ACP PIER
Role of The Physical Therapist in Critical Inquiry
Project Title Subtitle: make sure you specify it is a research project
How To conduct a thesis 1- Define the problem
Research Strategies.
How To conduct a thesis 1- Define the problem
Evidence-Based Public Health
Introduction to Systematic Reviews
Presentation transcript:

NUHS Evidence Based Practice I Journal Club Topic NUHS Evidence Based Practice I Journal Club Date: Team Members: Featured Research Article: Vancouver format example: Weinstein JN, Tosteson TD, Lurie JD, Tosteson AN, Hanscom B, Skinner JS, Abdu WA, Hilibrand AS, Boden SD, Deyo RA. Surgical vs nonoperative treatment for lumbar disk herniation: the Spine Patient Outcomes Research Trial (SPORT): a randomized trial. JAMA 2006 Nov 22;296(20):2441-50. Abstract URL http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=17119140&ordinalpos=7&itool=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_RVDocSum

Back Pain Therapies: Patient Scenario Evidence based practice begins and ends with a patient Describe the case or problem that focused your clinical question and structured search Present a patient focused clinical question (PICO)

Topic: Patient Scenario Copy the patient scenario here Have a picture? Use a picture? Just delete?

Topic: Patient Scenario Do you need to clarify patient scenario? Add history, details, specific information?

Topic: Clinical Question using the PICO format Patient, population, problem Intervention Comparison Outcome Key words, synonyms Key words, synonyms Key words, synonyms Key words, synonyms Consider Once you have formed the question using the PICO structure, you can think about what type of question it is you are asking, and therefore what type of research would provide the best answer. One of the benefits of careful and thoughtful question-forming is that the search for evidence is easier. The well-formed question makes it relatively straightforward to elicit and combine the appropriate terms needed to represent your need for information in the query language of whichever searching service is available to you. For [P= ], is [I= ] as effective as [C=] to [O=]? PICO

Search strategy and results List separate searches, queries. Summarize. Explain what you did. Bullet point how full text was located. Use the following template slides. Add slides if you have lots of information. Delete all these instructional and excess slides as needed!

Search strategy and results Searching, finding, accessing is essential to the evidence-based practitioner. Communication skills are essential to applying and assessing evidence. Your colleagues should be able to repeat the search or Develop similar searches for different topics

Search strategy and results Search Engines / Programs, Websites, Databases searched 1) Natural Standard, Natural Medicine 2) EBSCOhost: Academic Premier, CINAHL, etc. 3) NLM Entrez: PubMed Query used (Key Search Terms, Operators, Limits) 1) 2) 3) Limits and Special Techniques:

Search strategy and results: Search results: 1) # retrieved, % relevant, % high quality, authoritative 2) 3) Notes about what you found with your searches and revised searches Link to search results: add the RSS or alert URL link to search results How full text was accessed:

Topic Bibliographic citation (Vancouver format) – delete prompts when formatting for your presentation Static link (URL) to abstract Type of study: (Therapy, diagnosis, etiology, prognosis, etc) Study design: (RCT, case-control, cohort, case study, etc.)

Surgical vs nonoperative treatment for lumbar disk herniation: the Spine Patient Outcomes Research Trial (SPORT): a randomized trial. Weinstein JN, Tosteson TD, Lurie JD, Tosteson AN, Hanscom B, Skinner JS, Abdu WA, Hilibrand AS, Boden SD, Deyo RA. JAMA 2006 Nov 22;296(20):2441-50. http://www.ncbi.nlm.nih.gov/sites/entrez?Db=pubmed&Cmd=ShowDetailView&TermToSearch=17119140&ordinalpos=7&itool=EntrezSystem2.PEntrez.Pubmed.Pubmed_ResultsPanel.Pubmed_RVDocSum

Journal Paper Selection Rationale JTASS Summary 1 or 2 bulleted slides should be enough… Use JTASS questions Format your slides as needed Title relevance: What makes it relevant to PICO Don’t copy and paste the actual title Journal: Note quality characteristics Don’t just copy and paste the Journal name

Journal Paper Selection Rationale Authors Expertise, publishing history Site: Where was the study was conducted? How does it relate to PICO clinical question (relevance)?

Journal Paper Title URL to abstract – use creatively! Use journal logo? Summary (focus on features that made you select this article, relevance – not the whole appraisal) Research question / objective: Should find it in Abstract, Introduction How does it relate or compare to your PICO question? Outcomes measured: Primary: Secondary: Outstanding features / Significant results: What enticed you to read this paper? Relate to PICO Key relevant and interesting results Key issues, significant conclusions

Journal Paper Title URL to abstract – use creatively! Bottom line: What is the importance, relevance or context of this paper regarding your patient & PICO? Why did you / your team select this particular paper? Use pictures, diagrams or graphics that support your presentation: the journal logo, pictures of your patient, diagrams, tables and charts from the paper or supporting papers… Remove prompts and example text Format your slides

Type of study, study design, strength Was the study design stated and adequately described? What is the stated study design? Considering the strengths and limitations of the study design, is it suitable for the objectives? Systematic Reviews (SR), Meta-Analysis Best Evidence / Evidence Guidelines & Summaries Randomized, controlled trials (RCT) Clinical trials, Cohort Studies Case Control, Case series Case study / case report Animal studies, in vitro studies Expert opinions, editorials, ideas The informational and evidentiary sources we will rely upon include websites that we judge to be of high quality and contain valid evidence, databases that include evidence relevant to the patients, interventions and outcomes. Resources that are not as strong as gold standard, randomized controlled trials and research studies often contain useful, valid information, and should not be summarily dismissed. However, those sources should not be our primary source of information and evidence. When used, these sources should be evaluated carefully before health care decisions are based upon that information.

Study objectives and hypothesis State the purpose, objectives and hypothesis Using your words, what was the research question and objective(s) of the study? Was the purpose of the study conveyed plainly and rationally? Were the objectives of the study clearly stated? Was the hypothesis / null hypothesis explained? The informational and evidentiary sources we will rely upon include websites that we judge to be of high quality and contain valid evidence, databases that include evidence relevant to the patients, interventions and outcomes. Resources that are not as strong as gold standard, randomized controlled trials and research studies often contain useful, valid information, and should not be summarily dismissed. However, those sources should not be our primary source of information and evidence. When used, these sources should be evaluated carefully before health care decisions are based upon that information. Systematic Reviews (SR), Meta-Analysis Best Evidence / Evidence Guidelines & Summaries Randomized, controlled trials (RCT) Clinical trials, Cohort Studies Case Control, Case series Case study / case report Animal studies, in vitro studies Expert opinions, editorials, ideas

Study Design, Objectives, Hypothesis Add background or supporting information from other studies Add any figures, tables to support your presentation

Aims of Complete SPORT Study Birkmeyer et al. Spine 2002;27:1361–1372. To simultaneously conduct three multicenter randomized controlled trials comparing surgical and nonsurgical treatment for patients considered eligible for surgery with repeated longitudinal measurement up to 24 months with Intervertebral disk herniation (IDH) Spinal Stenosis (SpS) Degenerative Spondylolisthesis DS To characterize subjects declining participation in randomization but agree to be followed as part of an observational cohort. (treatments, outcomes, costs) To formally estimate the cost-effectiveness of surgical versus nonsurgical interventions for IDH, SpS, and DS through a synthesis of the results from the randomized controlled trial and the observational study cohorts.

IDH Intervertebral Disk Herniation SpS Spinal Stenosis DS Degenerative Spondylolisthesis

Study objectives and hypothesis Weinstein JN, et al. Surgical vs nonoperative treatment for lumbar disk herniation: the Spine Patient Outcomes Research Trial (SPORT): a randomized trial. JAMA 2006 Nov 22;296(20):2441-50. ABSTRACT Study objectives and hypothesis Objective: To assess the efficacy of standard open diskectomy with involved nerve root examination vs. nonoperative treatments This analysis for Lumbar Disk Herniation (LDH) and diskectomy Stated in abstract (with modifications from SPINE paper) Hypothesis not clear  Null hypothesis: Surgery is not effective for lumbar disk herniation Surgery is not as effective as nonoperative treatments  Initial “intention to treat” analysis intent The informational and evidentiary sources we will rely upon include websites that we judge to be of high quality and contain valid evidence, databases that include evidence relevant to the patients, interventions and outcomes. Resources that are not as strong as gold standard, randomized controlled trials and research studies often contain useful, valid information, and should not be summarily dismissed. However, those sources should not be our primary source of information and evidence. When used, these sources should be evaluated carefully before health care decisions are based upon that information.

Importance / Relevance / Context of the Research Question PICO: State your clinical question Research question: Compare the research question, hypothesis and study objectives to your patient oriented, PICO structure clinical question

Importance / Relevance / Context of the Research Question PICO: Is chiropractic manipulation / exercise / acupuncture as effective as surgery for relief of chronic low back pain? Are nonoperative therapies effective for treating chronic low back pain in adults desiring alternatives to surgery? Research question: Is surgery effective (treatment) for lumbar disk herniation 1o outcomes: bodily pain, physical function, disability 2o outcomes: sciatica severity, satisfaction with symptoms, self-reported improvement, and employment status

Ethical Approval Note approvals, reviews, Internal Review Board, Institutional Review, etc. Ethical approval and oversight is different from affiliation and disclosure Discuss affiliation and disclosure in conjunction with validity discussion (bias) Systematic Reviews (SR), Meta-Analysis Best Evidence / Evidence Guidelines & Summaries Randomized, controlled trials (RCT) Clinical trials, Cohort Studies Case Control, Case series Case study / case report Animal studies, in vitro studies Expert opinions, editorials, ideas The informational and evidentiary sources we will rely upon include websites that we judge to be of high quality and contain valid evidence, databases that include evidence relevant to the patients, interventions and outcomes. Resources that are not as strong as gold standard, randomized controlled trials and research studies often contain useful, valid information, and should not be summarily dismissed. However, those sources should not be our primary source of information and evidence. When used, these sources should be evaluated carefully before health care decisions are based upon that information.

Methods: Subjects / Participants / Patient / Population Critical Appraisal Guide section 3 Note strengths, weaknesses, potential biases Add flowcharts, tables, diagrams from original paper Make new graphics as needed Need help? Just ask! Case reports and case studies describe one patient. This is not a large enough sample size to analyze statistically. Therefore the appropriate “answer” for a case study would be that case studies do not use statistical analyses. Subject descriptions should be richly detailed. A general rule of thumb for clinical trials is a study size of 30 patients with at least one point of interaction or intervention. Therefore, in a clinical trial comparing 2 interventions, one would look for at least 30 study participants per group. A case series typically should have at least 10 subjects with well defined characteristics, baseline differences and medical histories which affect the outcome. Fewer participants might be used, and authors should describe their rationale for using a particular sample size – see 3f. (Again, non-experts should be able to depend on the investigator expert for information, evidence and rationale.)

Methods: Subjects / Participants / Patient / Population Inclusion criteria specific: list Exclusion criteria: The informational and evidentiary sources we will rely upon include websites that we judge to be of high quality and contain valid evidence, databases that include evidence relevant to the patients, interventions and outcomes. Resources that are not as strong as gold standard, randomized controlled trials and research studies often contain useful, valid information, and should not be summarily dismissed. However, those sources should not be our primary source of information and evidence. When used, these sources should be evaluated carefully before health care decisions are based upon that information.

Methods: Subjects / Participants / Patient / Population Baseline comparisons Did the population, experimental and control or comparison groups start with the same baseline demographics and prognostic factors? Clinical trials RCTs Cohort Case series How homogeneous is the population selected? Confounders: 2 or more factors that are “associated” (age and weight) and may affect (confuse, distort, augment?) the effect of the other factors on the outcome (onset of diabetes)

Methods: Randomization Recruitment Enrollment Randomization or allocation What makes a case a case?

Methods: Randomization Figure 1: Flow Diagram of the SPORT Randomized Controlled Trial of Disk Herniation Exclusion, Randomization and Follow-up. Select, copy (use camera in Adobe), paste, format Cite where figures are taken from… Weinstein, J. N. et al. JAMA 2006;296:2441-2450 http://jama.ama-assn.org/cgi/content-nw/full/296/20/2441/JOC60155F1

Methods: Intervention Standard open diskectomy well described Provided by experts, experienced surgeons Standardized and references provided Follow-up visits: 6 weeks, 3, 6, 12, 24 mo Comparison (256 / 501) Nonoperative treatments Heterogeneous, not well “controlled” or defined  Includes chiropractic, osteopathic, physical therapy, acupuncture, education, exercise therapy, NSAIDS and other meds, use of “devices” (shoe inserts to TENS) Comparable to each other? Comparable to surgery? A placebo is an inactive substance or intervention given to a subject in place of an experimental substance (intervention) used as a control in an experiment to test the effectiveness of the experimental substance. In a clinical study, placebo should mimic the experimental substance so exactly (taste, odor, shape, feel, look, administration, etc.) that the subjects and the administrator should not be able to tell the difference between the placebo and the experimental substance. A “sham” usually refers to a maneuver that takes the place of the experimental intervention. Shams are used in place of acupuncture, chiropractic, and massage techniques as well as psychological assessments, surveys, etc. Shams are used as controls or placebos. A “zero” point is a baseline point or assessment where initial subject data is taken, but no experimental, control, placebo or sham intervention is given.

323 had no surgery within 1st year Education 93% Initial groups: 245 surgery 256 nonoperative 323 had no surgery within 1st year Education 93% CCGPP = A grade evidence is positive Clinician vs. specific therapy or service Multiple alternatives Weinstein, J. N. et al. JAMA 2006;296:2441-2450 http://jama.ama-assn.org/cgi/content-nw/full/296/20/2441/JOC60155T2

Methods: Subjects / Participants / Patient / Population Follow up / Accountability Were all study participants or subjects accounted for at the end of the study? Rule-of thumb: >20% drop-out, non-adherence affects validity Unintended cross-over Cross-over not accounted for affects validity Are the reasons why patients withdraw from clinical trials included in the follow-up information

Outcomes Measured Primary outcomes: Secondary outcomes: Remember, outcomes are not the results Outcomes are what is mesured Clinically relevant?

Outcomes Measured Are outcome measurement tools are valid, well-recognized and referenced

Results Summarize Note key points Relate to research question Relate to clinical (PICO) question

Results 1991 eligible 501 enrolled in randomized, controlled trial 472 (94%) completion (at least 1 follow-up) Data available 73-86% for patients at each follow-up Baseline characteristics similar (average of group) for both groups Non-adherence to treatment assignment affected both groups 43% nonoperative treatment “crossed” to surgery All patients enrolled were surgery candidates Baseline Baseline characteristics for cross-over to surgery statistically different from non-crossover.

Results Add graphs and tables to illustrate and support Age- and sex-weighted population normative scores are plotted for Medical Outcomes Study 36-Item Short-Form Health Survey (SF-36) scales. To enhance readability, the plot symbols and error bars for the surgical group are slightly offset. Error bars indicate 95% confidence intervals. The primary measures were the Medical Outcomes Study 36-Item Short-Form Health Survey (SF-36) bodily pain and physical function scales18-21 and the American Academy of Orthopaedic Surgeons MODEMS version of the Oswestry Disability Index (ODI).22 As specified in the trial protocol, the primary outcomes were changes from baseline in these scales at 6 weeks, 3 months, 6 months, and 1 and 2 years from enrollment. Secondary measures included patient self-reported improvement, work status, and satisfaction with current symptoms and with care.23 Symptom severity was measured by the Sciatica Bothersomeness Index (range, 0-24; higher scores represent worse symptoms).24-25 Table 5 shows estimated mean changes from baseline and the treatment effects (differences in changes from baseline between treatment groups) for 3 months, 1 year, and 2 years. For each measure and at each point, the treatment effect favors surgery. The treatment effects for the primary outcomes were small and not statistically significant at any of the points. As shown in Figure 2, both treatment groups showed strong improvements at each of the designated follow-up times, with small advantages for surgery. However, for each primary outcome the combined global test for any difference at any period was not statistically significant. This test accounts for intraindividual correlations as described in the "Methods" section. Figure 2. Mean Scores Over Time for SF-36 Bodily Pain Weinstein, J. N. et al. JAMA 2006;296:2441-2450 http://jama.ama-assn.org/cgi/content-nw/full/296/20/2441/JOC60155F2

Statistical Analysis See sections 6, 7, 8 of the Critical Appraisal Guide Descriptive statistics Note predetermined p value Stated confidence intervals?

Validity & Limitations Hypothesis / Research Question Potential bias or problems with the study Did you see any flaws or bias with this study?

Validity & Limitations Population / Patient Potential bias or problems with the study Did you see any flaws or bias with this study?

Validity & Limitations Intervention and Methods Potential bias or problems with the study Did you see any flaws or bias with this study?

Validity & Limitations Blinding Potential bias or problems with the study Did you see any flaws or bias with this study?

Validity & Limitations Comparisons Potential bias or problems with the study Did you see any flaws or bias with this study?

Validity & Limitations Follow-up / drop-out / cross-over Potential bias or problems with the study Did you see any flaws or bias with this study?

Validity & Limitations Analysis and Statistics See Critical Appraisal Guide Sections 6, 7, 8 Potential bias or problems with the study Did you see any flaws or bias with this study?

Clinical Impact & Significance Do the studies add anything to the body of evidence? What is your evaluation of the strength of the evidence presented in these selected papers? Does your appraisal of the papers indicate studies are as strong as / stronger than the “CEBM” designations indicate? Is the evidence presented strong, moderately strong, neutral or weak if therapy, prognosis or etiology papers were selected? Does the evidence support the therapy, diagnosis, procedure or diagnostic tool discussed? What is the clinical significance in light of your patient? Form a “Clinical Impact Statement” referring to your patient

Clinical Impact & Significance Impact statement: Conclude using your own words, analysis and experience whether / why the results can or cannot be applied to your patient / situation. Make a statement regarding whether this study is useful in your practice. Resolve your clinical question in light of the study and your patient. Could this study lead to other studies?

Discussion Potential bias or problems with the study Is this study valid? Did you see any flaws or bias with this study? Do you agree with the impact statement? Why or Why Not? How would you treat / advise the patient? Do you feel this topic is applicable and important to the chiropractic profession?

Secret to success: Teamwork Everyone shows up Everyone works together