Using the Internet to Answer Clinical Questions STFM Spring Conference Brian S. Alper, MD, MSPH Anne-Marie Lozeau, MD, MS Beth Potter, MD

Disclosure “A funny thing happened to me on the way to rural family practice…” Dr. Alper is Editor-in-Chief of DynaMed™ and Medical Director of EBSCO Publishing

No Disclosures Anne-Marie Lozeau, MD, MS Beth Potter, MD University of Wisconsin - Madison Department of Family Medicine

Learning Objectives Recognize that using the Internet to meet clinical information needs is practical Meet many useful web sites Learn efficient strategies for selecting useful resources for specific needs Use a free Internet portal to organize Internet use during patient care

Our Goal in Medicine Provide the best care… Provide patients the best information to guide health care decisions… Improve health outcomes… …based on the “truth” – separating medical knowledge from folklore

How do we know medicine? WE = society MEDICINE = clinical knowledge Scientific investigation Original research published in journals Systematic reviews EVIDENCE-BASED MEDICINE

How do we know medicine? WE = individual clinicians MEDICINE = clinical knowledge Consultants Colleagues Lectures Textbooks Rounds Precepting Guidelines CME Experts Experience PRACTICAL choices selected for efficiency

“Just-in-Case” vs. “Just-In-Time” Apprentice-styleMemorization Soak up information now Retrieve information during practice Knowledge Mastery Find information when you need it Adult learning –Problem-oriented –Clinical application

Using Traditional Textbooks Not always written for clinical practice May not provide best research evidence (Are opinions well supported, or selectively supported?) May be years out-of-date Finding specific information within the text can be time-consuming

Using Journal Articles Individual journal articles –may not relate to specific information need –may not provide complete picture Finding one journal article can be time- consuming, let alone finding all the relevant articles Articles are written to promote research findings, not often written for clinical application BUT THIS IS OUR EVIDENCE SOURCE

Evidence-Based Medicine Definition: Integration of best research evidence with clinical expertise and patient values. –Sackett DL, Straus SE, Richardson WS, Rosenberg W, Haynes RB. Evidence-Based Medicine. How to Practice and Teach EBM. 2nd ed. London: Harcourt Publishers Ltd p. 1.

Best Research Evidence Comprehensive – evidence only known to be best if all the available evidence is known Valid – critical appraisal determines potential for bias Systematic – selection and evaluation of evidence by protocol reduces author bias, investigator bias Current – every day new evidence could be best Synthesized – one study vs. the whole picture

Ideal Sources for Clinicians Comprehensive – covering all relevant articles AND information needs. Valid/Systematic – driven by best available evidence. Relevant – focus on clinically relevant information. Easy to use – organized for use by clinicians. Affordable

Validity (“Truth”) Consider validity of original research PLUS validity of translation –Was the best evidence identified? –Was the best evidence selected? –Was the evidence evaluated well? –Is the summary accurate? –Are conclusions based on the underlying evidence?

Evidence-Based = conclusions based on best available evidence “Evidence-based clinical reference” requires the following: 1. Systematically identifying all applicable evidence 2. Systematically selecting the best available evidence from that identified 3. Systematically evaluating the selected evidence (critical appraisal) 4. Accurately summarizing the evidence and its quality 5. Making conclusions dependent on the evidence 6. Synthesizing multiple bits of evidence for overall conclusion 7. Changing the conclusions when new evidence alters the best available evidence

Systematic Evidence Identification Systematic Literature Search Commonly called Systematic Review Start with question, search for best available answers Systematic Literature Surveillance Also called Research Monitoring Start with literature being published, determine how best to use

Systematic Literature Search Start with clinical question Define inclusion criteria Search for all relevant information Assess methodology (validity) Combine results Determine clinical conclusion Apply to practice

Using Systematic Reviews to Answer Clinical Questions Cochrane Reviews –may be “gold standard” when available and current –many sources use Cochrane reviews Other Reviews - check whether process (search, evaluation) is systematic

Using Systematic Reviews to Answer Clinical Questions More difficult for non-RCT answers Consider additional info Most valid method for answering an individual question Not adequate to meet most information needs

Systematic Literature Surveillance Start with defined literature set Define inclusion criteria Select all relevant information Assess methodology (validity) Summarize results Determine clinical conclusion

Systematic Literature Surveillance - Uses Alert clinicians to critical info (EBM article summaries) Catalog for future searches (EBM search engine) Update clinical reference information (Integrated EBM)

Systematic Literature Surveillance - Advantages Cover all types of information - Diagnosis - Treatment - Etiology - Prognosis Keep up with current research Address current questions

Systematic Literature Surveillance - Disadvantages Can miss the big picture –1 study may be “rebuttal” –“ping-pong” between sources – overemphasis of study results Need to read collection of studies Miss older research (unless retrospective literature surveillance)

Ideal Sources Comprehensive – covering all relevant articles AND information needs. Valid/Systematic – driven by best available evidence. Relevant – focus on clinically relevant information. Easy to use – organized for clinician uses. USE SYSTEMATIC REVIEWS AND SYSTEMATIC LITERATURE SURVEILLANCE

Internet Portals: Useful Links for Patient Care Organized for effective searches A starting point for use during patient care Access from any computer with internet connection Links to all resources in this presentation You can make your own!

Examples of Portals My HQ: “Dr Alper’s links” I keep bookmarks

* Asterisk - Requires Registration - MAY Require $$ Subscription

Clinical Scenario 52-year old male presents with Shingles (zoster) for 2 days. Clinical Concerns: –short-term symptom relief –prevention of Post-Herpetic Neuralgia

EVIDENCE-BASED MEDICINE Highly Valid EBM sources Relevant - many have direct clinician input FIRST CHOICE if fast enough (many are) FIRST CHOICE when research likely –Quality research is possible? –Research is present? (difficult to guess)

Using EBM Search Engines Examples: TRIP, InfoRetriever Broader than Systematic Reviews alone Limitations: –individual article summaries may miss the “big picture” –may have to read multiple items –No subject overview

TRIP Database Turning Research Into Practice Identifies free websites with EBM and other medical content Catalogs titles and URLs to each page Inclusion based on Relevance and Rigor 300+ new articles added monthly Searches synonyms, cues misspelling

TRIP Database EBM Resources: systematic reviews, CATs, journal clubs Clinical Guidelines Query-answering Medical Images: over 80,000 eTextbooks: background information Patient Information Journals – automatically searches PubMed with EBM filters

TRIP Database Comprehensiveness: high Validity: variable Relevance: moderate Convenience: easy to use Affordability: will be free

InfoRetriever POEMs 2393 Cochrane Abstracts 734 Clinical Guidelines 229 Clinical Decision Rules 1373 Diagnostic Test Calculators 1345 H&P calculators ICD-9 search tool 5-Minute Clinical Consult

InfoRetriever Comprehensiveness: moderate Validity: variable –High for most content –Low for 5-Minute Clinical Consult Relevance: high Convenience: takes practice Affordability: $249/year

DynaMed Integrated EBM Resource combines best available evidence with clinical focus Updated continuously with systematic literature surveillance –> 500 Journals directly or via 10 journal reviews services –Cochrane reviews –National Guideline Clearinghouse Template system for rapid browsing

DynaMed Peer Review in process Includes ICD-9 Codes and patient handout links for each topic Easy to navigate –Alphabetical topic browse –Standardized templates –Some research-heavy topics can get difficult to navigate UNTIL new topics created

shing

DynaMed Comprehensiveness: shown to answer 69% of clinical questions in primary care in 2004 Validity: variable & explicit Relevance: high, clinical focus Convenience: easy to use Affordability: $200/year or effort

Ideal Sources Comprehensive – covering all relevant articles AND information needs. Valid/Systematic – driven by best available evidence. Relevant – focus on clinically relevant information. Easy to use – organized for clinician uses. USE SYSTEMATIC REVIEWS AND SYSTEMATIC LITERATURE SURVEILLANCE

Key sources for Systematic Reviews Cochrane Library DARE Major benefit : best evidence (at time of review) Major limitation : limited scope of coverage Clinical Evidence AHRQ

Highlights 200 common clinical topics Lists treatments for those topics Qualitatively describes Systematic Reviews and RCT data for and each treatment Compiles results for easy use Includes relevant background information Updates searches every 12 months Peer Reviewed

Clinical Evidence Comprehensiveness: modest Validity: high - limited to RCTs Relevance: high - clinical focus Convenience: easy to use Affordability: $97/year –free for US physicians via United Health Foundation for 6 months

PubMed Clinical Queries Use search filters that have been researched by Haynes, et al. who are involved with the McMasters EBM group Help to refine EBM searches in PubMed

Clinical Queries Comprehensiveness: moderate Validity: High Relevance: Low –Often finds many articles –Still need to sift through a lot of articles Convenience: takes practice –New feature allows you to receive updates when new info is added to your search Affordability: Free

UpToDate Review Articles Heavily Referenced Rapid Search Engine Broad Coverage

UpToDate Frequently Updated Electronic Textbook Limitations –reference-based is not “evidence-based” –specialty-oriented –varying quality

UpToDate Comprehensiveness: shown to answer 34% of internists’ clinical questions Validity: varies with author Relevance: high, clinical focus Convenience: variable, non-standard presentation Affordability: $495 then $395/year