1. www.library.qmul.ac.uk LIBRARY SERVICES Evaluating the evidence Paula Funnell p.a.funnell@qmul.ac.uk Senior Academic Liaison Librarian (Medicine and Dentistry) www.library.qmul.ac.uk i

2. Why? To weigh up how valid and useful the research will be

3. www.library.qmul.ac.uk Why? – to save time In order to keep up to date, clinicians would have to read 17 articles a day, 365 days a year Research is of variable quality Only an estimated 1% is judged clinically relevant Need to find the 1%

4. www.library.qmul.ac.uk Publication bias Papers with “interesting” results are more likely to be: Submitted and accepted for publication Published in a major journal Published in English Quoted by authors Quoted in newspapers

5. www.library.qmul.ac.uk Brainstorm What factors should you be bearing in mind when reading an article? Think about the research described how it is reported

6. www.library.qmul.ac.uk Brainstorm the research described how it is reported

7. www.library.qmul.ac.uk RCT checklist     

8. www.library.qmul.ac.uk How are the results presented? Number needed to treat (NNT) Odds Ratio Relative risk

9. www.library.qmul.ac.uk Odds and risk Odds of winning 1:9 You versus the rest Risk of winning 1:10 You versus all the runners 10 horses running, you bet on 1 horse

10. www.library.qmul.ac.uk Forest plots more than 1less than 1 1

11. www.library.qmul.ac.uk Forest plots more than 1less than 1 1 Line of no effect

12. www.library.qmul.ac.uk Forest plots more than 1less than 1 1 Line of no effect

13. www.library.qmul.ac.uk Forest plots more than 1less than 1 1 Line of no effect Best estimate

14. www.library.qmul.ac.uk Forest plots more than 1less than 1 1 Line of no effect Best estimate Confidence interval

15. www.library.qmul.ac.uk Forest plots more than 1less than 1 1 Line of no effect Best estimate Confidence interval

16. www.library.qmul.ac.uk Forest plots more than 1less than 1 1 Line of no effect Best estimate Confidence interval Pooled result

17. www.library.qmul.ac.uk P-value Could the result have occurred by chance? p = 0.001 (1 in 1000) p = 0.2 (1 in 5) A p-value of less than 0.05 (1 in 20) is considered to be statistically significant

18. www.library.qmul.ac.uk How it works Involves answering a short questionnaire We use the CASP questionnaires at http://www.sph.nhs.uk/what-we-do/public-health- workforce/resources/critical-appraisals-skills- programme The questionnaires were devised by doctors for doctors

19. www.library.qmul.ac.uk Summary Validity Is it trustworthy? Results What does it say? Relevance Will it help?