1. Automated Snowballing in 5 minutes in 20 slides What is snowballing – Citation tracking – A kind of literature discovery – Recommended practice Why should it work – Using human knowledge – Citation networks – Outside of database bounds How to do it manually – Start w/ appraised paper – Fetch full text – Extract citation strings – Find each citation – Add it to the start of the queue ESuRFr – Extract – Search – Retrieve (citation) – Fetch (full text) Results – Using MAS vs. GS – Citations extracted – Citations found – Text retrieved

3. “Bidirectional Citation Searching to Completion: An Exploration of Literature Searching Methods” S Hinde, E Spackman - PharmacoEconomics, 2014

4. Newer papers Older papers

5. Newer papers Older papers

6. 1 minute

7. 4% “Citation networks of trials: Feasibility of iterative bidirectional citation searching “ Robinson, Dunn, Tsafnat, Glasziou, Journal of Clinical Epidemiology 67(7) 2014

8. 4% “Citation networks of trials: Feasibility of iterative bidirectional citation searching “ Robinson, Dunn, Tsafnat, Glasziou, Journal of Clinical Epidemiology 67(7) 2014

9. “Citation networks of trials: Feasibility of iterative bidirectional citation searching “ Robinson, Dunn, Tsafnat, Glasziou, Journal of Clinical Epidemiology 67(7) 2014

10. 46 % “Citation networks of trials: Feasibility of iterative bidirectional citation searching “ Robinson, Dunn, Tsafnat, Glasziou, Journal of Clinical Epidemiology 67(7) 2014

11. 2 minutes

12. Extract citation strings 1 Ward P, Small I, Smith J, Suter P, Dutkowski R. Oseltamivir (Tamiflu) and its potential for use in the event of an influenza pandemic. J. Antimicrob. Chemother. 55(Suppl. S1), I5– I21 (2005). 2 Fuyuno I. Tamiflu side effects come under scrutiny. Nature 446(7134), 358–359 (2007). 3 Maxwell SR. Tamiflu and neuropsychiatric disturbance in adolescents: the case is not proved but caution is advisable. BMJ 334, 1232– 1233 (2007). 4 Toovey S, Rayner C, Prinssen E et al. Assessment of neuropsychiatric adverse events in influenza patients treated with oseltamivir: a comprehensive review. Drug Safety 31(12), 1097–1114 (2008). Reference strings Pdf

13. 2 Fuyuno I. Tamiflu side effects come under scrutiny. Nature 446(7134), 358–359 (2007). Fuyuno Tamiflu effects under scrutiny Nature Search the internet

14. Retrieve citation information @article { fuyuno2007tamiflu, title={Tamiflu side effects come under scrutiny}, author={Fuyuno, Ichiko}, journal={Nature}, volume={446}, number={7134}, pages={358--359}, year={2007}, publisher={Nature Publishing Group} }

15. Fetch full-text

16. 3 minutes

18. ESuRFr-S: Snowballing and Citation Tracking

19. “Automatic Evidence Retrieval for Systematic Reviews“ Choong, Dunn, Tsafnat Journal of Medical Internet Research (in press)

20. 1 Ward P, Small I, Smith J, Suter P, Dutkowski R. Oseltamivir (Tamiflu) and its potential for use in the event of an influenza pandemic. J. Antimicrob. Chemother. 55(Suppl. S1), I5– I21 (2005). 2 Fuyuno I. Tamiflu side effects come under scrutiny. Nature 446(7134), 358–359 (2007). 3 Maxwell SR. Tamiflu and neuropsychiatric disturbance in adolescents: the case is not proved but caution is advisable. BMJ 334, 1232– 1233 (2007). 4 Toovey S, Rayner C, Prinssen E et al. Assessment of neuropsychiatric adverse events in influenza patients treated with oseltamivir: a comprehensive review. Drug Safety 31(12), 1097–1114 (2008). Reference strings Pdf 97% citation string extraction

21. 4 minutes

22. 2 Fuyuno I. Tamiflu side effects come under scrutiny. Nature 446(7134), 358–359 (2007). Fuyuno Tamiflu effects under scrutiny Nature 86% citation strings found

23. 77% abstracts 75% full text fetched

26. Stop