Automated Snowballing in 5 minutes in 20 slides What is snowballing – Citation tracking – A kind of literature discovery – Recommended practice Why should it work – Using human knowledge – Citation networks – Outside of database bounds How to do it manually – Start w/ appraised paper – Fetch full text – Extract citation strings – Find each citation – Add it to the start of the queue ESuRFr – Extract – Search – Retrieve (citation) – Fetch (full text) Results – Using MAS vs. GS – Citations extracted – Citations found – Text retrieved

“Bidirectional Citation Searching to Completion: An Exploration of Literature Searching Methods” S Hinde, E Spackman - PharmacoEconomics, 2014

Newer papers Older papers

Newer papers Older papers

1 minute

4% “Citation networks of trials: Feasibility of iterative bidirectional citation searching “ Robinson, Dunn, Tsafnat, Glasziou, Journal of Clinical Epidemiology 67(7) 2014

4% “Citation networks of trials: Feasibility of iterative bidirectional citation searching “ Robinson, Dunn, Tsafnat, Glasziou, Journal of Clinical Epidemiology 67(7) 2014

“Citation networks of trials: Feasibility of iterative bidirectional citation searching “ Robinson, Dunn, Tsafnat, Glasziou, Journal of Clinical Epidemiology 67(7) 2014

46 % “Citation networks of trials: Feasibility of iterative bidirectional citation searching “ Robinson, Dunn, Tsafnat, Glasziou, Journal of Clinical Epidemiology 67(7) 2014

2 minutes

Extract citation strings 1 Ward P, Small I, Smith J, Suter P, Dutkowski R. Oseltamivir (Tamiflu) and its potential for use in the event of an influenza pandemic. J. Antimicrob. Chemother. 55(Suppl. S1), I5– I21 (2005). 2 Fuyuno I. Tamiflu side effects come under scrutiny. Nature 446(7134), 358–359 (2007). 3 Maxwell SR. Tamiflu and neuropsychiatric disturbance in adolescents: the case is not proved but caution is advisable. BMJ 334, 1232– 1233 (2007). 4 Toovey S, Rayner C, Prinssen E et al. Assessment of neuropsychiatric adverse events in influenza patients treated with oseltamivir: a comprehensive review. Drug Safety 31(12), 1097–1114 (2008). Reference strings Pdf

2 Fuyuno I. Tamiflu side effects come under scrutiny. Nature 446(7134), 358–359 (2007). Fuyuno Tamiflu effects under scrutiny Nature Search the internet

Retrieve citation { fuyuno2007tamiflu, title={Tamiflu side effects come under scrutiny}, author={Fuyuno, Ichiko}, journal={Nature}, volume={446}, number={7134}, pages={ }, year={2007}, publisher={Nature Publishing Group} }

Fetch full-text

3 minutes

ESuRFr-S: Snowballing and Citation Tracking

“Automatic Evidence Retrieval for Systematic Reviews“ Choong, Dunn, Tsafnat Journal of Medical Internet Research (in press)

1 Ward P, Small I, Smith J, Suter P, Dutkowski R. Oseltamivir (Tamiflu) and its potential for use in the event of an influenza pandemic. J. Antimicrob. Chemother. 55(Suppl. S1), I5– I21 (2005). 2 Fuyuno I. Tamiflu side effects come under scrutiny. Nature 446(7134), 358–359 (2007). 3 Maxwell SR. Tamiflu and neuropsychiatric disturbance in adolescents: the case is not proved but caution is advisable. BMJ 334, 1232– 1233 (2007). 4 Toovey S, Rayner C, Prinssen E et al. Assessment of neuropsychiatric adverse events in influenza patients treated with oseltamivir: a comprehensive review. Drug Safety 31(12), 1097–1114 (2008). Reference strings Pdf 97% citation string extraction

4 minutes

2 Fuyuno I. Tamiflu side effects come under scrutiny. Nature 446(7134), 358–359 (2007). Fuyuno Tamiflu effects under scrutiny Nature 86% citation strings found

77% abstracts 75% full text fetched

Stop