CAMARADES: Bringing evidence to translational medicine What could be going wrong? Randomisation and blinding
CAMARADES: Bringing evidence to translational medicine
You can usually find what you’re looking for … GroupDay 1 Day 2 Day 3 Day 4 Day 5 “Maze bright” “Maze dull” Δ Rosenthal and Fode (1963), Behav Sci 8, graduate psychology students 5 day experiment: rats in T maze with dark arm alternating at random, and the dark arm always reinforced 2 groups – “Maze Bright” and “Maze dull”
CAMARADES: Bringing evidence to translational medicine NXY-059 (Astra Zeneca) –11 publications, 29 experiments, 408 animals –Improved outcome by 44% (35-53%) Macleod et al, 2008 Efficacy RandomisationBlinded assessment of outcome Blinded conduct of experiment Drugs in animal stroke models
CAMARADES: Bringing evidence to translational medicine What’s a stroke drug worth?
CAMARADES: Bringing evidence to translational medicine The same thing happens for other diseases … Multiple SclerosisParkinson´s disease Alzheimer´s diseaseStroke
CAMARADES: Bringing evidence to translational medicine Are many studies at risk of bias? DiseaseRandomisatio n (%) Blinding (%) Power calculation (%) YesNoYesNoYesNo Stroke Alzheimer’s Parkinson’s Multiple Sclerosis Pain DiseaseRandomisatio n (%) Blinding (%) Power calculation (%) YesNoYesNoYesNo Stroke
CAMARADES: Bringing evidence to translational medicine But it’s just the neurosciences, right? Reporting of measures to reduce bias in 254 reports of in vivo, ex vivo or in vitro studies involving non human animals, identified from random sample of 2000 publications from PubMed Ioannidis et al, 2014
CAMARADES: Bringing evidence to translational medicine 1173 publications using non human animals, published in 2009 or 2010, from 5 leading UK universities “an outstanding contribution to the internationally excellent position of the UK in biomedical science and clinical/translational research.” “impressed by the strength within the basic neurosciences that were returned …particular in the areas of behavioural, cellular and molecular neuroscience” But not in leading institutions, right? Rand BlindI/ESSC
CAMARADES: Bringing evidence to translational medicine But not in journals of repute, right? Top 10% Bottom 10% Top 10% Bottom 10% Top 10% Bottom 10% Top 10% Bottom 10%
CAMARADES: Bringing evidence to translational medicine Reporting research details The Morris Water Maze in Alzheimer’s research
CAMARADES: Bringing evidence to translational medicine Reporting research details Reporting drop outs minocycline control minocycline control