1. CAMARADES: Bringing evidence to translational medicine What could be going wrong? Randomisation and blinding

2. CAMARADES: Bringing evidence to translational medicine

3. You can usually find what you’re looking for … GroupDay 1 Day 2 Day 3 Day 4 Day 5 “Maze bright” 1.331.602.602.833.26 “Maze dull” 0.721.102.231.83 Δ+0.60+0.50+0.37+1.00+1.43 Rosenthal and Fode (1963), Behav Sci 8, 183-9 12 graduate psychology students 5 day experiment: rats in T maze with dark arm alternating at random, and the dark arm always reinforced 2 groups – “Maze Bright” and “Maze dull”

4. CAMARADES: Bringing evidence to translational medicine NXY-059 (Astra Zeneca) –11 publications, 29 experiments, 408 animals –Improved outcome by 44% (35-53%) Macleod et al, 2008 Efficacy  RandomisationBlinded assessment of outcome Blinded conduct of experiment Drugs in animal stroke models

5. CAMARADES: Bringing evidence to translational medicine What’s a stroke drug worth?

6. CAMARADES: Bringing evidence to translational medicine The same thing happens for other diseases … Multiple SclerosisParkinson´s disease Alzheimer´s diseaseStroke

7. CAMARADES: Bringing evidence to translational medicine Are many studies at risk of bias? DiseaseRandomisatio n (%) Blinding (%) Power calculation (%) YesNoYesNoYesNo Stroke37633763397 Alzheimer’s168422780100 Parkinson’s168415850100 Multiple Sclerosis 99116840100 Pain128826740100 DiseaseRandomisatio n (%) Blinding (%) Power calculation (%) YesNoYesNoYesNo Stroke37633763397

8. CAMARADES: Bringing evidence to translational medicine But it’s just the neurosciences, right? Reporting of measures to reduce bias in 254 reports of in vivo, ex vivo or in vitro studies involving non human animals, identified from random sample of 2000 publications from PubMed Ioannidis et al, 2014

9. CAMARADES: Bringing evidence to translational medicine 1173 publications using non human animals, published in 2009 or 2010, from 5 leading UK universities “an outstanding contribution to the internationally excellent position of the UK in biomedical science and clinical/translational research.” “impressed by the strength within the basic neurosciences that were returned …particular in the areas of behavioural, cellular and molecular neuroscience” But not in leading institutions, right? Rand BlindI/ESSC

10. CAMARADES: Bringing evidence to translational medicine But not in journals of repute, right? Top 10% Bottom 10% Top 10% Bottom 10% Top 10% Bottom 10% Top 10% Bottom 10%

11. CAMARADES: Bringing evidence to translational medicine Reporting research details The Morris Water Maze in Alzheimer’s research

12. CAMARADES: Bringing evidence to translational medicine Reporting research details Reporting drop outs minocycline control minocycline control