Rapid Evidence Assessments: some practical considerations DfES Rapid Reviewing Seminar 17th November 2004

Purpose of presentation Not a methodology lesson! Practical considerations and lessons learned about conducting a rapid evidence assessment “in house”

Background to the assessment In the run up to SR2004, the effectiveness of drug treatment in criminal justice settings was recognised as a key evidence gap by policy customers DAR, RDS was asked to carry out a review of existing evidence Key aims of review were to: inform further development of interventions aimed at drug-using offenders inform the planned DIP evaluations identify potential areas for further research

The theory Rapid evidence assessments... –“...collate descriptive outlines of the available evidence on a topic, critically appraise them… sift out studies of poor quality, and will provide and overview of what the evidence is telling us…” and... –they should be completed in 8-12 weeks

Issues to consider... The search –tighten search criteria where possible –duplication of abstracts –“hard to reach” papers –systematic recording of studies –quality and format of abstracts

Issues to consider... The sift –quality assessment tool –“singing from the same songsheet” –systematic recording of assessments –being realistic about time taken to assess papers –methodological knowledge of reviewers

Two final lessons... Preparation –planning and preparation time should be factored in to your timetable “Protected time” –our assessment was delayed by other work/priorities

The timetable

The resources