Implementing a Randomised Controlled Trial for the evaluation of Probation supervision Presenter:Dominic Pearson Collaborators: David Torgerson Cynthia.

Slides:



Advertisements
Similar presentations
Introduction to Impact Assessment
Advertisements

Customised training: Learner Voice and Post-16 Citizenship.
Manchester Children and Young People’s CYP IAPT Learning Collaborative
Building up capacity for Roma inclusion at local level Kosice, November 6 th, 2013.
David Taylor Formerly Director of Inspection, Ofsted
Training in the Workplace
Interagency Perspectives Opportunities and Challenges in Working Together.
Training for Participants Date, Location, Venue 1 Welcome! Welcome to PEM 2 Module!
Evaluating the Outcomes of Social Work Education (OSWE)
Drilling down beneath the data. Stage 1/Stage 8 Core Data Analysis Impact of previous action  Define areas for development Stage 2 Monitoring Looking.
Drug Awareness for Primary Schools Richard Boxer Drug Education Consultant Health & Well-Being Team (CSF) Safeguarding: Drug Education Richard Boxer, Drug.
ECVET WORKSHOP 2 22/23/24 November The European Quality Assurance Reference Framework.
Nina Muscillo and Andrew Hargreaves November 2014 Supporting Medication Reconciliation.
SCN Cancer Champions Project Summary and Update. GMLSC SCN Cancer Champions Project The aim is to maximise the impact of the BCOC campaigns by establishing.
Disaster Law Programme Law and disaster risk reduction Sanne Boswijk Disaster Law Coordinator for MENA \Disasters and Law Consultation Kuwait, 11 June.
Renewable Energy in Africa: UNEP’s Initiatives Climate Change Kiosk, UNEP Event, COP12/MOP2 Sami Kamel, UNEP RISOE Centre Nairobi, Kenya November 17t h,
Accessibility Planning, Training & Advisory Programme Making the connections—making it happen Putting Accessibility Planning withinreach! Derek Palmer.
Kesgrave High School SEN Information Report Mission Statement As a school we value all our pupils and work hard to ensure that SEN pupils have access to.
A&E St. Mary’s 'Scientia Vincit Timorem' Implementation of screening and brief intervention in accident and emergency departments: challenges and solutions.
Evaluation Office 1 Evaluating Capacity Development David Todd Senior Evaluation Officer GEF Evaluation Office.
Birmingham Changing Futures Together- Research and Evaluation Services Talent Match Birmingham & Solihull – Research and Evaluation Services Bidders Presentation,
Mentoring for Excluded Groups and Networks (MEGAN) Peer Review Report Dr. Ioan Durnescu Brussels
SBAA 2009 Annual Meeting Savannah, Georgia November 10, 2009 Contours of Quality: Shaping the Future of Management Education Jerry E. Trapnell EVP & Chief.
Working Group on Crime Statistics 9 June 2011 Point 3. Commission Activities ( Doc. CR/WG2011/1)
South West Grid for Learning Educational Portal Awareness Event.
Development of a One UN Training Service Platform for Climate Change: Concept, Progress, Next Steps UNDP/UNEP/UNITAR Side Event, Bonn Climate Change Talks,
A&E St. Mary’s 'Scientia Vincit Timorem' Alcohol Screening and Brief Intervention Research Programme national brief intervention research consortium Paolo.
Adaptation knowledge needs and response under the UNFCCC process Adaptation Knowledge Day V Session 1: Knowledge Gaps Bonn, Germany 09 June 2014 Rojina.
Transforming Community Services Commissioning Information for Community Services Stakeholder Workshop 14 October 2009 Coleen Milligan – Project Manager.
Carers’ involvement and participation in the planning and implementation of staff training. (carers’ assessments) Presentation Denise Coy, Carers Lead.
John Burke and Clive Alderson Embedding Business & Community Engagement.
United Nations Volunteers Volunteerism for Development in the context of CBA Adeline Aubry CBA Volunteerism & Community Adaptation Specialist United Nations.
22 nd April 2015 Heather Ford and Fiona MacKenzie Integration Change Managers Strengthening the Links Staff Engagement -The Fife Story.
CHE Business Plan Mission The mission of the CHE is to contribute to the development of a higher education system that is characterised by.
Strategy & Work Programme the UN Special Rapporteur on Disability Hissa Al Thani.
Project: CAPACITY BUILDING FOR VIETNAMESE CIVIL SOCIETY ORGANISATIONS ON CLIMATE CHANGE Presented by: Ms. Pham Thi Bich Ngoc CC Project Coordinator, The.
African Centre for Statistics United Nations Economic Commission for Africa Proposed Framework for Monitoring, Evaluation and Reporting Negussie Gorfe.
The South African Human Rights Commission 2009/10 Annual Report.
KT Scotland Conference 23 April 2010 Building a Knowledge exchange culture Sarah Morton- Co-Director.
Kerry Cleary An evaluation of the impact of Values Based Interviewing at the OUH Values Based Conversations and wider engagement strategies.
Southend Together Secretariat 21 st February Developing Southend Together’s Sustainable Community Strategy
Name of Pilot Project: Developing pedagogy through collaboration, action research and reflection. Aim of the Project: to set up a collaborative partnership.
…to integration Information and advice: A single point of access that filters enquiries using a single source of information (the ‘local offer’) as soon.
Staff Survey Results Research Excellence Framework All Staff Open Meeting Monday 23 February 2015.
Our Strategic Priorities & Work Programme Sandie Smith, CEO 10 th July 2013.
Business Plan and Budget for the Council on Higher Education (CHE) 2009/10 Presentation to a Joint Meeting of the Portfolio Committees on Basic Education.
Presentation Aim The aim of this presentation is to: Give an overview of approach to future delivery Outline key priorities going forward Explain what.
LT07 " Promotion of Diversity in Culture and Arts within European Cultural Heritage" Lithuania Dalia Stabrauskaitė Ministry of Culture of the Republic.
Hearing Voices: Listening to Students' Views in Collaborative Partnerships Ian Willcock – February 2016.
WORFORCE PLANNING Ceri Gay Senior Workforce Development Officer Workforce Development Team 17 th January 2012 SOCIAL SERVICES DEPARTMENT.
New Zealand Refugee Resettlement Strategy – Phase 3 implementation: Interpreter Barriers Antoinette Tanguay, Senior Advisor Strategy and Governance, Refugee.
Becta Procurement News Regional Delivery Briefing.
Developing a national governance framework for health promotion in Scottish hospitals Lorna Smith Senior Health Improvement Programme Officer NHS Health.
Role of the Development Officers Curriculum for Excellence.
Review of Social Marketing South East Region Presentation to Department of Health South East 5 August 2009 Hannah Corbett (South East.
Fourth Overall Performance Study
Seminar Aims and Objectives
PSC Jamboree 4 June
A new approach to regulating small firms
Luxembourg Digital Skills Bridge A programme investing in employees' skills and securing their career paths Mai 2018.
Commissioning 2018/19.
Rahandusministeerium
VC/2012/0413 – ‘’Providing targeted advice on ESF support to apprenticeship and traineeship schemes’’ Flavia Pesce, IRS Rome, 16th October 2014.
Mapping “Out-of-School Time” (MOST) Development in Ireland
Developing a Research Impact Capture System
Collaborative Instruments for Ambitious Climate Action (CI-ACA)
Developing a Research Impact Capture System
THE INSPECTION SYSTEM AND THE SCHOOL EXTERNAL EVALUATION
February 2007 Note: Source:.
© Fresh Thoughts Consulting
Presentation transcript:

Implementing a Randomised Controlled Trial for the evaluation of Probation supervision Presenter:Dominic Pearson Collaborators: David Torgerson Cynthia McDougall Roger Bowles

Overview of Presentation Citizenship programme Commissioned evaluation Local implementation constraints Solutions adopted Results of deployment Conclusions Methodological questions

Citizenship programme Designed in County Durham Probation Area –Operational staff and managers, supported by a consultant (Professor Clive Hollin) Structured one-to-one work A planned response to assessed crime-related needs using specific modules (e.g. alcohol) Aims to raise awareness, motivate to change and link in with external resources

Commissioned evaluation Commissioner required a regional evaluation –3 Areas, different profiles Aims –Identify whether the programme reduces reconvictions –Identify whether the programme promotes engagement with relevant community provision –Identify the benefit-costs relationship

General barriers to an RCT in the National Probation Service Ethical resistance to random allocation –Judiciary –Probation managers –Probation practitioners Programme management concerns –Difficult for practitioners to manage cases in two different ways –Related quality control issues –Staff training: a randomised phased allocation of the programme = more training events

Specific local barriers to an RCT Area A - had already implemented at the time of commissioning Area B – had resource issues linked to workload climate Area C – had performance management issues in some sectors

Solutions adopted  Area A (had already implemented)  Retrospective design  Area B (had resource/workload issues)  Opted for a single Area-wide launch with senior management support (‘big bang’) – retrospective design  Area C (had offices with performance issues)  Opted for a ‘stepped wedge’ design with offices randomly allocated in sequence to begin programme deployment  Office 1 → April 2007  Office 2 → June 2007  Office 3 → August 2007  Office 4 → October 2007  Office 5 → December 2007  Office 6 → February 2008

Results of deployment - take up rates Area A –75% (3072 / 4078) Area B –27% (2499 / 9749)  Office 4: 40% (14 / 35)  Office 5: 31% (21 / 67)  Office 6: 65% (11 / 17) Area C –44% (188 / 426) Office 1: 47% (26 / 65) Office 2: 51% (50 / 98) Office 3: 46% (66 / 144)

Conclusions on Implementation Area A was a different case –Implemented in a previous period and over a longer time Area B vs. Area C –Phased deployment produced better results at less cost Area B needed to re-launch (‘big bang’ #2) Progress in Area C could be monitored and managed Differential take up can be adjusted for in the analyses Lesson in the importance of discussing evaluation at the time of implementation

Methodological questions Overall / Regional evaluation –3 stages –Different methodologies and Area profiles Citizenship programme is the constant Positive results from the first stage evaluation Results from the (deficient) retrospective designs will be illuminated by the RCT How will the effects associated with the different methodologies compare?

Thank you for listening We welcome your comments and thought- provoking questions!