TRANSFORMING EDUCATION THROUGH EVIDENCE. The Centre for Effective Education SCHOOL OF Education Conducting Educational Randomised Control Trials in Disadvantaged.

Slides:



Advertisements
Similar presentations
Gateway to better education and health care. Government funding >Budget 2011 provided government funding for services to address the needs of children.
Advertisements

AUSTRALIAS APPROACH TO SCHOOL BULLYING AND VIOLENCE THE NATIONAL SAFE SCHOOLS FRAMEWORK.
Learning Outcomes in quality enhancement
Implementing NICE guidance
Core Knowledge and Competencies, Professional Standards for Working with Children Birth Through Age Eight and in Afterschool Programs NJ Instructor Approval.
Intervention Research and Strategy Options
Introduction to the unit and mixed methods approaches to research Kerry Hood.
Extended Services Reaching the full core offer Nicky Tothill Burnham-on-Crouch Primary.
An Introduction to the “new” NCDB …a webinar for the National Deaf-Blind TA Network November 13, 2013 November 15, 2013 Presented by:
Parent Connectors: An Evidence-based Peer-to-Peer Support Program Albert J. Duchnowski, Ph.D. Krista Kutash, Ph.D. University of South Florida Federation.
Planning, assessment and reporting.  Reduce paperwork  Trust the judgement of the professional  Record significant learning  No need to evidence everything.
Head of Learning: Job description
Working with the Teachers’ Standards in the context of ITE. Some key issues for ITE Partnerships to explore.
PARENTING PROGRAMMES Edward Melhuish Institute for the Study of Children, Families & Social Issues, Birkbeck, University of London 7 Bedford Square London.
Comprehensive Organizational Health AssessmentMay 2012Butler Institute for Families Comprehensive Organizational Health Assessment Presented by: Robin.
A “Best Fit” Approach to Improving Teacher Resources Jennifer King Rice University of Maryland.
Awareness Raising for Boards of Governors. Aims for the Session To raise awareness of the context, rationale, aims and objectives and outcomes of the.
Awareness Raising Session. Aims for the Session To raise awareness of the context, rationale, aims and objectives and outcomes of the CRED Policy.
CB330005S Review and Planning UND: April 2007.
Project Monitoring Evaluation and Assessment
Session 3: Trial management Sarah Miller (Queens, Belfast) Laura Dunne (Queens, Belfast)
Youth mentoring and the well-being of young people: Evidence from an Irish mixed- methods evaluation Dr Bernadine Brady Child & Family Research Centre.
Area Officer Skills for Care – Surrey
MOST PROJECT Presentation on Final Phase Findings.
Closing the gap in educational attainment
Campbell Collaboration Colloquium 2012 Copenhagen, Denmark The effectiveness of volunteer tutoring programmes Dr Sarah Miller Centre.
Department of Education and Skills Action Plan on Bullying And Department of Education and Skills Anti-Bullying procedures Available on
CDI: Quality Services, Better Outcomes Conference Lynda Wilson Director, Barnardo’s Northern Ireland Julie Healy Programme Manager.
2013.  Established 2007;  One of the three Prevention and Early Intervention Programme Initiatives; “ We were set up with the objective of testing innovative.
Evaluation and combined methods research Geoff Lindsay ARM
Research, evidence and engaging learning Profiling the influence of school librarianship Penny Moore
Evaluating Services & Expenditure in Social Sectors Approaches supported by The Atlantic Philanthropies Gail Birkbeck Feb 1, 2013.
Working with parents and carers
Meeting SB 290 District Evaluation Requirements
Policy and practice in early years: From Sure Start to the Childcare Bill How we started Evidence since we started The wider children’s policy context.
Prevention and Early Intervention Programme Presentation to the Trinity College Summer School, August 2012.
United Way of Greater Toledo - Framework for Education Priority community issue: Education – Prepare children to enter and graduate from school.
18 th to 21 st June 2013 Primary Care Sciences Keele University RUNNING RANDOMISED CLINICAL TRIALS For further enquiries contact Debbie Cooke Tel: +44(0)1782.
ACJRD 16 th Annual Conference 4 th October  2007: Prevention and Early Intervention Programme, funded by DYCA and The Atlantic Philanthropies;
Needs Assessment: Young People’s Drug and Alcohol Services in Edinburgh City EADP Children, Young People and Families Network Event 7 th March 2012 Joanne.
How qualitative research contributes to evaluation Professor Alicia O’Cathain ScHARR University of Sheffield 22 June 2015.
Incorporating Research into Academic Learning & Professional Development 4 th October 2013.
Gráinne Smith Childhood Development Initiative (CDI) Accessing Primary Care: Lessons and Insights for Disadvantaged Communities.
Barbara Resnick, PhD, CRNP, FAAN, FAANP
CPD Network meeting 1 February 2008 Annette Bruton Chief Inspector, HMIE.
September 23 rd  Established 2007;  One of the three Prevention and Early Intervention Programme Initiatives; “ We were set up with the objective.
Brighter Futures Programme Cheryl Hopkins Independent Consultant.
The Delivering Social Change Signature Project Planning effective intervention.
Programme Information Incredible Years (IY)Triple P (TP) – Level 4 GroupPromoting Alternative Thinking Strategies (PATHS) IY consists of 12 weekly (2-hour)
Raising standards, improving lives The use of assessment to improve learning: the evidence 15 September Jacqueline White HMI National Adviser for Assessment.
1 The Prevention, Treatment and Management of Conduct Problems in Childhood David M Fergusson Christchurch Health & Development Study Department of Psychological.
September 21 st 2012 Meeting needs, making changes, improving outcomes. Dr Sinéad McNally CDI Voice of Community RESPOND! JUBILEE30 CONFERENCE 2012.
September 7 th 2011 Meeting needs, making changes, improving outcomes.
Shaping the future. ‘ People Say It’s Good to Talk…’
Copyright 2009 Northumberland County Council Safeguarding and Looked After Children’s Services Early Intervention and Prevention.
Project KEEP: San Diego 1. Evidenced Based Practice  Best Research Evidence  Best Clinical Experience  Consistent with Family/Client Values  “The.
SEELB Primary Principals 26 th & 27 th October 2011.
Transforming lives through learning EVALUATING THE PRIMARY CURRICULUM Sadie Cushley and Alison Drever, Education Scotland.
2 nd Year Principals Programme Day 1 TEC Omagh Tuesday 2 nd December 2008 Leading in time of changes.
Early Education and Care: an anti poverty strategy? Naomi Eisenstadt 1.
Talk Boost A targeted intervention for 4-7 year olds with language delay Wendy Lee Professional Director, The Communication Trust Mary Hartshorne Head.
PRACTICED BASED RESEARCH Overview 25 th November 2013.
Improving Patient Flow Using Groups SYDNEE SWAN, O.T. REG. (MB) JENNIFER PHILLIPS, O.T. REG. (MB) GARY ALTMAN M.D.
Enterprise Development for Secondary School Students in Sri Lanka Lalith Welamedage Roger Candy.
Schools as Organisations
An introduction to the SEN&D Pathfinder Evaluation
RUNNING RANDOMISED CLINICAL TRIALS
Childhood Development Initiative
RAPID RESPONSE program
9/16/2018 The ACT Government’s commitment to Performance and Accountability – the role of Evaluation Presentation to the Canberra Evaluation Forum Thursday,
Presentation transcript:

TRANSFORMING EDUCATION THROUGH EVIDENCE. The Centre for Effective Education SCHOOL OF Education Conducting Educational Randomised Control Trials in Disadvantaged Community Settings Andy Biggart & Liam OHare

SCHOOL OF Medicine, Dentistry and Biomedical Sciences Presentation Overview 1.Introduction to research context and programmes 2.Overview of Key Results 3.Conextualising Results in Wider Literature 4.Some methodological and ethical reflections of conducting RCTs in community settings The Centre for Effective Education | SCHOOL OF Education

SCHOOL OF Medicine, Dentistry and Biomedical SciencesThe Centre for Effective Education | SCHOOL OF Education Research Context Educational Research & Randomised Control Trials The Atlantic Philanthropies Some of first contemporary trials in UK and Ireland The two progammes grew out of a consultation with the local community in Tallaght (Dublin)

SCHOOL OF Medicine, Dentistry and Biomedical SciencesThe Centre for Effective Education | SCHOOL OF Education Two After-schools Programmes Doodle Den Newly developed after-schools programme Aimed at 5 and 6 year olds identified as struggling readers Adopted a balanced literacy framework Delivered by teacher and youth worker/child care assistant Ran throughout the school year 3 days a week for 1.5 hours afterschool Highly structured programme with strong emphasis on professional development

SCHOOL OF Medicine, Dentistry and Biomedical SciencesThe Centre for Effective Education | SCHOOL OF Education Two After-schools Programmes Mate Tricks Very similar in delivery to Doodle Den Hybrid Pro-social Behaviour Programme: Coping Power and Strengthening Families Program Aimed at 9 and 10 year olds Universally applied in schools in Tallaght Parental Components Designed to enhance childrens pro-social development, reduce anti-social behaviour, improve parenting skills and parent/child interactions

SCHOOL OF Medicine, Dentistry and Biomedical SciencesThe Centre for Effective Education | SCHOOL OF Education Common Methodology Individually randomised trials Qualitative Process Evaluation Children recruited on basis of teacher referrals 3 year rolling cohort design Over 600 children allocated to either intervention or to control: business as usual Child, parent and teacher measures Outcomes measured according to pre- validated measures where possible.

SCHOOL OF Medicine, Dentistry and Biomedical SciencesThe Centre for Effective Education | SCHOOL OF Education Summary Outcome Results – Doodle Den Primary Outcomes: –Statistically significant effects on both direct child and teacher assessed measures of literacy (d= ) Secondary Outcomes: –Statistically significant effect on childrens behaviour in regular school class (d=0.18) –No impact on attendance rates at school Exploratory Analysis –No significant differences in terms of literacy –Boys behaviour improved relative to control group –Greater attendance at the programme led to more positive outcomes

SCHOOL OF Medicine, Dentistry and Biomedical SciencesThe Centre for Effective Education | SCHOOL OF Education Summary Outcome Results – Mate Tricks Primary Outcomes: –No statistically significant effects on pro-social behaviour –Two significant negative effects on anti-social behaviour (d=0.18; 0.20) Secondary Outcomes: –No statistically significant positive effects on wide range of secondary measures –Some significant negative effects in relation to child reported parenting practices Exploratory Analysis –Child programme attendance not related to outcomes –Parental engagement with the programme significant predictor of a range of positive outcomes

SCHOOL OF Medicine, Dentistry and Biomedical SciencesThe Centre for Effective Education | SCHOOL OF Education Conextualising Results – Doodle Den First randomised trial of an after-school program in UK or Ireland focused on academic outcomes Mixed results of previous trials of the effectiveness on academic outcomes –e.g. 21 st Century schools U.S. national evaluation Reviews of evidence highlight complexity of the field Recent promising practice guides have concluded a need for much more research on what works in after-school settings Potential features driving positive outcomes: –Age of children; targeted at those most in need, well structured clearly defined curriculum, qualified staff with focus on professional development and fun engaging activities

SCHOOL OF Medicine, Dentistry and Biomedical SciencesThe Centre for Effective Education | SCHOOL OF Education Conextualising Results – Mate Tricks Hybrid programme with some evidence of effectiveness behind the two programmes No evidence of effectiveness of Mate Tricks in improving behavioural outcomes and some negative effects apparent Some evidence of in-school programmes focusing on social and emotional learning having promising effects e.g. Incredible years However, previous reviews have also highlighted null or adverse effects in after- school contexts The current study adds to existing evidence that behavioural programmes have the potential to cause adverse effects as well as benefits r

SCHOOL OF Medicine, Dentistry and Biomedical SciencesThe Centre for Effective Education | SCHOOL OF Education Some Lessons Learned: Methodological Issues Despite the critics, it is possible to implement RCTs in real world community settings. Making key stakeholders aware of key principles of RCT evaluation designs A willingness to be flexible, without undermining the core of the study and randomisation process Developing and maintaining good relationships Keeping attrition to a minimum without overburdening participants Importance of measurement and agreeing analysis plan in advance RCTs good at assessing intended outcomes but good process data should not be neglected

SCHOOL OF Medicine, Dentistry and Biomedical SciencesThe Centre for Effective Education | SCHOOL OF Education Ethical Issues and RCTs Equipose Randomisation perceived as a fair way of allocation Ethical Issues may arise at any stage Potential for burden Dissemination and not spoiling the field, especially when faced with null or negative findings

SCHOOL OF Medicine, Dentistry and Biomedical SciencesThe Centre for Effective Education | SCHOOL OF Education EVIDENCE MATTERS!!! We intervene in childrens lives on a regular basis! We may also do damage when we intend to do good! Interventions often driven by fashion rather than sound evidence! Do we owe it to children to try and ensure that the policies they are subjected to are effective in improving their life chances? Both reports available on CEE website: