Randomised controlled trial of incentives to improve attendance at adult literacy classes Greg Brooks, Maxine Burton, Pam Cole*, Jeremy Miles**, Carole.

Slides:

Advertisements

Similar presentations

Motivation and diabetes self-management *Cheryl L. Shigaki, PhD, ABPP, **Robin L. Kruse, PhD, MSPH, **David Mehr, MD, MS, † Kennon M. Sheldon, PhD, ‡ Bin.

Advertisements

30 April 2015NAWRA June Welfare Rights Service Training Welfare Rights in Children & Young Peoples Service Julie Burton Natalie Rigby.

Robert Coe Neil Appleby Academic mentoring in schools: a small RCT to evaluate a large policy Randomised Controlled trials in the Social Sciences: Challenges.

Building Evidence in Education: Workshop for EEF evaluators 2 nd June: York 6 th June: London

Experimental evaluation in education Professor Carole Torgerson School of Education, Durham University, United Kingdom International.

Adapting Designs Professor David Torgerson University of York Professor Carole Torgerson Durham University.

Conference for EEF evaluators: Building evidence in education Hannah Ainsworth, York Trials Unit, University of York Professor David Torgerson, York Trials.

Building Evidence in Education: Conference for EEF Evaluators 11 th July: Theory 12 th July: Practice

What makes a good quality trial? Professor David Torgerson York Trials Unit.

Teenage conceptions in Wales The challenge of intervention and evaluation.

 I would like to thank my dear teachers who have taken all the trouble to come to this remote place in upper Egypt.

Journal Club Alcohol, Other Drugs, and Health: Current Evidence May–June 2013.

1 Human Capital and Early Childhood Development Address to CEET 11 th Annual National Conference Prof. Peter Dawkins Secretary, Department of Education.

Support and Assessment for Fall Emergencies (SAFE) Trial An evaluation of the costs and benefits of computerised on-scene decision support for emergency.

Formative and Summative Evaluations

Teen Clinic Program Jessica Knaster Maternal and Child Health MPH Program An Evaluation of the.

A randomised controlled trial to improve writing quality during the transition between primary and secondary school Natasha Mitchell, Research Fellow Hannah.

In Crookfur Primary School.  5-14 Assessment  Standardised Test information  Gathered assessment information termly  Target Setting  Skills planner.

A trial of incentives to attend adult literacy classes Carole Torgerson, Greg Brooks, Jeremy Miles, David Torgerson Classes randomised to incentive or.

TCP Treatment Change Project

Dr Amanda Perry Centre for Criminal Justice Economics and Psychology, University of York.

What influences English and Mathematics attainment at age 11? Evidence from the EPPSE project.

Incentives James Habyarimana Impact Evaluation Initiative World Bank.

Building Evidence in Education: Conference for EEF Evaluators 11th July: Theory 12th July: Practice

1 Literacy and Numeracy Gains Webinar February 3, :00 am - 11:00 am.

Avoiding bias in RCTs David Torgerson Director, York Trials Unit

1 Classroom management and partnerships Working with other adults in the class.

SLOs for Students on GAA February 20, GAA SLO Submissions January 17, 2014 Thank you for coming today. The purpose of the session today.

ECOSOC GLOBAL PREPARATORY MEETING OF THE ANNUAL MINISTERIAL REVIEW(AMR) 28 APRIL 2011.

ARROW Trial Design Professor Greg Brooks, Sheffield University, Ed Studies Dr Jeremy Miles York University, Trials Unit Carole Torgerson, York University,

Project CLASS “Children Learning Academic Success Skills” This work was supported by IES Grant# R305H to David Rabiner Computerized Attention Training.

Report Samples The MAERS Development Team 1. Data Management Report Samples Characteristic Reports Participant Characteristics (AEPARTCHAR) Instructional.

KidSIM Journal Club Presenter: Amani Azizalrahman June 19 th, 2014.

Background Information Audience Response Systems (ARS) are a technology used in classrooms that consist of an input device controlled by the learner, a.

Week 7 Motivation Slides courtesy of Prof. Karen Wisdom.

Heppner et al. Chap 12, 18 Hogg & Deffenbacher (1988)

Critical appraisal of randomized controlled trial

Fasset Presentation Talent Management November 2008.

1 Centre for Sport and Exercise Science, Sheffield Hallam University, U. K. 2 York Trials Unit, Department of Health Sciences, University of York, U. K.

From Incidental Learning Analytics Research to a Sustainable Learning Analytics Program Stefan T. Mol University of Amsterdam.

Impact of two teacher training programmes on pupils’ development of literacy and numeracy ability: a randomised trial Jack Worth National Foundation for.

In Partnership with and Funded by the Arizona Department of Health Services. Office of Tobacco Education and Prevention Program (AzTEPP) The University.

Evidence based interventions in dementia: the EVIDEM early diagnosis trial Steve Iliffe, Jane Wilcock, Mark Griffin, Priya Jane, Ingela Thuné- Boyle, Frances.

Indirect and mixed treatment comparisons Hannah Buckley Co-authors: Hannah Ainsworth, Clare Heaps, Catherine Hewitt, Laura Jefferson, Natasha Mitchell,

Building an evidence-base from randomised control trials Presentation of the findings of the impact evaluation of the Reading Catch-Up Programme 18 August.

STUDENT MOTIVATION TO LEARN CONCLUSION Motivation in education has a crucial impact on promoting student learning. The strategies of intrinsic and extrinsic.

Understanding the NRS Rosemary Matt NYS Director of Accountability.

Factors affecting students’ throughput rates in an ACE(Language Education) programme Eugéne Marais UKZN.

Documenting California Program and Learner Outcomes to Federal and State Policymakers for the ACSA presentation on September 25, 2003 and for the California.

Centre for Diet and Activity Research Social inequalities in physical activity: do environmental and policy interventions help reduce the gap? A pilot.

Post-It Notes to Improve Questionnaire Response Rates in RCTs Findings from a Randomised Sub-Study Ada Keding 1, Helen Lewis 2, Kate Bosanquet 2, Simon.

Pupil Premium 2014/15 Donna Munday – Schools Finance Manager Tel /

1 Comments on Kirabo Jackson: «Recruiting and Retaining Quality Teachers» Torberg Falch Department of Economics Norwegian University of Science and technology.

EEF Evaluators’ Conference 25 th June Session 1: Interpretation / impact 25 th June 2015.

Methodological and practical challenges of undertaking a Randomised Controlled Trial in a non-clinical setting 11th annual Randomised Controlled Trials.

Pupil Equity Fund.

The English RCT of ‘Families and Schools Together’

TOPSpro Special Topics

Front Line Innovation and Trials

The DEPression in Visual Impairment Trial:

Is the freedom from Cognitive Impairment really at hand?

A randomised controlled trial to improve writing quality during the transition between primary and secondary school Natasha Mitchell, Research Fellow Hannah.

A Meta Analysis of the Impact of SBI on Healthcare Utilization

How did you learn how to fold the t shirt? How successful were you? What determined your success?

The aim of this study was to …….

Brahm Fleisch Research supported by the Zenex Foundation October 2017

A Meta Analysis of the Impact of SBI on Healthcare Utilization

Chetna Desai, R. K. Dikshit What they said about CBL…

Syhakhang L, Stenson B, Stålsby LC, Eriksson B, Tomson G

Vocab unit 2 Research.

Presentation transcript:

Randomised controlled trial of incentives to improve attendance at adult literacy classes Greg Brooks*, Maxine Burton*, Pam Cole*, Jeremy Miles**, Carole Torgerson*** and David Torgerson** *School of Education, University of Sheffield **York Trials Unit, Dept of Health Sciences, University of York ***Department of Educational Studies, University of York

Background Poor adult literacy widespread problem Regular attendance known to correlate with adult learners making better progress in reading. No evidence from randomised controlled trials on incentives to attend.

Methods Pragmatic cluster randomised controlled trial Built on top of existing University of Sheffield Effective practice in reading study

Funding for main study Funding for trial ESFUniversity of Sheffield  (separate fund) DfES   Learners SfLSU  IoE  NRDC  University of Sheffield

Ethical approval and informed consent obtained 29 adult literacy classes allocated by York Trials Unit to two groups using minimisation Classes mainly in East Midlands and North of England, with 3 outliers in South East Main outcome: number of sessions attended Secondary outcome: reading attainment (tests devised by NFER)

Both groups received £20 to attend pre- and post-tests sessions in January and June 2005 Intervention group also received £5 for each session attended between pre- and post-tests Payments to learners after end of study

Results One class did not meet inclusion criteria – excluded 14 classes in each group Tests marked by researcher at NFER Data analysed by statistician in York blind to status of groups

Effects of incentives on sessions attended and post-test scores VariableIntervention (n = 82) Control (n = 70) Mean (SD) number of sessions attended (p = 0.019) 5.28 (2.79) 6.69 (2.71) Mean (SD) post-test literacy scores (not significantly different from pre-test for either group) (8.68) (8.84)

Limitations Small study Small incentive Incentives in form of vouchers – cash better? Did not test policy of financial sanctions

Discussion Perverse result known variously as: ‘Over-Justification Hypothesis’ ‘Corruption Effect’ ‘The Hidden Cost of Reward’ ‘Cognitive Evaluation Theory’ ‘Crowding-Out Effect’

External interventions crowd out intrinsic motivation if they are perceived as controlling. In that case, both self- determination and self-esteem suffer, and the individuals react by reducing their intrinsic motivation in the activity controlled. (Frey and Jegen, 2001, p.594) - with rider ‘for interesting tasks’ added on p.598 Plausible explanation?