Translating evidence into improvement: Why is it so hard?

Slides:



Advertisements
Similar presentations
When Students Can’t Read…
Advertisements

Early Reading and Phonics
Using Evidence in the Classroom for Professional Learning Ontario Education Research Symposium February 2010 Helen Timperley University of Auckland.
January 5 th  What benefits can you see emerging from using Peer and Self Assessment?  What do you see as the likely.
The New English Curriculum
Research-Led Approaches to Increasing Pupil Learning BOWDEN ROOM.
Effective use of the Pupil Premium to close the attainment gap James Richardson Senior Analyst, Education Endowment Foundation 27 th June 2014
Communication Leaders A project all about communication led by and for children and young people.
Etc Objective: The pupils I teach will achieve their agreed individual targets this year and 50% will exceed their targets Timelines and QA Identification.
Using Assessment Data for Improving Teaching Practice ACER Conference August 2009 Professor Helen Timperley Faculty of Education University of.
Whole site approach to improvement Leading the Learning Workshop 3 - for leadership teams in secondary sites Quality, Improvement & Effectiveness Unit.
Communication Leaders A project all about communication led by and for children and young people.
What makes great teaching?
Assisting Struggling Readers and Writers: Using Evidence-Based Resources to Support Adult Learners Michigan Conference 2014 Kathy Houghton-- LINCS.
Presentation slide 1.1 Aims of the literacy module – the main features and teaching strategies used during English lessons – the role of the TA in supporting.
Challenges of leadership: Learning, CPD, accountability Robert Coe Durham Leadership Conference, 26 June
Teaching Quality Indicators Project Ian Solomonides Excellence is as low as we go or When is good, good enough?
Assessment for teaching Presented at the Black Sea Conference, Batumi, September 12, Patrick Griffin Assessment Research Centre Melbourne Graduate.
Closing the gap Evidence-based use of the pupil premium Robert Coe Closing the Gap in North Yorkshire, Harrogate, 27 June
Network of School Planners in Ireland Mark Fennell 28 th April 2012 Implementing effective changes to improve student learning:
Experiences and requirements in teacher professional development: Understanding teacher change Sylvia Linan-Thompson, Ph.D. The University of Texas at.
Ofsted lessons Clerks’ Update Jan Ofsted Sept 2012 The key judgements: Inspectors must judge the quality of education provided in the school – its.
Kazakhstan Centres of Excellence Teacher Education Programme Assessment of teachers at Level Two.
© Crown copyright 2008 Subject Leaders’ Development Meeting Mathematics Spring Term 2009 Session 1: APP and AfL.
“Current systems support current practices, which yield current outcomes. Revised systems are needed to support new practices to generate improved outcomes.”
Planning for Continuing Professional Development – A Whole School Approach A step by step guide to planning CPD including a framework for Teacher Induction.
Leading improvement using the Primary Framework. Keys to further improvement A growing body of research identifies important and interrelated keys to.
What makes great teaching? An overview of the CEM/Durham University/The Sutton Trust paper (published October 2014)......making... Capturing... promoting...
Action research projects This sequence may help you when planning your case study What does the data identify about this target group? What will.
Raising standards, improving lives The use of assessment to improve learning: the evidence 15 September Jacqueline White HMI National Adviser for Assessment.
Afternoon session. Aims  to become familiar with the rationale and structure of the renewed frameworks, including support for planning, teaching and.
Professional Learning and Development: Best Evidence Synthesis Helen Timperley, Aaron Wilson and Heather Barrar Learning Languages March 2008.
LEADING LEARNING CONFERENCE 5 June Leading Learning 1November 2005Management of complex change. The Knoster model. Leading Learning 2April/May 2006Developing.
A Quick Guide to the Characteristics of Highly Performing Schools Centre for the Use of Research and Evidence in Education (2014) produced for Teach First.
Primary.  There was a greater level of improvement in Literacy than Numeracy for both FSME and Non-FSME pupils.  Boys showed a greater level of.
Australian Teacher Performance and Development Framework Consultation proposal.
Raising standards, improving lives
Peer Coaching for Effective Professional Learning.
Rigorous innovation: leading for real improvement Daniel Muijs University of Southampton, UK.
Lesson Observations and Learning walks
What makes great teaching? Prof Robert Coe, Durham University COBIS, 9 May 2016.
Raising standards, improving lives
A Vision for Enhanced Professionalism
Fitting It All In Incorporating phonics and other word study work into reading instruction Michelle Fitzsimmons.
Growing great schools. What has the most impact?
What makes great teaching?
Delivering outstanding professional development for teaching
How can teachers learn to be better teachers?
Developing great teaching?
Boys and extended writing
What Makes Great Teaching? Grounding Ourselves in Research
Read the following & perform the open discussion on the contents in Page 6 variation of university teacher way.pdf.
Resilient Results: Primary assessment and accountability
Leading and coordinating CPD – training
MUHC Innovation Model.
Using data and evidence to improve performance
A Vision for Enhanced Professionalism
Data-Driven Instructional Leadership
Effective Primary Teaching Practice 2016: EFFECTIVE TEACHING
What are the key elements of observing and giving feedback?
Target Setting for Student Progress
VISIBLE LEARNING John Hattie.
Professional evidence
Progression and the Primary Framework
Leading Reading Programme – Day 1
CASL Meetings Collaborative Analysis of Student Learning
Standard for Teachers’ Professional Development July 2016
CPD: The Coaching & Mentoring Model
Growth mindset & Questioning
Encouraging Good Learning Behaviours for Vulnerable pupils
Presentation transcript:

Translating evidence into improvement: Why is it so hard? @ProfCoe Translating evidence into improvement: Why is it so hard? Robert Coe, Durham University SCHOOLS NorthEast Evidence-based Excellence Event, 9 Feb 2018

Key points Knowledge of research is important, and good summaries help Effective implementation depends on teacher skills; improvements depend on teacher learning Effective implementation depends on good, local, real-time evaluation

KS1 Literacy Guidance Develop pupils’ speaking and listening skills and wider understanding of language Use a balanced and engaging approach to developing reading, which integrates both decoding and comprehension skills Effectively implement a systematic phonics programme Teach pupils to use strategies for developing and monitoring their reading comprehension Teach pupils to use strategies for planning and monitoring their writing Promote fluent written transcription skills by encouraging extensive and effective practice and explicitly teaching spelling Use high-quality information about pupils’ current capabilities to select the best next steps for teaching Use high-quality structured interventions to help pupils who are struggling with their literacy

KS2 Literacy Guidance Develop pupils’ language capability to support their reading and writing Support pupils to develop fluent reading capabilities Teach reading comprehension strategies through modelling and supported practice Teach writing composition strategies through modelling and supported practice Develop pupils’ transcription and sentence construction skills through extensive practice Target teaching and support by accurately assessing pupil needs Use high-quality structured interventions to help pupils who are struggling with their literacy

Will this improve literacy skills? (almost certainly not) But … These reports are excellent: authoritative, evidence-based, concise, user-friendly Reading, thinking, discussing the research behind the guidance is valuable This kind of knowledge informs key decisions These things are hard If you know how to do these things effectively, then you are probably already doing them If you are not doing them well already, reading this guidance is not enough to get you there

Takeaway #1 there are no simple solutions. For an activity as complex, constrained and already well optimised as teaching, there are no simple solutions. Improvements are likely to be modest and hard-won.

Expertise requires many hours/years of ‘deliberate practice’ Challenge Specific goals Focus on sub-tasks Feedback Mental representations Ericsson, K. A. & Pool, R. (2016). Peak: Secrets from the New Science of Expertise. Boston, MA: Houghton Mifflin Harcourt Deans for Impact (2016). Practice with Purpose: The Emerging Science of Teacher Expertise. Austin, TX: Deans for Impact. https://deansforimpact.org/resources/practice-with-purpose/

In your CPD have you … http://tdtrust.org/cpdtest/ Yes No Tried to learn to do something that is relevant and supported by research evidence? Focused on (and evaluated success against) students’ learning outcomes? Engaged in activity that Surfaced, challenged and developed your thinking about learning and teaching Modelled/demonstrated new approaches Allowed experimentation to adapt/apply approaches to your classroom Included observation and feedback? Took place at least fortnightly over two terms? Drawn on explicit support from External experts Peer networks Coaches / mentors School/college leaders The CPD Test: http://tdtrust.org/cpdtest/ Cordingley, P., Higgins, S., Greany, T., Buckler, N., Coles-Jordan, D., Crisp, B., Saunders, L., Coe, R. (2015) Developing Great Teaching: Lessons from the international reviews into effective professional development. Teacher Development Trust. http://tdtrust.org/about/dgt/ Timperley, H., Wilson, A., Barrar, H. & Fung, I. (2007) Teacher professional learning and development: Best evidence synthesis iteration. Wellington, New Zealand: Ministry of Education. http://www.educationcounts.govt.nz/publications/series/2515/15341

Teachers’ professional learning Takes you from where you are at Is clear what success looks like Creates challenging expectations Assesses and feeds back on the gap Requires exposition and guidance from an expert Requires a coaching & mentoring role Benefits from peer support Requires trust: ‘OK to fail’ https://www.gov.uk/government/publications/standard-for-teachers-professional-development Cordingley, P., Higgins, S., Greany, T., Buckler, N., Coles-Jordan, D., Crisp, B., Saunders, L., Coe, R. (2015) Developing Great Teaching: Lessons from the international reviews into effective professional development. Teacher Development Trust. http://tdtrust.org/about/dgt/ The CPD Test: http://tdtrust.org/cpdtest/

How can teachers learn to be better teachers? You’re a teacher. You know how to help people learn hard stuff. Do that.

Takeaway #2 Significant improvements depend on significant teacher learning

Do we know a good lesson when we see one? http://www.cem.org/blog/414/

Do We Know a Successful Teacher When We See One? Filmed lessons (or short clips) of effective (value-added) and ineffective teachers shown to School Principals and Vice-Principals Teachers Public Some agreement among raters, but unable to identify effective teaching No difference between education experts and others 4 hrs training in RATE achieved ¾ accuracy (better than MET study) Strong, M., Gargani, J., & Hacifazlioglu, O. (2011). Do we know a successful teacher when we see one? Experiments in the identification of effective teachers. Journal of Teacher Education, 62(4), 367–382. [Abstract at: http://jte.sagepub.com/content/62/4/367.abstract ] Gargani, J., & Strong, M. (2014). Can we identify a successful teacher better, faster, and cheaper? Evidence for innovating teacher observation systems. Journal of Teacher Education, 65(5), 389-401. Strong et al 2011; Gargani & Strong, 2014

Obvious – but not true Why do we believe we can spot good teaching? We absolutely know what we like Strong emotional response to particular behaviours/styles is hard to over-rule We focus on observable proxies for learning Learning is invisible Preferences for particular pedagogies are widely shared, but evidence/understanding of their effectiveness is limited We assume that if you can do it you can spot it We don’t believe observation can miss so much

Takeaway #3 Evaluating the quality of teaching is much harder than you think (even if you think it is really hard)

Key points Knowledge of research is important, and good summaries help Effective implementation depends on teacher skills; improvements depend on teacher learning Effective implementation depends on good, local, real-time evaluation