5th March 2015 The role and effectiveness of Quality Control Audit: improving the ARCP process across Foundation Schools. Dr B T Langham Director of Foundation.

Slides:



Advertisements
Similar presentations
St. Louis Public Schools Curriculum Management Audit Speaker Dr. James Scott Lead Auditor for the St. Louis Public Schools Curriculum Management Audit.
Advertisements

SVQ Management Networking Event March 2011 Verification Update.
Securing the Foundation Programme Stuart Carney Deputy National Director, UKFPO.
The ARCP- For Core trainees Dr Kate Lovett – Head of School of Psychiatry- Southwest Peninsula Deanery March 2013.
This Coach Education Workforce Model is © of England Hockey Board, Scottish Hockey & Welsh Hockey. COACH EDUCATION WORKFORCE The Coach Education Workforce.
AmicusHorizon Making homes, helping people AmicusHorizon Using governance to deliver successful scrutiny
Trainer Recognition and Accreditation. New Arrangements for Trainer Recognition and Accreditation  In August 2012, the GMC released a document ‘Recognising.
Performing an educational supervisor report. Step by Step guide By Dr Kim Emerson January 2013.
Ian Whitehead TPD ARCP.  Structured postgraduate medical training is dependent on :  having curricula which clearly set out the standards and competences.
ARCP Panels What’s is all about?. What is ES doing when deciding on the outcome of an educational review?  Making a recommendation to the ARCP panel.
Reading and Newbury VTS 2014 Dr K Emerson Health Education Thames Valley.
UKPHR Public Health Register The Role of the Moderator – Assuring Quality Dr Cerilan Rogers UKPHR Moderator.
Forest Practices Code Transition Larry Pedersen Chief Forester, MOF.
Westminster City Council and Westminster Primary Care Trust Voluntary Sector Funding 2009/10 Voluntary Sector Funding Eligibility, Application Form Funding,
ST4 Induction 2015 An introduction to competency based training and the ARCP.
MMC – workplace based assessments Dr Lisa Joels Postgraduate Organiser Singleton Hospital 6 th August 08.
Bob Woodwards SAC Chair, Oral and Maxillofacial Surgery.
Verification: Quality Assurance in Assessment Verification is the main quality assurance process associated with assessment systems and practice - whether.
Understanding Meaning and Importance of Competency Based Assessment
Modernising Medical Careers for GPs Education Supervision and Review of Progression.
BTEC Quality Assurance BTEC Foundation Level – Level 3 including Workskills The quality assurance includes three processes: Lead Internal Verifier.
Revalidation Update December 2012 The Combined Conference: Educating for the Future 5 th December 2012.
Welcome to Mersey Deanery What You Need to Know About ISCP Elizabeth Collins, College Co-ordinator, RCS Eng.
August 2014 Dr James Fergsuon-Clinical Lead Debbie Johnston–RCP Head of Assessors & Accreditation Consultant Liver quest project Project update.
Practical Craft Skills CPD Presentation Unit Specifications and Unit Assessment Support Packs (UASP) National 3, 4 and 5.
GIM Requirements and PYA process
Mentor Training Brunel University Primary Partnership Friday 25 th January pm – 4.00pm Barbara Hosier & Alison Silby.
ISCP The Essentials for Trainers and Trainees Raymond Marlborough,RCS Regional Coordinator – East of England Laura Johnston,Core Trainee – East of England.
PRESENTATION ON PORTFOLIO OF EVIDENCE DEPARTMENT OF WATER AFFAIRS AND SANITATION RBIG, MWIG, ACIP & NT WORKSHOP AUGUST
E-Portfolio, ARCP and decision aids. Dr Derek Harrington, Consultant Cardiologist Maidstone and Tunbridge Wells NHS Trust Cardiology TPD HEKSS.
Planning the next 3 years Dr Nisha Ehamparanathan GP / Clinical Skills Lecturer.
The ARCP Annual Review of Competence Progression Intending Trainers’ Course.
LEEDS BECKETT UNIVERSITY CONTINUOUS AUDIT BRIEFING 2015/16 ACTIVITIES Quality Assurance Services.
ARCP of foundation trainees – an operational guide Dr Ajay Bedi Dean Director Northern Deanery Foundation School.
Introduction to the eportfolio and the MRCGP HEEKSS 2015 Dr Susan Bodgener Associate Dean of Assessment, HEEKSS.
1 ePortfolio update for 2014 Joel Smith. Contents Overview of changes to the foundation ePortfolio relating to ARCP 2014 Overview of changes to the foundation.
Speciality Training Aims To outline the changes to Speciality Training described in the “Gold Guide” Define trainees/trainer responsibilities New.
Sharing good practice in Foundation Programme training Miss Stacey Forde and Dr Clare Van Hamel UKFPO.
Core Skills for Managers
Induction for Dental Core Training
** Please put your microphone on mute! **
5th March 2015 Promoting excellence amongst Foundation Trainees and gathering constructive feedback on a local programme: an integrated process to deliver.
Alwen Jones Nicholson Education and Training Pharmacist BCUHB
Serious Concerns Review Group Health Education East Midlands
** Your microphone will remain on mute throughout the webinar **
Guide to E-Portfolio Intensive Care Medicine Induction 14th August 2015 Dr Gareth Hughes ST7 Intensive Care & Respiratory Medicine.
ARCP Update and Revalidation
National Dental Core training curriculum and assessment framework Dental Core Trainee training slides September 2016.
Understanding Standards: Nominee Training Event
Call to Conversation: SACS Reaffirmation
Midlands’ Final FFICM OSCE/SOE course 7th March 2017, Tuesday
ePortfolio and curriculum
Kath Hodgson Chair of QA SLWG
INTRODUCING THE TOOLKIT L3 & L5
Preparing for Systems Verification
Dr B Langham, Mrs H Breed, Dr N Spittle, Dr R Gregory
Vivienne Maskrey (UEA), Annie Blyth (UEA), Prof. David Wright (UEA)
Version 0.1Assessment Method Overview - 1 Process Assessment Method An objective model-independent method to assess the capability of an organization to.
Internal Audit Quality Assurance and Improvement Program
Sandeep Kapur Consultant Surgeon, NNUH Chair, CST committee EoE
Midlands’ Final FFICM OSCE/SOE course 7th March 2017, Tuesday
SPA Cycle 2 By end of June Discussion with Line Manager 1 April/May
Dr Jenni Rowlands DME SaTH Dr Adrian Marsh FY2 TPD SaTH
GMC visits: How to deal with them
ARCP Panel What happens, who's who How to pass without complications
School of Paediatrics Day
GMC – the road to “recognition” of Educational Supervisors
Midlands’ Final FFICM OSCE/SOE course 7th March 2017, Tuesday
The ARCP This podcast has been developed for use by members and prospective members of ARCP panels in the East of England. The podcast itself is part.
Making ARCPs work for trainees
Presentation transcript:

5th March 2015 The role and effectiveness of Quality Control Audit: improving the ARCP process across Foundation Schools. Dr B T Langham Director of Foundation Training for the East Midlands.

The tale of two Foundation Schools Trent LNR Kettering

The Change Prior to 2013 Two Schools Two different processes for sign off Equitable outcomes? Potential for challenge ARCPs 2013 Two Schools Same process Same sign off standards issued to all trainees and trainers All FTPDs trained for role as ARCP chairs.

The Challenge Two Questions: Would outcomes across 2 schools and 11 centres be equitable i.e. did the panel adhere to the evidence required for a satisfactory outcome? How would we test this?

Test through Audit Audit of 10% of ARCP outcomes: Randomly selected 3 auditors not involved in local ARCPs Accessed e-portfolios Checked available evidence at time of ARCP against ARCP checklist (used by all panels) Assigned an outcome + reasons

Results of quality control audit for 2013 Note: the quality control assessors agreed with all final outcomes.

Results for 2013: Percentage of trainees awarded outcome 5s

Outcome 5 awarded in Trent School

Next steps: Faculty development day when results were presented to FTPDs from both schools. Recommendations: FPCs and FTPDs to monitor e-portfolios of all trainees. Trainees identified as currently having e-portfolio issues must be interviewed by FTPDs before end of March. The ARCP outcome will be determined by the level of evidence required (see LNR/Trent sign off requirements) – if evidence is missing an Outcome 5 must be issued. Further audit of 2014 ARCP outcomes.

Results over two years: number of outcome 5s

Quality control assessor and panel agreement at 1st ARCP Foundation Year 1 trainees ARCP results

Quality control assessor and panel agreement at 1st ARCP Foundation Year 2 trainees ARCP results

Next Steps: Individual issues with panels/locations identified and feedback delivered to panels. Further sharing of best practice across sites. Further audit of 2015 ARCP outcomes.

Summary Quality control audit revealed discrepancies in ARCP outcomes (related to outcome 5) Sharing of quality control audit and faculty development improved consistency. Individual panel feedback delivered to improve consistency further. 3rd audit planned for August 2015.