Improving Selection to Foundation Programme Information on Stage Two of the Project.

Slides:



Advertisements
Similar presentations
Managing the Statutory Requirements for Assessment April 2011.
Advertisements

Managing the Statutory Requirements for Assessment April 2011.
FEBRUARY 2013: THREE KEY ACHIEVEMENTS AND THE BIGGEST CHALLENGE INTERNATIONALISATION CHANGE PROGRAMME
Australian Curriculum
Table of contents 1 Manual of Operational Procedures (MOP) 2
Review of Tomorrow’s Doctors Ben Griffith. The GMC’s role in medical education Promotes high standards Currently covers undergraduate education and the.
Project Management Shuffle Directions: take the definitions from the following cards and write a song using the tune from “Cupid Shuffle”
4 stage Career Planning Model Applications Purpose of interview How panels run –Specialty / GP Preparation Performance –How to succeed Interview questions.
Identifying and Selecting Projects
Chapter 3 Project Initiation
© 2015 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Hospitality - Practical Cake Craft CPD Presentation.
PREPARING FOR REVALIDATION. Licences issued Revalidation pilots ongoing to test the whole process – completion March 2011 Responsible Officers – to be.
Clinical Examination and Procedural Skills The assessment of psychomotor skills in WPBA for the MRCGP examination.
Improving Selection to the Foundation Programmewww.isfp.org.uk Improving Selection to the Foundation Programme Project Update July 2011.
Pertemuan Matakuliah: A0214/Audit Sistem Informasi Tahun: 2007.
Understanding Standards: Biology An Overview of the Standards for Unit and Course Assessment.
EVALUATION AND QUALITY ASSURANCE STRATEGY PRESENTED BY DR SHYAM PATIAR.
Chapter 3 Project Initiation. The stages of a project  Project concept  Project proposal request  Project proposal  Project green light  Project.
© Career Development and Employment Service 1 Effective Application forms Department of Student Services.
The London Older People Service Development Program (LOPSDP) The ‘Medicines Management’ Project (January to July 2003) Lelly Oboh Project Co-ordinator.
Work based assessment Challenges and opportunities.
Improving Selection to Foundation Programme Information on Stage Two of the Project.
Improving Selection to the Foundation Programmewww.isfp.org.uk Improving Selection to the Foundation Programme Briefing slides June
New Decade - New Challenges Annual Conference September 2010 Water Services Training Group 14 th Annual Conference New Decade – New Challenges 9 th September.
Demystifying the Business Analysis Body of Knowledge Central Iowa IIBA Chapter December 7, 2005.
Qualifications Update: Environmental Science Qualifications Update: Environmental Science.
Quality Assurance: Looking for Quality Data 1 I know it is in here somewhere Presented by The Early Childhood Outcomes Center Revised January 2013.
East Melbourne Medicare Local (EMML) GP Primary Health Networks (PHN) Survey 2015 Interim Results Apr 2015.
New arrangements for careers guidance 1 Dr Sharon Goddard, Transition Advisor 27 June 2011.
Bowel Screening Project Overview Rhys Blake Head of Business and Service Development.
National Commission for Academic Accreditation & Assessment Developmental Reviews at King Saud University and King Faisal University.
Project Life Cycle – Project Initiation © Ed Green Penn State University All Rights Reserved.
New Advanced Higher Subject Implementation Events Statistics Unit Assessment at Advanced Higher.
NCATE for Dummies AKA: Everything You Wanted to Know About NCATE, But Didn’t Want to Ask.
Qualifications Update: Human Biology Qualifications Update: Human Biology.
The National Improvement Framework - vision
Module 5 Session 5.2 Visual 1 Module 5 Refining Objectives, Scope, and Other Project Parameters Session 5.2 Reviewing the PAR and refining key project.
Standard 10: Preventing Falls and Harm from Falls Accrediting Agencies Surveyor Workshop, 13 August 2012.
Revised AQTF Standards for Registered Training Organisations Strengthening our commitment to quality - COAG February August 2006.
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov February 16, 2011.
Work Package 1: Progress and Focus on specific issues 5th Steering Committee Meeting Rijeka, 26/2/2015 Presented by: Mrs Maria Poulou.
Framework for Excellence What is the Framework? The Framework is the Governments National Assessment Framework for Education and Training Public.
Results Services 2015 Going forward …. Purpose: Provide an overview of Results Services in 2014 Outline changes being implemented to the Exceptional Circumstance.
Continual Service Improvement Methods & Techniques.
2013/14.  The Joint Project Board has published the arrangements for the joint teaching of the PCMD cohort of students.  This aims to safeguard the.
Stage 1 Integrated learning Coffee Shop. LEARNING REQUIREMENTS The learning requirements summarise the knowledge, skills, and understanding that students.
Assessment, Standardisation and Moderation Ensuring consistency in teacher assessment 2015 – 2016
UK Foundation Programme Office Prof Derek Gallen National Director.
Appraiser Skills Training Workshop One: Initial Training.
Raising standards improving lives The revised Learning and Skills Common Inspection Framework: AELP 2011.
0 End of Year Arrangements Training Presentation for Access Practitioners.
A2 Agreement Trial ICT November Key Points from Moderation  Majority of centres applied the assessment criteria successfully  Tasks selected and.
A2 Agreement Trial ICT November AGENDA  New Specification Principal Moderator’s Report Exemplar Materials  Lunch  1.00 Exemplar Materials.
New arrangements for careers guidance 1 Dr Sharon Goddard, Transition Advisor 18 October 2011.
LCR Sexual Health Strategy Project Board 6 October 2016
Pre-planning Planning to plan (and adapt) Implementation starts Here!
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov March 23, 2011.
Quality Assurance: Looking for Quality Data
The early use of Antibiotics in at Risk CHildren with InfluEnza
National Dental Core Training projects April 2016 update
Fashion & Textile Technology
Challenges and options in assessment
Lesson 5. Lesson 5 Extraneous variables Extraneous variable (EV) is a general term for any variable, other than the IV, that might affect the results.
Key Stage 1 SATs Meeting.
Student Administration and Support Programme and Project Timelines
Clinical academic careers for doctors and dentists
How to conduct Effective Stage-1 Audit
Key Stage 1 SATs Meeting.
Role of the Internal Verifier
Presentation transcript:

Improving Selection to Foundation Programme Information on Stage Two of the Project

Medical Schools Council Background Information There are a number of key issues with the current process. These are: Candidates answer ‘white space’ questions in their own time which makes it harder to ensure that work is their own Marking the ‘white space’ answers is labour intensive The academic quartile scores are not sufficiently standardised There is little evidence to provide the validity of ‘white space’ questions as a selection technique Some of these weaknesses would become critical if there were more applicants than posts, leaving the selection process open to legal challenge

Medical Schools Council Key Recommendations The Foundation Programme Project Group’s key recommendations for stage two of the project were: 1.Evolution not revolution 2.Pilot two new selection methods: Educational Performance Measure (EPM) Replace quartiles with a standardised scheme for medical schools to grade clinical knowledge and skills based on a student’s performance to date Situational Judgement Test (SJT) Replace white space questions with an invigilated machine-markable test of professional attributes, similar to selection methods for GP specialty training

Medical Schools Council Proposed Selection Process The highest scoring applicants continue to be selected Applicants continue to be allocated to Foundation Schools according to national algorithm Foundation Schools continue to allocate applicants to posts SJT scores and EPMs are loaded onto the online system Applicants continue to complete online form and specify preferences for Foundation Schools Applicants take invigilated Situational Judgement Test

Medical Schools Council Situational Judgement Tests The diagram below demonstrates how the SJTs will be produced and deployed: Outcomes are subject to psychometric analysis for QA purposes Test items drafted by trained writers at special workshops Items subject to 3- stage QA process Items stored in a secure bank for download by Med Schools Med Schools run the SJTs

Medical Schools Council Sample SJT Question You are a second year foundation doctor (F2 or FY2) working in general practice. At the baby clinic the nurse gives you a syringe with fluid already drawn up, an immunization (MMR), to give to a baby. After the parent and child have gone home you realise that the syringe contained only the diluent; the ampoule of active powder is intact. Rank in order the following actions in response to this situation (1= Most appropriate; 5= Least appropriate) A. Contact the parent immediately and explain what has happened B. Inform the practice manager of the nurse’s mistake C. Fill in a critical incident form D. Send a further appointment for the baby E. Take no action

Medical Schools Council Sample SJT Question - Answer A is the best answer. The parents should be informed of the mistake immediately so that they are aware the baby has not received the immunisation and can make appropriate arrangements. D is the next best answer. The need to repeat the immunisation is addressed, however this does not share with the parents what has happened or the reason for the appointment and so is not such a good answer. It is good to fill in a critical incident form so that the causes of the error are investigated but this does not address the need to repeat the immunisation so C is next best answer. B is not a good response because it does not address the baby’s need and it would be better to discuss the error directly with the nurse to find out what had happened. E is not a good response because you are the only person who knows the baby has not received the immunization and if you take no action this will not be redressed. PLEASE NOTE: This is an example of how the question might be marked. The scoring framework will be piloted as part of the SJT development to explore the best way of scoring candidates in a granular way.

Medical Schools Council Educational Performance Measure The EPM will be more robust than current quartile scores, which are not currently produced to a standard specification There may be separate scores for clinical skills and for knowledge based on performance at medical school The EPM will be more granular than quartiles All medical schools will be asked to produce a score for all their applicants EPM scores will be combined with the SJT scores to give an overall score which will be used for selection purposes The pilots of EPM will help to produce a standard specification and determine the effectiveness and practicality of producing an EPM score The pilots will consider the relative weightings of the SJT and EPM scores

Medical Schools Council Feasibility Study and PID In order to secure funding for phase two of the project two key documents were developed in order to provide more detailed information on how the project will be taken forward, when pilots will be run, the costs and key considerations. Feasibility study: This provides a very detailed and thorough plan for implementing the key recommendations of the Foundation Programme Project Group. A number of key factors were addressed including: the aims and objectives of the project, scope of the work, timelines, resources and skills needed, the costs of the project, constraints, assumptions, communications, risks and a detailed blueprint for 2012/13 onwards Project Implementation Document (PID): This looks at the objectives, scope and deliverables of the project. The PID defines: the objectives and scope, the deliverables and responsible owners, a detailed plan of work to be completed, risks and issues and costs and timelines

Medical Schools Council Timelines 09/10 round on existing system 10/11 round on existing system Procure and build new online system Contract for existing system expires 11/12 round on existing system 12/13 round on new system Pilots and trials Analysis and development Legal review and approvals needed here to allow time to procure and prepare new online system Prepare ‘live’ SJT August

Medical Schools Council SJT Pilots A number of pilots will be run before the live round in 2012/13. It is important to highlight that no component will be implemented into the live recruitment round in 2012/13 without an in-depth analysis of the results and agreement from the steering group that this is the most efficient and effective way of recruiting medical students to the Foundation Programme Situational Judgement Test items will be written at workshops in Spring/Summer 2010 There will be a mini pilot involving approximately 500 students on October/November 2010 and a subsequent pilot with approximately 2,000 students in April 2011 Live application of the SJTs will take place in November 2012