1. Medical Training Application Process (MTAS) – 2008-09 revised for 2012 EPM additions for Dec11 added Academic Scoring (‘Ranking’) Special Circumstances ‘Strugglers’ Referees Author - Prof David James, former Director of Medical Education Revisions – Curriculum Policy Group October 2010 Additional detail on deciles and Parallel Recruitment Exercise November 2011

2. Academic Scoring – Principles Principles 16-06-06: Initial meeting (ISC representation) discussion of the ‘rules’ for the ranking process Wider discussion amongst the student body to reach the final agreed approach Summary of agreed ranking process:  performance in Clinical Phases 1 and 2  final overall mark being derived from the following by evaluating a credit weighted mean across the 8 modules  Untaken (1 st sit) assessments excluded and total credits reduced in weighted sum

3. Academic Scoring – Overall score Clinical Practice *– Total CP % (based from combined Knowledge/Skills mark in a 50/50 ratio) x 50 CFU – CFU % x 15 Therapeutics –Therapeutics % x 15 Child Health – Total % (based on combined Knowledge/Skills mark in a 50/50 ratio) x 50 Obstetrics and Gynaecology - Total % (based on combined Knowledge/Skills mark in a 50/50 ratio) x 50 Health Care of the Elderly – HCE % (based on combined Knowledge/Skills mark in a 33/67 ratio) x 20 Psychiatry – Total % (based on combined Knowledge/Skills mark in a 50/50 ratio) x 30 Specials - Specials % (based on combined Knowledge/Skills mark in a 50/50 ratio) x 30 * CP Ratio is 50:50 for those beginning CP in Feb 2011 and for those graduating in 2013; until then 70:30 is used Credit weighted mean across the 8 modules (total out of 26000)

4. Academic Scoring – Example SubjectKnow or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Percent Clinical Practice 627150:50675050003350 CFU Theraptix Child Health O & G HCE Psyche Specials TOTAL

5. Academic Scoring – Example SubjectKnow or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Percent Clinical Practice 627150:50675050003350 CFU 61-- 151500915 Theraptix Child Health O & G HCE Psyche Specials TOTAL

6. Academic Scoring – Example SubjectKnow or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Percent Clinical Practice 627150:50675050003350 CFU 61-- 151500915 Theraptix 73-- 1515001095 Child Health O & G HCE Psyche Specials TOTAL

7. Academic Scoring – Example SubjectKnow or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Percent Clinical Practice 627150:50675050003350 CFU 61-- 151500915 Theraptix 73-- 1515001095 Child Health 695450:50625050003100 O & G HCE Psyche Specials TOTAL

8. Academic Scoring – Example SubjectKnow or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Percent Clinical Practice 627150:50675050003350 CFU 61-- 151500915 Theraptix 73-- 1515001095 Child Health 695450:50625050003100 O & G 747050:50725050003600 HCE Psyche Specials TOTAL

9. Academic Scoring – Example SubjectKnow or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Percent Clinical Practice 627150:50675050003350 CFU 61-- 151500915 Theraptix 73-- 1515001095 Child Health 695450:50625050003100 O & G 747050:50725050003600 HCE 445633:67522020001040 Psyche Specials TOTAL

10. Academic Scoring – Example SubjectKnow or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Percent Clinical Practice 627150:50675050003350 CFU 61-- 151500915 Theraptix 73-- 1515001095 Child Health 695450:50625050003100 O & G 747050:50725050003600 HCE 445633:67522020001040 Psyche 655750:50613030001830 Specials TOTAL

11. Academic Scoring – Example SubjectKnow or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Percent Clinical Practice 627150:50675050003350 CFU 61-- 151500915 Theraptix 73-- 1515001095 Child Health 695450:50625050003100 O & G 747050:50725050003600 HCE 445633:67522020001040 Psyche 655750:50613030001830 Specials 686250:50653030001950 TOTAL

12. Academic Scoring – Example SubjectKnow or Only % Skill % Overall ratio Overall % Adjust -ment factor Max mark Actual Mark Percent Clinical Practice 627150:50675050003350 CFU 61-- 151500915 Theraptix 73-- 1515001095 Child Health 695450:50625050003100 O & G 747050:50725050003600 HCE 445633:67522020001040 Psyche 655750:50613030001830 Specials 686250:50653030001950 TOTAL 260001688064.9 %

13. Academic Scoring – Ranking score  Whole final year are then ranked according to the overall percent score  Academic Ranking Component of MTAS Application comprises 40% of the final score (with the other 60% coming from the non-academic component)  Each medical school divides final year into quartiles according to their academic score ranking  % mark out of 40 to use in the Application will be 40 for those on 75 th centile and above 38 for those on 50 th centile up to 75 th centile 36 for those on 25 th centile up to 50th centile 34 for those below the 25th centile  Any resit student is automatically in the 4 th quartile

14. Total percent vs Rank order (328 students) 2007 data

15. Total percent vs Rank order (325 students) 2010 data

16. Ranking cut off points (2007 data) 68.4% 64.6% 61.3%

17. Ranking cut off points 2007on Quartile200720082009August 2010 August 2011 20122013 1st 67.5668.469.1068.3969.43 2nd 63.2064.665.8064.2465.51 3rd 58.4761.361.5060.1561.71 4 th (lowest %) 37.52 Not known 49.5251.4546.46

18. Most subject results are correlated R = 0.51; p<0.0001 R = 0.37; p<0.0001

19. Except with CFU R = 0.10; p = N/S

20. ‘Strugglers’  Identified during UG Course Academic problems Medical problems Domestic and other problems  Clinical subdean involvement  Liaison with Deanery with permission September (‘shortlist’) June (‘final shortlist’)  Advice to make on- scheme applications and placements before applications open

21. Special Circumstances - application to Foundation Programmes  Significant family responsibilities - most commonly a student who has responsibility as the primary carer for a young, school-age child or for a seriously ill partner or first degree relative.  Chronic illness (physical or psychological) or disability for which local follow up is an absolute requirement as confirmed by an Occupational Health report.  Terminally ill first-degree relative living locally as confirmed by a doctor's note.

22. Referees  Two senior doctors They should know you (from any other student)! They should have been impressed by you (rapport)! Eg Consultant of firm especially if you are interested in a specific career pathway  Ask them if they would be prepared to be a referee  Confirm with an email and a copy of your CV (layout like on-line reference form)  Let them know your choice

23. EPM – Deciles for December 2011  Process for calculating aggregate score exactly as before – same basket of assessments and weightings  Whole final year are then ranked according to the overall percent score  Deciles will score: 43, 42, 41, 40, 39,38, 37 36, 35, 34  Final Year Resit students will NOT be automatically placed in former lowest score (34 in quartiles) but student retains original ranking from earlier round and decile used  ISFP feeds back your decile in March 2012

24. Any Questions? Nottingham EPM/SJT Team SJT Lead - Judith.Franklin@nottingham.ac.uk SJT Lead - Giorgio.Vitale@nottingham.ac.uk EPM Lead - John.Whittle@nottingham.ac.uk ?