1. Specialist Diplomas Examiners Training Wendy Leversuch CSci FIBMS Deputy Head of Education wendyleversuch@ibms.org

2. The Examination Broken into 5 parts to ensure a broad approach to assessing and verifying ability to practice as a specialist practitioner 1.Presentation - demonstrates overview of application of practice 2.Portfolio review –Is it completed and signed? –Do reflective logs demonstrate understanding of scope of practice? 3.Laboratory tour - demonstrates application of knowledge and skills within scope of practice 4.Meeting with Training Officer 5.Feedback to Candidate

3. Data for the past 3 years… Specialist Portfolios Issued Reference Copies Issued Specialist Diplomas Awarded Cellular Pathology 28116213 Clinical Biochemistry 36520212 Clinical Immunology 49240 Cytopathology 48255 Haematology and Hospital Transfusion Practice 44414268 Histocompatibility and Immunogenetics 805 Medical Microbiology 33312321 Transfusion Science 37220 Virology 54532 Total 1619731166

4. Your Role as an IBMS Examiner A combination of verifying competence to practice and examining knowledge. Verify the employer has assessed competence to practice during post registration training according to local rules in accordance with portfolio rules. Ensure the candidate can perform duties commensurate to the level of a Specialist Practitioner in order to be eligible for the award of a Specialist Diploma. Examines the ability of the candidate to demonstrate an understanding of the scientific basis for tests, quality control, quality assurance, health and safety and use of equipment. External examiner thereby determines suitability for award of Specialist Diploma External examiner considers approval of laboratory for specialist training

5. 1 - The Presentation PowerPoint. 15 -20 mins followed by questions. Provide an overview of the candidates training Provide information on progression up to the examination and plans for the future Verbal description of lab and role Brief overview of the department and individual role. (analysers, workload, range of staff) Should not turn into a presentation on how an analyser works. Learning outcomes reflect: –development role and responsibilities –range of investigations/patient groups –recent trends/developments –professional activities

6. Examiners View - Presentation Fairly relaxed ‘ice breaker’ Timed therefore candidate needs to keep focussed Needs to demonstrate the ‘journey’ taken since the competence portfolio Relatively superficial précis of past two years or so Ensure practitioner articulates scope of practice and shows understanding of role in the laboratory.

7. Criteria for Assessment of PresentationSTANDARD MET STANDARD NOT MET Presentation was 15-20 mins. Presentation described individual’s scope of practice. Presentation highlighted current trends in the laboratory. Presentation highlighted specialist interests or activities. COMMENTS Please indicate the content of the presentation and overall standard of presentation skills. The Examiners Report

8. 2 - The Portfolio Review Should not normally exceed 1 hour There should be a signed statement from laboratory manager Documentation to meet requirements of EVIDENCE OF ACHIEVEMENT –Observations do NOT need to be backed by witness statements/personal testimonies –Questions asked by trainer, e.g. tutorials –Assignments completed – case studies, descriptions Portfolio completed and signed Reflective logs to capture understanding of scope of practice

9. Observations - Portfolio Mistakes made for registration are being repeated Quality of evidence Indexing overcomplicated Not relating it to the EVIDENCE OF ACHIEVEMENT Inclusion of reference material Evidence not signed and dated Plastic wallets – one page only Annotation!

10. Examiner’s View - Portfolio It is timed Do NOT exceed the time allocated unless very extenuating circumstances If possible tell candidate when you will be finished. You will NOT be able to read all of it!!

11. Criteria for Assessment of PortfolioSTANDARD MET STANDARD NOT MET Signed statement from laboratory manager regarding candidates’ scope of practice. Evidence of achievement sections had been completed and signed. Evidence reflected the requirements of the Evidence of Achievement Section, e.g. answered questions set by trainer. Reflective practice sheets completed. COMMENTS Please indicate the range of evidence used (highlighting weak and strong areas), the overall standard of the portfolio and ease of use.

12. 3 - Laboratory Tour with viva Approx 1 hour Pro-active questioning Expectation of knowledge related to principles and practice of in-house laboratory investigations Follow up on any gaps in the portfolio Remove specimen reception from tour. Similar to registration but more time spent discussing equipment/assays

13. CANDIDATE ABILITYSTANDARD MET STANDARD NOT MET Candidate was able to answer questions on the correct procedures for handling specimens, pre and post analysis. Candidate was able to answer questions on the application of health and safety requirements. Candidate was able to answer questions on the principles and practice of laboratory investigations. Candidate was able to answer questions on the significance of abnormal results, possible causes and further testing indicated. Candidate was able to answer questions on the correct operation and maintenance of equipment. Candidate was able to answer questions on the principles of quality control and quality assurance. COMMENTS Please provide a brief summary, indicting the range of questions asked and the candidates response.

14. 4 - Feedback to Trainer This meeting should always be kept even if there are no problems. If there are problems, sort with the training officer first. Feedback on evidence and laboratory viva examination. Opportunity to ensure training officer is happy with how the candidate performed. This also provides an opportunity to seek further clarification on points of evidence if required. Feedback should be concise, constructive and based on the Institute’s guidance for examiners, trainers and candidates in relation to specialist portfolio training and completion. Personal opinions or advice may be offered in the context of examples of good practice, but it should be clear they are NOT a specific requirement of the Institute.

15. 5- Feedback to Candidate Inform candidate of outcome Provide feedback to candidate Be kind - do not drag it out. Highlight positive bits. Mention negative bits in a constructive way. Inform of process of report/diploma/IBMS membership etc.

16. The Paperwork! Examiner to complete Examiner's Report and send to IBMS within 1 week Laboratory to complete Laboratory Feedback Form and send to IBMS within 1 week Until both documents are received the diploma will not be issued to candidate

17. Reasons for not awarding Incomplete portfolios Lack of evidence related to questions asked by trainer Section not completed Lack of knowledge Training approval not given

18. What to do if the candidate fails Do not be afraid to fail a candidate Ensure a detailed report is written covering all the areas which require improvement. Clear communication with training officer and candidate Suggest time lines.

19. Examiner’s View - Do’s and Don’ts It is for the candidates benefit - NOT yours Do NOT spend time picking up ideas for your own lab!! Remember your tensions will transfer to the candidate. Relax and enjoy the opportunity to have time away from the day job and see how others do their job.

20. How to become an examiner Criteria: –Member or Fellow of the Institute of Biomedical Science with a minimum qualification at academic level 7 (level 11 in Scotland) such as MSc, MPhil, HSD. –HCPC registered (or equivalent registration authority for non-UK members); –Currently practicing in an Institute approved training laboratory with a minimum of 4 years experience post registration; –Actively participating in the Institute’s CPD scheme or equivalent (submission of overview of past 2 years CPD required). –Specialist level experience in named discipline/disciplines. –Have attended an Institute approved training session for Specialist Examiners. Complete the application form Email to specialistportfolio@ibms.orgspecialistportfolio@ibms.org