1. 5th March 2015
The role and effectiveness of Quality Control Audit: improving the ARCP process across Foundation Schools.
Dr B T Langham
Director of Foundation Training
for the East Midlands.

2. The tale of two Foundation Schools
Trent
LNR
Kettering

3. The Change Prior to 2013 Two Schools
Two different processes for sign off
Equitable outcomes?
Potential for challenge
ARCPs 2013
Two Schools
Same process
Same sign off standards issued to all trainees and trainers
All FTPDs trained for role as ARCP chairs.

4. The Challenge Two Questions:
Would outcomes across 2 schools and 11 centres be equitable i.e. did the panel adhere to the evidence required for a satisfactory outcome?
How would we test this?

5. Test through Audit Audit of 10% of ARCP outcomes: Randomly selected
3 auditors not involved in local ARCPs
Accessed e-portfolios
Checked available evidence at time of ARCP against ARCP checklist (used by all panels)
Assigned an outcome + reasons

6. Results of quality control audit for 2013
Note: the quality control assessors agreed with all final outcomes.

7. Results for 2013:
Percentage of trainees awarded outcome 5s

8. Outcome 5 awarded in Trent School

9. Next steps:
Faculty development day when results were presented to FTPDs from both schools.
Recommendations:
FPCs and FTPDs to monitor e-portfolios of all trainees.
Trainees identified as currently having e-portfolio issues must be interviewed by FTPDs before end of March.
The ARCP outcome will be determined by the level of evidence required (see LNR/Trent sign off requirements) – if evidence is missing an Outcome 5 must be issued.
Further audit of ARCP outcomes.

10. Results over two years: number of outcome 5s

11. Quality control assessor and panel agreement at 1st ARCP
Foundation Year 1 trainees ARCP results

12. Quality control assessor and panel agreement at 1st ARCP
Foundation Year 2 trainees ARCP results

13. Next Steps:
Individual issues with panels/locations identified and feedback delivered to panels.
Further sharing of best practice across sites.
Further audit of 2015 ARCP outcomes.

15. Summary
Quality control audit revealed discrepancies in ARCP outcomes (related to outcome 5)
Sharing of quality control audit and faculty development improved consistency.
Individual panel feedback delivered to improve consistency further.
3rd audit planned for August 2015.