Auditor Report Card Effective January 2018, PRI Registrar started gathering data to help evaluate the risk and performance of our auditors. The criteria.

Slides:



Advertisements
Similar presentations
Performance Management Process
Advertisements

Manager Performance Evaluation
Introduction Performance appraisals, reviews and evaluations are all terms used to describe a process for documenting and communicating employees’ performance.
1 Customer and Market Focus in the Baldrige Criteria Examines how an organization determines requirements, expectations, and preferences of customers and.
Presented at CLEAR’s 23rd Annual Conference Toronto, Ontario September, 2003 Public Accountability – Best Practices Accrediting Your Certification Program.
REVIEW AND QUALITY CONTROL
1 Workshop sessions: day two ● CD infrastructure ● CD advisors ● Quality and contract management ● Referral pathways and standardised service ● Discussion.
2013 Calendar Year Customer Survey Results
Implementation Issues of Sarbanes-Oxley CASE Presentation September 23, 2004 By Denise Farnan.
1 Kingsley Karunaratne, Department of Accounting, University of Sri Jayewardenepura, Colombo - Sri Lanka Practice Management.
Practice Management Quality Control
Paul Hardiman and Rob Brown SMMT IF Planning and organising an audit.
Company Confidential Registration Management Committee RMC Auditor Workshop Charleston, SC July Supplemental Oversight AS9104/2A & Special.
RMC Auditor Workshop Charleston, SC July 2015 Registration Management Committee Company Confidential RMC Auditor Workshop Charleston, SC
Table 1. The Five Medical Laboratory Case Studies Jan Martin et al. Transnational Evaluation of a New Continuing Professional Development Activity for.
WORKSHOP ON ACCREDITATION OF BODIES CERTIFYING MEDICAL DEVICES INT MARKET TOPIC 6 CH 5 ISO MANAGEMENT RESPONSIBILITY Philippe Bauwin Medical.
The following training presentation is for all 1Prospect employees and is taken upon joining the company team. Quality Management System (QMS) Training.
HOUSTON INDEPENDENT SCHOOL DISTRICT Appraisal Training for Central Office and Campus-Based Non-Teacher Employees September 2013 HOUSTON INDEPENDENT.
PERFORMANCE MANAGEMENT TRAINING SHRA Employee Annual Performance Appraisal Program.
A LOOK AT AMENDMENTS TO ISO/IEC (1999) Presented at NCSLI Conference Washington DC August 11, 2005 by Roxanne Robinson.
UCPEA Supervisor Performance Evaluation Training
UCPEA Supervisor Performance Evaluation Training
Performance Management
James Hale.
Training for Faculty Search Committees
Performance Management
Polices, procedures & protocols
Eastern’s Assessment System
ISO 14001: 2004 Environmental Management Review Presentation
TOPS TRAINING.
PowerPoint to accompany:
The following training presentation is for all subcontract employees and is taken upon joining a contract or task order to which we are the Prime vendor.
Performance Review Tool Updates College of Engineering
Intermediate Small Business Programs, Part B SBP 202 Lesson 1: Introduction February 2017 Lesson 1: Introduction.
Subcontracting SBP 210 Lesson 1: Introduction
The following training presentation is for all employees and is taken upon joining the company team. Quality Management System (QMS) Training Proprietary.
Five-Level Performance Management System
RMS Overview PRI Registrar.
Evaluating performance management
Multi Rater Feedback Surveys FAQs for Participants
Multi Rater Feedback Surveys FAQs for Participants
Request for Proposal - Best Value
ISO 9001:2015 Auditor / Registration Decision Lessons Learned
Internal Controls.
PRI Registrar Auditor Survey
Registration Decision Criteria
OASIS NextGen (G2) and AQMS:2016 for Auditors
Industry Controlled Other Party Aerospace Auditor Expectations Kristy Heffernan Director - Quality Integrated Defense Systems The Boeing Company.
Request for Proposal - Best Value
Performance Review for County Educators
ISO 14001:2015 Auditor / Reg Decision Transition Training
Quality Department
AQMS 2016 Transition Training for AUDITORS and DECISION MAKERS
Back to Basics: Auditor Performance
Introduction to ISO 9000 ISO
Performance Review for County Educators
FY19 Federal Grant Monitoring: Titles I, II, IV
IHSAA Tournament Officials Ratings System
Evaluating the Performance of Salespeople
RTI University ScorecarD
Chapter 5THE NCLEX-PN®
Performance Management Training
How to conduct Effective Stage-1 Audit
IHSAA Tournament Officials Ratings System
ePerformance: A Process Crosswalk May 2010
Good Morning and Welcome
Internal Controls.
ANAB AQMS Activity 2011 ~ to date July 2011
Chapter 5THE NCLEX-PN®
Internal Controls.
Presentation transcript:

Auditor Report Card Effective January 2018, PRI Registrar started gathering data to help evaluate the risk and performance of our auditors. The criteria we will be reviewing today will be used as measurements for performance as part of our Auditor Management procedure.

Purpose of the Report Card ISO/IEC 17021-1:2015 requires that we monitor auditor competence based on a combination of audit documentation review, customer feedback and witness audits. We will be using the office review of documentation and customer feedback to establish risk-based intervals for on-site evaluation via a witness audit. It is important that you, as suppliers and partners of PRI Registrar, receive all available feedback on your performance on an on-going basis, in order to drive continual improvement.

What the Report Card Isn’t Intended to do: Be Unfair Give Biased Evaluations Fire You! Criticize you! Demoralize Reprimand

Surveys: Audit Documentation Client Satisfaction Scheduling Methods of Evaluation Surveys: All surveys are conducted on a scale of 1 – 5 1 = Unsatisfactory to 5 = Excellent Audit Documentation Client Satisfaction Scheduling

Methods of Evaluation Audit Documentation Client Manager Survey: Following each closed audit, the client manager completes a survey consisting of 3 questions evaluating the auditors: Timeliness and Accuracy of Audit Documentation Responsiveness to Requests

Did the auditor submit the audit report within the scheduled deadline? Methods of Evaluation Question #1 Did the auditor submit the audit report within the scheduled deadline? Rating Scale: 5 = Exceptional (5 business days or less) 4 = Exceeds Expectations (6 - 8 business days) 3 = Meets Expectations (9 - 10 business days) 2 = Improvement Needed (11 - 12 business days) 1= Unsatisfactory (13 business days or longer )

Did the auditor complete all documentation accurately? Methods of Evaluation Question #2 Did the auditor complete all documentation accurately? Rating Scale: 5 - Exceptional (No Typo’s or Revisions) 4 - Exceeds Expectations (1 Typo/No Revision) 3 – Meets Expectations (Minimal Typo’s/ No Revision) 2 - Improvement Needed (Multiple Typo’s and /or 1 Revision) 1 - Unsatisfactory (Multiple Typos / 2 or more Revisions)

(Includes responding to emails and returning phone calls) Methods of Evaluation Question #3 How responsive was the auditor in troubleshooting issues throughout the audit process? (Includes responding to emails and returning phone calls) Rating Scale: 5 – Exceptional (Same Day) 4 - Exceeds Expectations (1 business day) 3 – Meets Expectations (2 business days) 2 - Improvement Needed (3-4 business days) 1 - Unsatisfactory (5 business days or longer)

Client Satisfaction Methods of Evaluation Professionalism Following each Stage 2, Recertification, or Surveillance, clients are offered the opportunity to answer 7 questions about auditor performance related to: Professionalism Communication Knowledge Value Added Any responses that are submitted are logged, and the scores for each question are averaged together equally.

Client Satisfaction Survey Questions Methods of Evaluation Client Satisfaction Survey Questions Scale Rating: 5= very satisfied 4= somewhat satisfied 3= neutral 2= somewhat dissatisfied 1= very dissatisfied Question #1: How satisfied were you with the professionalism of the auditor? Question #2: How satisfied were you with the communication by the auditor (on and off-site)?

Methods of Evaluation Customer Survey Questions Cont’d: How satisfied were you that our auditor improved your understanding of the standard? Question #4: How satisfied were you that our auditor used time effectively to complete your audit?

Methods of Evaluation Customer Survey Questions Cont’d: How satisfied were you that our auditor added value to your Management System? Question #6: How satisfied were you with how the auditor explained each nonconformance? Question #7: How satisfied were you with the auditor's explanation of PRI Registrar’s nonconformance response process, including the appeals process?

Scheduling Methods of Evaluation 1 - Blank/Never Uses Each quarter, the PRI Registrar Scheduling department completes a survey regarding the auditor’s use of the RMS calendar for scheduling purposes, with possible scores of: 1 - Blank/Never Uses 3 - Mostly Current 5 - Always Current Scores for each quarter will be averaged together equally.

Weighted Average Score: Methods of Evaluation Weighted Average Score: 50% - Audit Documentation 40% - Customer Satisfaction 10% - Scheduling

Frequency of Witness Audit Methods of Evaluation Frequency of Witness Audit Intervals for on-site witness audits will be determined by the risk category assigned to the auditor based on these general criteria: Weighted average score from surveys Number of audit days performed for PRI Registrar annually External complaints received outside of the customer satisfaction survey Witness audit results

Risk Categories and Associated Witness Intervals Methods of Evaluation Risk Categories and Associated Witness Intervals Witness audits will count towards on-site witness evaluation, re-setting the interval, but poor performance may change the auditor’s risk category, resulting in a shorted interval. Risk categories will be evaluated on a semi-annul basis. If the change in risk category results in a shortened interval, and the new required witness year has already passed, the witness will be scheduled for the following year. High 2 years Medium 5 years Low 10 years

Auditor Report Card Auditor Report Card Auditor Information: Report Generated: 1- Jan-2018 Auditor Information: Auditor name Joe Auditor Period of evaluation Jan 2017 – Dec 2017 Number of audits performed in the period 15 Number of audit days in the period 40.5 Auditor Scores: Audit documentation score 4.02 Client satisfaction score 5.00 Scheduling score Total weighted score 4.51

Auditor Report Card Witness Audit: Year of next witness 2026 Year of last witness 2016 Risk category Low Year of next witness 2026 Customer Feedback Comments: Joe Auditor was firm, fair, stuck by the audit process but helped us understand. He is a great blend of an auditor and instructor, while still maintaining the separation of duties.   OUTSTANDING assistance in drawing attention where it matters. Best, most professional and knowledgeable auditor we've had to date. Joe Auditor was very professional and asked good questions to get an understanding of the various processes that he audited. Disclaimer: This report is confidential, will not be shared with anyone but the evaluated auditor.

How often will I receive a Report Card? How can you impact your score? Conclusion How often will I receive a Report Card? Semi-Annually How can you impact your score? Market the Client Satisfaction Survey Participate in PRI Registrar Training Use your Calendar Exhibit Highly Ethical and Professional Behavior Conduct a Fair and Professional Audit

Conclusion