Presentation is loading. Please wait.

Presentation is loading. Please wait.

Company Confidential Registration Management Committee (RMC) 1 2010 Report on Oasis Data for 2007-2010 Primary focus on 12 month roll starting in November.

Similar presentations


Presentation on theme: "Company Confidential Registration Management Committee (RMC) 1 2010 Report on Oasis Data for 2007-2010 Primary focus on 12 month roll starting in November."— Presentation transcript:

1 Company Confidential Registration Management Committee (RMC) 1 2010 Report on Oasis Data for 2007-2010 Primary focus on 12 month roll starting in November 2009 to December 2010 (For Open Meeting) San Diego, CA January 18 – 19, 2011 R. Darrell Taylor Raytheon

2 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 2 Executive Summary Setting a Baseline for the future Statistically Based Analysis Two-fold Analysis of data –Trends for the total population –Trends for the individual CB’s

3 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 3 Agenda OASIS Entries – Audits OASIS Nonconformities AS9100 Elements – Quick Overview no change Feedback Monitoring Model

4 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 4 Comparison of Entries 2007 -2010 Entries: –2007 – 5114 –2008 – 5972 ^14% –2009 – 6969 ^17% –2010 – 5987 »As of 12/2010 Consistent with Record Entry Delays Projecting a flat to a slight increase compared to 2009 year

5 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 5 Comparison of Types 2007 -2010 SUR=Surveillance REC = Recertification INT = Initial NOTE : 2010 is still not complete, consistent with previous years

6 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 6 Standards Entered Into Database 2 AS9100C audits now in the database

7 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 7 Summary of OASIS Data MAJORS MINORS Average number of Non Conformities per audit slightly over 3 Average number of minors 2.4 per audit On average a major is written every 5 th audit Minors – 15,814 Majors - 1117

8 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 8 AS9100 Nonconformities Top 10 Top Ten 2010 same as 2009 & 2008 Will monitor as we transition to AS9100C and determine if there are any industry related trends

9 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 9 Feedback Analysis 2009 average 112 per month, none in December 2008 – average 110 per month as of August

10 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 10 ANAB Audit Summary 2010 –6.07 Minors per audit,.4 Majors per audit Other Categories monitored: –Escalated N/CCustomer Complaints –Negative ShiftSuspensions (2 Yrs) –Additional Audits –N/C from outside assessments

11 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 11 Certification Body Statistical Assessment Model ANAB Audits - 6 Criteria OASIS Results - 3 Criteria Feedback - 2 Criteria General - 1 Criteria + 1 Added Old Feedback “OPEN” as separate criteria ANAB Performance - + 4 Customer Complaints Suspensions C/A’s outside of Audits Extra Audits

12 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 12 Threshold Violations RMC & ANAB need to research –>6 ANAB to report to RMC –4-5 ANAB to investigate –2-3 No Action –<2

13 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 13 Quantity of CB’s & Threshold Violations 11/2009 – 11/2010

14 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 14 Non - Statistical Driven Metrics Feedback (Only 9 CB’s did not have a hit) –Closed > average 30 Days –Open > average 30 Days –OPEN over one year Escalated N/C’s (9 CB’s had escalated N/C’s)

15 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 15 Questions

16 Company Confidential Registration Management Committee (RMC) 16 Back Up

17 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 17 ANAB Audits - Minors Normal Distribution Identify those CB’s in the top 5 % receiving Minors from ANAB audits

18 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 18 ANAB Audits - Majors NOT Normal Distribution Identify those CB’s in the top 5 % receiving Majors from ANAB audits

19 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 19 ANAB Audits – Majors (cont.) Poisson Distribution supports the use of > 2 as threshold

20 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 20 ANAB Audits – Ratio Total Normal Distribution Identify those CB’s in the top 5 % receiving Nonconformities as a ratio to audits performed from ANAB audits

21 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 21 ANAB Audits – Ratio Minors Normal Distribution Identify those CB’s in the top 5 % receiving Minors as a ratio to audits performed from ANAB audits

22 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 22 ANAB Audits – Ratio Majors NOT Normal Distribution Identify those CB’s in the top 5 % receiving Majors as a ratio to audits performed from ANAB audits

23 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 23 ANAB Audits – Ratio Majors (cont.) Poisson Distribution supports the use of >1

24 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 24 ANAB Score Negative Shift Formula TY Ratio of Total – LY Ratio of Total –Trigger count if decrease is > than 1 SD (TY) Based on a one standard deviation shift in the negative direction, may be an indicator of a potential issue TY= This Year LY = Last Year SD= Standard Deviation Identify those CB’s with a greater than one standard deviation shift in performance in the negative direction

25 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 25 FEEDBACK Rule of Thumb threshold > 30 days based on “Closed” Rule of Thumb threshold > 30 days based on “Currently OPEN” Rule of Thumb any violation of older “OPEN” feedback Identify CB’s with outstanding feedback responses >30 days

26 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 26 ANAB DATA – CB Performance Additional ANAB Audits >0 Escalated Nonconformities > 0 Customer Complaints > 2 over two years Corrective Actions issued outside of Assessment Minors >1, Majors >0 Suspensions in past 2 years >0 Outside Assessment Influence

27 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 27 OASIS Ratio of Total Findings Modified Modified criteria excluding outlier

28 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 28 Ratio Majors/Entries On average, one Major is written every fifth audit – NOTE: Average down to.21 per audit for 2010 (1/5 audits) Totals 2010 – 1117 YTD 2009 -1135 2008 – 976 2007 - 870

29 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 29 OASIS Ratio of Majors NOT Normal Distribution Identify CB’s in the bottom 5% writing majors

30 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 30 OASIS Ratio of Majors - Modified Normal Distribution after a transformation

31 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 31 Ratio Minors/Entries On average, 2.8 Minors are written every audit, down to 2.47 minors per audit Totals 2010 – 15,814 YTD 2009 -19,414 2008 -17,393 2007 –14,087

32 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 32 OASIS Ratio of Minors Normal Distribution Identify CB’s in the bottom 5% writing minors

33 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 33 AS9100 Nonconformities Quantities NO CHANGE

34 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 34 AS9100 Nonconformities Quantities (cont.) NO CHANGE

35 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 35 Time – Line, Data Presentation JAN MAR JUL SEP First 6 Months Summary Previous Year Summary RULE VIOLATORS

36 San Diego, CA January 18-19, 2011 Registration Management Committee (RMC) 36


Download ppt "Company Confidential Registration Management Committee (RMC) 1 2010 Report on Oasis Data for 2007-2010 Primary focus on 12 month roll starting in November."

Similar presentations


Ads by Google