Company Confidential Registration Management Committee (RMC) 1 July 2010 Report on Oasis Data for 2007,2008,2009 & 2010 (YTD May) Atlanta, Georgia July 20-21, 2010 R. Darrell Taylor Raytheon
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 2 ACTION ITEM: January –Report OASIS data over a 3 year time frame to determine if any trends exist.
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 3 Executive Summary The process has not changed statistically from 2008 to 2009 – 2007 was not normal in comparison Majors are written app. Every 4 audits, seeing a change in 2010 App. 3 Minors are written every audit, no change, consistent Feedback usually closes quickly but a small percentage stay open for months
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 4 Agenda CRB Activity Entries – Audits Nonconformities Scores AS9100 Elements Feedback Proposed Monitoring Model
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 5 Comparison of Entries 2007,2008, first 5 months 2010 Entries: –2007 – 5114 –2008 – 4529 (DB error) – –2010 – 1385 »(as of May) As of May, only 27% of data in with 42% of year gone
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 6 Comparison of Types SUR=Surveillance REC = Recertification INT = Initial If pace holds, we will have about ½ the number of initials
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 7 Standards Entered Into Database App. 2% increase in 9120 activity, note minimal data entry errors
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 8 Scores Analysis NOTE: The result statistically is not a normal curve SCORES will be going away, little change year to year
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 9 Ratio- Total Nonconformities/Entries 2007 not normal, or more majors, one with 20… Totals 2010 – 13,166* , , – 14,957 * At current pace
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 10 Ratio Majors/Entries On average, one Major is written every fourth audit – NOTE: Average up to 6.6 audits for 2010 Totals –
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 11 Ratio Minors/Entries On average, 2.8 Minors are written every audit, no significant change from the past Totals 2010 – 3, , , –14,087
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 12 AS9100 Nonconformities Top 15 Top Ten 2009 same as 2008
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 13 Feedback Analysis 2009 average 112 per month, none in December
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 14 Feedback NOTE 2007 starts in May Supplier Admin makes up 72%, next biggest category is Other 7.2 %
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 15 Aging Report – Open Feedback Issues beyond 2 quarters in for a long time
Atlanta Georgia July , 2010 Registration Management Committee (RMC) Feedback Closed Status % open % open ALL Average closure time improved from 2008 to 2009
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 17 Time – Line, Data Presentation JAN MAR JUL SEP First 6 Months Summary Previous Year Summary RULE VIOLATORS
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 18 Certification Body Statistical Assessment Model ANAB Audits - 6 Criteria OASIS Results - 3 Criteria Feedback - 2 Criteria General - 1 Criteria
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 19 Threshold Violations RMC & ANAB need to research ANAB to report to RMC ANAB to investigate No Action
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 20 Grading Criteria ANAB Audit Results –Majors (> 2) –Minors (> 10) –Ratio To Audits (>2 SD away from mean) –Ratio of Majors (>2 SD away from mean) –Ratio of Minors (>2 SD away from mean) –Trend –Total Ratio (-SD shift from last year)
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 21 Grading Criteria (cont.) OASIS Audit Results –Ratio of Majors (>1 SD away from mean) –Ratio of Minors (>1 SD away from mean) –Ratio of Total (>1 SD away from mean) FEEDBACK –Average closure date (>30 days) –Average open date (>30 days) GENERAL –Based on review of all the above, and known issues
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 22 Recommended Approach Based on the number of violations: 2 – 3; ANAB to follow up 4 – 5; ANAB to follow up and report to RMC > 5; Detailed Analysis of issues, action to be based on the severity of the issue
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 23 Take Aways Data Entry – accuracy counts Looking for Outliers Increased oversight supported by data
Atlanta Georgia July , 2010 Registration Management Committee (RMC) 24 Questions