Company Confidential Registration Management Committee (RMC) Report on Oasis Data Long Beach, CA September , 2011 R. Darrell Taylor Raytheon Long Beach, CA September 13-14, 2011

Registration Management Committee (RMC) 2 Executive Summary Baselines have been established for 2007 – 2010 No Feedback data, changing metric Review Proposed revision to the CB Report Card

Registration Management Committee (RMC) 3 Agenda OASIS Entries – Audits OASIS Nonconformities AS9100 Elements Feedback Monitoring Model

Company Confidential Registration Management Committee (RMC) 4 Entries – Audits Long Beach, CA September 13-14, 2011

Registration Management Committee (RMC) 5 Comparison of Entries Entries: –2007 – 5114 –2008 – 5972 ^16% –2009 – 6969 ^17% –2010 – 7502 ^7.6% –-2011 – /1/2011 Increase slowing down

Registration Management Committee (RMC) 6 Comparison of Types SUR=Surveillance REC = Recertification INT = Initial 2011 – 72%, 21 %, 7%

Registration Management Committee (RMC) 7 Standards Entered Into Database 38 AS9100C – 2010; 225 in 2011 as 05 8/1/2011

Registration Management Committee (RMC) 8 CRB Comments – 2010 Data baselined Going to Rolling Format

Company Confidential Registration Management Committee (RMC) 9 Nonconformities Long Beach, CA September 13-14, 2011

Registration Management Committee (RMC) Pareto of Total Nonconformities 10 Totals 2010 – 20, , , – 14, – 65% 2 or less

Registration Management Committee (RMC) 11 OASIS Ratio of Total Findings Violates Normal Distribution Strongest fit 3 Parameter Lognormal Identify CBs in the bottom 5% writing nonconformities

Registration Management Committee (RMC) Total - Comments Field Family of Standards states ISO9001:2000 s/b 2008? 35 (<.5%)Entries with N/A in Numbers, what does that mean? –2 Initials, 1 surveillance, 32 recertification 12

Registration Management Committee (RMC) 13 Ratio Majors/Entries On average, one Major is written every fifth audit – NOTE: Average down to.18 per audit for 2010 (1/5 audits) No Change in 2011 (.19).22 for AS9100C audits Totals 2010 – –

Registration Management Committee (RMC) 14 OASIS Ratio of Majors NOT Normal Distribution strongest 3 parameter loglogistic Identify CBs in the bottom 5% writing majors

Registration Management Committee (RMC) 15 Ratio Minors/Entries On average, 2.5 Minors are written every audit 2011 – down to 2.12 AS9100C – 3.18 Totals 2010 – 18, , , –14,087

Registration Management Committee (RMC) 16 OASIS Ratio of Minors NOT Normal Distribution Lognormal Distribution Identify CBs in the bottom 5% writing minors

Registration Management Committee (RMC) Evaluation of Audit Type INT, REC, SUR Chi Squared Test returned a P-Value = MajorAVGSDCountMINMEDMAX INT REC SUR Minor INT REC SUR

Registration Management Committee (RMC) 18 AS9100 Nonconformities Top 10 Top Eight 2010 same as 2009 & 2008 NO CHANGE

Registration Management Committee (RMC) 19 Feedback Analysis 2010 average 103 per month 2009 average 112 per month 2008 average 110 per month As of June 6% of 2010 Feedback Responses still open ON HOLD

Registration Management Committee (RMC) 20 Certification Body Statistical Assessment Model ANAB Audits - 6 Criteria OASIS Results - 3 Criteria Feedback - 3 Criteria General - 1 Criteria ANAB Performance -4 ON HOLD

Registration Management Committee (RMC) 21 Threshold Violations RMC & ANAB need to research –>6 ANAB to report to RMC –4-5 ANAB to investigate –2-3 No Action –<2

Company Confidential Registration Management Committee (RMC) Oversight Results 2011 Major & Minor Numbers 2 WA – 1 Minor / 0 Majors & 2 Minors / 0 Majors 2 OA – 3 Minors / 0 Majors & 10 Minors / 3 Majors 2009 Major & Minor Numbers 2 WA –1 Minor /4 Majors 2 OA –7 Minors /0 Major NCR trends – Not verifying OASIS admin. on site, OASIS accuracy, depth of audit, not documenting all NCRs, various checklist issues CB Activity & AEAs Standard Sites AEAs Applicant OASIS DataSupplemental Activity AB Actions: 2010 – March WA was a 2009 re-audit CB has received 2 OAs per year for two years. 1 major NCR written outside of an assessment RMC Member: (Supplemental oversight data) 2 events, 4 minor NCRs CB Name: XXX -2011

Company Confidential Registration Management Committee (RMC) CB Name: XXX ANAB Additional Comments

Registration Management Committee (RMC) 24 Questions

Company Confidential Registration Management Committee (RMC) 25 Back Up

Registration Management Committee (RMC) 26 ICOP/ANAB Audit Results

Registration Management Committee (RMC) 27 Performance Metrics

Registration Management Committee (RMC) 28 Oasis Metrics

Registration Management Committee (RMC) 29 Feedback Metrics

Registration Management Committee (RMC) 30 Time – Line, Data Presentation JAN MAR JUL SEP First 6 Months Summary Previous Year Summary RULE VIOLATORS