1. Company Confidential Registration Management Committee (RMC) 1 2010 Report on Oasis Data 2007-2010 Long Beach, CA September 13 -14, 2011 R. Darrell Taylor Raytheon Long Beach, CA September 13-14, 2011

2. Registration Management Committee (RMC) 2 Executive Summary Baselines have been established for 2007 – 2010 No Feedback data, changing metric Review Proposed revision to the CB Report Card

3. Registration Management Committee (RMC) 3 Agenda OASIS Entries – Audits OASIS Nonconformities AS9100 Elements Feedback Monitoring Model

4. Company Confidential Registration Management Committee (RMC) 4 Entries – Audits Long Beach, CA September 13-14, 2011

5. Registration Management Committee (RMC) 5 Comparison of Entries 2007 -2010 Entries: –2007 – 5114 –2008 – 5972 ^16% –2009 – 6969 ^17% –2010 – 7502 ^7.6% –-2011 – 3253 8/1/2011 Increase slowing down

6. Registration Management Committee (RMC) 6 Comparison of Types 2007 -2010 SUR=Surveillance REC = Recertification INT = Initial 2011 – 72%, 21 %, 7%

7. Registration Management Committee (RMC) 7 Standards Entered Into Database 38 AS9100C – 2010; 225 in 2011 as 05 8/1/2011

8. Registration Management Committee (RMC) 8 CRB Comments - 2010 2007 – 2010 Data baselined Going to Rolling Format

9. Company Confidential Registration Management Committee (RMC) 9 Nonconformities Long Beach, CA September 13-14, 2011

10. Registration Management Committee (RMC) Pareto of Total Nonconformities 10 Totals 2010 – 20,009 2009 -20,980 2008 -18,803 2007 – 14,957 2011 – 65% 2 or less

11. Registration Management Committee (RMC) 11 OASIS Ratio of Total Findings Violates Normal Distribution Strongest fit 3 Parameter Lognormal Identify CBs in the bottom 5% writing nonconformities

12. Registration Management Committee (RMC) Total - Comments Field Family of Standards states ISO9001:2000 s/b 2008? 35 (<.5%)Entries with N/A in Numbers, what does that mean? –2 Initials, 1 surveillance, 32 recertification 12

13. Registration Management Committee (RMC) 13 Ratio Majors/Entries On average, one Major is written every fifth audit – NOTE: Average down to.18 per audit for 2010 (1/5 audits) No Change in 2011 (.19).22 for AS9100C audits Totals 2010 – 1387 2009 -1135 2008 – 976 2007 - 870

14. Registration Management Committee (RMC) 14 OASIS Ratio of Majors NOT Normal Distribution strongest 3 parameter loglogistic Identify CBs in the bottom 5% writing majors

15. Registration Management Committee (RMC) 15 Ratio Minors/Entries On average, 2.5 Minors are written every audit 2011 – down to 2.12 AS9100C – 3.18 Totals 2010 – 18,627 2009 -19,414 2008 -17,393 2007 –14,087

16. Registration Management Committee (RMC) 16 OASIS Ratio of Minors NOT Normal Distribution Lognormal Distribution Identify CBs in the bottom 5% writing minors

17. Registration Management Committee (RMC) Evaluation of Audit Type INT, REC, SUR Chi Squared Test returned a P-Value = 0.069 17 MajorAVGSDCountMINMEDMAX INT.2514.7991217006 REC.2609.97073840011 SUR.1532.64927860010 Minor INT3.9074.02333720329 REC3.3693.98049660266 SUR2.0053.0911028401151

18. Registration Management Committee (RMC) 18 AS9100 Nonconformities Top 10 Top Eight 2010 same as 2009 & 2008 NO CHANGE

19. Registration Management Committee (RMC) 19 Feedback Analysis 2010 average 103 per month 2009 average 112 per month 2008 average 110 per month As of June 6% of 2010 Feedback Responses still open ON HOLD

20. Registration Management Committee (RMC) 20 Certification Body Statistical Assessment Model ANAB Audits - 6 Criteria OASIS Results - 3 Criteria Feedback - 3 Criteria General - 1 Criteria ANAB Performance -4 ON HOLD

21. Registration Management Committee (RMC) 21 Threshold Violations RMC & ANAB need to research –>6 ANAB to report to RMC –4-5 ANAB to investigate –2-3 No Action –<2

22. Company Confidential Registration Management Committee (RMC) Oversight Results 2011 Major & Minor Numbers 2 WA – 1 Minor / 0 Majors & 2 Minors / 0 Majors 2 OA – 3 Minors / 0 Majors & 10 Minors / 3 Majors 2009 Major & Minor Numbers 2 WA –1 Minor /4 Majors 2 OA –7 Minors /0 Major NCR trends – Not verifying OASIS admin. on site, OASIS accuracy, depth of audit, not documenting all NCRs, various checklist issues CB Activity & AEAs Standard Sites AEAs 9100 100 14 9110 Applicant 0 9120 8 8 OASIS DataSupplemental Activity AB Actions: 2010 – March WA was a 2009 re-audit CB has received 2 OAs per year for two years. 1 major NCR written outside of an assessment RMC Member: (Supplemental oversight data) 2 events, 4 minor NCRs CB Name: XXX -2011

23. Company Confidential Registration Management Committee (RMC) CB Name: XXX -2011 ANAB Additional Comments

24. Registration Management Committee (RMC) 24 Questions

25. Company Confidential Registration Management Committee (RMC) 25 Back Up

26. Registration Management Committee (RMC) 26 ICOP/ANAB Audit Results

27. Registration Management Committee (RMC) 27 Performance Metrics

28. Registration Management Committee (RMC) 28 Oasis Metrics

29. Registration Management Committee (RMC) 29 Feedback Metrics

30. Registration Management Committee (RMC) 30 Time – Line, Data Presentation JAN MAR JUL SEP First 6 Months Summary Previous Year Summary RULE VIOLATORS