1. Air Armament Center Mr. John Mistretta Technical Director, AAC/EN 850-883-3700 War-Winning Capabilities…On Time, On Cost Systems Engineering Update AAC Industry Day 18 Mar 08 DISTRIBUTION STATEMENT A: Approved for public release; distribution is unlimited.

2. War-winning Capabilities…On Time, On Cost Outline Systems Engineering Assessment (SEA) –AAC SEA Updates/Progress –AF SEA Systems Engineering Plans (SEP) –AAC SEP Activities –Zero Baseline Documentation (ZBD)/Center SEP Initiative Systems Engineering Improvement Activities –D&SWS Improvement Opportunities –TRA/MRA Updates

3. War-winning Capabilities…On Time, On Cost AAC Systems Engineering Assessment “Spiral I SEA” Standardized / Summarized Policy & Processes (06) Interfaced with Industry and Government: (06/07) Developed Focused SE Training (06) Conducted Spiral I SEAs Identified Program Specific Findings & Recommendations (06) Hosted Workshops Sharing Lessons Learned & Best Practices (07) Advised / Consulted on Action Plans (07) Streamlined Module Based on Feedback & Lessons Learned (07) Expanded Module to Include Manufacturing & Sustainment (07) Fielded as “Spiral II SEA” (07) FY06-07 Improvement Activities Program Support Guides & Tools Enterprise Support

4. War-winning Capabilities…On Time, On Cost Key Process Areas Technical Processes –Requirements –Design –Verification/Validation –Transition Technical Management Processes –Planning –Risk Management –Configuration Management –Decision Analysis –Technical Assessment Technical Processes –Requirements –Design –Verification/Validation –Manufacturing –Fielding & Follow-on Sustainment Technical Management Processes –Planning –Risk Management –Configuration Management –Decision Analysis –Technical Assessment Spiral 1Spiral 2 & 3

5. War-winning Capabilities…On Time, On Cost FY08 AAC SEA Activities “Spiral II SEA” Two New Process Areas Successfully Piloted –Manufacturing, Fielding & Follow-on Sustainment –Completed HTS as Beta Program, Jan 08 Synchronize Spiral II SEA w/IA Tools –Manufacturing element w/MRA tool –Sustainment element w/LHA tool Support Assessments as Requested by PMs –Updates to Spiral I –Emerging Programs may have Full Assessments e.g., CRIIS, SDB II Ensure Effective Transition to Spiral III

6. War-winning Capabilities…On Time, On Cost AF Standard SEA “Spiral III SEA” Champions: SAF/AQR & AFMC/EN Objective: Develop a common assessment methodology using the Defense Acquisition Guidebook, AFI 63-1201, and current SE best practices as a baseline Participants: SAF/AQR, HQ AFMC Staff, all AFMC Product & Logistic Centers, Space and Missile Center Targeted as the AAC Spiral III SEA

7. War-winning Capabilities…On Time, On Cost AF Approach FY08-09 AAC SEA Module Identified as Best Practice –Serving as foundation for AF SEA module –Valuable additions from all Centers Develop Implementation Plan –Develop scoring criteria and assessment methods –Train Center ENs & affected organizations –Run pilot test Plan for 4 program assessments Compare results of all assessments SEA Complementary to SEPs

8. War-winning Capabilities…On Time, On Cost System Engineering Plans (SEP) DoD/AF Policy Requires SEPs –Applicable to All ACAT Levels –Required Content Areas/Topics Identified –AAC Programs Generated 17 SEPs in CY 07 All Signed by Program Milestone Decision Authority Captured Government and Contractor Information –Leveraged Existing Program Data Completion Tracked/Reported at AFMC & SAF Used the AAC SEP Guide

9. War-winning Capabilities…On Time, On Cost AFMC/EN Developed Coordination Guidance (6 Feb 2008) –Clarification of current SAF SEP policy –Cross Center coordination/signatures –Joint program coordination/signatures –Center ENs keep e-copy of approved SEP & submit to AFMC/EN System Engineering Plans (SEP) Zero Baseline Documentation (ZBD) Effort Driving Future SEP Approach

10. War-winning Capabilities…On Time, On Cost ZBD Background D&SWS related initiative led by the Deputy PEO for Weapons, Ms Judy Stokley, for Ms Payton Driven by redundancy and burden of large number of required program plans/ documentation and excessive staffing lead time April 07 SAF/AQ Memo –Identify minimum documentation –Minimum coordination levels Nov 07 SAF/AQ Memo –Endorsement of AFPEO/WP implementation plan –Supports development of AAC Center SEP Create a Center SEP that captures Standard Work

11. War-winning Capabilities…On Time, On Cost Center SEP Goal: Single document that will be accepted/acknowledged by AFPEO/WP, SAF/AQ, and OSD as the standard SE work/processes for armament and support systems Benefit: Get it right now and NO comprehensive SEP writing will be required for new programs. Minimal program specific tailoring will be captured.

12. War-winning Capabilities…On Time, On Cost SEP Approach Approach : –Integrated 308 th and AAC/EN Team –Use AAC SEP outline as starting point for Center SEP –Develop material – address sections with standard work potential –Use source documents to capture common processes –Translate common processes into “standard” processes applicable to AAC’s portfolio and all ACAT levels –Identify sections to capture in LCMP Source Documents: –AAC SEP Guide –Existing SEPs (e.g. JASSM, JDAM, SDB2, AMRAAM, HTS) –693 ARSS/HTS Operating Instructions –OSD SEP Guide, AFI 63-1201, AFMCI 63-1201 –AFPEO/WP Independent Review Team – implementation recommendations

13. War-winning Capabilities…On Time, On Cost AAC SEP Content Assessment 1Introduction 1.1Program Description and Applicable Documents 1.1.1Program Description # 1.1.2Applicable Documents # 1.1.3Program Technical Status as of the SEP Date # 1.1.4Approach for SEP Updates 1.2System Capabilities, Require and Design Considerations 1.2.1Capabilities to be Achieved # 1.2.2Key Performance Parameters (KPPs) # 1.2.3Statutory and Regulatory Requirements # 1.2.4Certification Requirements # 1.2.5Design Considerations 2Engineering Organization 2.1Integrated Product Teams 2.1.1IPT Structure # 2.1.2Coordination # 2.1.3Integration 2.2Technical Authority and Organizational Responsibilities 2.2.1Authority 2.2.2Responsibilities and Roles 2.3Technical Staffing Plan # 3Systems Engineering Processes 3.0.1 Process Selection # 3.0.2 Process Improvement 3.1Technical Processes 3.1.1Requirements Development and Management 3.1.2Design 3.1.3Verification and Validation (V&V)# 3.1.4Transition to Production (Manufacturing) # STANDARD WORK CANDIDATES (26) 65% of SEP Content 3.2Enabling Processes 3.2.1Planning 3.2.2Risk Management # 3.2.3Decision Analysis (Approach for Trades) # 3.2.4Systems Engineering Tools and Resources 3.3Technical Baseline Management 3.3.1Configuration Management # 3.3.2Configuration Change Assessment # 3.3.3Configuration Baselines 3.3.4Technical Data Management # 3.4Technical Reviews and Assessments 3.4.1Technical Review Plan (Strategy and Approach) 3.4.2Technical Review Authorities 3.4.3Participants 3.4.4Technical Assessment # 4Integrated Acquisition Management 4.1Acquisition and Contract Strategies 4.1.1Acquisition Strategy # 4.1.2Contract Management # 4.2Risk Management Integration # 4.3Program Planning and Tracking (IMP/IMS/EVMS) # 5Life Cycle Logistics and Sustainment 5.1OSS&E Baseline Document (OBD) 5.2Inspections and Maintenance # 5.3Sources of Supply, Maintenance and Repair # PROGRAM UNIQUE CONTENT (14) # DUPLICATION WITH LCMP (25) 63% of SEP Content NOT INCLUDED IN CALCULATIONS ZBD INITIATIVE CREATING: - OPPORTUNITIES FOR STREAMLINING - DOCUMENT COORDINATION INTERDEPENDENCIES

14. War-winning Capabilities…On Time, On Cost Additional SE 08 Initiatives Evaluating Emerging TRA/MRA Material –Closely Engaged with D&SWS –Update/Improve the AAC IA Processes/Guides Establishing TRA/MRA Training –Multiple Levels –Appropriate for PM, Acquisition Engineers and Logisticians “Off Program” SMEs at Technical Reviews –Complements the IA Process

15. War-winning Capabilities…On Time, On Cost What Can Industry Do? Share Lessons Learned & Best Practices Work with Us to Institutionalize SE Across Our Integrated Teams Flow SE Discipline Down the Supply Chain Include Good SE Processes in Best Value Proposals Help Us Restore Credibility in Our Collective Processes