1. NTSA Engineering Forum Revitalizing Systems Engineering 21 July 2004 Mark Adducchio Director of Engineering (acting) USAF Training Systems Product Group mark.adducchio@wpafb.af.mil (937) 255-7388 x3257

2. NTSA Engineering Forum Revitalizing Systems Engineering Renewed interest in Systems Engineering from AF leadership Some policy & guidance rolling in from both OSD & SecAF - pending within ASC and the TSPG TSPG & Industry should go forward single-mindedly with what works, what’s useful, and what’s reasonable

3. NTSA Engineering Forum Revitalizing Systems Engineering Objectives Gain a clear idea on ways to apply systems engineering initiatives to training systems developments How best to formulate future training systems acquisitions to reflect these initiatives How to stimulate good systems engineering processes that directly relate to delivering the product

4. NTSA Engineering Forum Revitalizing Systems Engineering TSA Contractor SE capabilities/practices evaluated during source selection Task orders assume SE in place No specific SE requirements SE assessment of task order proposals integrated into IMP/IMS evaluation For individual orders, contractor determines scope of SE effort Typically risk management, reviews, IMP/IMS, Req’t tracking SE Incentives  schedule milestones Nothing precludes additional SE requirements from task orders

5. NTSA Engineering Forum Revitalizing Systems Engineering Discrete Programs (non-TSA) Treat SE as needed and/or per prevailing policy/climate SE requirements thoroughly defined on some programs  C-17 MTS Some dictated by parent program  F/A-22

6. NTSA Engineering Forum Revitalizing Systems Engineering How is SE managed in the TSPG? Program specific Reliant on contractor emphasis & practices Individual experience Sometimes personality driven Usually tied to the IMP/IMS Few institutional guidelines IRM, DAU guides and courses OSS&E Gov’t specific indicators based in Tech Health charts

7. NTSA Engineering Forum Revitalizing Systems Engineering Technical Health Charts Subjective assessment on complexity and progress Risk items Issues TD count

9. NTSA Engineering Forum Revitalizing Systems Engineering Current Issues Obscure requirements & requirements drill-down Milestone preparation – design review criteria & expectations Poorly defined HSI completion criteria – premature testing SE staying power Risk identification between contractor & Gov’t diverge CM failures Integration of engineering activities w/ management controls & indicators

10. NTSA Engineering Forum Revitalizing Systems Engineering Renewed emphasis on SE processes Risk Management Engineering/developmental milestones Incentives More Gov’t guidance Likely no new standards (i.e. MIL-STD- 499B) CMMI?

11. NTSA Engineering Forum Revitalizing Systems Engineering Establish more robust SE policy & guidance within TSPG Consistent application of SE practices within TSPG ASC policies & guidance Operating instructions Training TSA III emphasis TSA II Task orders

12. NTSA Engineering Forum Revitalizing Systems Engineering How Do We Apply To Our Programs Contractor defined milestones? SEP Leading Indicators/Metrics Incentives (not disincentives) Technical Baseline Content Control Robust Product Design

13. NTSA Engineering Forum Revitalizing Systems Engineering Transitioning to the SE Plan Provides vehicle for program standardization Map expected technical progress Report technical indicators IMP/IMS criteria; integration milestones; test results Integrate these w/ incentives How do we normalize this with contractor milestones & indicators?

14. NTSA Engineering Forum Revitalizing Systems Engineering 3 Discussion Groups Proposal guidance for effective SE Policy Implementation Technical management & leading indicators How can industry help this “revitalization”? Speak up Put up Ante up

15. NTSA Engineering Forum Revitalizing Systems Engineering QUESTIONS?