1. SIAP SE TEM 00720.ppt-1 IEEE Standard for Application & Management of the Systems Engineering Process Robert L. Hobart Deputy Commander, C4I Integration (703) 784-0700 HobartRL@mcsc.usmc.mil 23 Oct 2001

2. SIAP SE TEM 00720.ppt-2 Evolution of Standards MILSTD 499 MIL STD 1521 MIL STD 490A MIL STD 2167A IEEE 1220 - 1998 MIL STD 961D IEEE 12207 COLD WAR 2000 ACQUISITION REFORM

3. SIAP SE TEM 00720.ppt-3 IEEE 1220 - 1998 u Defines the interdisciplinary tasks that are required throughout a system’s life cycle to transform customer needs, requirements, and constraints into a system solution. u Intent is to guide the development of systems or commercial, government, military, and space applications. u Specifies the requirements for the systems engineering process and its application throughout the product life cycle. IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

4. SIAP SE TEM 00720.ppt-4 IEEE 1220 - 1998 (cont’d) u Describes an integrated approach to product development, which represents the total technical effort for –Understanding the environments and related conditions for which product will be utilized/designed; –Defining product requirements in terms of functional requirements, quality factors, usability, producibility, supportability, safety, and environmental impacts; –Defining life cycle processes for manufacturing, test, distribution, support, training, and disposal IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

5. SIAP SE TEM 00720.ppt-5 Systems Engineering Defined u Interdisciplinary approach encompassing the entire technical effort to evolve and verify an integrated and life-cycle balanced set of system people, product, and process solutions that satisfy customer needs. u Systems engineering encompasses: –Technical efforts related to the development, manufacturing, verification, deployment, operations, support, disposal of, and user training for, system products and processes –Definition and management of the system configuration –Translation of the system definition into work breakdown structures –Development of information for management decision making EIA Interim Standard, Systems Engineering 1994

6. SIAP SE TEM 00720.ppt-6 Discipline and Control System Definition Production Customer Support Preliminary Design Detailed Design Fabrication, Assembly, Integration, and Test (FAIT) System Definition SYSTEM BASELINE BUILD-TO BASELINE ACR SDR DESIGN-TO BASELINE Revise Eng & Tech Plans for Detailed Design Update System Baseline Identify Interfaces Resolve Component Risks Prepare Integrated Data Package SRR PDR TRR FCA PAR/PCA DDR ACR =Alternative Concept Review SDR =System Definition Review SRR =Software Requirements Review PDR =Preliminary Design Review DDR =Detailed Design Review TRR =Test Readiness Review FCA =Functional Configuration Audit PAR =Production Approval Review PCA =Physical Configuration Audi t Software Requirements Definition Phase Test Planning Phase Software Verification & Validation Planning Phase Revise Eng & Tech Plans for FAIT Production & Deployment, Customer Support Complete Specifications Update System and Design-To Baselines Complete Preliminary Drawings for Each Subsystem Complete Specifications Complete Component Definition (HW & SW)

7. SIAP SE TEM 00720.ppt-7 Specification Tree IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

8. SIAP SE TEM 00720.ppt-8 Systems Engineering Process Requirements Analysis Requirements Verification Functional Analysis Functional Verification Synthesis Requirements trade studies and assessments Functional trade studies and assessments Design trade studies and assessments PROCESS INPUTS Design Verification Verified physical architecture Physical architecture Verified functional architecture Functional architecture Validated requirements baseline Requirements baseline Design solution requirements and alternatives Design solution trade-offs and impacts Decomposition/allocation trade-offs and impacts Decomposition and requirement allocation alternatives Requirement trade-offs and impacts Requirement and constraint conflicts PROCESS OUTPUTS System Analysis Control IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

9. SIAP SE TEM 00720.ppt-9 Requirements Analysis IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

10. SIAP SE TEM 00720.ppt-10 Requirements Validation IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

11. SIAP SE TEM 00720.ppt-11 Functional Analysis IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

12. SIAP SE TEM 00720.ppt-12 Functional Verification IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

13. SIAP SE TEM 00720.ppt-13SynthesisSynthesis IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

14. SIAP SE TEM 00720.ppt-14 Design Verification IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

15. SIAP SE TEM 00720.ppt-15ControlControl IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

16. SIAP SE TEM 00720.ppt-16 Technical Reviews u Conduct Technical Reviews and audits for the purpose of assessing technical progress. u Design reviews should be conducted at the completion of each application of the SE process and accomplish the following: –Assess system requirements and allocations –Assess design maturity –Present risks associated with continued development –Assess life cycle processes and infrastructure –Identify resources required for continued development –Determine whether to proceed IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

17. SIAP SE TEM 00720.ppt-17 Technical Review Process DSMC, Systems Engineering Fundamentals, 1999

18. SIAP SE TEM 00720.ppt-18 Technical Review Comparison MIL-STD-1521B EIA IS-632IEEE P1220 Alternative Systems Review (ASR) System Req’t Review (SRR) System Functional Review (SFR) SSR Preliminary Design Review (PDR) Critical Design Review (CDR) TRR Functional Configuration Audit (FCA) System Verification Review (SVR) - Replaced FQR & PRR System Physical Configuration Review (PCA) System Req’t Review (SRR) System Design Review(SDR) Software Spec Review (SSR) Preliminary Design Review (PDR) Critical Design Review (CDR) Test Readiness Review (TRR) Production Readiness Reviews (PRR) Formal Qualification Review (FQR) Functional Configuration Audit (FCA) - Replaced by MIL-STD-973 Physical Configuration Review (PCA) - Replaced by MIL-STD-973 Alternative Concept Review (ACR) System Definition Review (SDR) Subsystem, System PDR Component, Subsystem, System Detail Design Review (DDR) Component, Subsystem, System TRR Component, Subsystem, System Production Approval Reviews (PAR) Component, Subsystem, System FCA Component, Subsystem, System PCA DSMC, Systems Engineering Fundamentals, 1999

19. SIAP SE TEM 00720.ppt-19 Phasing of Technical Reviews Specifications Major Technical Reviews & Audits        MIL-STD-1521B SRRSSRPDRCDRTRRFCAPCA  SDR EIA/IS-632 Reviews ASRSRRSFRSSRPDRCDRTRRSVR/PCA FCAs IEEE P1220 Reviews ACRSDefRPDRDDRTRRFCAsPCAs PARs System Specification (formerly the A spec) Item Performance Spec (formerly the B spec) Item Detail (C), Process (D) and Material (E) Specification Functional (System) Baseline Allocated (Design-To) Baseline Product (Build-To) Baseline Configuration Baselines Program-Unique Specifications DSMC, Systems Engineering Fundamentals, 1999

20. SIAP SE TEM 00720.ppt-20 Alternative Concept Review (ACR) u Conducted to ensure that: –Allocations reasonable and sound –Capability of concept to satisfy customer requirements –Completion of system and product interface specifications and preliminary system specification –Establishment of the system baseline –Assessed risks associated with concept –Adequacy and completeness of systems analysis data to substantiate decisions made in defining concept IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

21. SIAP SE TEM 00720.ppt-21 System Definition Review (SDR) u Conducted to ensure that: –Sufficient maturity to meet Systems Engineering Management Schedule (SEMS) criteria –System-level risks have been adequately addressed –Trade-study data are adequate to substantiate that requirements are achievable –Decisions made in arriving at the system definition configuration are well supported by analysis, test, and/or other technical data. IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

22. SIAP SE TEM 00720.ppt-22 Preliminary Design Review (PDR) u Conducted to ensure sufficient progress is being made toward completion of: –Item performance specifications –Draft Item Detail, Process, and Material specifications –Design data-defining major subsystems, equipment, software, and other systems elements –Analyses, reports, “-ility” analyses, trade studies, logistics support analysis data, and design documentation –TPM data and analysis –Engineering breadboards, laboratory models, test models, mockups, prototypes used to support the design, and –Supplier data describing specific components IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

23. SIAP SE TEM 00720.ppt-23 Detailed Design Review (DDR) u Conducted to ensure that: –Each detailed component definition is sufficiently mature to meet MOE/MOP criteria –Component specifications are reasonable and provide sound concept –Component and related LC risks have been assessed and mitigated to support Fabrication, Assembly, Integration, and Test (FAIT) –Trade-study data are adequate to substantiate that detailed component requirements are achievable –Decisions made are well supported by analysis and technical data IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

24. SIAP SE TEM 00720.ppt-24 Test Readiness Review u Conducted to assure that: –Test procedures comply with test plans and descriptions, demonstrate adequacy to accomplish test requirements, and satisfy specification qualification requirements –Pretest predictions and informal test results indicate testing will confirm satisfaction of specification requirements –New or modified test support equipment, facilities, and procedural manuals, are available –Required specification, baseline, and other supporting documentation are complete IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

25. SIAP SE TEM 00720.ppt-25 Production Approval Review (PAR) u Conducted to confirm that: –Issues for components, assemblies, subsystems, products, and LC processes and services are resolved –Test procedures were completed and accurate –System and products were confirmed ready for test –Tests were conducted IAW established procedures –An audit trail from design reviews is established with changes substantiated, and all products meet specification requirements –Risk handling procedures are satisfactory for production –Evolutionary development requirements and plans have been refined –Planning is complete and procedures, resources, and other requisite people, products, and processes are available to initiate production, etc. IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

26. SIAP SE TEM 00720.ppt-26 Functional Configuration Audit u Conducted to verify that: –Products have achieved requirements –Products have satisfied the characteristics as specified in specifications, interface specifications, and other baseline documentation –Test plans and procedures were complied with IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

27. SIAP SE TEM 00720.ppt-27 Physical Configuration Audit u Conducted to ensure that: –System, subsystem, configuration item detailed design satisfy user requirements –All system, subsystem, configuration items have been baselined –All system elements conform to the technical documentation that defines the Product (Build-To) baseline –Changes to previous baselines have been completed –Testing deficiencies have been resolved and implemented –System processes are current and can be executed IEEE Std 1220-1998, IEEE Standard for Application and Management of the Systems Engineering Process

28. SIAP SE TEM 00720.ppt-28 Back-up Slides

29. SIAP SE TEM 00720.ppt-29 Systems Engineering Process PROCESS OUTPUT Integrated Decision Data Base.. Decision Support Data.. System Functional Physical Architectures.. Specifications & Baseline Baseline System Solution Requirements Analysis Analyze Missions & Environments Identify Functional Requirements Define/Refine Performance & Design Constraint Requirements Requirements Loop Systems Analysis & Control Design Loop Verification Select Preferred Alternatives Trade-Off Studies Effectiveness Analysis Risk Management Configuration Management Interface Management Data Management Performance-Based Progress Measurement.. SEMS.. TPM.. Technical Reviews Functional Analysis/Allocation Decomposition is Lower-Level Functions Allocate Performance & Other Limiting Requirements is Lower-Level Functions Define/Refine Functional Interfaces (Internal/External) Define/Refine/Integrate Functional Architecture Synthesis Transform Architecture (Functional to Physical) Define Alternative Product Concepts Define/Refine Physical Interfaces (Internal/External) Define Alternative Product & Process Solutions PROCESS INPUT Customer Needs/ Objectives/ Requirements.. Mission/ Operations.. Measures of Effectiveness.. Environments.. Constraints Technology Base Prior Output Data Program Decision Requirements Requirements From Tailored Standards and Specifications

30. SIAP SE TEM 00720.ppt-30 Acquisition Process Product Baseline.. MS 0 Phase 0 Phase I Phase II Phase III MS IMS II MS III Functional Baseline Allocated Baseline Technical Management Plan (TMP) UpdateUpdateUpdate ASR SRR SFR SSR PDR CDR TRR FCA PCA ENGINEERING CHANGE REVIEWS Operational Requirement Document (ORD) Operational Requirement Document (ORD) Operational Requirement Document (ORD) System Threat Assessment System Threat Assessment System Threat Assessment Mission Need Statement Concept System Subsystems Deficiency Correction Mods/Product Improvements System Performance Specification Item Performance Specification Item Detail Specification Reassess ThreatReassess ThreatReassess Threat Preplanned Product Improvement (P3I) Draft Government Approves. Developmental. Conceptual Performance Baseline PROCESS INPUT Customer Needs/ Objectives/ Requirements.. Mission/ Operations.. Measures of Effectiveness.. Environments.. Constraints Technology Base Prior Output Data Program Decision Requirements Requirements From Tailored Standards and Specifications Requirements Analysis Analyze Missions & Environments Identify Functional Requirements Define/Refine Performance & Design Constraint Requirements Functional Analysis/Allocation Decomposition is Lower-Level Functions Allocate Performance & Other Limiting Requirements is Lower-Level Functions Define/Refine Functional Interfaces (Internal/External) Define/Refine/Integrate Functional Architecture Requirements Loop Systems Analysis & Control Design Loop Synthesis Transform Architecture (Functional to Physical) Define Alternative Product Concepts Define/Refine Physical Interfaces (Internal/External) Define Alternative Product & Process Solutions PROCESS OUTPUT Integrated Decision Data Base.. Decision Support Data.. System Functional Physical Architectures.. Specifications & Baseline Baseline System Solution Verification Select Preferred Alternatives Trade-Off Studies Effectiveness Analysis Risk Management Configuration Management Interface Management Data Management Performance-Based Progress Measurement.. SEMS.. TPM.. Technical Reviews PROCESS INPUT Customer Needs/ Objectives/ Requirements.. Mission/ Operations.. Measures of Effectiveness.. Environments.. Constraints Technology Base Prior Output Data Program Decision Requirements Requirements From Tailored Standards and Specifications Requirements Analysis Analyze Missions & Environments Identify Functional Requirements Define/Refine Performance & Design Constraint Requirements Functional Analysis/Allocation Decomposition is Lower-Level Functions Allocate Performance & Other Limiting Requirements is Lower-Level Functions Define/Refine Functional Interfaces (Internal/External) Define/Refine/Integrate Functional Architecture Requirements Loop Systems Analysis & Control Design Loop Synthesis Transform Architecture (Functional to Physical) Define Alternative Product Concepts Define/Refine Physical Interfaces (Internal/External) Define Alternative Product & Process Solutions PROCESS OUTPUT Integrated Decision Data Base.. Decision Support Data.. System Functional Physical Architectures.. Specifications & Baseline Baseline System Solution Verification Select Preferred Alternatives Trade-Off Studies Effectiveness Analysis Risk Management Configuration Management Interface Management Data Management Performance-Based Progress Measurement.. SEMS.. TPM.. Technical Reviews PROCESS INPUT Customer Needs/ Objectives/ Requirements.. Mission/ Operations.. Measures of Effectiveness.. Environments.. Constraints Technology Base Prior Output Data Program Decision Requirements Requirements From Tailored Standards and Specifications Requirements Analysis Analyze Missions & Environments Identify Functional Requirements Define/Refine Performance & Design Constraint Requirements Functional Analysis/Allocation Decomposition is Lower-Level Functions Allocate Performance & Other Limiting Requirements is Lower-Level Functions Define/Refine Functional Interfaces (Internal/External) Define/Refine/Integrate Functional Architecture Requirements Loop Systems Analysis & Control Design Loop Synthesis Transform Architecture (Functional to Physical) Define Alternative Product Concepts Define/Refine Physical Interfaces (Internal/External) Define Alternative Product & Process Solutions PROCESS OUTPUT Integrated Decision Data Base.. Decision Support Data.. System Functional Physical Architectures.. Specifications & Baseline Baseline System Solution Verification Select Preferred Alternatives Trade-Off Studies Effectiveness Analysis Risk Management Configuration Management Interface Management Data Management Performance-Based Progress Measurement.. SEMS.. TPM.. Technical Reviews PROCESS INPUT Customer Needs/ Objectives/ Requirements.. Mission/ Operations.. Measures of Effectiveness.. Environments.. Constraints Technology Base Prior Output Data Program Decision Requirements Requirements From Tailored Standards and Specifications Requirements Analysis Analyze Missions & Environments Identify Functional Requirements Define/Refine Performance & Design Constraint Requirements Functional Analysis/Allocation Decomposition is Lower-Level Functions Allocate Performance & Other Limiting Requirements is Lower-Level Functions Define/Refine Functional Interfaces (Internal/External) Define/Refine/Integrate Functional Architecture Requirements Loop Systems Analysis & Control Design Loop Synthesis Transform Architecture (Functional to Physical) Define Alternative Product Concepts Define/Refine Physical Interfaces (Internal/External) Define Alternative Product & Process Solutions PROCESS OUTPUT Integrated Decision Data Base.. Decision Support Data.. System Functional Physical Architectures.. Specifications & Baseline Baseline System Solution Verification Select Preferred Alternatives Trade-Off Studies Effectiveness Analysis Risk Management Configuration Management Interface Management Data Management Performance-Based Progress Measurement.. SEMS.. TPM.. Technical Reviews PROCESS INPUT Customer Needs/ Objectives/ Requirements.. Mission/ Operations.. Measures of Effectiveness.. Environments.. Constraints Technology Base Prior Output Data Program Decision Requirements Requirements From Tailored Standards and Specifications Requirements Analysis Analyze Missions & Environments Identify Functional Requirements Define/Refine Performance & Design Constraint Requirements Functional Analysis/Allocation Decomposition is Lower-Level Functions Allocate Performance & Other Limiting Requirements is Lower-Level Functions Define/Refine Functional Interfaces (Internal/External) Define/Refine/Integrate Functional Architecture Requirements Loop Systems Analysis & Control Design Loop Synthesis Transform Architecture (Functional to Physical) Define Alternative Product Concepts Define/Refine Physical Interfaces (Internal/External) Define Alternative Product & Process Solutions PROCESS OUTPUT Integrated Decision Data Base.. Decision Support Data.. System Functional Physical Architectures.. Specifications & Baseline Baseline System Solution Verification Select Preferred Alternatives Trade-Off Studies Effectiveness Analysis Risk Management Configuration Management Interface Management Data Management Performance-Based Progress Measurement.. SEMS.. TPM.. Technical Reviews

31. SIAP SE TEM 00720.ppt-31 Functional Baseline (System) u Describes a system’s or item’s functional performance, interoperability, and interface requirements. u Includes: –System interface specification –Product interface specifications –System specification –Product specifications –Integrated database that captures the design, data, models, metrics, changes, design rationale, and other pertinent information on decisions or calculations made to system requirements

32. SIAP SE TEM 00720.ppt-32 Allocated Baseline (Design-To) u Describes a subsystem functional, performance, interoperability, and interface requirements that are allocated from those of the system or a higher level sub-system u Includes: –Assembly and component interface specifications –Subsystem specifications –Assembly specifications –Integrated database that captures the design, data, models and tools used, metrics, changes, design rationale, and other pertinent information on decisions or clarification made to subsystem requirements

33. SIAP SE TEM 00720.ppt-33 Product Baseline (Build-To) u Describes all the necessary functional, performance, and physical requirements of the subsystem; the functional and physical requirements designated for production acceptance testing u Includes: –Component interface specifications –Component specifications –Integrated database that captures the design, data, models and tools used, metrics, changes, design rationale, and other pertinent information on decisions or clarification made to component requirements u Product baseline may consist of the actual equipment and software

34. SIAP SE TEM 00720.ppt-34 OPERATIONAL NEEDS AND REQUIREMENTS OPERATIONAL NEEDS AND REQUIREMENTS FEEDBACK (to include PMs and Operators) REVISE OR REFOCUS AS REQUIRED 3. IDENTIFY ATTRIBUTES TO SUPPORT OBJECTIVES 3. IDENTIFY ATTRIBUTES TO SUPPORT OBJECTIVES TOP LEVEL PERFORMANCE REQUIREMENTS 2. DEFINE SYSTEM BOUNDARIES 2. DEFINE SYSTEM BOUNDARIES DESIGN REFERENCE MISSION 4. ESTABLISH FUNCTIONAL BASELINE 4. ESTABLISH FUNCTIONAL BASELINE FUNCTIONAL BASELINE 1. DEFINE ENVIRONMENT 1. DEFINE ENVIRONMENT SYSTEM DESCRIPTION INTERFACES SYSTEM ANALYSIS WARFIGHTER CONCURRENCE PM SELECT ALTERNATIVE Partially Concurrent Not Sequential Iterative 5. CONDUCT SYSTEM RQMTS. REVIEW 5. CONDUCT SYSTEM RQMTS. REVIEW Products of the Systems Engineering Process Common Process WARFIGHTER CONCURRENCE GEO-ECONOMIC ALTERNATIVES AFFORDABILITY BOUNDARIES ID KEY COST ATTRIBUTES AND RELATIONSHIPS CONDUCT LCC AND CAIV TRADE-OFFS Updated: 5 August 1997 ORD ATTRIBUTES

35. SIAP SE TEM 00720.ppt-35 Discipline and Control System Rqmts Definition Phase Interface Definition Phase Software Rqmts Definition Phase Software Top-Level Design Phase Software Test Planning Phase Detailed Software Design Phase Code Debug Phase Software Integration Test Phase CSCI Test Phase Deployment Phase A-SPEC SRR SFR MS I B1,B2-SPECS IRS MS II SSR C, D, E-SPECS PCA/FCA MS III Software Top-Level Design Document Software Test Plan PDR C-SPEC (Prelim) CDR Software Detailed Design Document Software Test Procedures TRR ALLOCATED BASELINE PRODUCT BASELINE FUNCTIONAL BASELINE

36. SIAP SE TEM 00720.ppt-36 Production Review u Conducted to confirm that: –Issues for the components, assemblies, subsystems, products, and life-cycle processes and services are resolved –Test procedures for components, assemblies, subsystems, and products were completed and were accurate –The system and products were confirmed ready for test –Tests were conducted IAW established procedures –Audit trail is established with changes substantiated and all requirements met –Risk management procedures satisfactory for production –Evolutionary development requirements and plans have been defined/refined –Planning is complete and procedures, resources, and other requisite people, products, and processes are available to initiate production, distribution, operations, support, training, disposal, and evolutionary development