1. Ron Kratzke, Vitech Corporation rkratzke@vitechcorp.com MBSE for System Testing Managing the development of system testing using the principles of Model Based System Engineering

2. Context Diagram - Verification Process (Ref: INCOSE Handbook Ver 3.2.2 Oct 2011) Vitech Corporation2 Controls - Applicable Laws and Regulations - Industry Standards - Agreements - Project Procedures and Standards -Project Directives Outputs - Verification Strategy - Verification Enabling System Requirements - Verification Constraints on Design - Verification Procedures -Final RVTM - Verified System - Verification Report Enablers - Organization / Enterprise Policies, Practices, and Procedures - Organization / Enterprise Infrastructure - Project Infrastructure - Verification Enabling Systems Activities - Plan Verification - Perform Verification Inputs - System Requirements - Verification Criteria - Specification Tree - Updated RVTM - Interface Requirements - Integrated System - Interface Control Documents - Integration Report

3. Model-Based Systems Engineering Model-based systems engineering (MBSE) is the formalized application of modeling to support system requirements, design, analysis, verification and validation activities beginning in the conceptual design phase and continuing throughout development and later life cycle phases. – From “INCOSE Systems Engineering Vision” 2020 INCOSE-TP-2004-004-02 September, 2007 Vitech Corporation3

4. MODELS Vitech Corporation4

5. Everyone has a model … VITECH CORPORATION5

6. System Testing has to account for a number of items… Vitech Corporation6 Requirements Functions (Behavior Architecture) Components (Physical Architecture) Testing

7. MBSE Verification Process Model Must … Provides insight into the problem and potential solutions Provide order and traceability Possess integrity and consistency Have ability demonstrate and explain the test program Vitech Corporation7

8. Is The VCRM Enough??? Vitech Corporation8

9. Additional Information Needed In addition to the method, shouldn’t we also know? – Objective – Environment – Special Conditions – Success Criteria Vitech Corporation9 Ref: A Day in the Life of a Verification Requirement Tutorial, Northrop Grumman, Steve Scukanec, 27 th Annual T&E Conference, March 14, 2011

10. Status of Completing the Verification Wouldn’t we also want to track? – Method (which is in the VCRM) – Planning Status – Completion Status – Where / When the Verification Event will take place Vitech Corporation10

11. Verification Requirement Statement Vitech Corporation11 Verification Requirement Description statement provides the details on HOW the verification will be accomplished

12. Relating Requirements to Verification Vitech Corporation12 Function, Requirement verified by (verifies) Verification Requirement Verification Requirement attributes: - Description - Method - Status - Level Add two more attributes

13. Table Output from Model … Vitech Corporation13 Provides the data from the model to provide overall status of verification planning… But what about the test events?

14. What about the actual Testing? Vitech Corporation14 Function, Requirement verified by (verifies) Verification Requirement What test events are planned? Which Verification Requirements will be verified in which test event? Who is doing the testing? What Organization is responsible? What configuration is going to be used in testing? Which Test Procedures will be used during any particular Test Event?

15. What about the actual Testing? Vitech Corporation15 Function, Requirement verified by (verifies) Verification Requirement Verification Event fulfilled by (fulfills) Add “Verification Event” to specify and describe a Test Event which will be used to verify a subset of Verification Requirements (for example, Limited User Test, Laboratory Bench Test, Operational Test, etc.)

16. What about the actual Testing? Vitech Corporation16 Function, Requirement verified by (verifies) Verification Requirement Verification Event Organization Test Procedure assigned to (responsible for) employs (employed by) Test Configuration employs (employed by) fulfilled by (fulfills) Relate the Verification Event to an Organization, Test Configuration, and Test Procedure

17. Provide a complete picture… Vitech Corporation17

18. Verification Event Information Vitech Corporation18

19. What about time and resources for the Verification Requirement? Vitech Corporation19 Function, Requirement verified by (verifies) Verification Requirement Verification Event Organization Test Procedure assigned to (responsible for) employs (employed by) Test Configuration employs (employed by) fulfilled by (fulfills) Test Activity executed by (executes)

20. Test Activity – Detailed Test Planning Vitech Corporation20

21. Produce a Test Plan from the Model Vitech Corporation21

22. Summary … System Testing model – Extends traditional VCRM to provide added insight – Plan Verification Events including support resources – Manage Testing Activity sequence and timing – Produce Test Plans Traceability Completeness Consistency Document Generation Vitech Corporation22

23. Ron Kratzke, Vitech Corporation rkratzke@vitechcorp.com MBSE for System Testing Questions ???