1. Model Interchange Working Group (MIWG) Interchange Testing Roadmap Draft January 16, 2012 Sanford Friedenthal MIWG Chair safriedenthal@gmail.com http://www.omgwiki.org/model-interchange

2. Roadmap Goals Extend interchange testing to address – additional functionality of UML and SysML – additional profiles (SoaML and UPDM) – additional versions (UML 2.4.1, SysML 1.3) – operational testing (e.g., industrial strength) – other testing (e.g., diagram interchange) Conduct in most efficient and timely manner 01-16-20122

3. Approach Define what test cases are needed Define release schedule that sequences the test cases Agree on updated testing process – Create diagram from reference diagram, generate xmi export, transform to canonical XMI, and validate against reference canonical XMI – Vendors should also import both the reference canonical XMI and the reference non-canonical XMI file and recreate diagram and validate against the reference diagram Unresolved as to whether vendors should import, one, the other or both. Need vendor input. Do vendors want to commit to canonical XMI as the standard interchange format? Execute test cases based on participant level of commitment 01-16-20123

4. 4 MIWG Roadmap Initial Test Suite (Test Cases 1-16) SoaML Test Cases Additional UML 2.3 Test Cases Additional SysML 1.2 Test Cases UPDM Test Cases UML 2.4.1/ SysML 1.3 / XMI 2.4.1 Test Cases Industrial Strength Test Cases 01-16-2012

5. Initial Test Suite December, 2011 UML 2.3/ SysML 1.2 / XMI 2.1 Test Case 1Test Case 1 - Basic Class Modeling Test Case 2Test Case 2 - Advanced Class Modeling Test Case 3Test Case 3 - Profile Definition and Application Test Case 4Test Case 4 – Simple Activity (including fUML execution) Test Case 5Test Case 5 – Activity (including fUML execution) Test Case 6Test Case 6 – Composite Structure Test Case 7Test Case 7 – State Machines Test Case 8Test Case 8 – Use Cases Test Case 9Test Case 9 – Interactions Test Case 10Test Case 10 – SysML Blocks Test Case 11Test Case 11 – SysML Requirements Test Case 12Test Case 12 – SysML + UML Intermediate activities Test Case 13Test Case 13 – Instances Test Case 14Test Case 14 – SysML Parametrics Test Case 15Test Case 15 – Advanced Activities Test Case 16Test Case 16 – SysML Allocations Approximately 60% of UML and SysML Coverage 01-16-2012 5

6. UML/SysML Not Tested by Initial Test Suite 01-16-20126 UML Classes Unused AcceptCallAction ActionExecutionSpecification ActionInputPin AddVariableValueAction AnyReceiveEvent Artifact BroadcastSignalAction CentralBufferNode ClassifierTemplateParameter ClearStructuralFeatureAction ClearVariableAction Collaboration CollaborationUse CombinedFragment CommunicationPath Component ComponentRealization ConnectableElementTemplateParameter ConsiderIgnoreFragment Continuation CreateLinkObjectAction DataStoreNode Deployment DeploymentSpecification Device Duration DurationConstraint DurationInterval DurationObservation ElementImport ExecutionEnvironment Expression FunctionBehavior Gate GeneralOrdering InformationItem InteractionConstraint InteractionOperand InteractionUse Interval IntervalConstraint LiteralNull Manifestation Node OccurrenceSpecification OpaqueAction OperationTemplateParameter ParameterSet PartDecomposition ProtocolConformance QualifierValue ReadIsClassifiedObjectAction ReadLinkObjectEndAction ReadLinkObjectEndQualifierAction ReadVariableAction ReclassifyObjectAction RedefinableTemplateSignature ReduceAction RemoveStructuralFeatureValueAction RemoveVariableValueAction ReplyAction SendObjectAction SendSignalAction SequenceNode StartClassifierBehaviorAction StartObjectBehaviorAction StateInvariant StringExpression Substitution TemplateBinding TemplateParameter TemplateParameterSubstitution TemplateSignature TimeConstraint TimeEvent TimeExpression TimeInterval TimeObservation UnmarshallAction ValuePin Variable SysML Stereotypes Unused AllocateActivityPartitio n Conform ConnectorProperty ControlOperator Copy Discrete DistributedProperty NoBuffer Optional Overwrite ParticipantProperty Probability Problem Rate TestCase View Viewpoint

7. Follow-on Test Cases SoaML 01-16-20127 UML 2.3/ SoaML 1.0 / XMI 2.1 Test Case 17 – Service Contracts –ServiceContract, MessageType, Participant, ServicesArchitecture, Consumer/Provider, Attachment? Test Case B – Service Interfaces –ServiceInterface, MessageType, Participant, ServicesArchitecture, Service/Request, ServiceChannel, Attachment? Test Case C – Multi-Party Service Contracts –ServiceContract, MessageType, Participant, ServiceArchitecture, Agent? Test Case D – Capabilities - Capability, ServiceInterface, Participant, Expose, Service Test Case E – Milestones –Milestone Test Case F – Categorization –Catalog, Category, FreeFormDescriptor, FreeFormValue, CategoryValue, Categorization

8. Follow-on Test Cases UML Additional Functionality 01-16-20128 UML 2.3 / XMI 2.1 Test Case A – Component Diagram Test Case B – Timing Diagram Test Case C – Interaction Overview Diagram Test Case D – Collaboration (integrate with SoaML??) Test Case E – Deployment Diagram Test Case F – Information Flow

9. Follow-on Test Cases SysML Additional Functionality 01-16-20129 UML 2.3/ SysML 1.2 / XMI 2.1 Test Case A – SysML View/Viewpoint –view, viewpoint, conform Test Case B – SysML Requirements –test case, copy, problem Test Case C – SysML Properties –distributed property, value property Test Case D – SysML Internal Block Diagram-advanced –connector property, participant property Test Case E – SysML Advanced Activities –Rate, Optional, Overwrite, NoBuffer, Discrete, AllocateActivityPartition, ControlOperator

10. Follow-on Test Cases UPDM 01-16-201210 UML 2.3/ SysML 2.2 / UPDM 2.1/ XMI 2.1 Initial Conditions – Ensure Existing Test Cases 1-16 with UPDM Profile Applied Test Case A – Additional Functionality Test Case B – Additional Functionality …. Test Case M – Additional Functionality Test Case N – SAR Model

11. Follow-on Test Cases UML / SysML Version Updates 01-16-201211 UML 2.4.1 / SysML 1.3 / XMI 2.4.1 Test Case 1 – Class Diagram (start early and validate Validator 2.4.1) Test Case 2-16 – Update previous test cases 2-16 and rerun Test Case N – Backward compatibility test cases? Test Case N+1 – UML Interactions Test Case N+2 – SysML Ports and Flows

12. Follow-on Test Cases Industrial Strength Test Case 01-16-201212 UML 2.3 / SysML 1.2 / XMI 2.4.1 Test Case A – Roundtrip Test Case B – Delta XMI Test Case C – Size and performance Test Case D - Federated model with remote references

13. Industrial Strength Use Case for Model Interchange S. Friedenthal 11/12/11 01-16-201213

14. Diagram Interchange starting 2013 ? Other Interchange Testing 01-16-201214

15. UML 2.2 UML 2.3 UML 2.4.1 SysML 1.2 SysML 1.3 SoaML 1 UPDM 2.0 NIST Validator Roadmap 01-16-201215

16. MIWG Testing Process

17. Canonical XMI - Process 01-16-201217