© Fraunhofer FIRST Dr. Stephan Weißleder Research Manager Testing Department Quality of Embedded Systems (QUEST) Fraunhofer-Institute FIRST Relation of Model-Based Testing and Safety-Relevant Standards

© Fraunhofer FIRST Page 2 Fraunhofer-Institute FIRST – Department QUEST Review and AssessmentTestingVerification IEC DO-178B ISO IEC EN IEC DO-178B ISO IEC EN certified

© Fraunhofer FIRST Page 3 Model-Based Testing

© Fraunhofer FIRST Page 4 –Early testing –Low costs –Support for certification –Early testing –Low costs –Support for certification –Better test management –Early testing –Low costs –Support for certification –Better test management –High degree of automation –Better test coverage Model-Based Testing Requirements Model Implementation Unit test System test Acceptance test Validation and traceability of requirements Generation of test design & test oracle Early acceptance test by model simulation Design Test management, Variant management

© Fraunhofer FIRST Page 5 How Does MBT Support Safety-Relevant Standards?

© Fraunhofer FIRST Page 6 How Does MBT Support Safety-Relevant Standards? Requirements Tests ? Higher Efficiency, Automatic Traceability Validation of requirements, Better Traceability? Measure/Achieve code coverage, More detailed coverage information for system tests? Relation of model coverage and requirements coverage? TraceabilityCoverage

© Fraunhofer FIRST Page 7 How do Safety-Relevant Standards Support MBT?

© Fraunhofer FIRST Page 8 Standards The good things about standards is there are so many to choose from. VDE 0801 IEC ISO ISO RTCA DO-178B ARINC 653 EN EN EN IEC EN ISO ISO TR General purpose Automotive Aviation Railway Machinery

© Fraunhofer FIRST Page 9 ISO (under publication) "Testing activities are also treated differently since models can be used as a useful source of information for the testing process (model-based testing)."

© Fraunhofer FIRST Page 10 RTCA DO-178B – 1992 DAL EDAL DDAL CDAL BDAL A No effectMinorMajorHazardousCatastrophic (Source: John Joseph Chilenski) (Source: DO-178B Standard)

© Fraunhofer FIRST Page 11 RTCA DO-178B – 1992 ObjectiveDAL ABCD Test coverage of high-level requirements is achieved. XXXX Test coverage of low-level requirements is achieved. XXX Test coverage of software structure is achieved. (MC/DC) X Test coverage of software structure is achieved. (Decision Coverage) XX Test coverage of software structure is achieved. (Statement Coverage) XXX Test coverage of software structure is achieved. (Data coupling / control coupling) XXX No support for model-based testing. Things are getting better in DO-178C ?

© Fraunhofer FIRST Page 12 IEC – 2010 !!!

© Fraunhofer FIRST Page 13 IEC – 2010

© Fraunhofer FIRST Page 14 IEC – 2010 Advantages: -Early requirements validation -Automatic test case generation -Combination of test case generation and code coverage measurement Model-based testing is (highly!) recommended. Model-based testing is (highly!) recommended.

© Fraunhofer FIRST Page 15 Dr. Stephan Weißleder +49 (0) Our mission is to bring model- based testing to industrial practice.