1. 1 Lars Frantzen, Pieter Koopman, René de Vries, Tim Willemse, Jan Tretmans Radboud University Nijmegen © Jan Tretmans Radboud University Nijmegen Testing at RadBoud

2. © Jan Tretmans Radboud University Nijmegen 2 Testing Research in Nijmegen Overview  Introduction  Integrating Data with ioco  Specification Mining Jan Tretmans Lars Frantzen Tim Willemse

3. © Jan Tretmans Radboud University Nijmegen 3 Model Based Testing s  LTS i  IOTS i ioco s pass fail test tool gen : LTS   (TTS) t || i i || der(s)  pass i ioco s    soundexhaustive pass fail spec IUT confto spec test tool test generation tool test execution tool IUT passes tests IUT confto spec    soundexhaustive with Transition Systems

4. © Jan Tretmans Radboud University Nijmegen 4 A Tool for Transition Systems Testing: TorX  On-the-fly test generation and test execution  Implementation relation: ioco  Mainly applicable to reactive systems / state based systems;  specification languages: LOTOS, Promela, FSP, Automata TorX IUT observe output offer input next input specification check output pass fail inconclusive user: manual automatic

5. © Jan Tretmans Radboud University Nijmegen 5 ? money ? button1 ? button2 ! coffee ! tea test case fai l ! money ! button2 ? tea fai l ? coffee pass  n: int  [ n  35 ] -> [ n  50 ] -> with data model and time and hybrid c := 0 c < 10 c < 15 [ c  5 ] -> c := 0 d V t / dt = 3 d V c / dt = 2 V c := 0 [V c = 10 ] -> V t := 0 [V t = 15 ] -> ?coin1 ?coin3 ?coin2 and action refinement ? Testing Transition Systems:StatusExtensions

6. © Jan Tretmans Radboud University Nijmegen 6 Testing Properties of Input/Output Programs: G  st  Specification: property over x and y  property(x,y) = x  0  |y  y - x|    Implementation is function i :: X  Y  Test set T  X  A tool like G  ST (or QuickCheck) generates thousands of tests by systematic traversal of all values of type X  But still: what is a "good" set ? IUT i(x) =  x x: real pre: x  0 y: real post: |y  y - x|  

7. © Jan Tretmans Radboud University Nijmegen 7 Current and Future Research Radboud  Testing transition systems with data  integrating data with ioco  Specification mining  reverse engineering of specification from observations  Approximate correctness  some systems are more correct than others  test selection  G  st  specification/model testing  Model Based Testing with UML  use of industrial modelling techniques  Integration of real-time and data testing

8. © Jan Tretmans Radboud University Nijmegen 8 Current and Future Research Radboud  Tools for transition system testing  TorX  generic test environments  automatic generation of test adapter and test interface  TorXakis - experimenting with data/symbolic testing  Applications  web page testingG  st  smart card testingG  st / TorX(akis)  ASML DCB (Laser Dose Control)TorX

9. © Jan Tretmans Radboud University Nijmegen 9 Testing Projects  Atomyste -ATOm splitting in eMbedded sYStem TEsting Uni. of TwenteRadboud Uni. Nijmegen  Stress - Systematic Testing of Real-time Embedded Software Systems Uni. of TwenteRadboud Uni. Nijmegen  Tangram - Model Based Testing and Diagnosis ASML, ESI, TUD, TUE, UT, RU, S&T, TNO  Tarot - EU FP6 Marie Curie  Artist 2 - EU FP6 Network of Excellence