VerTeCS Verification models and techniques applied to the Testing and Control of reactive Systems Thierry Jéron IRISA/INRIA Rennes, France

Slides:



Advertisements
Similar presentations
Auto-Generation of Test Cases for Infinite States Reactive Systems Based on Symbolic Execution and Formula Rewriting Donghuo Chen School of Computer Science.
Advertisements

1 Lars Frantzen, Pieter Koopman, René de Vries, Tim Willemse, Jan Tretmans Radboud University Nijmegen © Jan Tretmans Radboud University Nijmegen Testing.
Finding bugs: Analysis Techniques & Tools Comparison of Program Analysis Techniques CS161 Computer Security Cho, Chia Yuan.
Technology of Test Case Generation Levi Lúcio University of Geneva Marko Samer Vienna University of Technology.
Testing and Quality Assurance
1 Regression-Verification Benny Godlin Ofer Strichman Technion.
Lecture #21 Software Model Checking: predicate abstraction Thomas Ball Testing, Verification and Measurement Microsoft Research.
Timed Automata.
Ossi Taipale, Lappeenranta University of Technology
Zonotopes Techniques for Reachability Analysis Antoine Girard Workshop “Topics in Computation and Control” March 27 th 2006, Santa Barbara, CA, USA
ECE 720T5 Fall 2012 Cyber-Physical Systems Rodolfo Pellizzoni.
Combining Symbolic Simulation and Interval Arithmetic for the Verification of AMS Designs Mohamed Zaki, Ghiath Al Sammane, Sofiene Tahar, Guy Bois FMCAD'07.
Chapter 2- Visual Basic Schneider1 Chapter 2 Problem Solving.
Model-based Testing of Hybrid Systems Michiel van Osch IPA Spring Days on Testing 19 April – 21 April 2006.
Test generation using model-checking Thierry Jéron Irisa/Inria Rennes, France Adapted from works with C. Jard, B. Jeannet,
1 INTAS Meeting, Moscow Tools for Verification of Specification Given by Basic Protocols Oleksandr Letychevskyi, Ph.D. Glushkov Institute of Cybernetics.
1 Jan Tretmans Embedded Systems Institute Eindhoven Radboud University Nijmegen Model-Based Testing.
ECE Synthesis & Verification1 ECE 667 Spring 2011 Synthesis and Verification of Digital Systems Verification Introduction.
Towards Automatic Generation of Parameterized Test Cases from Abstractions Jens R. Calamé Natalia Ioustinova Jaco van de Pol Centrum voor Wiskunde en Informatica,
1 Jan Tretmans Radboud University Nijmegen (NL) © Jan Tretmans Radboud University Nijmegen together with: University of Twente Enschede.
1 Program Analysis Mooly Sagiv Tel Aviv University Textbook: Principles of Program Analysis.
On the Correctness of Model Transformations Gabor Karsai ISIS/Vanderbilt University.
Program Analysis Mooly Sagiv Tel Aviv University Sunday Scrieber 8 Monday Schrieber.
1 Scenario-based Analysis of UML Design Class Models Lijun Yu October 4th, 2010 Oslo, Norway.
Chapter 2- Visual Basic Schneider1 Chapter 2 Problem Solving.
MCA –Software Engineering Kantipur City College. Topics include  Formal Methods Concept  Formal Specification Language Test plan creation Test-case.
LSR ASE 2005 Panel on Education in Automated Software Engineering Yves Ledru LSR/IMAG, University of Grenoble-1, (France) Long Beach, CA,Nov. 11th 2005.
Cheng/Dillon-Software Engineering: Formal Methods Model Checking.
CS527: (Advanced) Topics in Software Engineering Overview of Software Quality Assurance Tao Xie ©D. Marinov, T. Xie.
1 Jan Tretmans Embedded Systems Institute Eindhoven, NL Radboud University Nijmegen, NL Model-Based Testing with Labelled Transition.
Bernd Bruegge & Allen H. Dutoit Object-Oriented Software Engineering: Using UML, Patterns, and Java 1 Introduction to Software Engineering CEN 4010.
ECE 720T5 Winter 2014 Cyber-Physical Systems Rodolfo Pellizzoni.
Using Mathematica for modeling, simulation and property checking of hardware systems Ghiath AL SAMMANE VDS group : Verification & Modeling of Digital systems.
Verification and Validation Overview References: Shach, Object Oriented and Classical Software Engineering Pressman, Software Engineering: a Practitioner’s.
Advanced Technology Center Slide 1 Requirements-Based Testing Dr. Mats P. E. Heimdahl University of Minnesota Software Engineering Center Dr. Steven P.
1 Automatic Non-interference Lemmas for Parameterized Model Checking Jesse Bingham, Intel DEG FMCAD 2008.
1 Hybrid-Formal Coverage Convergence Dan Benua Synopsys Verification Group January 18, 2010.
Wishnu Prasetya WLP for Automated Testing.
Conformance Test Suites, Extensionally Arend Rensink University of Twente Dutch Workshop on Formal Testing Techniques University of Twente 13 September.
Institut Mines-Télécom Symbolic Passive Testing - Application to an industrial case study (Diamonds project) Pramila Mouttappa, Stephane Maag and Ana Cavalli.
Natallia Kokash (Accepted for PACO’2011) ACG, 31/05/ Input-output conformance testing for channel-based connectors 1.
1 Black-box conformance testing for real-time systems Stavros Tripakis VERIMAG Joint work with Moez Krichen.
Ed Brinksma Course 2004 TorX : A Test Generation Tool.
Partnership for International Research and Education A Global Living Laboratory for Cyberinfrastructure Application Enablement II. International Experience.
PRESENTER PRIYANKA GUPTA.  Testing the complete system with respect to requirements.  In System testing, the functionalities of the system are tested.
Construction of Abstract State Graphs with PVS Susanne Graf and Hassen Saidi VERIMAG.
LSR Test purposes: adapting the notion of specification to testing Yves Ledru, L. du Bousquet, P. Bontron, O. Maury, C. Oriat, M.-L. Potet LSR/IMAG Grenoble,
Properties Incompleteness Evaluation by Functional Verification IEEE TRANSACTIONS ON COMPUTERS, VOL. 56, NO. 4, APRIL
Test Purpose template discussion Group Name: TST WG Source: ETSI Meeting Date:
SAT-Based Model Checking Without Unrolling Aaron R. Bradley.
Introduction to Hardware Verification ECE 598 SV Prof. Shobha Vasudevan.
CS223: Software Engineering
Winter 2007SEG2101 Chapter 121 Chapter 12 Verification and Validation.
An Automated Test Generation Process from UML Models to TTCN-3 Jens R. Calamé.
Testing Overview Software Reliability Techniques Testing Concepts CEN 4010 Class 24 – 11/17.
Test Generation for Input/Output Transition Systems Ed Brinksma Course 2004.
Chapter 2- Visual Basic Schneider1 Chapter 2 Problem Solving.
Authors: Amira RADHOUANI Akram IDANI Yves LEDRU Narjes BEN RAJEB Laboratoire d’Informatique de Grenoble.
CS223: Software Engineering Lecture 25: Software Testing.
1 Testing Implementations Of Access Control Systems (New Proposal) Ammar Masood: Graduate Student Arif Ghafoor (ECE) and Aditya Mathur (CS) Purdue University,
An Automated Test Generation Process from UML Models to TTCN-3
Introduction to Formal Verification
SOFTWARE TESTING OVERVIEW
Verification and Validation Overview
Gabor Madl Ph.D. Candidate, UC Irvine Advisor: Nikil Dutt
Introduction to Formal Verification
Software Engineering Lecture #12.
Alan Mishchenko UC Berkeley
Test Generation with Abstraction and Concretization
Presentation transcript:

VerTeCS Verification models and techniques applied to the Testing and Control of reactive Systems Thierry Jéron IRISA/INRIA Rennes, France Team : 4 Inria researchers, 1 Post Doc, 4 PhD, 1 Engineer T Ve C r e s

Main research activities  Verification of finite/infinite state systems  Controller synthesis for Discrete Event Systems  Model-based test generation  Model-based fault diagnosis

Verification M P Model M ⊨ P ? Y/N (witnesses/diagnostic) Prop Model-checking Abstract Interpretation Theorem proving

Controler synthesis for DES P M x C M c uc Controler synthesis Prop Build C s.t. M x C ⊨ P Model

Testing Vis(IUT) fail Vis(M) TC !otherwise Test generation ioco ? Build TC s.t. TC sound / M & ioco TS={TC} is exhaustive Impossible in practice ⇒ selection IUT Model TC || IUT ioco S  STraces(IUT) ⋂ STraces(S).  !  Straces(S)

Main research activities in test generation  Enumerative on-the-fly techniques → TGV off-line selection of behaviors of vis(M) accepted by TP based on reachability & co-reachability analysis  Symbolic test generation techniques → STG off-line selection by symbolic transformations and approximated analysis ∼ slicing of M wrt TD execution : on-line constraint solving  Methodological combination of V & T: “test on IUT what you tried to verify on M” (Vlad’s talk) M ⊨ P ? TC that detects ⌝( I ioco S) and/or I ⊭ P ? For enumerative and symbolic techniques

Test selection by test purpose fail Vis(M) ! TP Acc coreach(Acc) TC Vis(M) x TP inconc Pass ! !otherwise Coreach(Acc) not computable for (infinite) models with data ⇒ over-approximation needed

Test selection by approximate analysis Wait Acc * ⌝ (p=2 ∧ x≥3) !ok(p) Sink * p=2 ∧ x≥3 !ok(p) !err(p) * Idle Ry Rx Cmp End ?start x≥0 ?a(p) y:=p ?a(p) x:=p !end p=y-x ∧ -2≤p≤2 !ok(p) x<0 ∧ p=x !err(p) y<0 ∧ p=y !err(p) p=y-x ∧ ⌝( -2≤p≤2) !nok(p) M TP Idle Wait Ry Wait Rx Wait Cmp Wait End Wait ?start x≥0 ?a(p) y:=p ?a(p) x:=p !end p=2 ∧ x≥3 ∧ p=y-x ∧ -2≤p≤2 !ok(p) x<0 ∧ p=x !err(p) y<0 ∧ p=y !err(p) p=y-x ∧ ⌝( -2≤p≤2) !nok(p) Pass - Sink ⌝ (p=2 ∧ x≥3) -2≤p≤2; !ok(p) Syntactical product M x TP

Test selection by approximate analysis Idle Wait Ry Wait Rx Wait Cmp Wait End Wait ?start x≥0 ?a(p) y:=p ?a(p) x:=p !end p=2 ∧ x≥3 ∧ p=y-x ∧ -2≤p≤2; !ok(p) x<0 ∧ p=x !err(p) y<0 ∧ p=y !err(p) p=y-x ∧ ⌝( -2≤p≤2) !nok(p) Rx Acc - Sink ⌝ (p=2 ∧ x≥3) ∧ p=y-x ∧ -2≤p≤2; !ok(p) M x TP ⊤ ⊥ ⊤ ⊥ x≥3 y-x=2 ∧ x≥3 Idle Wait Ry Wait Rx Wait Cmp Wait End Wait ?start p=x+2; ?a(p) y:=p p≥3 ?a(p) x:=p !end p=2 ∧ x≥3 ∧ p=y-x ∧ -2≤p≤2; !ok(p) x<0 ∧ p=x !err(p) y<0 ∧ p=x !err(p) p=y-x ∧ ⌝( -2≤p≤2) ! nok(p) Pass - Sink ⌝ (p=2 ∧ x≥3) ∧ p=y-x -2≤p≤2; !ok(p) reach  (Acc) computed by NBAC → simplification !otherwise fail coreach  (Acc) computed by NBAC → guard strengthening p=2 !ok(p) inconc ⊤ ⊤ x≥3 x≥3 ∧ y-x=2 ⊤ ⊥ TC x≥3 ∧ y-x=2 ⊤ Test execution against IUT: check output / choose input values by on-line constraint solving

Perspectives linked with Artist  Extension of symbolic techniques to symbolic timed models  Testing of security policies: formalization of conformance, generation of attacks (Potestat French project with LSR, Verimag)  Tools extensions