1. FITTEST F UTURE I NTERNET T ESTING (ICT-257574, 2010-2013) Industrial Track of the Seventh IEEE International Conference on RESEARCH CHALLENGES in INFORMATION SCIENCE (RCIS) Modelio SaaS, Future Internet Testing in Softeam May 31st, 2013, Paris Alessandra Bagnato and Etienne Brosse, Softeam R&D

2. O VERVIEW The Future Internet (FI) and FITTEST Project Modelio and Modelio SaaS Future Internet Testing Case Study Modelio SaaS and FITTEST FI challenges Conclusions

3. F UTURE I NTERNET The Future Internet (FI) a complex interconnection of services, applications, content Society increasingly dependent on FI critical activities such as social services, learning, finance, business, as well as entertainment. Challenging problems for quality assurance/testing

4. F UTURE I NTERNET : C HALLENGES (1) CH1 Self modification Rich clients have increased capability to dynamically adapt the structure of the Web pages; server-side services are replaced and recomposed dynamically based on Service Level Agreements (SLA) and newly discovered services. CH2 Autonomic behaviour FI applications are highly autonomous; their correct behaviour cannot be specified precisely at design-time. CH3 Low observability FI applications are composed of an increasing number of 3rd-party components and services, accessed as a black box, which are hard to test.

5. F UTURE I NTERNET : C HALLENGES (2) CH4 Asynchronous interactions FI applications are highly asynchronous and hence hard to test. Each client submits multiple requests asynchronously; multiple clients run in parallel; server-side computation is distributed over the network and concurrent. CH5 Time and load dependent behaviour For FI applications, factors like timing and load conditions make it hard to reproduce errors during debugging. CH6 Huge feature configuration space FI applications are highly customisable and self-configuring, and contain a huge number of configurable features, such as user-, context-, and environment-dependent parameters. CH7 Ultra-large scale FI applications are often systems of systems; traditional testing adequacy criteria cannot be applied, since even in good testing situations low coverage will be achieved.

6. FITTEST P ROJECT Aims at addressing FI testing challenges; Continuous evolutionary automated testing; Developing an integrated testing environment; Assessment of developed techniques on FI applications provided by industrial partners: Softeam (Modelio CASE Tool); IBM (Highly scalable services for web applications);

7. H OW : T HE G LOBAL P ICTURE

8. M ODELIO FOR S OFTWARE AND S YSTEM E NGINEERING UML editor with more than 20 years’ history UTP SysML MARTE Code generation Documentation Teamwork www.modeliosoft.com Available under open source at Modelio.org

9. T HE SUT: M ODELIO S AA S S YSTEM It is a web administration console written in PHP, which allows an administrator to connect to his account for managing modelling projects.  create project servers,  create modelling projects,  manage the Modelio CASE tool modules and  specify the users allowed to work on a project. The source code is composed of 50 PHP files for a total of 2141 lines of executable code.

10. M ODELIO S AA S C ASE S TUDY

11. Modelio SaaS is a proof-of-concept project, it extends Modelio UML modeling tool sharing facilities by making the distributed environment configuration transparent for its users. Runs on different cloud platforms presenting high number of configurations to challenge testing.

12. M ODELIO C ASE S TUDY FI Applications Low Observability Modelio SaaS is composed by different components and services, accessed as a black box, we will maximize users‘ interaction coverage of our test suite through FITTEST B&M CTE Combinatorial testing. FI Applications Autonomic Behavior Explore possible inputs dynamically and look for suspicious behavior by using FITTEST GUI Testing tool to evaluate the unexpected ways that users use the Modelio SaaS services. FI Applications Asynchronous interactions Multiple clients run in parallel and server-side computation is distributed over the network we will generate a model of the system that is human-readable.

13. C ONCLUSIONS FI Applications Low Observability FITTEST B&M CTE Combinatorial testing. FI Applications Autonomic Behavior FITTEST GUI Testing tool to evaluate the unexpected ways that users use the Modelio SaaS services. FI Applications Asynchronous interactions Fittest continuous testing ITE environment.

14. T HANKS ! Alessandra Bagnato Softeam R&D, alessandra.bagnato@softeam.fr FITTEST: EU FP7 Project https://www.facebook.com/FITTESTproject Modelio Web Site: http:// www.modelio.org Modelio UML Testing Profile : http://www.modeliosoft.com/en/modelio- store/modules/modeling-extensions/utp.html http://www.modeliosoft.com/en/modelio- store/modules/modeling-extensions/utp.html