OPEN-O CSIT Infrastructure Gary Wu <gary.i.wu@huawei.com>

Continuous System and Integration Testing Continuously run System and Integration Tests against any code changes Maintain quality and detect regressions Detect and prevent breaking code changes

OPEN-O CSIT Infrastructure Test Suites written using Robot Framework OPEN-O Microservices run via docker Mock southbound services run via docker e.g. mock VIMs or SDN controllers Robot test suites executed via Jenkins Each test suite runs on a fresh Jenkins slave VM Docker containers run within single VM Robot process runs on VM directly Supports parallel test runs Jenkins Master Jenkins slave VM Robot process OPEN-O Microservice 1 OPEN-O Microservice 2 Docker containers OPEN-O Microservice 3 Mock Services / Components

OPEN-O CSIT Design Goals Maximize Developer Productivity Each microservice deployed as a Docker container to ensure consistent environment Script allows developers to run CSIT test suites on local environments Ease of reproducing errors on dev environments Reduced cycle time Test suite components can be refactored and shared across different CSIT test suites e.g. shared scripts and test suites for initializing Microservice Bus

Verify vs. Merge Jobs Proposed changes in Gerrit verified using “Verify Jobs” Only Verified changes may be merged Same Verify process applies to Code, Dockerfile, and Robot test suite changes Prevent bad changes from being merged Change Proposed (Gerrit) Verify Job (Jenkins) Pass? Change Merged (Gerrit) Merge Job (Jenkins) Yes No

Robot test suite change merged OPEN-O CSIT Flow Code change merged Docker change merged Robot test suite change merged Gerrit Change Merged (after Verify cycle) Code Merge Job Docker Merge Job CSIT Test Job 1 Jenkins Jobs CSIT Test Job 2, …, etc. Pull code from Gerrit Push Java artifact to Nexus Pull dockerfile from Gerrit Pull Java artifact from Nexus Push docker image to Docker Hub Pull test suites from Gerrit Pull docker images from Docker Hub

Jenkins Job Dependencies Code Merge Builds deployment archive for Java/Python code Deploys deployment archive to Nexus Triggers Docker Merge job Docker Merge Builds docker image using deployment archive in Nexus Deploys docker image to Docker Hub (docker.io) Triggers affected downstream CSIT Test jobs CSIT Test Runs CSIT Robot test suites using latest docker images from Docker Hub