1. Hackfest April 2017 Orange labs. Paris
FUNCTEST EUPHRATES
release plan
Hackfest April 2017
Orange labs. Paris

2. Euphrates release schedule
MILESTONES
DUE
MS1 – Planning complete
2 May
MS2 – Test planning (which test cases will be part of the release)
22 May
MS3 – Installer integration with OpenStack
30 May
MS4 – Test framework ready, infrastructure updates completed
5 June
MS5 – Scenario integration and Feature freeze
21 July
MS6 – Test cases and preliminary docs completed
11 Aug.
MS7 – Stable branch window closed
1 Sept.
MS8 – Formal test execution completed
18 Sept.
MS9 – JIRA issues assigned closed
20 Sept.
MS10 – Documentation completed
22 Sept.
MS11 – Release
25 Sept.

3. Where are we and where do we go?
Release plan
(2 May)
Test framework ready
(5 June)
Test cases completed
(11 Aug.)
RELEASE
(25 Sept)
OPNFV Hackfest
(24-28 Apr)
April
May
OPNFV Summit
(12-15 June)
June
July
August
September

4. Framework Tests CI Test API Documentation Collaboration General
WORK AREAS
Framework
Tests CI
Test API
Documentation
Collaboration
General
2/5/2019
Footer Lorem Ipsum Dolor Sit

5. FRAMEWORK Story Tasks Owner SNAPs
Snap-rize the current test cases (e.g. vPing)
Get rid of openstack_utils eventually
Also update feature projects using openstack_utils, like SFC, BGPVPN
All
Steven
Functest offline
Provide a way to run Functest without internet connectivity
SNAPS must by default use internal images if available
Skip tests that strictly require internet
Pre-download standard Ubuntu image for test cases.
Running unit test offline
Jose
VNF
abstract.
vnf_base must be updated to take the new rules defined into account
Morgan
Cedric
Feature
integration
Use Feature as driver for all bash third-party testcases
Set cmd as run args in testcases.yaml
Feature code status
Cover feature by unit tests
Call main() of testcases that are implemented in python
Criteria
Better way to manage criteria (args, …)
6 June
6 June
6 June
6 June
6 June

6. FRAMEWORK Story Tasks Owner Unit tests
Coverage > 80% and if possible 100%
anyone providing new code MUST provide the associated unit test
Catch false positives (e.g. Tempest, …)
All
Cedric
Logging
Each test case should produce an individual log file
Produce standard output in test case class. Keep log files for debugging.
Helen
Functest API
(medium prio)
Micro service approach to allow user to call Rest API to see test tiers and trigger test
Serena
Docker slicing
(low prio)
Slice the image into smaller ones
Architecture and design
Implementation
Use the Functest API to call the different containers.
Code
Continue improving code towards an well Object Oriented framework
Pylint
Return codes
Python 3 (F-release?)

7. TEST CASES Story Tasks Owner Overlaps
Identify test that overlap and exclude them or make then optional (e.g. tempest_smoke_serial vs tempest defcore)
Tempest parallel? investigate
Morgan
Jose
Juha
ONAP
Collaboration XCI with ONAP
Consider end to end test, not validate ONAP
VNFs
Add more sample VNF deployments in Functest  discussion with SampleVNF team
Valentin K8
Add test for Kubernetes based deployments (container based VNFs) No-Openstack scenarios?
SNAPS support
Add test cases (e.g. container ping)
Add util functions for Kubernetes
Narinder
Steven
11 Aug
11 Aug
11 Aug
11 Aug

8. CI Story Tasks Owner Promotions
Promote scenarios and test cases that work more often.
Morgan
CI gating
More CI scripts to ensure no regression in coverage, no regression in file permission rights...
For each patch-set, it should be a verify job that runs the code on a fresh virtual deployment
Jose
Dashboard
Minor improvements (e.g. arm results)

9. TEST API Story Tasks Owner Enhancements
Provide website and support pagination there,
testresults.opnfv.org expose the website instead of swagger page
Serena
Login/Auth
Provide a way to authenticate to store/fetch results

10. DOCUMENTATION Story Tasks Owner Docs update Update config guide
Update user guide
Update dev guide
All
Test API
Update docs for Test API
Serena
Automatic
Framework
documentation
Add proper doc-strings everywhere in the framework
Jjob to create the doc API
Cedric
Release notes
Discussion about how to handle release notes
Jose
Morgan
22 Sep
22 Sep

11. COLLABORATION Story Tasks Owner CVP
Identify and collect requirements from CVP towards Functest/Test API
Jose
ODL
Collaboration with the ODL community to add new test cases (robot)
Cedric
Refstack
Review and provide feedback to interop working group/refstack

12. WE CAN DO IT!