1. EXPOSING OVS STATISTICS FOR Q UANTUM USERS Tomer Shani 19.6.13 Advanced Topics in Storage Systems Spring 2013

2. Project goals In order to develop QoS for the cloud environment it is necessary to collect network statistics from the different network element. This project aims to expose network statistics from the “open virtual switch” so that further functionality can be added to the open stack environment.

3. Theoretical Overview OpenStack Quantum Quantum Plugin Architecture Open Virtual Switch Proposed Solution

4. Quantum Introduced as part of OpenStack Folsom release (sept 2012) Provides Network as a Service between interface devices managed by other OpenStack services (most likely Nova). Allows users to create their own networks / network services and then attach interfaces to them. Quantum has a pluggable architecture to support many popular networking vendors and technologies.

5. Quantum – the big picture

6. Quantum – the details

7. Quantum server – implements the RESTful API and routes requests to the correct plugin-in API abstractions: – Network: layer 2 network object, attributes: admin state, name & subnets. – Subnet: layer 3 network object, attributes: admin state, name, ip addr, subnet mask, dhcp, dns … – Port: NIC object, attributes: network, device (virtual server), mac addr … Quantum plugin architecture

8. Plugin will typically update the quantum database Plugin agent runs on each compute node, the agent gathers the configuration from the database and communicates directly with the local OVS instance. Quantum also provides an “extensibility” mechanism that enables extension of the Core API (resource/attribute/action) Quantum client - a command line API for accessing quantum functionality

9. Open virtual switch OVS components (www.openvswitch.org):www.openvswitch.org – Kernel module implementing the data path – User space daemon “ovs-vswitchd” implementing the flow logic layer – User space daemon “ovsdb-server” which holds switch configuration – User space utilities, ovs-ofctl is the OpenFlow switch management utility which also provides port statistics

10. Open virtual switch Available counters – Rx packets – Rx bytes – Rx drop – Rx errors – Rx crc errors – Rx frame – Rx overruns – Tx packets – Tx bytes – Tx drop – Tx errors – Tx collisions

11. Design Quantum OVS plugin API DB Compute node OVS instance CLI client OVS Plugin agent

12. Design options - discussion Pros Data is retrieved as needed, no constant access to database (saves network bandwidth) Data is (close to) “real- time” which may be critical for some applications Cons Plugin has longer access time when compared to local database access. If multiple applications require the statistics, traffic is duplicate. No “natural” path for providing real-time data on request Should plugin-agent be polled or push data Pros & Cons of “polling solution”

13. Hands on overview Setting up a work environment Installing OpenStack Configuring OpenStack Creating a Cloud

14. Setting up a work environment First attempt: Dual 3 Ghz cores, 2 GB RAM, Ubuntu 12.10 Desktop, SLOW….. Second attempt: switched to server installation (no GUI), still sluggish.. Third attempt: 8 * 3.4 Ghz cores, 4 GB RAM, much better Installed SMB to provide remote access to file system (coding). Enabled SSH to provide shell access.

15. Installing OpenStack Installed by utilizing Devstack, a shell script to build complete OpenStack development environments. – git clone https://github.com/openstack- dev/devstack.git (have to install git first)https://github.com/openstack- dev/devstack.git – cd devstack &&./stack.sh -------------------------------------------------------------------- Horizon is now available at http://10.4.2.45/ Keystone is serving at http://10.4.2.45:5000/v2.0/ Examples on using novaclient command line is in exercise.sh The default users are: admin and demo The password: 123456 --------------------------------------------------------------------

16. Configuring OpenStack Now that we have access to the web server, we can start configuring a virtual network But that would be too easy… Default devstack installation configures nova networking (pre-quantum days) Modify localrc to enable quantum and run devstack again tomers@ubuntu:~$ cat /opt/stack/devstack/localrc disable_service n-net ….. enable_service quantum

17. And finally

18. Creating a network

19. Add a virtual host

20. Add a virtual host - cont.

21. And we have a network

22. Network objects

23. Quantum client

24. Generating traffic

25. It works !

26. Resources Openstack www.openstack.org www.openstack.org Devstack http://devstack.org/ http://devstack.org/ Openstack dcumentation http://docs.openstack.org/ http://docs.openstack.org/ Open vSwitch http://openvswitch.org/ http://openvswitch.org/

27. Q UESTIONS ?