1. OpenNebula: Experience at SZTAKI Peter Kacsuk, Sandor Acs, Mark Gergely, Jozsef Kovacs MTA SZTAKI EGI CF 2014 - Helsinki

2. Outline OpenNebula installations at SZTAKI Usage patterns Usage statistics User feedbacks Our OpenNebula contributions EGI CF 2014 - Helsinki

3. Why OpenNebula? It could be easily tailored to our existing infrastructure OpenNebula was ready for production back in 2011 Lightweight and stable middleware Powerful, yet not too complex, easy to learn Vibrant and helpful community, our contributions was always welcome EGI CF 2014 - Helsinki

4. OpenNebula installations at SZTAKI Laboratory level cloud o Infrastructure: 11 Cloud Node (hosts), 184 CPU cores, 468 GB RAM, 37.3TB shared storage o Software: OpenNebula 4.4, KVM (based virtualization) o Interfaces: OCCI 1.1 and 1.2, EC2 compatible interface, SunStone WEB frontend o Part of the EGI FedCloud SZTAKI level cloud o Infrastructure: 8 Cloud Node, 512 CPU cores, 2TB RAM, 36TB iSCSI shared and 288 TB local storage o (Software and interfaces are the same as above) EGI CF 2014 - Helsinki

5. SZTAKI Cloud Architechture Node 64Core 256GB RAM Node 64Core 256GB RAM Node 64Core 256GB RAM Node 64Core 256GB RAM Frontend 8 Core, 16GB RAM Switch 48port,4X10G Switch 48port,4X10G Storage 36TB Storage 36TB Frontend 8 Core, 16GB RAM Node 64Core 256GB RAM Node 64Core 256GB RAM Node 64Core 256GB RAM EGI CF 2014 - Helsinki

6. Number of users EGI CF 2014 - Helsinki Almost one third of the whole institute uses the OpenNebula SZTAKI Cloud infrastructure.

7. User feedbacks OpenNebula brought the cloud paradigm to SZTAKI Number of users are still increasing Usage patterns are extending SZTAKI cloud is an appropriate incubator environment for development and experiments SZTAKI cloud maintains production services in a dependable way Therefore, our users like the cloud EGI CF 2014 - Helsinki

8. Usage scenarios Production services o SZTAKI dictionary, gLite grid resources o Project infrastructures (e.g mail, web, document repositories) o Related projects: RobustPlanet, HEXAA, CloudSME, agINFRA, SCI-BUS Experimental platforms o One-click cloud orchestrator; Cloud performance characterization framework; Kopi Crawler; Big Data trend visualisation; Crossmedia portal; DBpedia spotlight; BOINC cluster … Development Environments o Scientific Gateways (WS-PGRADE/gUSE) with cloud access, OpenCL, Hadoop … EGI CF 2014 - Helsinki

9. Number of running VMs > 242 VM Years > €160k in Amazon EC2* *without networking and storage costs EGI CF 2014 - Helsinki

10. Power consumption EGI CF 2014 - Helsinki Power consumption measurements proves that: o Higher cloud utilization results lower power consumption per VM o Current power usage is 23W/VM(!)

11. SZTAKI LPDS Cloud in EGI FedCloud EGI CF 2014 - Helsinki

12. Our contributions in OpenNebula Several bugfixes Additional feature developments o Rewritten iSCSI storage driver, o SSO authentication module, o ATA-Over-Ethernet (AoE) storage driver, Optimizing iSCSI storage driver and related scripts; EC2 interface improvements EGI CF 2014 - Helsinki

13. One-Click One-Click Infrastructure orchestration, the backend is OpenNebula Already used by several projects: e.g. agINFRA, CloudSME

14. One-Click architecture overview Infrastructure Queue contains the instantiated infrastructure representation. Queue Handler handles the instantiated infrastructures. Orchestrator Queue contains the elements of the infrastructure. Executor reads the Orchestrator queue and instructs the infrastructure handler to realize VMs VM Handler deploys a Virtual Machine in an infrastructure, and instructs the Cloud Interface to start the required VM. Parameters passed through contextualization, retrieval is done by the Tests and Requirements Handler

15. EGI CF 2014 - Helsinki VM2 VM1 WS-PGRADE WF Developer UI gUSE workflow engine DCI Bridge WS-PGRADE End-User UI A B BES interface SZTAKI Desktop Grid server 3G Bridge BOINC project Binaries APP VM4 BOINC client job VM3 BOINC client job BOINC client On-demand integrated service deployment in the cloud Volunteers 15 Infrastructure created by OC Actively used by the CloudSME project

16. WS- PGRAD E Virtual Machine Slave DCI Bridge Slave DCI Bridge User DCI Bridge Administrator Master DCI Bridge Master DCI Bridge Repository IMAGE Job Submission Starting VM(s) OpenNebula EC2 Frontend gUSE Direct Cloud integration WS-PGRADE / gUSE can directly submit workflow jobs into OpenNebula Clouds EGI CF 2014 - Helsinki

17. Cloud Performance Characterization Framework EGI CF 2014 - Helsinki Framework which can characterize the performance of a IaaS Cloud Makes the clouds comparable with each other o Performance wise o QoS wise

18. Thank you for the attention! Questions? EGI CF 2014 - Helsinki