GRNET Cloud Services and Collaborations Kostas Koumantaros {kkoum at grnet.gr}

GRNET GRNET provides Internet connectivity, high-quality e-Infrastructures and advanced services to the Greek Educational, Academic & Research community. 2

Active member of the global research and education network community GRNET represents Greece in the Pan- European network GÉANT It is an active member of all international organizations related to the development of network & computing infrastructures and the support of advanced applications 3

GRNET Services Networking services Computing Services High Performance Computing Services Authorisation Services E-science Services 4

~okeanos History: Design started late 2010 Production since July 2011 Numbers (9/2014): Users: > 8000 VMs: > 6800 currently active ~400K VMs spawned so far (started/destroyed) More than 110K vlans spawned so far (user owned VLANs) Typical VM flavor (more than 340 flavors available! ) 4 cores (vCPUs), 80GB Hard Disk, 4 or 8GB RAM 5

~okeanos Lives at: ~okeanos-global for eduGAIN users: Demo at: 6

Pithos+ Pithos+ is the Virtual Storage service of ~okeanos: 50 GBs of online storage by default Ability to share files and content with other Pithos+ users or public. GUI and CLI Pithos+ clients sync local folders with Pithos+ Images and data integrated with ~okeanos 7

Synnefo Synnefo is a complete open source cloud stack written in Python that powers ~okeanos and provides: Compute, Network, Image, Volume and Storage services Synnefo: Manages multiple Ganeti clusters at the backend for handling low-level VM operations Uses Ceph RADOS via the Archipelago component to unify cloud storage. Lives at 8

Synnefo around the World GRNET ~okeanos service (Greece) GEANT okeanos-global service (EU) DeIC (Denmark), synnefo.sky.deic.dk DataCentres in US/Germany (private sector) Australia (private sector) South East Asia (South East Asia Network Operators Group – SANOG) Pilots in Ireland, Belgium, Poland, Italy, Azerbaijan Synnefo mailing lists: ~200 subscribers, ~400 threads on support topics 9

EGI FedCloud Participating actively since the beginning as a taskforce by Implementing snf-occi, snf-cdmi + other tools/adaptors for synnefo Leading Scenario 2: Data Management Leading Scenario 8: VM Image Management 10

Snf-OCCI Implements the OCCI specification on top of synnefo’s API in order to achieve greater interoperability. This module is a translation bridge between OCCI and the synnefo endpoints. It is designed to be as independent as possible from the rest IaaS, providing an OCCI compatibility layer 11

Snf-CDMI Design of a CDMI/v1.0.2-compliant server skeleton Plug-in your backend Pithos+ backend implemented Coded in Scala/Finagle for scalability/performance/flexibility In production for a few months now OCCI auth via GRNET’s auth proxy 12

HPC Services GRNET represents Greece in PRACE and is currently deploying a large (~180 Tflop) National (Tier-1) HPC system for researchers. GRNET also offers VPS services to its members, universities and research centers, file storage services to organizations and end- users and advanced grid services to the scientific community, through its modern datacenters. 13

Application Database A user-driven registry for vApps and their related VMIs in a versioned manner Visitor/user: search, locate, download and use register vApps in the fedCloud infra vApp provider: Create/manage/update versioned vApps and associate VMI(s) to them Tool for the VO managers in order to compile lists with vApps Mechanism for distributing vApps to the site/RPs (based of HEPiX vmcaster/vmcatcher technology) 14

GN3+ Activities GÉANT Open cloud Exchange (OCX) brings together CSPs with Cloud consumers each consumer with just one link to the local OCX pop can get many L2 internal connections to any preferred CSP 15

GN3+ Activities Cloud Integration (eduGAIN, GEANT Cloud Catalogue) Help vendors and cloud providers integrate their services with GÉANT at the networking and authorisation level Provide integrated services view with the GÉANT Cloud Service catalogue Services appraised against approved set of criteria at Green, Amber, Red levels: provide users with choice 16

E-Science Integrated e-Science platform: Hadoop / Yarn on demand via an intuitive GUI Scientists will set up cluster, stage in data, process, and stage out results without requiring proficiency in Hadoop / Yarn and distributed computing Lowering the barrier of entry Allowing easy processing of big data 17

Backup and Archiving Backup as a Service: oriented towards end- users, comprehensive back-up solution (full, incremental backups, snapshots, etc.). Archiving as a Service: oriented towards institutions, archiving of big data in tape libraries. 18