EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI /09/14 1 Appliance lifecycle services Marios Chatziangelou, et al. Institute of Accelerating Systems and Applications (IASA)

EGI-InSPIRE RI The “Tools” Tools has been used, developed or extended for this purpose:  EGI Applications Database service EGI Applications Database  Hepix VMCaster/VMCatcher toolsetVMCasterVMCatcher

EGI-InSPIRE RI AppDB: Cloud Marketplace Main objectives of the Cloud MP section of the AppDB:  A user-driven registry for vApps and their related VMIs in a versioned manner  Tool for the VO managers in order to compile lists with vApps  Mechanism for distributing vApps to the site/RPs (based of HEPiX vmcaster/vmcatcher technology)

EGI-InSPIRE RI HEPiX VMCaster & VMCatcher VMCaster is a tool for managing and updating your published virtual machines image lists. Following the HEPiX image list format. Tip: In fedCloud setup, the AppDB acts as the VMCaster. VMCatcher is a tool which allows users to subscribe to Virtual Machine Image Lists, cache the images referenced to in the Virtual Machine Image List, validate them against sha512 hashes in the images lists and provide events for further applications to process updates or expire changes of virtual machine images. Tip: You are welcome to imagine VMCatcher something like YUM for VMIs

EGI-InSPIRE RI Indicative statistics 24 registered vApps 3 supported VOs demo.fedcloud.egi.eu fedcloud.egi.eu highthroughputseq.egi.eu (more to come, biomed, drihm.eu, ebi-project,… ) 8 out of 20 sites, already configured with the vmcatcher, 12 are on the go.

EGI-InSPIRE RI Cloud MP: Actors & related features (1)  For developers and/or vApp providers -Register one or more vApps -Create/manage/update vApp versions and associate VMI(s) -Publish vApp versions and therefore make them available to the public -Tune whether the vApp sensitive data is publicly available or accessible by a specific group of individuals (Privacy) -Permissions tuning on a vApp level per user, in order to: -Modify the high-level vAppliance metadata (general details, vApp description, derived publications etc.) -Allow access to it sensitive data (if the vAppliance is marked as ‘private’) -Manage (edit/modify/delete) vAppliance versions -or even, full control to a given vAppliance -Communicate with the VO representatives in order to request inclusion/exclusion of the vApp to/from the VO specific infrastructure (cloud sites that support the VO)

EGI-InSPIRE RI Cloud MP: Actors & related features (2)  For visitors and users (users: people that would like to make use of a VMI available in the infrastructure) -Search features for vApps -Free text searching -Faceted search mechanism, allowing users to explore a collection of information by applying multiple filters, such as: -Hypervisors (KVM, QEMU, Xen, …), OS family (Linux, Windows, BSD, …), Architectures (x86, x86_64, ARMv7, ARMv8, SPARC, …), Middlewares (OpenStack, OpenNebula, …), Supported Virtual Organization, Offered by a specific country, …. and many more -Provide details for the vApp, as well as for its associated VMIs -for the vApp as a whole: -High-level description/main aim/scope -Contacts where the user may find direct support -Technical details like: programming languages used, compatible middlwares,…. -Projects & Organizations that are related to the vApp -Related countries and Virtual Organizations -for the vApp VMIs: -Whereto URI/location for accessing/downloading the actual image file -Checksums and file size (mainly for verification purposes) -Contextualization script(s) proposed by the vApp owner -Additional details like: description, minimum/recommended number of cores or RAM, etc.

EGI-InSPIRE RI Cloud MP: Actors & related features (3)  For visitors and users: (…continue) -Availability & Usage information, addressing topics like: -in which site(s) a VMI is available to -is it available and endorsed by a specific VO and therefore a VO membership is required, or it can be used without VO membership -all the necessary technical elements one needs to start a VMI at a site using the rOCCI command line tool. Such as: -Site endpoint – defining where the VMI will be instantiated -Template ID of the template that could be used by the user i.e. 4 cores, 32 GB RAM, Linux -OCCI ID, of the VMI

EGI-InSPIRE RI Cloud MP: Actors & related features (4)  For Virtual Organization managers -Ability to manage/compile the VO-wide image list for their VO: -Associate/Add a vApp with the VO-wide image list -Update a vApp, with a newest version, already exists in the VO-wide image list -Remove/Exclude a vApp from the VO-wide image list. -and finally, publish the new/updated VO-wide image list and makes it available to the sites.

EGI-InSPIRE RI Cloud MP: Actors & related features (5)  For Sites/Resource Providers -Compatible VO-wide image lists with the HEPiX image list format -Provides two different ways to sites, for automatic downloading the VMIs of a registered vApp: -A. By subscribing to a VO-wide image list and therefore retrieves all the VMIs endorsed by the VO management team. -B. By subscribing to a vApp image list and gets the VMIs of the vApp as submitted by the user (without having the VO endorsement)  For external/3 rd -party services and applications -RESTfull API, that supports HTTP verbs such as PUT, POST, and DELETE. Verb mappings to data operations follow a CRUD convention. -Supported by a flexible authentication mechanism using Personal Access Tokens and/or username/password -API documentation in good shape

EGI-InSPIRE RI Cloud MP: Typical workflow RPs/Sites vmcatcher site-bdii cloud mw AppDB Cloud Marketplace Top-BDII vmcaster sub-service Insert/update/remove image(s) Publish new vApp version Register a vApp Create a new vApp version ImL Store:VOImL Store:vApp Republish VO-wide image list Select/update/exclude vApp Search for vApps Download images Get usage details (SiteEP/tplID/OCCI ID) Start/Stop/…. an image users/visitors VO ManagervApp provider/submitter subscribe and/or get image_list updates perform occi cmds subscribe and/or get image_list updates (optional) push info retrieve info generate image_list generate image_list AppDB portal Notify VO manager (optional)

EGI-InSPIRE RI Thank you!! Questions Links & documentation: Contact: