1. www.egi.eu EGI-InSPIRE RI-261323 EGI-InSPIRE www.egi.eu EGI-InSPIRE RI-261323 Data Management Interface: CDMI for CMF Ilja Livenson PDC KTH

2. www.egi.eu EGI-InSPIRE RI-261323 Background & motivation Based on the CDMI-Proxy server developed in FP7 VENUS-C Developing ‘v2’ as part of the EGI mini- project “From scratch” New name – Stoxy (STOrage proXY) Target use case – AWS S3-like storage

3. www.egi.eu EGI-InSPIRE RI-261323 Technology Python + Twisted + ZODB + ZCA Buildout packaging Installs with a script Multiplatform 3

4. www.egi.eu EGI-InSPIRE RI-261323 Stoxy architecture OMS management framework Stoxy plugin SSH endpoint CDMI endpoint Zope DB (VOMS- enabled) OpenStack Keystone 1. Get CMS token 2. Add it as a HTTP header

5. www.egi.eu EGI-InSPIRE RI-261323 Data vs Metadata Sizes are not clear any more But use cases are still there Stoxy’s target is on a smarter server-side processing E.g. filtering or post-processing of the data based, metadata enrichment Depends on the scenarios 5

6. www.egi.eu EGI-InSPIRE RI-261323 CDMI Security Different credentials are used for those cases (in the setting of the academic infrastructure) Username/passwords CMS token-based (OpenStack Keystone) CDMI unfortunately is not Keystone token compliant (yet) Abusing standard to get it working

7. www.egi.eu EGI-InSPIRE RI-261323 Stoxy authentication HTTP Basic/Digest X509 client certificate based Via Apache HTTPD Keystone authentication Only CMS (crypto) tokens Token = signed blob of information from Keystone

8. www.egi.eu EGI-InSPIRE RI-261323 Keystone token example 8 { "access": { "metadata": {....metadata goes here.... }, "serviceCatalog": [....endpoints goes here.... ], "token": { "expires": "2013-05-26T08:52:53Z", "id": "placeholder", "issued_at": "2013-05-25T18:59:33.841811", "tenant": { "description": null, "enabled": true, "id": "925c23eafe1b4763933e08a4c4143f08", "name": "user" } }, "user": {....userdata goes here.... } Generated token

9. www.egi.eu EGI-InSPIRE RI-261323 Explorative browsing with SSH Stoxy-specific functionality Comes with OMS framework Not CDMI interface Use putty for operating on the Stoxy objects/containers Useful for debugging/browsing

10. www.egi.eu EGI-InSPIRE RI-261323 Supported CDMI feature set Blob CRUD JSON-encoded Streaming Container CRUD ACL – planned to be full At the moment requires admin privileges

11. www.egi.eu EGI-InSPIRE RI-261323 Plans Finding scenarios We are happy to provide extensive help with integration Finishing documentation/example cases Integration into Fedcloud’s infrastructure Requires enabling of the PKI tokens in Keystone installations Implementation of the lightweight browser on top

12. www.egi.eu EGI-InSPIRE RI-261323 Summary Open Source CDMI server (Apache2 license) https://github.com/stoxy Includes python client sdk/cli Accent on metadata manipulation Currently in active development, first production release is planned in Dec 2014 Feedback/contributions are very welcome!

13. www.egi.eu EGI-InSPIRE RI-261323 And many thanks to EGI Federated Cloud TF group Andrei Sosnin, OpenNode PDC KTH 13 Thank you for listening!