1. MMG: from proof-of-concept to production services at scale (part II)
Lars Ailo Bongo (ELIXIR-NO, WP6)
WP4 F2F, June 2017, Prague, Czech

2. Outline MMG updates Short term needs (= EOSC pilot) Long term needs
Demo
Discussion about business models

3. MMG on Elixir Compute Platform
Done:
META-pipe on cPouta, CESNET and EGI Federated Clouds
META-pipe integrated with ELIXIR AAI
EMG on Embassy cloud and GCP
Marine metagenomics portal
Metagenomics workshops using cPouta
In progress:
META-pipe on AWS
Open META-pipe web app for ELIXIR users
EMG in CWL
Documentation of best practices
TODO:
Test META-pipe and EMG at scale
ELIXIR compute cloud business model
Deploy META-pipe and EMG production service on cloud
Incorporate other MMG pipelines such as BioMaS

4. MMG EOSC Pilot MMG, Compute Platform, EGI Elixir CC Aims: Not funded
Evaluate the performance of META-pipe and EMG at scale using EOSC resources.
Cost-optimize the analyses on EOSC.
Evaluate the use of elasticity in EOSC for execution of job queues.
Develop a full-service delivery model and potential business model between the stakeholders and entities involved.
Not funded
Next step?

5. MMG needs (next two years)
Cloud
Business model / resources needed to analyze end-user data
Resources needed to generate reference databases
Pipeline optimizations
Storage and data transfer
Object store
Cache for pipeline reference databases and VMs
Optimize META-pipe deployment (reference DBs >> user data)
Optimize EMG data transfer to/from cloud
Red = urgent

6. MMG needs (next two years)
AAI
Integrated with object store
Service registry/ help desk
Help end-users to get resources

7. MMG needs (after Excelerate)
Cloud
Sustainable business model
Maintain cloud setup tools
Easy deployment of new pipelines, databases, and services
Storage and data transfer
Access data in ENA on behalf of users (as in EBI)
AAI
Established service
Service-registry / help-desk ?

8. Business model alternatives
Users gets resources
Project or national funding/ resource
Pan-European resources (EOSC?)
Direct payment (industry)
Elixir pool of funding
Service provider gets resources
Elixir node(s)
Elixir funded
Pan-European resources
Resource provider gets funding
Elixir nodes

9. Business model alternatives
User gets resources
Many small allocations
Compute platform problem
Service provider gets resources
Few big allocations
MMG problem
Resource provider gets funding
Few big grants
Resource provider problem

10. Summary How to get resources at scale?
How to establish compute platform business model?
What happens to MMG use case and compute platform after Excelerate?
How can others take advantage of MMG experiences?

11. Demo
Alternative 1