1. SAHARA Project overview and update May 2018
TELLES NOBREGA IRC: TELLESNOBREGA

2. What does Sahara do? Data processing service
Provides a way to deploy data processing clusters with minimum effort from the user.
Provides the capability to manage the clusters and submit jobs to them.

3. Project background Latest user survey adoption numbers:
First official release was Juno
17 contributors for latest release
Latest user survey adoption numbers:
Deployed: 11% clouds in production or test phase indicate they are using Sahara; 3% using Sahara in production and 8% in test phase
Considering: 25% of users indicated they are interested in this project

4. Quick Overview Cluster Node Group Templates Cluster Templates
Jobs - EDP (Elastic Data Processing)
Data Sources
Job Binary
Job Templates

5. Architecture

6. New features & enhancements in Queens
EXPOSING APIv2 AS EXPERIMENTAL
We released APIv2 as experimental
This will open a wide range of possibilities for new features in Sahara
POLICY IN CODE
Allows policy enforcement to be done in code
S3 OBJECT STORE
EDP job binary may reference a file stored in S3-like object store

7. New features & enhancements in Queens
DECOMMISSION OF A SPECIFIC NODE
Allows the removal of a specific node from cluster
IMPORT AND EXPORT TEMPLATES
We added the option to import and export templates

8. New features & enhancements in Rocky
INCREASE SUPPORT OF APIv2
We plan to improve APIv2 and have
BOOT FROM VOLUME
Allows the creation of clusters from volumes instead of images
PLUGINS SPLIT FROM MAIN SAHARA CODE
We are moving the plugins to its own repo
MIGRATION TO STORYBOARD
Sahara now tracks its bugs and features on Storyboard

9. Rocky release themes for Sahara
MINOR
FOCUS
MAJOR
FOCUS
FOCUS
NOT A
FOCUS
MAJOR
FOCUS NO
INFO
NOT A
FOCUS
MAJOR
FOCUS NO
INFO NO
INFO NO
INFO
MINOR
FOCUS
MINOR
FOCUS
MAJOR
FOCUS

10. Possible features & enhancements for Stein
FULL SUPPORT OF APIv2
We plan to have APIv2 as the main supported version
HEALTH REPAIR
Cluster health repair: working towards elimination of manual steps from managing lifecycle of a Sahara cluster
PYTHON 3 AS DEFAULT
Python 2 time is running out, we need to move to python 3 full support asap

11. Stein release themes for Sahara
MINOR
FOCUS
MAJOR
FOCUS
FOCUS
NOT A
FOCUS
MAJOR
FOCUS
MINOR
FOCUS NO
INFO
NOT A
FOCUS NO
INFO NO
INFO NO
INFO
MINOR
FOCUS
MINOR
FOCUS
MAJOR
FOCUS

12. We need your help!
QUESTION: What services would you like to see supported in Sahara?

13. THANKS!
Questions?
openstack
openstack
OpenStackFoundation