1. Searchlight Lei Zhang Search service for OpenStack
Image source:

2. Searchlight includes indexing plugins for many of Openstack's core services. This session will focus on:
Concept overview
Architecture overview
Aggregations abilities and example
Searchlight UI show
Ocata goals

3. Is managing relationships between things
Power off all of Bob’s instances
What flavors work for encryption workloads?
What resources are tagged with “web”?
What am I using in the East availability zone?
Managing Clouds
Is managing relationships between things

4. Pre-defined lists for all the things
Availability Zones
Baremetal Nodes
Domains
Flavors
Floating IPs
Host Aggregates
Hypervisors
Images
Instances
Key Pairs
Metadata Definitions
Networks
Projects
Routers
Security Groups
Subnets
Volumes
...
The CLI
Pre-defined lists for all the things

5. Pre-defined lists for all the things
The UI
Pre-defined lists for all the things

6. Predefined lists are one way to do it…
Details of one thing
List of things
Details of one thing
List of things
Details of one thing
List of things

7. What about MY list of things?
Cloud
Requires
Search
What about MY list of things?

8. OpenStack is a set of distributed services Searchlight
Based on Elasticsearch
Powerful search and aggregation API
Full text search on any resource
Support search for Nova, Neutron, Cinder, Glance, Swift, Designate resources
CLI and Horizon UI
OpenStack is a set of distributed services
Searchlight
Unified Search
~ 3 minutes

9. List and Query Requests
Concept Flow
UIs and API Clients
Searchlight
List and Query Requests
plugins
Resources indexed:
On demand bulk indexing
Via notifications
Direct Injection Libraries
Cloud Services
Action Requests
~ 20 minutes. Hand over to Steve

10. Components

11. Searchlight Core Engine
Plugin architecture
Searchlight Core Engine
Zero Downtime Bulk Indexing (to [re-]initialize data)
Incremental Indexing (ongoing)
Rich Policy Based Access Controls
Per User Field Level Data Security
Resource Plugin
Data Mapping
Retrieves resources from source service API
Transforms event notifications
Defines resource RBAC rules
Note how it's not necessarily specific to Openstack
Examples of RBAC - filter by project, neutron's more complicated rules
Keystone (auth)
RMQ / Oslo.messaging
Nova

12. Improve the Notifications
Notifications in OpenStack are spotty
missing events
missing data
Improve
the
Notifications
avoid api callbacks

13. Aggregations Provide aggregated data based on a search query
Can be composed in order to build complex summaries of the data.
Based on the query provided as well as Searchlight RBAC filters.

14. How many volumes and how many gigabytes does each project use?{
"query": {"match_all": {}},
"type": "OS::Cinder::Volume",
"limit": 0,
"all_projects": true,
"aggregations": {
"volumes_by_tenant": {
"terms": {
"field": "project_id" },
"total_volume_gb": {
"sum": {
"field": "size" }
}}}}} {
"volumes_by_tenant": {
"buckets": [
"doc_count": 2,
"key": "a3845ef5d afeed4838a9",
"total_volume_gb": {
"value": 4.0 } },
"key": "b1fbc f abe1d2",
"value": 3.0

15. Plugging resource types into the interface
Web front-end to Searchlight
Is a plugin to Horizon
Repo: searchlight-ui
AngularJS
~2,000 LOC (JS)
Uses Neutron Horizon
Searchlight UI
Plugging resource types into the interface

25. Ocata list
Add more service plugins: Ironic, Murano, Glare, Magnum, Lbaas(Octavia), Heat
Provide sort and pagination support for Nova cell v2
Implement pipeline for Searchlight, allow arbitrary publishers can be added into Searchlight
Zaqar publisher(Searchlight Zaqar Horizon integration)

26. More info http://docs.openstack.org/developer/searchlight/