1. Elasticsearch-powered Faceted Search in the Deep Carbon Observatory Data Portal
Stephan Zednik, Patrick West, Peter Fox
Tetherless World Constellation
Rensselaer Polytechnic Institute
Summer Meeting
July 19-22, 2016
Durham, NC
@szednik

2. Deep Carbon Observatory (DCO)
10 year initiative
Global community scientists
doing collaborative multi-disciplinary work
Focusing on carbon’s role in geophysical processes in Earth
The Deep Carbon Observatory is a global research program to transform our understanding of carbon in Earth. At its heart, DCO is a community of scientists, from biologists to physicists, geoscientists to chemists, and many others whose work crosses these disciplinary lines, forging a new, integrative field of deep carbon science.

3. DCO Data Portal
We take heterogeneous data and information from multiple different science domains across different organizations and organize them into a knowledge graph with over 550,000 triples.

4. DCO Data Portal

5. Challenge and Objective
Allow users to easily find relevant or interesting
publications
potential collaborators
datasets
projects
from within the DCO community
DCO Data Portal User profile page

6. Approach Implement faceted search interfaces for several people
publications
projects/field studies
datasets
A canonical example of a faceted navigation at LinkedIn

7. A new solution was needed
Faceted Search v1 (S2S)
difficult to maintain
difficult to update
non-standard behavior
slow
A new solution was needed

8. Elasticsearch Search-engine based on Lucene
Real-time search and analytics capabilities
Sophisticated RESTful API
Distributed, scalable, and highly available
schema-free
supports faceting

9. DCO Elasticsearch Ingest
denomalize…
Knowledge graph
Stack of
JSON documents

10. Search Document JSON

11. FacetView2 + Handlebars.js
Elasticsearch REST API
JS library for faceted search
Templating engine
easy to maintain
easy to configure
fast
HTTP GET
JSON
Webserver
Client Browser

12. FacetView2 config

13. Handlebars.js Templates

14. Publication Browser (v2)

15. Field Studies Map (v2)

16. Summary and Future Work
Highlight
Elasticsearch + Facetview2 provides a simple and performant solution for faceted search of DCO Data Portal content
Very easy to deploy and evolve
Future work
Incorporate new facet types
Add analytics to search interface?
Thanks for listening
@szednik 16

17. DCO Faceted Browser Links
Faceted Browsers
Faceted Field Studies Map