1. NDS Labs and Dataverse:
David Raila
National Data Service Labs
July 12, 2016
Dataverse Community Meeting 2016
Harvard Medical School

2. The National Data Service
National effort towards enabling scientists to broadly publish, find, and reuse digital data collections.
Bringing together R&D software and cyberinfrastructure efforts focused on the management, movement, access, analysis and overall publication of data.
Addressing interoperability of data management tools and services.
“To build on the data archiving and sharing efforts already underway within specific communities and link them together with a common set of tools designed around the following capabilities”

3. NDS Labs Re-use existing tools
Develops environments, tools, and practices for rapid development, sharing, integration, experimentation, and collaboration around NDS-oriented applications.
Assembling modern innovations in IT, cloud, and container-based service infrastructures in reusable form.
Fast, self-managed, scalable, reliable, reusable, turn-key environments.
Data tools, developer tools, infrastructure tools
Re-use existing tools

4. NDS Labs Testdrive
Web-based, turn-key deployment of data tools
Browse catalog of tools - community contributed
Deploy in seconds
Add, remove at will
Test, evaluate, compare
A personal test environment

5. Example: Dataverse
Integration of new, existing and modified containers
Room for more!

6. Clowder: with Terra-MEPP
Mobile Energy- Crop Phenotyping (MEPP)

7. Dataverse + iRODS in NDS Labs
Files
bitcurator.r
Dataverse
irsync
archive.r
iCAT
Preservation
Federation
Collaboration to add Odum/RENCI Dataverse-iRODS integration in Labs
10 different containers representing Dataverse, local iRODS iCAT, preservation federation iCAT
Files are synchronized from Dataverse to a local iRODS instance
Custom curation workflow applies BitCurator rule to identify sensitive information

8. NDS Labs Develop
Turn-key, web hosted developer tools
Code, test, containerize from a browser
Sharable - developer and Data tools
Button-press publish to NDS Labs catalog
NDSC6 - October

9. Contribute and collaborate
General Q&A (Google group)
Ask questions, propose ideas, announce your services
Code and issues (Github):
Fork, create pull requests, report issues
Developer chat (Gitter)
Chat with NDS Labs community developers