NDS Labs and Dataverse: David Raila National Data Service Labs July 12, 2016 Dataverse Community Meeting 2016 Harvard Medical School

The National Data Service National effort towards enabling scientists to broadly publish, find, and reuse digital data collections. Bringing together R&D software and cyberinfrastructure efforts focused on the management, movement, access, analysis and overall publication of data. Addressing interoperability of data management tools and services. “To build on the data archiving and sharing efforts already underway within specific communities and link them together with a common set of tools designed around the following capabilities”

NDS Labs Re-use existing tools Develops environments, tools, and practices for rapid development, sharing, integration, experimentation, and collaboration around NDS-oriented applications. Assembling modern innovations in IT, cloud, and container-based service infrastructures in reusable form. Fast, self-managed, scalable, reliable, reusable, turn-key environments. Data tools, developer tools, infrastructure tools Re-use existing tools

NDS Labs Testdrive Web-based, turn-key deployment of data tools Browse catalog of tools - community contributed Deploy in seconds Add, remove at will Test, evaluate, compare A personal test environment

Example: Dataverse Integration of new, existing and modified containers Room for more! https://github.com/nds-org/ndslabs-specs/dataverse https://github.com/nds-org/ndslabs-dataverse

Clowder: with Terra-MEPP Mobile Energy- Crop Phenotyping (MEPP) https://github.com/nds-org/ndslabs-specs/clowder https://github.com/nds-org/ndslabs-clowder

Dataverse + iRODS in NDS Labs Files bitcurator.r Dataverse irsync archive.r iCAT Preservation Federation Collaboration to add Odum/RENCI Dataverse-iRODS integration in Labs 10 different containers representing Dataverse, local iRODS iCAT, preservation federation iCAT Files are synchronized from Dataverse to a local iRODS instance Custom curation workflow applies BitCurator rule to identify sensitive information

NDS Labs Develop Turn-key, web hosted developer tools Code, test, containerize from a browser Sharable - developer and Data tools Button-press publish to NDS Labs catalog NDSC6 - October

Contribute and collaborate General Q&A (Google group) https://groups.google.com/forum/#!forum/ndslabs Ask questions, propose ideas, announce your services Code and issues (Github): Fork, create pull requests, report issues https://github.com/nds-org/ndslabs Developer chat (Gitter) https://gitter.im/nds-org/ndslabs Chat with NDS Labs community developers