TSD Status and TSD API USIT Maria Francesca Iozzi, Leon Du Toit and many more …

TSD IN NUMBERS # projects vs. time

Drift of TSD Routines and Documentation Monitoring / Logging (ELK) Weekly on-duty watcher (high volume of tickets!) Incident Reports Operational Logs Collaboration / communication across groups at USIT

TSD offer to the users Platform for secure storage and analysis HPC Data Collection Tools / Nettskjema Statistical Analysis Tools Electronic Consent Secure Data Collection from App (personalized medicine!) Video and audio support

Bulk delivery of TSD to … HiAO (80 projects) HSØ (130 projects) UiT (80 projects) NTNU (80 projects)

Further developments Developments driven by use cases Developments financed by user communities Users want: Fast / volume-intensive ingestion mechanism Data management tools Effective workflows involving video User friendliness Much more….

Future Reaching soon the limit of the current set-up: Too many manual operations More automation and serf-service needed

Architecture, features, roadmap TSD API Architecture, features, roadmap

Architecture TSD project area client proxy api db

Architecture TSD project area client proxy api db https https https ssl client proxy api db

Architecture TSD project area client proxy api db trusted https https ssl client proxy api db auth auth auth authnz

Architecture TSD ipad_1 Underernœring nginx ipad_2 Nettskjema nginx psql postgrest ipad_n

Architecture TSD data collection data analysis ipad_1 Underernœring nginx ipad_2 Nettskjema nginx psql postgrest ipad_n

Scalability, redundancy Architecture Scalability, redundancy project 1 project 2 nginx HA proxy nginx … firewall …

Architecture Modularity storage psql files nginx HA proxy nginx export firewall stream

Value for researchers No longer have to care about implementation details of data transfer or storage - focus on doing science Enables a complete data workflow, automation Authenticated, secure and reliable data transfer Persistent and redundant storage

Value for client developers an API \o/ Supports development of end-user solutions (both collection and analysis sides) multiple data types (JSON, files, arbitrary data streams) self service (client registration, get approved, read the docs and go) test environment outside of TSD - offers the same features and interface as in production

Roadmap Improved operational readiness Automated deployment Monitoring and alerting Documentation (for developers and maintainers) Risk analysis

About export Data export - with BankID and Nettskjema

Next Integration with a 3rd party developer (JSON data) Files from medical instruments video streaming from psychological interviews