Measurement Data Workspace and Archive: Current State and Next Steps GEC15 Oct 2012 Giridhar Manepalli Corporation for National Research Initiatives
Measurement Data Object /A2BE-C Experiment A Run 1 Logs Run 2 Logs Metadata Measurement Data: – A sequence or stream of bytes that correspond to one or more I&M experiments – Could consist of Planning data: scenario documents, source code, etc. Input data: configurations, rspecs, etc. Output data: log files, results, etc. – Captured as file-system directories and files for ease of use /B5A7-D Exp. A & B Exp. A Exp. B Metadata Measurement Data Object = Data + Metadata OR – Data that corresponds to ‘multiple’ related experiments – Data that corresponds to a ‘single’ experiment with one or more ‘runs’ PLUS – Metadata that describes the data object
Measurement Data Flow – Slices to Workspaces Experimenter Y Experimenter X Workspace Key: 1. Experiment Initiated 1 1 Slice 2. Measurement Data Collected = Measurement Data Object 22
Index/Catalog Digital Objects Logical Storage Layer Experiment Run 1 Logs Run 2 Logs Metadata Experiment Run 1 Logs Run 2 Logs Metadata Physical Storage Layer User Accounts SFTP SMBWebLogical Interfaces Physical - Logical Map Workspace Architecture
Measurement Data Flow – Workspaces to Archive Workspace 1 Experimenter Workspace N Experimenters Archive..... Stores Data Registers Handle Handle System
Science Times Article Title Data ID Handle System Use Archive 1.User follows Data ID into the Handle System. 2 2.User is redirected to Data Object stored in the Archive Handle System 1
SUITE OF SERVICES Science Times Article Title Data ID Extended Handle System Use Suite of extensible services end users can leverage by following the ID. Visualization Archive I Agree Terms:… License Enforcement I Agree Terms:… I Agree Terms:… Data Set Dissemination … … …. Data Processing 1.User follows Data ID into the Handle System. 2.User is presented with various Archive Service Options. Handle System 3.User reaches the desired Archive Service. 12 3
Next Steps Consolidate I&M Metadata Schema – Simplify metadata for lowering the entry barrier – Define a serialization schema, e.g., XSD Integrate the Handle System into GENI I&M Archive Identify and define the Archive sustainability plan and usage policies – Who manages it? Who uses it? How to use it? Etc.