NEESGrid Data and MetaData Technologies Kincho Law, Jun Peng, Jim Eng, Terry Weymouth, Paul Hubbard, Charles Severance

Goals n Data is online and persistent n Data and Metadata are supported together n Data migrates transparently including security, and metadata n Data is completely secure with access controls but security does not get in the way n Data provenance - how was it gathered, how has it been manipulated? n Data in support of research publication n Support for repeatable experiments n Data oriented research computation support n Support for workflow

Overview of tools and technologies n Model development in RDF n Project Browser n Data Repository n Electronic Notebook n Data Mappings n Data Viewer(s) n Data Turbine n Data As Video n Still Cameras 11/2003

Models + Data Model Repo Models Configure Data Load Configure RDF/ OWL RDF

Protégé - 2K Models + Data Model Repo Models Configure Data Load Configure RDF/ OWL RDF

DOE ELN / Example

Mappings and the Data Viewer n ISO 8601 Time channel n Column data with time recorded as a column n Column – generate time n Column – generate time – trigger filter Channel units: g,g,in,kip Time ATL1 ATT T15:48: T15:48: public class NEESDataMap { public static boolean repoMap(File mainFile, File mappingFile, String mapping) { // Code here }

DT Main System CTL NTCP Plugin Data Turbine - Today NTCP Control DAQ Data Capture DT Client BT848 rbnbjcap DT Client NEES NSDS Driver Control Plugin AXIS / DT Gateway Axis

DT Main System Data Turbine NTCP Control Plugin Thumbs Control Start Technology Celebration

DT Main System PTZ/ USB Still Capture DT Client DT Capturing Camera Control DAQ Data Capture DT Client Audio Encoder DT Client BT848 rbnbjcap DT Client Still Capture - Minnesota / Paul Hubbard Video capture - From Creare Audio capture - From Creare (TBD) Data Capture - From sites (upwards compatible) NEES NSDS Driver - Paul Hubbard Camera Control Plugin - Mich / Minn NEES NSDS Driver Each still capture produces two channels - Small 1-5fps stream + large single images when picture is taken Control Plugin

DT Main System User Views / Still Camera Quicktime Storage System Quicktime Slicing Tool Still Image / Camera Control ~ <> ^ ^ <> Control Plugin Data Viewer Thumbnail Process Thumbnail + Audio + Data <>+ Images as combination of time lapse with triggers, live video, and human- taken pictures

Video and Data Tivo Thumbnail + Audio + Data <>+

Summary n We have many elements completed and working, but there is much more that is still not done: –Additional visualization capabilities –Improved tele-presense capabilities –Improved experiment management tools –Improved linking of simulation and experimental analysis –Central data repository curation –Data mining and knowledge creation –Federation of indexes and searching across many sites –Many incremental improvements - upgrading components, internationalization