Measurement Data Workspace and Archive: Current State and Next Steps GEC15 Oct 2012 Giridhar Manepalli Corporation for National Research Initiatives

Slides:



Advertisements
Similar presentations
Current Status (Tutorial tomorrow)
Advertisements

Interoperability Scenarios All Working Groups Meeting May, Rome, Italy.
Information Infrastructure: Foundations for ABS Transformation Stuart Girvan, Australian Bureau of Statistics MSIS Paris, April 2013.
SWIM WEB PORTAL by Dipti Aswath SWIM Meeting ORNL Oct 15-17, 2007.
Brief Overview of Major Enhancements to PAWN. Producer – Archive Workflow Network (PAWN) Distributed and secure ingestion of digital objects into the.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation
Harvard University Oracle Database Administration Session 2 System Level.
Presented by IBM developer Works ibm.com/developerworks/ 2006 January – April © 2006 IBM Corporation. Making the most of Creating Eclipse plug-ins.
Mike Jackson EPCC OGSA-DAI Today Release 2.2 Principles and Architectures for Structured Data Integration: OGSA-DAI.
Chapter 1- Visual Basic Schneider1 Chapter 1 An Introduction to Computers and Visual Basic.
Overview of Transaction Processing and Enterprise Resource Planning Systems Chapter 2.
Enterprise Workflow CPSC 476 Lightening Talk Brenda Griffith/Katie Soto.
Measurement Data Archive – Project Highlights GEC12 Nov 2011 Giridhar Manepalli Corporation for National Research Initiatives
Streams – DataStage Integration InfoSphere Streams Version 3.0
OCLC Online Computer Library Center OCLC’s Digital Archive – Disseminating with METS Jay Goodkin Software Engineer Digital Collection and Preservation.
RMIS - Building a Research Management Information System at the University of Glamorgan Leanne Beevers & Neil Williams.
GEMINI Indiana University, University of Kentucky.
EXtensible Neuroimaging Archive Toolkit (XNAT) Washington University Neuroinformatics Group.
National Science Foundation Arlington, Virginia January 7-8, 2013 Tom Lehman University of Maryland Mid-Atlantic Crossroads.
® IBM Tivoli Directory Integrator Tivoli Directory Integrator Exercise 2 – Mapping to inetOrgPerson Eddie Hartman
Measurement Data Archive GEC11 July 2011 Giridhar Manepalli Corporation for National Research Initiatives
THE GITB TESTING FRAMEWORK Jacques Durand, Fujitsu America | December 1, 2011 GITB |
The NISO Question/Answer Transaction Protocol (QATP) AVIAC January 2004 Donna Dinberg Library and Archives Canada Mark Needleman Sirsi Corporation.
Digital Object Architecture
Indo-US Workshop, June23-25, 2003 Building Digital Libraries for Communities using Kepler Framework M. Zubair Old Dominion University.
M EASUREMENT D ATA O BJECT D ESCRIPTOR S PECIFICATION - P RESENT S TATUS Giridhar Manepalli Corporation for National Research Initiatives.
The NISO NETREF Protocol Mark H Needleman Product Manager- Standards Sirsi Corporation LITA National Conference 2004.
Dr. Mohamed Osman Hegazi 1 Database Systems Concepts Database Systems Concepts Course Outlines: Introduction to Databases and DBMS. Database System Concepts.
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: Gathering, Transferring and Sharing MD Goals Architecture Overview –Process.
File Systems (1). Readings r Reading: Disks, disk scheduling (3.7 of textbook; “How Stuff Works”) r Reading: File System Implementation ( of textbook)
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: MD Objects and Descriptors Goals Architecture Overview –Process –Functional.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
Measurement Data Archive – Integration Effort GEC11 July 2011 Giridhar Manepalli Corporation for National Research Initiatives.
Sponsored by the National Science Foundation GENI I&M Update: Architecture Overview and Current Status GENI Engineering Conference 10 San Juan, PR GPO.
Introduction to the new mainframe © Copyright IBM Corp., All rights reserved. Chapter 12 Understanding database managers on z/OS.
The european ITM Task Force data structure F. Imbeaux.
Overview of the SAS® Management Console
Fall 2000M.B. Ibáñez Lecture 22 File-System I File Concept.
GIMI I&M and Monitoring Mike Zink University of Massachusetts Amherst GEC 15, Houston, October 23 rd 1.
Large Scale Nuclear Physics Calculations in a Workflow Environment and Data Provenance Capturing Fang Liu and Masha Sosonkina Scalable Computing Lab, USDOE.
Framework for MDO Studies Amitay Isaacs Center for Aerospace System Design and Engineering IIT Bombay.
Presented by Scientific Annotation Middleware Software infrastructure to support rich scientific records and the processes that produce them Jens Schwidder.
SCORM Course Meta-data 3 major components: Content Aggregation Meta-data –context specific data describing the packaged course SCO Meta-data –context independent.
LAMP: Bringing perfSONAR to ProtoGENI Martin Swany.
IT320 OPERATING SYSTEM CONCEPTS Unit 7: File Management May 2012 Kaplan University 1.
Sponsored by the National Science Foundation 1 Nov 4, 2010 Inst & Meas WG Meeting at GEC9 Thur, Nov 4, 9am – 10:30am Introductions (9am) Topic 2: Meas.
1 Ontolog OOR-BioPortal Comparative Analysis Todd Schneider 15 October 2009.
ESG-CET Meeting, Boulder, CO, April 2008 Gateway Implementation 4/30/2008.
1 Active Directory Service in Windows 2000 Li Yang SID: November 2000.
UML - Development Process 1 Software Development Process Using UML.
1 CLASS – Simple NOAA Archive Access Portal SNAAP Eric Kihn and Rob Prentice NGDC CLASS Developers Meeting July 14th, 2008 Simple NOAA Archive Access Portal.
Data Foundation IG DF Organizing Chairs: Gary Berg-Cross & Peter Wittenburg.
GIMI Tutorial GIMI Team GEC 16, Salt Lake City, March 19 th 1.
Application Design Document Developers: o Uri Goldenberg o Henry Abravanel o Academic.
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: I&M Service Types, Arrangements, Assembling Goals Architecture Overview.
Physical Oceanography Distributed Active Archive Center THUANG June 9-13, 20089th GHRSST-PP Science Team Meeting GHRSST GDAC and EOSDIS PO.DAAC.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
Apache Cocoon – XML Publishing Framework 데이터베이스 연구실 박사 1 학기 이 세영.
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: Sharing MD Objects with Researchers, MDA Service Goals Architecture Overview.
System Design.
VI-SEEM Data Repository
Flexible Extensible Digital Object Repository Architecture
Flexible Extensible Digital Object Repository Architecture
VI-SEEM Data Repository
Complete 1z0-161 Exam Dumps - Pass In 24 Hours - Dumps4download.us
Unified Modeling Language
OBSERVER DATA MANAGEMENT PRINCIPLES AND BEST PRACTICE (Agenda Item 4)
Implementation Plan system integration required for each iteration
Presentation transcript:

Measurement Data Workspace and Archive: Current State and Next Steps GEC15 Oct 2012 Giridhar Manepalli Corporation for National Research Initiatives

Measurement Data Object /A2BE-C Experiment A Run 1 Logs Run 2 Logs Metadata Measurement Data: – A sequence or stream of bytes that correspond to one or more I&M experiments – Could consist of Planning data: scenario documents, source code, etc. Input data: configurations, rspecs, etc. Output data: log files, results, etc. – Captured as file-system directories and files for ease of use /B5A7-D Exp. A & B Exp. A Exp. B Metadata Measurement Data Object = Data + Metadata OR – Data that corresponds to ‘multiple’ related experiments – Data that corresponds to a ‘single’ experiment with one or more ‘runs’ PLUS – Metadata that describes the data object

Measurement Data Flow – Slices to Workspaces Experimenter Y Experimenter X Workspace Key: 1. Experiment Initiated 1 1 Slice 2. Measurement Data Collected = Measurement Data Object 22

Index/Catalog Digital Objects Logical Storage Layer Experiment Run 1 Logs Run 2 Logs Metadata Experiment Run 1 Logs Run 2 Logs Metadata Physical Storage Layer User Accounts SFTP SMBWebLogical Interfaces Physical - Logical Map Workspace Architecture

Measurement Data Flow – Workspaces to Archive Workspace 1 Experimenter Workspace N Experimenters Archive..... Stores Data Registers Handle Handle System

Science Times Article Title Data ID Handle System Use Archive 1.User follows Data ID into the Handle System. 2 2.User is redirected to Data Object stored in the Archive Handle System 1

SUITE OF SERVICES Science Times Article Title Data ID Extended Handle System Use Suite of extensible services end users can leverage by following the ID. Visualization Archive I Agree Terms:… License Enforcement I Agree Terms:… I Agree Terms:… Data Set Dissemination … … …. Data Processing 1.User follows Data ID into the Handle System. 2.User is presented with various Archive Service Options. Handle System 3.User reaches the desired Archive Service. 12 3

Next Steps Consolidate I&M Metadata Schema – Simplify metadata for lowering the entry barrier – Define a serialization schema, e.g., XSD Integrate the Handle System into GENI I&M Archive Identify and define the Archive sustainability plan and usage policies – Who manages it? Who uses it? How to use it? Etc.