ICAT Schema Current Schema organization What’s there but not yet implemented What could we want in the future 1 ICAT developer workshop, 25-26 August 2009.

Slides:

Advertisements

Similar presentations

October 11, eTTF Status Update Accomplishments Open Issues Planned Activities.

Advertisements

Shoaib Sufi CCLRC e-Science Centre CCLRC Scientific Metadata (CSMD) Model April 2004 NESC.

Towards an information model for I2S2

I2S2 - Infrastructure for Integration in Structural Sciences Cross-Institutional Pilot

I2S2 - Infrastructure for Integration in Structural Sciences Information Model Development Workshop RAL 11 th February 2010

Metadata and the UK Data Archive CESSDA Expert Seminar Odense September 2008 Margaret Ward Lenin Ageer.

ICAT + Information Model Brian Matthews Scientific Information Group E-Science Centre STFC Rutherford Appleton Laboratory

PaN-data WP7 - Integration Brian Matthews STFC-e-Science.

Visibility Information Exchange Web System. Source Data Import Source Data Validation Database Rules Program Logic Storage RetrievalPresentation AnalysisInterpretation.

ICAT Integration at DLS. Alun Ashton. What were the requirements? Integrate with current business system Collect Data and Metadata relating to a proposal.

Data Catalogue Service Work Package 4. Main Objective: Deployment, Operation and Evaluation of a cataloguing service for scientific data. Why: Potential.

Best Practices for Website Design & Web Content Management.

NOAA Metadata Update Ted Habermann. NOAA EDMC Documentation Directive This Procedural Directive establishes 1) a metadata content standard (International.

Data Ingest Automation GHRC Status and Plans Helen Conover GHRC DAAC Operations Manager Presented at ESIP Summer Meeting 2015.

Implementing Digital Object Identifiers at the GESIS Data Archive for the Social Sciences Workshop “Persistent Identifiers for the Social Sciences” Bonn,

M. Lautenschlager (M&D/MPIM)1 The CERA Database Michael Lautenschlager Modelle und Daten Max-Planck-Institut für Meteorologie Workshop "Definition.

1 EDMS 101 Speaker: Monica Crocker, DHS EDMS Coordinator Overview of current project(s) Objective of this section: This session outlines EDMS fundamentals.

Best Practices for ADL Registry Metadata Thursday, August 29, 2007 Nina Pasini Deibler Joint ADL Co-Lab.

Database Technical Session By: Prof. Adarsh Patel.

Chapter 9 Scripting RMAN. Background Authors felt that scripting was a topic not covered well Authors wanted to cover both Unix/Linux and Windows environments.

Integrated e-Infrastructure for Scientific Facilities Kerstin Kleese van Dam STFC- e-Science Centre Daresbury Laboratory

Metadata for Large Science: The ICAT Data Model Brian Matthews, Leader, Scientific Applications Group, E-Science Centre, STFC Rutherford Appleton Laboratory.

F. Toussaint (WDCC, Hamburg) / / 1 CERA : Data Structure and User Interface Frank Toussaint Michael Lautenschlager World Data Center for Climate.

The HDF Group Virtual Object Layer in HDF5 Exploring new HDF5 concepts May 30-31, 2012HDF5 Workshop at PSI 1.

Context and Linking in the Research Lifecycle CERIF and other standards Catherine Jones Scientific Information Group Scientific Computing Department STFC.

M.Lautenschlager (WDCC, Hamburg) / / 1 Semantic Data Management for Organising Terabyte Data Archives Michael Lautenschlager World Data Center.

1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.

Managing the Impacts of Change on Archiving Research Data A Presentation for “International Workshop on Strategies for Preservation of and Open Access.

Your Poster Title Here Your name here, and names of others Place the name of your institution here Your Poster Title Here Your name here, and names of.

WP5 – Virtual Laboratories. WP5 Deliverables  D5.1: Specific requirements for the virtual laboratories M6  D5.2: Deployment of Specification of the.

Metadata Mòrag Burgon-Lyon University of Glasgow.

Create Content Capture Content Review Content Edit Content Version Content Version Content Translate Content Translate Content Format Content Transform.

Metadata for structural science Workshop on research metadata in context Nijmegen, 7–8 September 2010 Simon Lambert STFC e-Science UK.

IDigBio is funded by a grant from the National Science Foundation’s Advancing Digitization of Biodiversity Collections Program (Cooperative Agreement EF ).

Overview and Motivation of the ICAT Software Suite Kerstin Kleese van Dam.

TopCAT Use Cases Priorities User Interface 1 ICAT developer workshop, August 2009 Laurent Lerusse – STFC

Monte-Carlo Event Database: current status Sergey Belov, JINR, Dubna.

Managing Enterprise GIS Geodatabases

Barry Weiss 1/4/ Jet Propulsion Laboratory, California Institute of Technology Quality Elements in ISO Metadata Design for Proposed SMAP Data.

GEM METADATA DEVELOPMENT Xiaoping Wang, Macrosearch Allen Macklin, PMEL and Bernard Megrey, AFSC.

ESG-CET Meeting, Boulder, CO, April 2008 Gateway Implementation 4/30/2008.

Using the ICAT API to ingest business and experiment metadata Tom Griffin, STFC ISIS Facility NOBUGS 2012 ICAT Workshop

HUBzero® Platform for Scientific Collaboration Copyright © 2012 HUBzero Foundation, LLC Collaboration and Contribution Emily Kayser Hub Liaison, HUBzero®

AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.

ICAT Integration at ISIS Tom Griffin, ISIS Facility ICAT Developer Workshop The Cosener’s House, Abingdon August 2009

PERMISSION ANALYZER 2 Reports NTFS permissions from the file system combined with user and group data from the Active Directory.

AliRoot Classes for access to Calibration and Alignment objects Magali Gruwé CERN PH/AIP ALICE Offline Meeting February 17 th 2005 To be presented to detector.

Excel Services Displays all or parts of interactive Excel worksheets in the browser –Excel “publish” feature with optional parameters defined in worksheet.

The Virtual Observatory and Ecological Informatics System (VOEIS): Using RESTful architecture and an extensible data model to provide a unique data management.

External Data Access 5/29/08. Current Problems No way to load, process & analyze live Atlas data via critical analysis & programming tools (SAS, R, Perl)

1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.

CRISP WP 17 1 / 2 Proposed Metadata Catalogue Architecture Document.

User Domain Storage Elements SURL  TURL LFC Domain (LCG File Catalogue) SA1 – Data Grid Interoperation Enabling Grids for E-sciencE EGEE-III INFSO-RI

E-infrastructure requirements from the ESFRI Physics, Astronomy and Analytical Facilities cluster Provisional material based on outcome of workshop held.

PROV NETWORK MEETING Linda Tolson, Corporate Records Manager 6 May, 2016.

Developing our Metadata: Technical Considerations & Approach Ray Plante NIST 4/14/16 NMI Registry Workshop BIPM, Paris 1 …don’t worry ;-) or How we concentrate.

WaM-DaM: A Data Model to Synthesize and Organize Water Management Data 1 EWRI CONGRESS June 4, 2014 Adel M. Abdallah David E. Rosenberg.

Database Principles: Fundamentals of Design, Implementation, and Management Chapter 1 The Database Approach.

ICAT- Experience and activities at ISIS

Experimental Definition in SynchWeb for XPDF

Data Management: Documentation & Metadata

Scientific Data Management with MXCuBE

خشنه اتره اهورهه مزدا شيوۀ ارائه مقاله 17/10/1388.

Metadata The metadata contains

DATABASES WHAT IS A DATABASE?

Proposal of a Geographic Metadata Profile for WISE

Stuart Pullinger 24th January 2018

Reportnet 3.0 Database Feasibility Study – Approach

Presentation transcript:

ICAT Schema Current Schema organization What’s there but not yet implemented What could we want in the future 1 ICAT developer workshop, August 2009 Laurent Lerusse – STFC

ICAT Schema 2

Proposal Metadata Catalogue Information Experiment Secure Storage Data Analysis Publication E-Pubs Proposal System Data Acquisition System Data and Metadata Capture is automated. Integrated e-Infrastructure

Experiment 4 What is it all about? Title Abstract Full proposal Publications Who will participate? What will be studied? Sample information Safety information A Proposal Publication Investigator Keywords Topics Sample Sample parameters Investigation visits Investigation

Only one Sample in a DataSet. No other fixed rules. Examples 1 DataSet / Investigation 1 DataSet / Sample 1 DataSet / Scan How will the data be analyzed? Has the configuration changed? Authorization is at this level. The DataSet level is where you organize your experiment. Experiment Sample Sample parameters Investigation DataSet DataSet parameters DataSet

Data Capture 6 Could point to a specific entry in a neXµs file. Hold a URL to the data. Sample Sample parameters Investigation DataSet DataFile DataFile parameters DataSet parameters Parameter A parameter table keeps the description of sample/dataset/datafile parameters

Larger View 7 Investigation Sample Sample Data Simulations DataSet DataFile Reduced Data Analyzed Data DataSet DataFile Raw Data DataSet DataFile Study Investigation Not yet implemented Related DataFiles Not yet implemented Study

Many to Many relation between Investigation and DataSet/Sample Read-only Investigation for facility. Read-write for user (better metadata) Can define a’ Reference data Investigation’ Sharing data Virtual experiment combining data from multiple visits. Is it useful? Development Cost? Performance? Multiplication of Investigation. Future Development Investigation Sample A Published Investigation DataSet 2 DataSet 1 Sample B

Future Development 9 Investigation Sample Reduced Data Analyzed Data DataSet DataFile Raw Data DataSet DataFile Many to Many relation between DataSet and DataFile Reorganize your data. Sharing specific data. More metadata. Is it useful? Development Cost? Performance? How to make sure that we don’t analyze twice the same data? Sample description (ISPyB). Analysis description. Others?

Comments and Questions 10 ICAT schema is the foundation of the ICAT system. Careful evaluation is needed before any change. Migration path has to be defined. More on governance tomorrow. Jdeveloper project included in icatproject

Integration via Metadata 11 Data Store Data Data Store Data Experiment Data Analysis Simulation Data