A Practical Approach to Metadata Management Mark Jessop Prof. Jim Austin University of York.

Slides:

Advertisements

Similar presentations

Panel 2 – Promoting Re-Use of Scientific Collections John Harrison SHAMAN Project University of Liverpool

Advertisements

The Seven Pillars of Open Language Archiving: A Vision Statement Gary Simons and Steven Bird Workshop on Web-based Language Documentation and Description.

Improving Learning Object Description Mechanisms to Support an Integrated Framework for Ubiquitous Learning Scenarios María Felisa Verdejo Carlos Celorrio.

Smart Qualitative Data: Methods and Community Tools for Data Mark-Up SQUAD Libby Bishop Online Qualitative Data Resources: Best Practice in Metadata Creation.

CVRG Presenter Disclosure Information Tahsin Kurc, PhD Center for Comprehensive Informatics Emory University CardioVascular Research Grid Core Infrastructure.

Metadata at ICPSR Sanda Ionescu, ICPSR.

The Documentum Team Lance Callaway, Brooke Durbin, Perry Koob, Lorie McMillin, Jennifer Song Missouri University of Science and Technology Rolla, Missouri.

The design and implementation of the Neurophysiology Data translation Format (NDF) Developed by Bojian Liang, Martyn Fletcher, Jim Austin. Advanced Computer.

1 Richard White Design decisions: architecture 1 July 2005 BiodiversityWorld Grid Workshop NeSC, Edinburgh, 30 June - 1 July 2005 Design decisions: architecture.

1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.

Introduction to Web services MSc on Bioinformatics for Health Sciences May 2006 Arnaud Kerhornou Iván Párraga García INB.

A New Computing Paradigm. Overview of Web Services Over 66 percent of respondents to a 2001 InfoWorld magazine poll agreed that "Web services are likely.

Please Describe Data ingestion. This includes support for real-time sensor data (object ring buffers) as well as simulation output (grid portals) –We have.

Deployment and Evaluation of an Observations Data Model Jeffery S Horsburgh David G Tarboton Ilya Zaslavsky David R. Maidment David Valentine

A Data Curation Application Using DDI: The DAMES Data Curation Tool for Organising Specialist Social Science Data Resources Simon Jones*, Guy Warner*,

Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.

Web service testing Group D5. What are Web Services? XML is the basis for Web services Web services are application components Web services communicate.

Methods for Data Discovery – Portals Portal facilitates access to and also assimilation of data Portal is not simply a web site: it offers services such.

MDC Open Information Model West Virginia University CS486 Presentation Feb 18, 2000 Lijian Liu (OIM:

QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.

Špindlerův Mlýn, Czech Republic, SOFSEM Semantically-aided Data-aware Service Workflow Composition Ondrej Habala, Marek Paralič,

Discussion and conclusion The OGC SOS describes a global standard for storing and recalling sensor data and the associated metadata. The standard covers.

XForms: A case study Rajiv Shivane & Pavitar Singh.

1 Yolanda Gil Information Sciences InstituteJanuary 10, 2010 Requirements for caBIG Infrastructure to Support Semantic Workflows Yolanda.

The Earth System Curator Metadata Representations Prototype Portal in Collaboration with ESMF and ESG Rocky Dunlap Spencer Rugaber Georgia Tech.

Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski

Sept 19,  Provides a common set of terminology and definitions  A framework for describing resources and processes  Enables computer based interoperability.

QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.

Distributed Aircraft Maintenance Environment - DAME DAME Workflow Advisor Max Ong University of Sheffield.

1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.

Design of a Search Engine for Metadata Search Based on Metalogy Ing-Xiang Chen, Che-Min Chen,and Cheng-Zen Yang Dept. of Computer Engineering and Science.

Application portlets within the PROGRESS HPC Portal Michał Kosiedowski

Options for Managing CARMA Databases Prepared by David Taylor Taylor Geomatics.

CBSOR,Indian Statistical Institute 30th March 07, ISI,Kokata 1 Digital Repository support for Consortium Dr. Devika P. Madalli Documentation Research &

The DAME project Professor Jim Austin University of York.

The Functional Genomics Experiment Object Model (FuGE) Andrew Jones, School of Computer Science, University of Manchester MGED Society.

Large Scale Nuclear Physics Calculations in a Workflow Environment and Data Provenance Capturing Fang Liu and Masha Sosonkina Scalable Computing Lab, USDOE.

NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.

Technology behind using Taverna in caGrid caGrid user meeting Stian Soiland-Reyes, myGrid University of Manchester, UK

ACGT: Open Grid Services for Improving Medical Knowledge Discovery Stelios G. Sfakianakis, FORTH.

FuGE: A framework for developing standards for functional genomics Andrew Jones School of Computer Science, University of Manchester Metabomeeting 2.0.

INFSO-RI Enabling Grids for E-sciencE A service oriented framework to create, manage and update metadata for earth system science.

The International Virtual Observatory Alliance (IVOA) interoperability in action.

Domain Modeling In FREMA Yvonne Howard David Millard Hugh Davis Gary Wills Lester Gilbert Learning Societies Lab University of Southampton, UK.

1 Service Creation, Advertisement and Discovery Including caCORE SDK and ISO21090 William Stephens Operations Manager caGrid Knowledge Center February.

Children’s Health Exposure Analysis Resource (CHEAR) CHEAR Center for Data Science Susan Teitelbaum, PhD November 4, 2015.

Sharing the knowledge of electrophysiology data Phillip Lord, Frank Gibson and the CARMEN Consortium.

Data Integration in Bioinformatics Using OGSA-DAI The BioDA Project Shirley Crompton, Brian Matthews (CCLRC) Alex Gray, Andrew Jones, Richard White (Cardiff.

U.S. Environmental Protection Agency Central Data Exchange Pilot Project Promoting Geospatial Data Exchange Between EPA and State Partners. April 25, 2007.

Mike Hildreth DASPOS Update Mike Hildreth representing the DASPOS project 1.

11 Researcher practice in data management Margaret Henty.

AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.

An introduction to the MEDIN Discovery Metadata Standard.

Partnerships in Innovation: Serving a Networked Nation Grid Technologies: Foundations for Preservation Environments Portals for managing user interactions.

XMC Cat: An Adaptive Catalog for Scientific Metadata Scott Jensen and Beth Plale School of Informatics and Computing Indiana University-Bloomington Current.

Application Web Service Toolkit Allow users to quickly add new applications GGF5 Edinburgh Geoffrey Fox, Marlon Pierce, Ozgur Balsoy Indiana University.

ECHO Technical Interchange Meeting 2013 Timothy Goff 1 Raytheon EED Program | ECHO Technical Interchange 2013.

InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.

International Planetary Data Alliance Registry Project Update September 16, 2011.

The Earth System Curator Metadata Infrastructure for Climate Modeling Rocky Dunlap Georgia Tech.

A Semi-Automated Digital Preservation System based on Semantic Web Services Jane Hunter Sharmin Choudhury DSTC PTY LTD, Brisbane, Australia Slides by Ananta.

IPDA Registry Definitions Project Dan Crichton Pedro Osuna Alain Sarkissian.

Pasquale Pagano (CNR-ISTI) Project technical director

Web Ontology Language for Service (OWL-S)

Grid Metadata Management

Web services, WSDL, SOAP and UDDI

Code Analysis, Repository and Modelling for e-Neuroscience

Code Analysis, Repository and Modelling for e-Neuroscience

Australian and New Zealand Metadata Working Group

Presentation transcript:

A Practical Approach to Metadata Management Mark Jessop Prof. Jim Austin University of York

Introduction Follow on from DAME/Broaden (York) Neuroscience Domain Aims to promote collaboration and enable sharing of resources: Data, Analysis Online Portal to store Data, Analysis Code, Experimental protocols. Current deployment: Upload and annotate experimental data and apply security, search across data, analyse with services, share and download. Working on workflows and a common data format.

e - Neuroscience Neuroscience at start of e- science journey. Proprietary data formats. Private Local data. Primitive data annotation (Metadata). Desktop tools. x x x x x A B A: Neuro-Scientists B: Computer-Scientists

Metadata Metadata is essential to allow resource discovery, interpretation, evaluation and re-use. Resources (Data, Services, Workflows) must be adequately annotated. Metadata needs to searchable. Metadata needs to be viewable!

Managing Metadata Comprehensive Metadata definition provided for each resource type. Electrophysiology data described by the MINI. –Based on FuGE object model (Materials, Data, Protocols). Services described by MIAOWS.

Metadata Systems Symba data archive tool integrated into CARMEN. –Implements FuGE-OM. –Early in development program. User trials revealed problems. –Form complexity. –Response times.

Metadata Systems Take 2 Revisit Requirements –Capture Mini Schema. –Must be responsive. –Must be simple to use. –Must be able to re-use metadata. System built based on forms. Generic metadata storage. Search across schemas.

Implementation Form/Schema designer generates XML description of forms and schema. XML schema stored in a database. Portal requests XML which is used to generate input forms or to display existing metadata.

Were we Successful? Some users complete the full document. Some users complete enough to facilitate searching. Templates are widely used. Many users re-use complete templates resulting in repeated metadata.

Metadata for Services Combine WSDL and user metadata to describe services. Generate invocation forms from metadata. –Default parameters. –Validation. Search on function. Metadata applied to Service output. –Provenance. –Re-use.

Future Work Ontologies. Organisation of metadata – prevent repeats. Smarter templates. Ways to encourage completion of full metadata.

CARMEN Consortium Demos on White Rose Grid Stand 15:00.