Portable Infrastructure for the Metafor Metadata System Charlotte Pascoe 1, Gerry Devine 2 1 NCAS-BADC, 2 NCAS-CMS University of Reading PIMMS provides.

Slides:



Advertisements
Similar presentations
Panel 2 – Promoting Re-Use of Scientific Collections John Harrison SHAMAN Project University of Liverpool
Advertisements

Improving Learning Object Description Mechanisms to Support an Integrated Framework for Ubiquitous Learning Scenarios María Felisa Verdejo Carlos Celorrio.
28 March 2003e-MapScholar: content management system The e-MapScholar Content Management System (CMS) David Medyckyj-Scott Project Director.
What can we do with controlled vocabularies? The PIMMS story Charlotte Pascoe May 11 th 2012, Rutherford Appleton Laboratory.
ESGF and ES-DOC Documenting climate models and their simulations ES-DOC current and future plans Working with ESGF Eric Guilyardi, Balaji, Cecelia DeLuca,
The Documentum Team Lance Callaway, Brooke Durbin, Perry Koob, Lorie McMillin, Jennifer Song Missouri University of Science and Technology Rolla, Missouri.
e-Framework Components and Responsibilities.
Business Process Modeling in Microsoft Visio® Interfacing’s BPMN Modeler: Overview.
PERFORMANCE FOR ALL The Project & the System. A HE project co-ordinated by University of Bristol, open to HE internationally. Developing the requirements.
Content Management System (CMS) - An overview. Project Organisation.
ARCS Data Analysis Software An overview of the ARCS software management plan Michael Aivazis California Institute of Technology ARCS Baseline Review March.
Thee-Framework for Education & Research The e-Framework for Education & Research an Overview TEN Competence, Jan 2007 Bill Olivier,
FREMA: e-Learning Framework Reference Model for Assessment Yvonne Howard David Millard Hugh Davis Gary Wills Lester Gilbert Learning Societies Lab University.
Page 1 Building Reliable Component-based Systems Chapter 18 - A Framework for Integrating Business Applications Chapter 18 A Framework for Integrating.
Understanding of Automation Framework A Storehouse of Vast Knowledge on Software Testing and Quality Assurance.
Domain Modelling the upper levels of the eframework Yvonne Howard Hilary Dexter David Millard Learning Societies LabDistributed Learning, University of.
A Semantic Workflow Mechanism to Realise Experimental Goals and Constraints Edoardo Pignotti, Peter Edwards, Alun Preece, Nick Gotts and Gary Polhill School.
Section 13.1 Add a hit counter to a Web page Identify the limitations of hit counters Describe the information gathered by tracking systems Create a guest.
MDC Open Information Model West Virginia University CS486 Presentation Feb 18, 2000 Lijian Liu (OIM:
DYNAMICS CRM AS AN xRM DEVELOPMENT PLATFORM Jim Novak Solution Architect Celedon Partners, LLC
DoD Architecture Registry System DARS 16 September 2009 Walt Okon Senior Architect Engineer Senior Architect Engineer for Information Sharing Enterprise.
1 Eric Guilyardi and the Metafor team Common Metadata for Climate Modelling Digital Repositories Metafor Dissemination Workshop Abingdon, 14 March 2011.
Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.
CIM – The Common Information Model in Climate Research
M ETADATA OF NATIONAL STATISTICAL OFFICES B ELARUS, R USSIA AND K AZAKHSTAN Miroslava Brchanova, Moscow, October, 2014.
Using IESR Ann Apps MIMAS, The University of Manchester, UK.
NE II NOAA Environmental Software Infrastructure and Interoperability Program Cecelia DeLuca Sylvia Murphy V. Balaji GO-ESSP August 13, 2009 Germany NE.
METADATA QUALITY IN EUROPEANA , Den Haag.
Introduction to MDA (Model Driven Architecture) CYT.
State Records Office of Western Australia.NET Proof of Concept Project Slideshow: Prototype Online Disposal Authority/Recordkeeping Plan System Project.
Call with D. Maraun Statistical Downscaling Controlled Vocabulary 5 DEC 2013.
Making Connections: SHARE and the Open Science Framework Jeffrey Open Repositories 2015.
Scalable Metadata Definition Frameworks Raymond Plante NCSA/NVO Toward an International Virtual Observatory How do we encourage a smooth evolution of metadata.
Metadata and Geographical Information Systems Adrian Moss KINDS project, Manchester Metropolitan University, UK
Interfacing Registry Systems December 2000.
Domain Modeling In FREMA David Millard Yvonne Howard Hugh Davis Gary Wills Lester Gilbert Learning Societies Lab University of Southampton, UK.
A Conceptual Overview Presentation: 60 minutes Q&A: 30 minutes.
Building Applications with the KNS. The History of the KNS KFS spent a large amount of development time up front, using the best talent from each of the.
U.S. Department of Agriculture eGovernment Program Design Approach for usda.gov April 2003.
EPA’s Environmental Terminology System and Services (ETSS) Michael Pendleton Data Standards Branch, EPA/OEI Ecoiformatics Technical Collaborative Indicators.
VO Sandpit, November 2009 CEDA Metadata Steve Donegan/Sam Pepler.
Questionnaire Project Plan Alpha development Beta development Release for CMIP5 approval Production Phase After CMIP5 Questionnaire 01 Jan 2010 – 30 Dec.
InSPIRe Australian initiatives for standardising statistical processes and metadata Simon Wall Australian Bureau of Statistics December
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Sarah Callaghan 1, Eric Guilyardi 2, Charlotte Pascoe 3 and the Metafor Project Team 1 BADC- UK, 2 University of Reading, UK.
The Digital Library for Earth System Science: Contributing resources and collections GCCS Internship Orientation Holly Devaul 19 June 2003.
1 Understanding Cataloging with DLESE Metadata Karon Kelly Katy Ginger Holly Devaul
Domain Modeling In FREMA Yvonne Howard David Millard Hugh Davis Gary Wills Lester Gilbert Learning Societies Lab University of Southampton, UK.
Topic Maps introduction Peter-Paul Kruijsen CTO, Morpheus software ISOC seminar, april 5 th 2005.
Mantid Stakeholder Review Nick Draper 01/11/2007.
Summary PlatformModel Model Components Conformance Files and Variables Model Modification CMIP5 Questionnaire Roadmap – beta1 Inputs Needed Resolve Inputs.
1 Class exercise II: Use Case Implementation Deborah McGuinness and Peter Fox CSCI Week 8, October 20, 2008.
1 Accomplishments. 2 Overview of Accomplishments  Sustaining the Production Earth System Grid Serving the current needs of the climate modeling community.
Sarah Callaghan 1, Gerry Devine 2, Eric Guilyardi 3, Bryan Lawrence 1, Charlotte Pascoe 1, Lois Steenman-Clark 2 and the Metafor Project Team 1 NCAS-BADC;
Earth System Curator and Model Metadata Discovery and Display for CMIP5 Sylvia Murphy and Cecelia Deluca (NOAA/CIRES) Hannah Wilcox (NCAR/CISL) Metafor.
The Modeling Circle Courtesy M. Lautenschlager, DKRZ.
A WEB-ENABLED APPROACH FOR GENERATING DATA PROCESSORS University of Nevada Reno Department of Computer Science & Engineering Jigar Patel Sergiu M. Dascalu.
ESMF and the future of end-to-end modeling Sylvia Murphy National Center for Atmospheric Research
Application of RDF-OWL in the ESG Ontology Sylvia Murphy: Julien Chastang: Luca Cinquini:
Data Management: Data Processing Types of Data Processing at USGS There are several ways to classify Data Processing activities at USGS, and here are some.
Metadata Support for Model Intercomparison Projects Sylvia Murphy: Cecelia DeLuca: Julien.
Developing our Metadata: Technical Considerations & Approach Ray Plante NIST 4/14/16 NMI Registry Workshop BIPM, Paris 1 …don’t worry ;-) or How we concentrate.
A Quick Tour of the NOAA Environmental Software Infrastructure and Interoperability Group Cecelia DeLuca Dr. Robert Detrick visit March 28, 2012
1 The XMSF Profile Overlay to the FEDEP Dr. Katherine L. Morse, SAIC Mr. Robert Lutz, JHU APL
CMIP5 Questionnaire Roadmap – beta
A Web-enabled Approach for generating data processors
IP Publishing From IP Data Base to IP list to IP catalog
Evaluating Compuware OptimalJ as an MDA tool
An ecosystem of contributions
Presentation to SISAI Luxembourg, 12 June 2012
Presentation transcript:

Portable Infrastructure for the Metafor Metadata System Charlotte Pascoe 1, Gerry Devine 2 1 NCAS-BADC, 2 NCAS-CMS University of Reading PIMMS provides institutions with tools to capture information about the workflow of running simulations A python parser processes the XML files generated by the mind maps Python Parser UML overview of the Metafor Common Information Model (CIM). CIM XML documents are used to generate experiment descriptions and conformance pages in the web interface. Django is used to generate the dynamic structure and content of the web based questionnaire from processed xml and the METAFOR Common Information Model (CIM) CMIP5 Questionnaire Screen shot from the CMIP5 model documentation questionnaire showing a metadata entry page for describing the Atmosphere Radiation component of a model. Mind maps are used to capture information requirements from domain experts and build a controlled vocabulary. Mind Maps Definition of component type Radiation required Definition of property name RadiativeTimeStep required Definition of property name SchemeType required Definition of property name Method required Definition of property name NumberOfSpectralIntervals required Django is a high-level Python Web framework which makes it possible to build web applications with minimal code. The CMIP5 questionnaire, on which PIMMS is based, makes much use of Django templates. The templates allow us to separate design, content and Python code. PIMMS provides institutions with tools to capture information about the workflow of running simulations from the design of experiments to the implementation of experiments via simulations running models. PIMMS uses the Metafor methodology for simulation documentation which consists of a common information model (CIM), a set of controlled vocabularies (CV) and software tools. PIMMS software tools provide for the creation and consumption of CIM content via a web infrastructure and portal. PIMMS will: Refactor the Metafor questionnaire for CMIP5 for use in university departments Create a new tool for defining experiments Engage with university community on usage (and CIM content) Connect data holdings at Bristol University and Reading University to Metafor metadata. Promulgate the Metafor approach elsewhere in UK PIMMS will deploy a system for documenting the provenance of computer simulations of real world earth system processes into two university departments: at the University of Bristol and the University of Reading. This system will be a key part of the data management ecosystem for simulation data – without “PIMMS class” information simulation data can become effectively useless very soon after it is created. By extending and repackaging a prototype infrastructure developed by METAFOR and originally deployed to support CMIP5, PIMMS will be able to achieve significant leverage on previous R&D funding to provide a relatively mature system targeted at the university community. Beyond PIMMS Beyond the PIMMS project itself, the eventual goal of the work will be to see the PIMMS system implemented across multiple institutions and extended to support other scientific domains. With PIMMS in place, community based federated data infrastructures which support simulation data reuse, yet are based on institutional data holdings, can become a reality. If you have any comments or questions about PIMMS or the CIM we’d love to hear from you! Further information about the PIMMS project can be found at Information about Metafor and the CIM can be found at The controlled vocabulary captured in the mind map interviews is used to populate drop-down lists in the web interface and the structure of the mind maps generates a navigation tree. The navigation tree shown on the left hand frame of the CMIP5 questionnaire screen shot, allows users to get to any component of the model description. The web interface also allows users to enter descriptions of components which are not covered by the mind maps. The mind map driven sections of the web interface ensure that we collect a standardised set of metadata about each model but if users wish to describe their models in more detail then the web interface is flexible enough to allow them to do it. The key to the customisation of PIMMS is in the modularity of its tools and the clear separation of structure (CIM) from content (CV). The PIMMS project will extend the CMIP5 controlled vocabulary to encompass descriptions of paleoclimate models and will also demonstrate how the CIM can be used to document an Integrated Assessment Model (IAM). This proof of concept prototype will create a new controlled vocabulary in collaboration with the Ermitage project and use it to reconfigure PIMMS to collect metadata in a different discipline. PIMMS will further explore how the CV that is used to configure PIMMS may be of further use to our stake holders and the wider JISC community through the development of the University of Cambridge chemicaltagger tool. PIMMS will provide a local portal so that research groups can view and search their own content, as well as publish their metadata content to institutional, national and international services. In addition PIMMS will also include data node software so that data documented with PIMMS can also be published to the web, both locally, and to national and international services. The initial PIMMS deployment will be based on the controlled vocabularies collected by the Metafor project in support of CMIP5 (5 th Climate Model Intercomparison Project). The CMIP5 controlled vocabularies will be extended to cover paleoclimate simulations by PIMMS partners at the University of Bristol. PIMMS controlled vocabularies are recorded using mind maps. Mind maps not only collate lists of controlled vocabulary, but also provide a structure for the way the information is collected in the PIMMS web interface. PIMMS will provide a local portal so that research groups can view and search their own content, as well as publish their metadata content to institutional, national and international services. PIMMS will also include data node software so that data documented with PIMMS can be published to the web, both locally, and to national and international services.