Metadata Creation and Validation Methods. Writing Metadata.

Slides:



Advertisements
Similar presentations
Training Structure Agenda Metadata Creation Considerations
Advertisements

How to Write Quality Metadata Lesson 8: How to Write Quality Metadata CC image by Sara Bjork on Flickr.
Applications and Tools Jaci Mize NOAA/NESDIS/NODC/NCDDC Rob Dollison USGS.
DAVID M. KROENKE’S DATABASE PROCESSING, 10th Edition © 2006 Pearson Prentice Hall 13-1 COS 346 Day 24.
Tutorial 8: Developing an Excel Application
Writing Metadata. First records are the hardest. Not all fields may need to be filled in. Tools are available. Training classes can be taken. Can often.
SRDC Ltd. 1. Problem  Solutions  Various standardization efforts ◦ Document models addressing a broad range of requirements vs Industry Specific Document.
Transitioning from FGDC CSDGM Metadata to ISO 191** Metadata National Coastal Data Development Center A division of the National Oceanographic Data Center.
National Coastal Data Development Center A division of the National Oceanographic Data Center Please a list of participants at each location to
Oregon Spatial Data Library Partnership Metadata Training OU Knight Library Eugene, Oregon December 3, 2009 Kuuipo Walsh Institute for Natural Resources.
XML Unit 6 October 31. XML, review XML is used to markup data Used to describe information Uses tags like HTML –But all tags are user-defined –Must be.
Customizing Outlook. Forms Window in which you enter and view information in Outlook Outlook Form Designer The environment in which you create and customize.
September 15, 2003Houssam Haitof1 XSL Transformation Houssam Haitof.
Introduction to XML This material is based heavily on the tutorial by the same name at
MEDIN Standards Workshop Standards / XML / Validation / Transformation / ESRI.
National Coastal Data Development Center A division of the National Oceanographic Data Center Please a list of participants at each location to
Technical Workshops | Esri International User Conference San Diego, California Leveraging Metadata Standards in ArcGIS for Interoperability Aleta Vienneau.
National Coastal Data Development Center A division of the National Oceanographic Data Center Please a list of participants at each location to
Introduction to Geospatial Metadata – ISO 191** Metadata National Coastal Data Development Center A division of the National Oceanographic Data Center.
COMPREHENSIVE Excel Tutorial 8 Developing an Excel Application.
National Coastal Data Development Center A division of the National Oceanographic Data Center Please a list of participants at each location to
Introduction to Geospatial Metadata – FGDC CSDGM National Coastal Data Development Center A division of the National Oceanographic Data Center Please .
Transitioning from FGDC CSDGM Metadata to ISO 191** Metadata National Coastal Data Development Center A division of the National Oceanographic Data Center.
Chapter 12 Creating and Using XML Documents HTML5 AND CSS Seventh Edition.
Oy Metadata Content j of Metadata. Discovery Access Understanding Levels of Metadata joy of Metadata Metadata Standards Why standards Which standards.
Metadata Understanding the Value and Importance of Proper Data Documentation Based Heavily on the Virginia Metadata Workshop created by: John McGee The.
XML 1 Enterprise Applications CE00465-M XML. 2 Enterprise Applications CE00465-M XML Overview Extensible Mark-up Language (XML) is a meta-language that.
1 CIS336 Website design, implementation and management (also Semester 2 of CIS219, CIS221 and IT226) Lecture 6 XSLT (Based on Møller and Schwartzbach,
XSLT transforms Mapping from Different Metadata Standards.
 XML is designed to describe data and to focus on what data is. HTML is designed to display data and to focus on how data looks.  XML is created to structure,
Generating Metadata Through ArcCatalog. Metadata Entry Tools There are many different metadata entry tools There are many different metadata entry tools.
2008 EPA and Partners Metadata Training Program: 2008 CAP Project Geospatial Metadata: Introduction Module 2: FGDC CSDGM Metadata Compliancy.
Writing Metadata Working Towards Best Practices. Tips for Writing Metadata First records are the hardest Not all fields may need to be filled in Tools.
Various tools created depending on user needs: Desktop vs. Web Applications GUI vs. XML Tools for Creating and Editing ISO Metadata.
How do I use HTML and XML to present information?.
ECA 228 Internet/Intranet Design I XSLT Example. ECA 228 Internet/Intranet Design I 2 CSS Limitations cannot modify content cannot insert additional text.
10/18/2015 NORTEL NETWORKS CONFIDENTIAL – FOR TRAINING PURPOSES ONLY Global Documentation Evolution System Overview and End-to-End Process Training.
Salt Suite User Guide (Copyright Salt ).
Mind Your Metadata Geri Miller. Metadata in ArcGIS ArcGIS metadata goals Editing metadata Setting your metadata style Leveraging metadata in ArcGIS Importing.
LTER Information Management Training Materials LTER Information Managers Committee Documenting Spatial Data Theresa Valentine Andrews LTER.
Esri UC2013. Technical Workshop. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California Leveraging Metadata.
CSDGM Overview CSDGM Tools and Resources. Resources Series Materials: ftp://ftp.ncddc.noaa.gov/pub/Metadata/Online_ISO_Tr aining/Intro_to_Geospatial_Metadata/
1 Introduction  Extensible Markup Language (XML) –Uses tags to describe the structure of a document –Simplifies the process of sharing information –Extensible.
Part One Review Policy Intro to ISO Levels of Metadata Data Discovery.
MEDIN Standards Workshop Using ESRI ARC 10 to create metadata.
Accessing Data Using XML CHAPTER NINE Matakuliah: T0063 – Pemrograman Visual Tahun: 2009.
U.S. Department of the Interior U.S. Geological Survey Tutorials on Data Management Lesson 3.1: How to Write Quality Metadata CC image by Sara Bjork on.
Tools for Creating and Editing Metadata. Desktop Applications Web Applications Graphical User Interface (GUI) XML editor Standalone Editor Part of Larger.
Introduction to Geospatial Metadata – FGDC CSDGM National Coastal Data Development Center A division of the National Oceanographic Data Center Please .
Transitioning from FGDC CSDGM Metadata to ISO 191** Metadata
ATN GIS Support ArcGIS: ArcCatalog.
Metadata Understanding the Value and Importance of Proper Data Documentation Michael Moeller Metadata Specialist NOAA Coastal Services Center.
MEDIN Standards Workshop Standards / XML / Validation / Transformation / ESRI / Search.
MEDIN Standards Workshop Standards / XML / Validation / Transformation / ESRI / Search.
ArcGIS: ArcCatalog. Agenda The ArcCatalog Interface General ArcCatalog ▫Navigating directories ▫Preview data ▫View metadata Advanced ArcCatalog ▫Modifying.
UML Basics and XML Basics Navigating the ISO Standards.
The MEDIN stylesheet and ESRI Arc 10: metadata format conversion MEDIN Workshop BGS, Edinburgh, June 2015.
ESRI Education User Conference – July 6-8, 2001 ESRI Education User Conference – July 6-8, 2001 Introducing ArcCatalog: Tools for Metadata and Data Management.
Writing Metadata Working Towards Best Practices for SEFSC.
Tools for Creating ISO Metadata National Centers for Environmental Information (NCEI)
Let’s Review Metadata is a document that describes your data’s content, condition, and quality. Metadata is an integral component of your data. Metadata.
CHAPTER NINE Accessing Data Using XML. McGraw Hill/Irwin ©2002 by The McGraw-Hill Companies, Inc. All rights reserved Introduction The eXtensible.
Esri UC2013. Technical Workshop. Technical Workshop 2013 Esri International User Conference July 8–12, 2013 | San Diego, California Working with Metadata.
Chapter 2 Build Your First Project A Step-by-Step Approach 2 Exploring Microsoft Visual Basic 6.0 Copyright © 1999 Prentice-Hall, Inc. By Carlotta Eaton.
How Do You Write Good Metadata? Steps to Quality Metadata Organize information Write your metadata file Review your file Have someone review Revise it.
Validation of Metadata XML files SeaDataNet Training, June 2008 Presented by with contributions from Karen Vickers (BODC) Presented by Michèle Fichaut.
Excel Tutorial 8 Developing an Excel Application
The MEDIN stylesheet and ESRI Arc 10: metadata format conversion
The MEDIN stylesheet and ESRI Arc 10: metadata format conversion
Geospatial Metadata, Standards and Infrastructure
Presentation transcript:

Metadata Creation and Validation Methods

Writing Metadata

I T ’ S NOT SO BAD !! First records are the hardest Not all fields may need to be filled in Tools are available Training classes can be taken Can often be produced automatically Can (and should) be reviewed for updates Tips for Writing Metadata

StepsforwritingqualitymetadataStepsforwritingqualitymetadata Writing Metadata Organize your information Write your metadata file Review your file Have someone else review ReviseRevise PublishPublish Organize your information Write your metadata file Review your file Have someone else review ReviseRevise PublishPublish

Before you begin writing, get organized Document your data as you go Write so others can understand Always review your document Writing Metadata

Metadata entry tool Metadata entry tool coffee chocolate standard and/or workbook ISO editor sense of humour!!!

Write simply but completely Document for a general audience Be consistent in style and terminology Keep your readers in mind

Define all acronyms Avoid using jargon Clearly state data limitations Keep your readers in mind

Write a complete title that includes… What Where When Who Writing Metadata

Which is better? Greater Yellowstone Rivers from 1:126,700 Forest Visitor Maps ( ) The title is critical in helping others find your data.

Vague: We checked our work and it looks complete. Specific: We checked our work using 3 separate sets of check plots reviewed by 2 different people. We determined our work to be 95% complete based on these visual inspections. Be specific. Quantify when you can.

Select your key words wisely Use unambiguous words Use descriptive words Fully qualify geographic locations

Have someone else read it If you’re the only reviewer, put it away and read it again later Check for clarity and omissions Review your final product

Can a novice understand what you wrote? Are your data properly documented for posterity? When you review your work, ask:

Does the documentation present all the information needed to use or reuse the data? Are any pieces missing? When you review your work, ask:

Organize your information Write your metadata file Review your file Have someone else review ReviseRevise PublishPublish Six Steps for Writing Quality Metadata Six Steps for Writing Quality Metadata Writing Metadata

Write so that others will understand

ISO Metadata Creation Methods

Creating ISO Metadata Ways to create ISO metadata 1.Transform from existing FGDC Metadata 2.Develop from templates ftp://ftp.ncddc.noaa.gov/pub/Metadata/Onlin e_ISO_Training/Transition_to_ISO/templates/ 3.Develop from scratch FGDC Metadata Guidance – -metadata-standards

Transform from Existing CSDGM using XSLT Extensible Stylesheet Language Transformations (XSLT) is an XML- based language used for the transformation of XML documents into other XML or "human-readable" documents via stylesheets (XSL). The original document is not changed; rather, a new document is created based on the content of an existing one. It does NOT guarantee valid XML records against a particular schema!!!! (simply displays the content in a new way.)

This is a part of the mapping for FGDC CSDGM to ISO Comments are Best Practices or Questions Transforming Metadata

transform CSDGM ISO Your input here is an xml version of a CSDGM record. XSLT Transformation csdgm2iso19115.xslt Your result is an xml instance of an ISO record. Transforming Metadata

Transforming CSDGM to ISO using XMLSpy Open XMLSpy XML Editor Open FGDC RSE XML file named Metadata to Transform.xml Select “F10” or XSL/Xquery > XSL Transformation from Menu – Select transform – CSDGM to ISO, use csdgm2iso xml – RSE to ISO, use fgdcrse2iso xsl Run transformation Select Text for output view Save as XML

Clue this is FGDC RSE so must use correct transform

Transforming FGDC Metadata using Open XML Editor Open FGDC RSE XML file named Metadata to Transform.xml Set up transformation scenario – one time set up – Name the scenario e.g. as “RSE to ISO ” – Select transform and transformation engine – For RSE to ISO use fgdcrse2iso xsl – Select Saxon-PE or EE transformers) Run transformation

Transforming FGDC Metadata using MERMAid Navigate to record to transform in Record level interface Select “Export” tab Select ISO , and “Produce View” button New window will open Select ISO for Section 5, Entity and Attributes.

Other Transformations ISO to FGDC DIF to ISO FGDC THREDDS netCDF to ISO Various ISO and FGDC views Custom transforms (from databases to metadata standards)

Transforming Metadata

Develop Metadata from Templates../pub/Metadata/Online_ISO_Training/Transition_to_ISO/ templates MDtemplate for ISO MIBiotemplate for ISO with Biological Extensions MItemplate For ISO

Exercise Transforming FGDC CSDGM Metadata to ISO Metadata Exercise ftp://ftp.ncddc.noaa.gov/pub/Metadata/Online_ ISO_Training/Transition_to_ISO/exercises/metad ata2transform.xml

Validating ISO Metadata

Tools for Validation Schemas NameSpaces Schematrons

XML Schemas Defines the structure, content, and some semantics of XML documents Pattern that represents the data’s model and defines the objects, attributes, and relationships Defines the rules for the structure and content of an XML document

Which schema do I use? Use the schema reference at ma.xsd – MD_Metadata root (19115) is found at gmd.xsd – MI_Metadata root ( ) is found at gmi.xsd – FC_FeatureCatalogue root (19110) is found at gfc.xsd Use biological schema set to document biological records (extends either MD or MI Metadata)

insert text insert text xmlns:gmi=“ xmlns:gmd=“ xmlns:gco=" Namespaces These codes are called namespaces. The namespace is a container providing context and rules for items. A definition of a term may change, depending on what namespace is applied.

Validation Tips <gmi:MI_Metadata xmlns:xsi=" xmlns:gmd=" xmlns:gco= “ xmlns:xlink=" xmlns:srv=" xmlns:gml=" xmlns:gsr=" xmlns:gss=" xmlns:gts=" xmlns:gmx=" xmlns:gmi=" xsi:schemaLocation="

Schematrons Used in conjunction with schemas Checks for additional validation that the schema cannot check – Content such as west bounding coordinate is west of the east bounding coordinate Delivers human-readable error messages

Online Validation Help ISO Validation FYI – ide.noaa.gov/wiki/index.php?title=ISO_Validation Validation Error Guidance for both XMLSpy and oXygen – ide.noaa.gov/wiki/index.php?title=Validation_Error_Guidan ce Online Validation –

Exercise Metadata to Fix – ftp://ftp.ncddc.noaa.gov/pub/Metadata/Online_ISO_Tra ining/Transition_to_ISO/exercises/metadata2fix1.xml Open record above in Spy or oXygen Apply correct schema Check namespaces Check validation

questions to