NOAA National Coastal Data Development Center Writing FGDC Compliant Metadata Introduction to Geospatial Metadata

Metadata 101 What is Metadata? Why is it Important?

Metadata is information about data Metadata is information about data What is Metadata?

Metadata functions documentation management discovery access use Metadata functions documentation management discovery access use Who, What, Where, When, Why, and How What is Metadata?

Who Who collected the data? Who processed the data? Who wrote the metadata? Who to contact for questions? Who to contact to order? Who owns the data? Who Who collected the data? Who processed the data? Who wrote the metadata? Who to contact for questions? Who to contact to order? Who owns the data? Where Where were the data collected? Where were the data processed? Where are the data located? Where Where were the data collected? Where were the data processed? Where are the data located? What What are the data about? What project were they collected under? What are the constraints on their use? What is the quality? What are appropriate uses? What parameters were measured? What format are the data in? What What are the data about? What project were they collected under? What are the constraints on their use? What is the quality? What are appropriate uses? What parameters were measured? What format are the data in? When When were the data collected? When were the data processed? When When were the data collected? When were the data processed? How How were the data collected? How were the data processed? How do I access the data? How do I order the data? How much do the data cost? How was the quality assessed? How How were the data collected? How were the data processed? How do I access the data? How do I order the data? How much do the data cost? How was the quality assessed? Why Why were the data collected? Why Why were the data collected? What is Metadata?

We often use metadata without even knowing it. Examples? What is Metadata?

This is the metadata for this. What’s Missing? What is Metadata?

Author(s) Boullosa, Carmen. Title(s) They're cows, we're pigs / by Carmen Boullosa Place New York : Grove Press, Physical Descr viii, 180 p ; 22 cm. Subject(s) Pirates Caribbean Area Fiction. Format Fiction Author(s) Boullosa, Carmen. Title(s) They're cows, we're pigs / by Carmen Boullosa Place New York : Grove Press, Physical Descr viii, 180 p ; 22 cm. Subject(s) Pirates Caribbean Area Fiction. Format Fiction While the card-catalog entry is a form of metadata, it does not address topics such as quality, accuracy, or scale. Well-written geospatial metadata describes these and many more aspects of the data. What is Metadata? This is the metadata for this.

Identification_Information Citation Citation_Information Originator: NOAA Coastal Services Center Publication_Date: Title: Hurricane Storm Surge Geospatial_Data_Presentation_Form: Map Publication_Information Publication_Place: Charleston, SC Publisher: NOAA Coastal Services Center Larger_Work_Citation Citation_Information Identification_Information Citation Citation_Information Originator: NOAA Coastal Services Center Publication_Date: Title: Hurricane Storm Surge Geospatial_Data_Presentation_Form: Map Publication_Information Publication_Place: Charleston, SC Publisher: NOAA Coastal Services Center Larger_Work_Citation Citation_Information What is Metadata? This is the metadata for this.

Metadata contains vital information Without a label, how would you know which one to open? Dog Food? Ravioli? Imagine being given two identical cans. Your task is to choose one to eat. But here’s the catch. Neither can has a label. Which would you choose?

Metadata as a Component of Data

Properly documented data provides vital information to interested parties. A Component of Data

A published map contains elements of metadata… Publisher Publication date Type of map Title / Description Spatial references Scale and accuracy Sources Legend A Component of Data

Metadata is that component of data which describes it. Environmental Sensitivity Index Data Metadata RARNUM - unique combination of species, concentration, and seasonality CONC (concentration) = Density species is found at location Season_ID = seasonality code like to the seasonal table Element - Biology group A Component of Data

Metadata describes… CONTENT CONDITION QUALITY CONTENT CONDITION QUALITY Characteristics of the data A Component of Data

Because metadata provides vital information about a dataset, it should never be viewed or treated as a separate entity. Metadata is a critical component of a complete data set. Metadata is a critical component of a complete data set. A Component of Data

Metadata should be updated to reflect changes in the data 1980 HEW Teheran British Honduras Cape Hatteras Light Mt. St. Helen West Germany 2005 HHS & HUD Tehran Belize Cape Hatteras Light Mt. St. Helen Germany

The Value of Metadata The Value of Metadata (Why Metadata?)

Properly documenting a data set is the key to preserving its usefulness through time.

Standardized Metadata at a Glance Standardized Metadata at a Glance Establishing the FGDC Standard

Metadata - Documentation of geospatial data written in a consistent manner FGDC - Federal Geographic Data Committee CSDGM - Content Standard for Digital Geospatial Metadata, referred to commonly as “The Standard ” or “The Content Standard ” Clearinghouse - A distributed catalog of metadata Geospatial - refers to a geographic location Metadata - Documentation of geospatial data written in a consistent manner FGDC - Federal Geographic Data Committee CSDGM - Content Standard for Digital Geospatial Metadata, referred to commonly as “The Standard ” or “The Content Standard ” Clearinghouse - A distributed catalog of metadata Geospatial - refers to a geographic location Some Terms We Will be Using

The Federal Geographic Data Committee (FGDC) was organized in 1990 under the Office of Management and Budget to promote the coordinated use, sharing, and dissemination of geospatial data on a national basis. The FGDC was tasked with creating a metadata standard to meet these objectives. The Federal Geographic Data Committee (FGDC) was organized in 1990 under the Office of Management and Budget to promote the coordinated use, sharing, and dissemination of geospatial data on a national basis. The FGDC was tasked with creating a metadata standard to meet these objectives. The Metadata Standard Establishing the Standard

"... each agency shall document all new geospatial data it collects or produces, either directly or indirectly, using the standard under development by the FGDC, and make that standardized documentation electronically accessible to the Clearinghouse network." The Content Standard for Digital Geospatial Metadata (CSDGM) Executive Order 12906, signed by President Clinton in Executive Order 12906, signed by President Clinton in Establishing the Standard

The Content Standard helps the user determine... The Content Standard helps the user determine... If a set of geospatial data is available and fit for a particular use How to access and transfer the data set If a set of geospatial data is available and fit for a particular use How to access and transfer the data set Establishing the Standard

The Content Standard utilizes... Common terms Common definition Common language Common structure The Content Standard utilizes... Common terms Common definition Common language Common structure Access constraints Citation currentness entity attribute domain lineage Process step Establishing the Standard

The Content Standard… Establishes names of compound elements and data elements Defines the information about the values that are to be provided for the data elements The Content Standard… Establishes names of compound elements and data elements Defines the information about the values that are to be provided for the data elements Type=“free text” Domain=Real currentness entity attribute Citation lineage Establishing the Standard

This “Content Standard” serves as a uniform summary description of the data set. This “Content Standard” serves as a uniform summary description of the data set. Establishing the Standard

Who Who collected the data? Who processed the data? Who wrote the metadata? Who to contact for questions? Who to contact to order? Who owns the data? Who Who collected the data? Who processed the data? Who wrote the metadata? Who to contact for questions? Who to contact to order? Who owns the data? Where Where were the data collected? Where were the data processed? Where are the data located? Where Where were the data collected? Where were the data processed? Where are the data located? What What are the data about? What project were they collected under? What are the constraints on their use? What is the quality? What are appropriate uses? What parameters were measured? What format are the data in? What What are the data about? What project were they collected under? What are the constraints on their use? What is the quality? What are appropriate uses? What parameters were measured? What format are the data in? When When were the data collected? When were the data processed? When When were the data collected? When were the data processed? How How were the data collected? How were the data processed? How do I access the data? How do I order the data? How much do the data cost? How was the quality assessed? How How were the data collected? How were the data processed? How do I access the data? How do I order the data? How much do the data cost? How was the quality assessed? Why Why were the data collected? Why Why were the data collected? Metadata written using the Content Standard answers these important questions: Establishing the Standard

What does a metadata record look like? What does a metadata record look like?

A Sample Metadata Record – Text Version

A Sample Metadata Record – HTML Version

A Sample Metadata Record – XML Version

The FGDC Workbook Organization and Content The FGDC Workbook Organization and Content

FGDC’s Metadata Workbook FGDC’s Metadata Workbook Parallels the Standard Defines 334 available metadata elements Parallels the Standard Defines 334 available metadata elements

A resource for applying the FGDC Content Standard Uses a Graphical Representation of the Production Rules Describes domain values (valid values that can be assigned to the data element) Describes domain values (valid values that can be assigned to the data element) Provides section and element definitions Using the Workbook

The Workbook uses graphics to illustrate the production rules of the standard. The graphics include most of the information provided by the production rules: The Workbook uses graphics to illustrate the production rules of the standard. The graphics include most of the information provided by the production rules: How elements are grouped What is mandatory and what is not What elements can repeat and how many times they can repeat How elements are grouped What is mandatory and what is not What elements can repeat and how many times they can repeat Using the Graphical Representation

Section Sections are depicted by this symbol Compound Element Compound elements are depicted using a 2-dimensional box Data Element Data elements are depicted using a 3-dimensional box with shadow Using the Graphical Representation

A section is composed of groups of data elements or other compound elements that describe that particular section. There are 7 main Sections Identification InformationIdentification Information Data Quality InformationData Quality Information Spatial Organization InformationSpatial Organization Information Spatial Reference InformationSpatial Reference Information Entity and Attribute InformationEntity and Attribute Information Distribution InformationDistribution Information Metadata Reference InformationMetadata Reference Information And 3 supporting Sections Citation Information Citation Information Time Period Information Time Period Information Contact Information Contact Information Section Using the Graphical Representation

A compound element is group of data elements or other compound elements. The form for the definition of a compound element is: Compound element name -- definition. Type: compound An example of a definition of a compound element is: Description - characterization of the data set, including its intended use and limitations Type: compound Compound Element Using the Graphical Representation

Data Element A data element is a logically primitive item of data. Data elements are the things that you “fill in.” The form for the definition of a data element is: Data element name -- definition. Type: (choice of “integer”, “real”, “text”, “date”, or “time”) Domain: (describes valid values that can be assigned) An example of the definition of a data element is: Abstract – a brief narrative of the data set. Type: text Domain: free text Using the Graphical Representation

Compound Element 1 Compound Element 1.1 Data Element Data Element Data Element 1.2 Compound elements are composed of other compound and data elements. The composition is represented by nested boxes. Using the Graphical Representation

Mandatory - must be provided. Meaning Data Element Compound Element What’s Mandatory? What’s Not? Mandatory if Applicable - must be provided if the data set exhibits the defined characteristic. Optional - provided at the discretion of the data set producer. Using the Graphical Representation

Using the Graphics to Make Decisions All elements are colored yellow, so all are mandatory and must be filled in. Compound Element 1 Compound Element 1.1 Data Element Data Element Data Element 1.2 Using the Graphical Representation

Compound Element 1 is mandatory if applicable. If not applicable to the data set, do not report any elements. If applicable, it is mandatory and: Compound Element 1.1 is mandatory. Data Element is mandatory if applicable. If not applicable, do not report it. If applicable, it is mandatory. Data Element is mandatory. Data Element 1.2 is optional. Compound Element 1 Compound Element 1.1 Data Element Data Element Data Element 1.2 Using the Graphical Representation

Content Standards for Digital Geospatial Metadata Mandatory Legend Identification Information Data Quality Information Spatial Data Organization Information Spatial Reference Information Entity and Attribute Information Metadata Reference Information Distribution Information Metadata Mandatory If Applicable

Section 8 Citation Information Section 10 Contact Information Section 9 Time Period Information MM / AO

Tailoring Metadata Fine Tuning your metadata for your data needs.

Key Concepts Be able to identify which extension or profile best fits dataset Identify discipline specific thesauri Be able to identify which extension or profile best fits dataset Identify discipline specific thesauri

Why Tailor? Dataset specific Organization or Community guidelines Publishing or harvesting purposes Dataset specific Organization or Community guidelines Publishing or harvesting purposes

What if the dataset is not accurately described by the FGDC CSDGM?

Extensions Extensions are used when some data does not fit into a particular section Example of extensions: Remote Sensing Extensions that includes metadata describing the sensor, platform, the information need to determine the geographical location, and the method and process of deriving geospatial information from the raw telemetry Extensions are used when some data does not fit into a particular section Example of extensions: Remote Sensing Extensions that includes metadata describing the sensor, platform, the information need to determine the geographical location, and the method and process of deriving geospatial information from the raw telemetry What are Extensions?

Profiles Profiles extend the base standard by adding metadata elements to meet their specific community metadata requirements Examples of profiles: Biological profile Shoreline data profile Profiles extend the base standard by adding metadata elements to meet their specific community metadata requirements Examples of profiles: Biological profile Shoreline data profile

Remote Sensing Extensions

Remote Sensing Extension Remote Sensing Extension

Biological Profile Objective is to increase the FGDC CSDGM utility for documenting biological resources data and information Helps broaden the understanding and implementation of the FGDC metadata content standard within the biological resources community Objective is to increase the FGDC CSDGM utility for documenting biological resources data and information Helps broaden the understanding and implementation of the FGDC metadata content standard within the biological resources community

Biological Profile

Biological Profile element Biological Profile element

Shoreline Profile

Ecological Metadata Language (EML) Metadata specification developed by the ecology discipline for the ecology discipline

Different Standards

Other Standards These other standards can often be “mapped” or used with a “crosswalk” to compare to FGDC data Examples Marc21 DCMI ISO These other standards can often be “mapped” or used with a “crosswalk” to compare to FGDC data Examples Marc21 DCMI ISO

Review Know your dataset Know your needs Know your options Thesauri Extensions Profiles Know your dataset Know your needs Know your options Thesauri Extensions Profiles

Metadata Enterprise Resource Management Aid (MERMAid) Metadata Enterprise Resource Management Aid (MERMAid)

Developed at NCDDC, MERMAid uses the framework of NCDDC’s web application server, the Z-Object Publishing Environment (ZOPE) Open-source leverages outside resources freely distributable Platform independent Utilizes an object-oriented database available in ZOPE Offers secure, remote access through a web browser ( Developed at NCDDC, MERMAid uses the framework of NCDDC’s web application server, the Z-Object Publishing Environment (ZOPE) Open-source leverages outside resources freely distributable Platform independent Utilizes an object-oriented database available in ZOPE Offers secure, remote access through a web browser ( Metadata Enterprise Resource Management Aid (MERMAid) Technical Elements Metadata Enterprise Resource Management Aid (MERMAid) Technical Elements

Enables the Metadata provider to: Organize metadata - Establish unlimited metadata databases - Group records as needed (by program, project, data type, personnel …) Regulate workflow - Establish manager & custodian roles & permissions (at the resource, data source and/or database level) - Monitor record status Store supplemental information associated with a record or data set (documents, correspondence,…) Metadata Enterprise Resource Management Aid (MERMAid) Management Features

Generates FGDC Standard, Biological, Shoreline, Remote Sensing Profile Records Supports Ecological Metadata Language (EML) Enhanced validation / continuous validation Import existing FGDC records in XML or TXT format Export records in XML, TXT, HTML, or MARC XML via “save as” Robust “Help” functions Contents of records stored as generic objects in OODB Metadata Enterprise Resource Management Aid (MERMAid) Capabilities

Implement record version control capabilities - Multiple persons, same record - Multiple versions of same record Integrate Contact databases - Contact Manager Direct access to controlled vocabulary databases - Keyword Manager Integration with other metadata repositories Metadata Enterprise Resource Management Aid (MERMAid) Continuing Development

Automate translation from FGDC to other standards - ISO, DIF, Dublin Core Import / Export records in “batch” mode (“harvesting”) Evaluate need for various custom extensions - NOAA Server, ESRI, … Metadata Enterprise Resource Management Aid (MERMAid) Continuing Development

You are given an account at this level You need to create a Data Source You need to create a Database You may now start creating records Record 1 Resource Store (training) Resource Folder (Resource00) Data Source (any name) Database (any name)

Project Office Project Office Project Office Department LIne Office LIne Office Project Office Project Office Project Example Structure

Request accounts through the NCDDC Metadata Tools web page: tools/view Select 'Request an Account' to access the account request form.

Complete all fields in the account request form. Select a short descriptive Resource Folder name. Avoid the use of personal names for your Resource Folder. Click on the 'Submit' button. Your account 'User Name' and 'Password' will be sent via .

Writing Metadata Tips for writing quality metadata

6 Steps for Writing Quality Metadata Organize your information Write your metadata file Review your file Have someone else review Revise Publish

Before you begin writing, get organized Document your data as you go Write so others can understand Always review your document Writing Metadata

Items required Sense of Humor! Chocolate FGDC Standard and Workbook FGDC Standard and Workbook Metadata entry tool Metadata entry tool Coffee

Write simply but completely Document for a general audience Be consistent in style and terminology Write simply but completely Document for a general audience Be consistent in style and terminology Keep your readers in mind Writing Metadata

Define all acronyms Avoid using jargon Clearly state data limitations Keep your readers in mind Writing Metadata

Write a complete title that includes: What Where When Who What Where When Who Writing Metadata

The title is critical in helping others find your data. Which is better? Greater Yellowstone Rivers from 1:126,700 Forest Visitor Maps ( ) Writing Metadata

Discipline specific vocabularies Describes data in a standardized manner Tools in which to manage the knowledge held within resources and the relationships between their entries Goal is to facilitate interoperability and enable data discovery Discipline specific vocabularies Describes data in a standardized manner Tools in which to manage the knowledge held within resources and the relationships between their entries Goal is to facilitate interoperability and enable data discovery Keyword Thesauri

Global Change Master Directory (GCMD) Dynamic lists that evolve to meet changing needs of Earth science community Organized in a hierarchy constructed of Topics, Terms, and Variables Dynamic lists that evolve to meet changing needs of Earth science community Organized in a hierarchy constructed of Topics, Terms, and Variables

ISO International standard for geographic metadata Topic Categories are used as Keywords in FGDC CSDGM International standard for geographic metadata Topic Categories are used as Keywords in FGDC CSDGM

Geographic Names Information System (GNIS) Federal body created in 1890 to maintain uniform geographic name usage throughout the Federal Government

What is a Data Dictionary? User defined and vetted Consistency between data items User defined and vetted Consistency between data items Data Dictionaries

Be specific. Quantify when you can. Vague: We checked our work and it looks complete. Specific: We checked our work using 3 separate sets of check plots reviewed by 2 different people. We determined our work to be 95% complete based on these visual inspections. Vague: We checked our work and it looks complete. Specific: We checked our work using 3 separate sets of check plots reviewed by 2 different people. We determined our work to be 95% complete based on these visual inspections. Writing Metadata

Select your key words wisely Use unambiguous words Use descriptive words Fully qualify geographic locations Use unambiguous words Use descriptive words Fully qualify geographic locations Writing Metadata

Have someone else read it If you’re the only reviewer, put it away and read it again later Check for clarity and omissions Have someone else read it If you’re the only reviewer, put it away and read it again later Check for clarity and omissions Review your final product Writing Metadata

Can a novice understand what you wrote? Are your data properly documented for posterity? Can a novice understand what you wrote? Are your data properly documented for posterity? When you review your work, ask: Writing Metadata

Does the documentation present all the information needed to use or reuse the data? Are any pieces missing? Does the documentation present all the information needed to use or reuse the data? Are any pieces missing? When you review your work, ask: Writing Metadata

Write so that others will understand Writing Metadata

6 Steps for Writing Quality Metadata Organize your information Write your metadata file Review your file Have someone else review Revise Publish

Metadata as a Data DiscoveryTool Metadata as a Data DiscoveryTool A Brief Look at the FGDC Clearinghouse and Geospatial One-Stop (GOS) Portal

A Brief Look at the Geospatial One-Stop (GOS) Clearinghouse A Brief Look at the Geospatial One-Stop (GOS) Clearinghouse The geodata.gov portal is a catalog of geospatial information containing thousands of metadata records and links to live maps, features, and catalog services, downloadable data sets, images, clearinghouses, map files, and more.

Search enables you to find and access a wide variety of geographic information within geodata.gov. You can perform a Search from the geodata.gov Home page or by clicking the Search tab. A Brief Look at the Geospatial One-Stop (GOS) Clearinghouse A Brief Look at the Geospatial One-Stop (GOS) Clearinghouse

Metadata Enterprise Resource Management Aid (MERMAid) More Information Metadata Enterprise Resource Management Aid (MERMAid) More Information