Harvesting Metadata for Use by the geodata.gov Portal Doug Nebert FGDC Secretariat Geospatial One-Stop Team

2 NSDI: a Foundation for GOS Geospatial One-Stop (GOS) implements the principles of the NSDI spelled out in Executive Order (recently revised) GOS builds on the resources already available in the NSDI – FGDC and endorsed external Framework Standards, NSDI Clearinghouse Network Operated as project coordinated through FGDC Secretariat with many agency partners

3 Geodata.gov and the NSDI Clearinghouse Over 150 collections of metadata exist within searchable NSDI Clearinghouse Nodes in the US All FGDC metadata records are searchable by fields and full-text through six replicated search gateways geodata.gov will speed and simplify search and browse of these and other metadata through its portal interface

4 What's different about One-Stop? GOS has a timeline for implementation of the various modules Standards are being developed with multi- sectoral stakeholders as national (ANSI) standards, not FGDC ones Visibility of the initiative as one of 24 e-gov initiatives from the Administration Goals include measures of costs and savings through cost-sharing in data acquisition, processing, and service of geospatial data

5 What else is different? More explicit focus on including State and Local government as primary stakeholders Decisions in GOS are made by a governmental (non-FGDC) Board of Directors who advise the Executive Director GOS as an initiative is intended to sunset when all Modules are operational (2005+) Management partners from DOI and OMB are watching performance and capabilities (and budget effects) very closely

6 GOS Expectations of Portal Search for geospatial data is 'easy-to-use‘ and would replace the primary search facilities of the NSDI Clearinghouse Gateways Metadata are harvested from remote collections into a single metadatabase Browsing for geospatial data is made possible through common ISO Categories and resource type assignments Descriptions of map and data services are also indexed from FGDC metadata entries Data descriptions are linked to an online map viewer where map services exist

7 Portal at geodata.gov Initial release of the GOS portal is online with startup content selectively gathered from key providers and entered ‘by hand’ New content will be harvested from the Web or individual metadata files may be uploaded as XML or via form input OGC Web Map Services (WMS) and ArcIMS ‘image’ services supported in viewer Data, map services, static maps, and applications are among the resource types indexed

8

9 Current Publication Options Users may contribute metadata one of three ways: Enter FGDC metadata into a form at geodata.gov and they are stored and indexed there Upload metadata as FGDC XML to the geodata.gov site Register their existing metadata collection to be harvested into the GOS metadata repository

10 metadata cache geodata.gov map viewer metadata data form entry XML upload search map services

11 How do I publish? Before you can publish metadata in geodata.gov, you need to register as a publisher After your registration is completed, you will have username and password to access the portal as a publisher

12 Data Entry Form If you do not have any FGDC metadata and anticipate only a few records to be published to geodata.gov you can use an online entry form to collect abbreviated FGDC metadata that will be hosted at geodata.gov

13 Upload XML Metadata If you have access to a metadata editor such as ArcCatalog but do not have a Z39.50 server or ArcIMS Metadata Server you can upload a small set of FGDC metadata to geodata.gov

14 Harvesting Option If you have or would like to maintain a collection of metadata at your site and can let geodata.gov know its location, geodata.gov can ‘harvest’ or fetch new and updated metadata to make it searchable You can describe any type of resource (planned data activity, existing data, a map service, an application, etc.) using your published set of metadata

15 Harvesting options A provider wanting to have content harvested into in geodata.gov can register: Z39.50 “GEO” Metadata server (NSDI Clearinghouse Node) ArcIMS Metadata Server OAI-PMH (Open Archives Initiative, Protocol for Metadata Harvest) Web Accessible Folder

16 Harvesting capabilities Harvesting is a scheduled retrieval of metadata from a remote collection, such as an existing Clearinghouse Node The harvester detects new content and brings it into a metadata ‘cache’ at geodata.gov for inclusion in search Scheduling can be established in the registration profile of each provider

17 If you have a Z39.50 Clearinghouse Node If your metadata collection is served on Z39.50 (such as Isite), you need to implement the new version of Isite Update version for Isite is available at: ftp://ftp.awcubed.com/pub/Software/Isite2/ Other brands of Z39.50 software (Compusult, Intergraph, ESRI, Blue Angel) will be implementing the new features for harvest in coming months

18 Inclusion Strategy FGDC Staff will be working on an outreach and ‘inclusion’ schedule to get all domestic Clearinghouses (Z39.50 and otherwise) from State/Local, Federal, and Commercial sources Encourage partnerships and community networking to include as many resources as possible