CEOS IDN Report Cocoa Beach, FL WGISS-37, April 2014 Michael Morahan

IDN Session Agenda WGISS-36 Action Items IDN website design New Development IDN Metrics Questions 2

WGISS-35 Action Items WGISS Description: The IDN Interest Group to investigate a DIF Management Tool. IDN has created a mock-up and started development of tool 3

WGISS-35 Action Items WGISS

IDN New Design Story-board IDN New Site Design 5

GCMD/IDN Release 6

7

8

9

10

GCMD/IDN Release 11

GCMD/IDN Release 12

GCMD/IDN Release 13

GCMD/IDN Release 14

GCMD/IDN Release 15

GCMD/IDN Release 16

GCMD/IDN Release 17

GCMD/IDN release (Spring 2014) GCMD/IDN Release 18 New Features: Metadata Mapping Table and API OpenSearch

IDN Release Metadata Tagging The IDN/GCMD is implementing a generic metadata tagging API allowing organizations to apply externally defined "Tags" to metadata held in the IDN/GCMD database. These tags are user defined (tied to an account) and are intended to capture metadata details such as: Collaborations: work flow process details like "has been reviewed by xyx" Catalogers: impromptu grouping of records o events like an earthquake o similar studies relating to a discipline across providers Metadata Handlers: non-scientific data such as an internal tracking number Researchers: Personal notes ("cite this record in report abc") 19

IDN Release API Calls The latest API can be found on with the future destination of the API being the existing public service server Both servers requires an account in the EOSDIS User Registration System (URS) and can be called with the "curl" command or restful software. All tags are tired to the URS account. 20

IDN Release API Calls

IDN Release XML Output The primary GET interface will return a list of tags and documents or just one document if an entry id is supplied. Optionally additional metadata information can be specified in the the "sections" list and these tags will be included in the output XML but by default only then entry_id only tags is returned.

IDN Release Tags example: 20ms MOD021KM... org.ceos.wgiss.cwic public_data_set cwic_public Set to cwic_public when this record is to be included in the CWIC repository

IDN Release Further Reader:

IDN Release IDN/GCMD OpenSearch The GCMD OpenSearch implementation has been designed to support both browser integration (via custom search sites in FireFox for example) and API implementers interesting in including IDN/GCMD in distributed searches. In both cases metadata records can be searched using free text and GCMD Keywords and API writers calling the OpenSearch interface directly can include, GEO Box coordinates, and temporal values. Results can be viewed in either HTML, Atom, RSS, or CSV (BETA). All Open Search query results can also be bounded by GCMD portal subsets (portals; predefined queries forces on one discipline and/or provider contribution). Long result lists are returned in "pages", that is 500 results could be viewed in page requests. 25

IDN Release OpenSearch Description Document (OSDD) Access to the IDN/GCMD OpenSearch interface begins with the OpenSearch Description Document, a machine readable XML file which describes the capabilities available in the IDN/GCMD implementation of OpenSearch. This document defines how to properly build a query. 26

IDN Release Amongst all the XML there are a set of links inside of "Url" tags that describe the format of a query. Below is an example of the url to call for getting results in the Atom: <Url type="application/atom+xml" method="GET” template=" ?searchTerms={searchTerms} &count={count?} &startIndex={startIndex?} &startPage={startPage?} &MetadataType=0 &output=atom &Portal=idn_ceos" /> 27

IDN Release Explanation: &ampamp; is how XML says "&". Type "&" in curl or browser. Open Search variables to the URL are described with {} brackets and ? denotes optional calls searchTerms - Freetext, GCMD Query Language, GCMD Keywords pagination - `{count?}`, `{startPage?}` geo - `{geo:box?}` (code assumes `INTERSECTS` mode) date - `{time:start?}`, `{time:end?}` (code assumes `T00:00:00Z`) output - hardcoded in each URL, possible options include: HTML - uses standard IDN/GCMD view for the requested portal ATOM - most robust output RSS - simple and basic CSV - XSL compatible spreadsheets are fun and cool! portal - hardcoded in each URL, defaults to GCMD, can use idn_ceos for the IDN, see:

IDN Release Results: Results very based on the standards for each output type but in all cases Entry IDs and urls to more detailed descriptions can be found for records in the IDN/GCMD database. In the atom response you should expect URLs in link tags for example: " Try it out: A search for the first 10 records with a word that starts with water (water*) in a specific location and time within the IDN subset: curl" &output=atom&count=10&startPage=1&geoBox=-150,-45,- 150,45&timeStart= &timeEnd= &Portal=idn_ceos""" &output=atom&count=10&startPage=1&geoBox=-150,-45,- 150,45&timeStart= &timeEnd= &Portal=idn_ceos" 29

IDN Release Further Reader:

IDN Metrics IDN Site March 2013 – March 2014 Total Visits: 34,672 Average Visits per day: 88 Average Visits per month: 2,667 Total Page Views: 69,289 Average pages viewed per day:

IDN Usage by Continent

IDN Usage by Country Top 5 Countries: 1)United States 2)China 3)India 4)Republic of Korea 5)Canada

User Access of CSW Total Visits: 42,807 Average Visits per day: 108 Total Page Views: 1,222,882 Average Page Views per day: 3,

User Access of GCMD Services Total Visits: 77,478 Average Visits per day: 212 Total Page Views: 283,679 Average Page Views per day: 777 Other

US GEO/GEOSS Metrics Current IDN/GCMD Database Statistics Total ISO Metadata Records in CSW Server: ISO Metadata Records Tagged as GEOSSDataCore: 9697 (+15 INPE & +1 JAXA Metadata Records) Centers for Disease Control and Prevention (CDC)18 Department of Homeland Security (DHS)8 National Oceanic and Atmospheric Administration (NOAA)1720 Department of Defense (DOD)142 Department of Energy (DOE)336 Department of the Interior (DOI)1998 Department of State (DOS)15 Department of Transportation (DOT)23 Environmental Protection Agency (EPA)164 National Aeronautics and Space Administration (NASA)4788 National Science Foundation (NSF)1541 Smithsonian Institute (SI)46 U.S. Department of Agriculture (USDA)710 US GEO Data Core Contributions by Agency: 36

IDN Statistics Page IDN Statistics Page link: Stats: o CEOS DIF counts o CEOS DIFs by Parameters o CEOS DIFs by Source_Name Bucket (Platform Type) o CEOS DIFs by IDN_Node o CEOS DIFs by Data Center 37

IDN Statistics Page 38

Stay Connected notifications (Send to gsfc- to sign up)gsfc-  docBUILDER: News and downtime notifications on metadata authoring tool  Interoperability Forum: Release announcements and proposed changes to DIF and SERF 39

Questions 40