1. CEOS IDN Report Cocoa Beach, FL WGISS-37, April 2014 Michael Morahan Michael.P.Morahan@nasa.gov

2. IDN Session Agenda WGISS-36 Action Items IDN website design New Development 9.9.3 IDN Metrics Questions 2

3. WGISS-35 Action Items WGISS-36-16 Description: The IDN Interest Group to investigate a DIF Management Tool. IDN has created a mock-up and started development of tool 3

4. WGISS-35 Action Items WGISS-35-7 4

5. IDN New Design Story-board IDN New Site Design 5

6. GCMD/IDN 9.9.1 Release 6

7. 7

8. 8

9. 9

10. 10

11. GCMD/IDN 9.9.1 Release 11

12. GCMD/IDN 9.9.1 Release 12

13. GCMD/IDN 9.9.1 Release 13

14. GCMD/IDN 9.9.1 Release 14

15. GCMD/IDN 9.9.1 Release 15

16. GCMD/IDN 9.9.1 Release 16

17. GCMD/IDN 9.9.1 Release 17

18. GCMD/IDN 9.9.3 release (Spring 2014) GCMD/IDN 9.9.2 Release 18 New Features: Metadata Mapping Table and API OpenSearch

19. IDN Release 9.9.3 Metadata Tagging The IDN/GCMD is implementing a generic metadata tagging API allowing organizations to apply externally defined "Tags" to metadata held in the IDN/GCMD database. These tags are user defined (tied to an account) and are intended to capture metadata details such as: Collaborations: work flow process details like "has been reviewed by xyx" Catalogers: impromptu grouping of records o events like an earthquake o similar studies relating to a discipline across providers Metadata Handlers: non-scientific data such as an internal tracking number Researchers: Personal notes ("cite this record in report abc") 19

20. IDN Release 9.9.3 API Calls The latest API can be found on http://gcmddemo.gsfc.nasa.gov/mws/tags with the future destination of the API being the existing public service server http://gcmdservices.gsfc.nasa.gov/mws/tags. Both servers requires an account in the EOSDIS User Registration System (URS) and can be called with the "curl" command or restful software. All tags are tired to the URS account. 20

21. IDN Release 9.9.3 21 API Calls

22. IDN Release 9.9.3 22 XML Output The primary GET interface will return a list of tags and documents or just one document if an entry id is supplied. Optionally additional metadata information can be specified in the the "sections" list and these tags will be included in the output XML but by default only then entry_id only tags is returned.

23. IDN Release 9.9.3 23 Tags example: 20ms MOD021KM... org.ceos.wgiss.cwic public_data_set cwic_public Set to cwic_public when this record is to be included in the CWIC repository

24. IDN Release 9.9.3 24 Further Reader: http://gcmd.nasa.gov/Connect

25. IDN Release 9.9.3 IDN/GCMD OpenSearch The GCMD OpenSearch implementation has been designed to support both browser integration (via custom search sites in FireFox for example) and API implementers interesting in including IDN/GCMD in distributed searches. In both cases metadata records can be searched using free text and GCMD Keywords and API writers calling the OpenSearch interface directly can include, GEO Box coordinates, and temporal values. Results can be viewed in either HTML, Atom, RSS, or CSV (BETA). All Open Search query results can also be bounded by GCMD portal subsets (portals; predefined queries forces on one discipline and/or provider contribution). Long result lists are returned in "pages", that is 500 results could be viewed in 10 50 page requests. 25

26. IDN Release 9.9.3 OpenSearch Description Document (OSDD) Access to the IDN/GCMD OpenSearch interface begins with the OpenSearch Description Document, a machine readable XML file which describes the capabilities available in the IDN/GCMD implementation of OpenSearch. This document defines how to properly build a query. http://gcmd.nasa.gov/KeywordSearch/default/openSearch.jsp?Portal=idn_ceos 26

27. IDN Release 9.9.3 Amongst all the XML there are a set of links inside of "Url" tags that describe the format of a query. Below is an example of the url to call for getting results in the Atom: <Url type="application/atom+xml" method="GET” template="http://gcmd.gsfc.nasa.gov/KeywordSearch/OpenSearch.dohttp://gcmd.gsfc.nasa.gov/KeywordSearch/OpenSearch.do ?searchTerms={searchTerms} &count={count?} &startIndex={startIndex?} &startPage={startPage?} &MetadataType=0 &output=atom &Portal=idn_ceos" /> 27

28. IDN Release 9.9.3 Explanation: &ampamp; is how XML says "&". Type "&" in curl or browser. Open Search variables to the URL are described with {} brackets and ? denotes optional calls searchTerms - Freetext, GCMD Query Language, GCMD Keywords pagination - `{count?}`, `{startPage?}` geo - `{geo:box?}` (code assumes `INTERSECTS` mode) date - `{time:start?}`, `{time:end?}` (code assumes `T00:00:00Z`) output - hardcoded in each URL, possible options include: HTML - uses standard IDN/GCMD view for the requested portal ATOM - most robust output RSS - simple and basic CSV - XSL compatible spreadsheets are fun and cool! portal - hardcoded in each URL, defaults to GCMD, can use idn_ceos for the IDN, see: http://gcmd.nasa.gov/add/portals.html http://gcmd.nasa.gov/add/portals.html 28

29. IDN Release 9.9.3 Results: Results very based on the standards for each output type but in all cases Entry IDs and urls to more detailed descriptions can be found for records in the IDN/GCMD database. In the atom response you should expect URLs in link tags for example: "http://gcmd.nasa.gov/r/d/SHADOZ_TAHITI" Try it out: A search for the first 10 records with a word that starts with water (water*) in a specific location and time within the IDN subset: curl"http://gcmd.nasa.gov/KeywordSearch/OpenSearch.do?searchTerms=water* &output=atom&count=10&startPage=1&geoBox=-150,-45,- 150,45&timeStart=2000-02-14&timeEnd=2010-02-14&Portal=idn_ceos"""http://gcmd.nasa.gov/KeywordSearch/OpenSearch.do?searchTerms=water* &output=atom&count=10&startPage=1&geoBox=-150,-45,- 150,45&timeStart=2000-02-14&timeEnd=2010-02-14&Portal=idn_ceos" 29

30. IDN Release 9.9.3 Further Reader: http://gcmd.nasa.gov/Connect http://gcmd.nasa.gov/add/portals.html http://gcmd.nasa.gov/learn/faqs/search_directions.html 30

31. IDN Metrics IDN Site March 2013 – March 2014 Total Visits: 34,672 Average Visits per day: 88 Average Visits per month: 2,667 Total Page Views: 69,289 Average pages viewed per day: 175 31

32. IDN Usage by Continent

33. IDN Usage by Country Top 5 Countries: 1)United States 2)China 3)India 4)Republic of Korea 5)Canada

34. User Access of CSW Total Visits: 42,807 Average Visits per day: 108 Total Page Views: 1,222,882 Average Page Views per day: 3,088 2014 2013

35. User Access of GCMD Services Total Visits: 77,478 Average Visits per day: 212 Total Page Views: 283,679 Average Page Views per day: 777 Other

36. US GEO/GEOSS Metrics Current IDN/GCMD Database Statistics Total ISO-19115 Metadata Records in CSW Server: 24733 ISO-19115 Metadata Records Tagged as GEOSSDataCore: 9697 (+15 INPE & +1 JAXA Metadata Records) Centers for Disease Control and Prevention (CDC)18 Department of Homeland Security (DHS)8 National Oceanic and Atmospheric Administration (NOAA)1720 Department of Defense (DOD)142 Department of Energy (DOE)336 Department of the Interior (DOI)1998 Department of State (DOS)15 Department of Transportation (DOT)23 Environmental Protection Agency (EPA)164 National Aeronautics and Space Administration (NASA)4788 National Science Foundation (NSF)1541 Smithsonian Institute (SI)46 U.S. Department of Agriculture (USDA)710 US GEO Data Core Contributions by Agency: 36

37. IDN Statistics Page IDN Statistics Page link: Stats: o CEOS DIF counts o CEOS DIFs by Parameters o CEOS DIFs by Source_Name Bucket (Platform Type) o CEOS DIFs by IDN_Node o CEOS DIFs by Data Center http://idn.ceos.org/idn-resources/stats_ceos_dif_count.pdf 37

38. IDN Statistics Page 38

39. Stay Connected Email notifications (Send email to gsfc- gcmduso@mail.nasa.gov to sign up)gsfc- gcmduso@mail.nasa.gov  docBUILDER: News and downtime notifications on metadata authoring tool (ceos-idn-docbuilder@lists.nasa.gov)ceos-idn-docbuilder@lists.nasa.gov  Interoperability Forum: Release announcements and proposed changes to DIF and SERF (ceos-idn-interop@lists.nasa.gov)ceos-idn-interop@lists.nasa.gov 39

40. Questions Michael.P.Morahan@nasa.gov 40