Discovery Best Practices ESIP Winter Meeting, 10:30am January 8, 2015 Doug Newman (NASA Earthdata – Raytheon) This work was supported by NASA/GSFC under.

Slides:

Advertisements

Similar presentations

Report on progress Stakeholder workshop, 29 Jan 2003.

Advertisements

Catalog REST for data providers ECHO Technical Interchange 04/30/13 3:15pm EST Doug Newman.

What is ECHO? HTTP-based Search and Ordering Using ECHOs REST and OpenSearch APIs How Can.

Wilson 1 ESDSWG Meeting, Philadelphia, PA, Oct , 2008 Service Casting: A Proposal for Advertising Web Services Brian Wilson Jet Propulsion Laboratory.

Integrating NOAA’s Unified Access Framework in GEOSS: Making Earth Observation data easier to access and use Matt Austin NOAA Technology Planning and Integration.

Extending the Capabilities of Geospatial One-Stop Through Partner-Developed Web-Services April 16, 2010 Federal Geographic Data Committee’s (FGDC) Cooperative.

What is a web service?  A remote procedure call (RPC) over HTTP.  A web-accessible operation that takes input and returns results in XML.  Like a web.

River Campus Libraries Metadata That Supports Real User Needs David Lindahl Director of Digital Library Initiatives University of Rochester Libraries.

River Campus Libraries Metadata That Supports Real User Needs Jennifer Bowen Head of Cataloging University of Rochester Libraries David Lindahl Director.

Lesson 2 Technology: Federated Searching Explained.

River Campus Libraries Metadata That Supports Real User Needs Jennifer Bowen Head of Cataloging University of Rochester Libraries David Lindahl Director.

GEOSS Common Infrastructure: A practical tour Doug Nebert U.S. Geological Survey September 2008.

WGISS-37 Meeting Tuesday April 15 th 2014, 1:00PM CWIC-Smart A generic OpenSearch client Calin Duma Doug Newman

ECHO Open Search ECHO Technical Interchange 05/01/13 9:00am EST Doug Newman.

Lecture 3: Geospatial Web Services From Web sites to Web services Geospatial Web service functions Web service types Interoperability and geospatial service.

The GeoConnections Discovery Portal Michael Robson MacDonald Dettwiler and Associates Brian McLeod, Michael Adair Natural Resources Canada.

Refactoring the EarthGrid SOAP API to REST style and implementing it to Metacat Serhan Akın Ph.D. candidate in Earth System Sciences Institute of Earth.

DM_PPT_NP_v01 SESIP_0715_AJ HDF Product Designer Aleksandar Jelenak, H. Joe Lee, Ted Habermann Gerd Heber, John Readey, Joel Plutchak The HDF Group HDF.

1 CLASS – Simple NOAA Archive Access Portal SNAAP Eric Kihn and Rob Prentice NOAA/NGDC ESIP Meeting January 7 th, 2009 Simple NOAA Archive Access Portal.

Earth Data Open Search Specifications Doug Newman (NASA ECHO) CWIC January 2014.

GCMD/IDN STATUS AND PLANS Stephen Wharton CWIC Meeting February19, 2015.

Registration and Harvest IIB Presentation May 1,

1 Maintaining the momentum of OpenSearch in Earth Science data discovery Doug Newman (NASA ECHO) & Dr Chris Lynnes (GES DISC) 12/11/13 10:50am PT IN32A-03.

Web Services Brenton Lovett Wizard Information Services.

SESIP_0715_DN1 OpenSearch Standards ESIP Summer Meeting 2015 Doug Newman (NASA Earthdata – Raytheon) Andrew Mitchell (NASA Earthdata) This work was supported.

Sharing Metadata Recommendations Ted Habermann, John Kozimor Earth Science The HDF Group 1 John Farley Raytheon.

Consolidated Metadata Repository (CMR) Status and Look Ahead CWIC 2015 Annual Meeting, February 18-19, 2015 This work was supported by NASA/GSFC under.

Alexandria Digital Earth ProtoType DIGITAL LIBRARIES AND ENVIRONMENTAL INFORMATION Terence R. Smith Alexandria Digital Library Project.

DSTT Report - OGC Services May 8, 2002Page 1 Allan Doyle DSTT Report OGC Services DSTT Report OGC & GRID Services Allan Doyle NASA/II May 8, 2002.

What is CWIC? Authors: Doug Newman Andrew Mitchell

1 Interoperability and a Spatial Web Portal April 20, 2007 Myra Bambacus NASA Applied Sciences Program Geosciences Interoperability Office.

Retrieving and Transforming ISO Metadata ESIP Summer 2014.

DM_PPT_NP_v01 SESIP_0715_JR HDF Server HDF for the Web John Readey The HDF Group Champaign Illinois USA.

Digital libraries and web- based information systems Mohsen Kamyar.

What do you understand about how each system works to index-retrieve images? Manually Index Expensive but effective.

Interoperability = Leverage + Collaboration  Chris Lynnes  GES DISC.

Federated Space-Time Query for Earth Science Data Using OpenSearch Conventions ESIP Federated Search Cluster Chris Lynnes Bruce Beaumont Ruth Duerr Hook.

CWIC Developers Meeting January 28 th 2014 Calin Duma CSW and OpenSearch from the CWIC Start client perspective.

Task IN-03 GEO Work Plan Symposium 2014 GEOSS Common Infrastructure IN-03.

ESIP AQ Cluster Community Components for the Air Quality SBA in AIP-2.

CEOS CWIC Report: Metadata Mapping Table Cocoa Beach, FL WGISS-37, April 2014 Michael Morahan

CEOS Open Search Best Practices Doug Newman (NASA ECHO) CWIC January 2014.

ORNL DAAC SPATIAL DATA ACCESS TOOL Open Geospatial Consortium (OGC) Services Bruce E. Wilson Suresh K. Santhana Vannan Yaxing Wei Tammy W. Beaty National.

What is ECHO? ECHO Open Search ECHO Facts NASA’s Earth Observing System ClearingHOuse (ECHO) acts as the core metadata.

CWIC Open Search Best Practices Doug Newman (NASA ECHO) CEOS WGISS-37 April 15th 2014 Presenter: Archie Warnock (A/WWW Enterprises)

CEOS OpenSearch Project Yoshiyuki Kudo (JAXA) WGISS-37.

1 CS 430: Information Discovery Lecture 26 Architecture of Information Retrieval Systems 1.

1 2.5 DISTRIBUTED DATA INTEGRATION WTF-CEOP (WGISS Test Facility for CEOP) May 2007 Yonsook Enloe (NASA/SGT) Chris Lynnes (NASA)

Repository for Archiving, Managing and Accessing Diverse DAta Thiru.

Linked Open Data for European Earth Observation Products Carlo Matteo Scalzo CTO, Epistematica epistematica.

GHRC Dashboard *** work in progress *** Ajinkya Kulkarni Rahul Ramachandran Helen Conover.

Linking Big Data from Space to Apps on Earth

Earthdata Login and Open ID A Look at Federated User Identities

Session 3A: Catalog Services and Metadata Models

Big Earth Data Initiative (BEDI) Metadata Improvement: Case Studies

GF and RS, Dept. of CS, Mangalore University

ESIP Discovery – Show & Tell ESIP Summer Meeting 2011 Matt Cechini

Granule Discovery and Services

WHAT DOES THE FUTURE HOLD? Ann Ellis Dec. 18, 2000

Common Framework for Earth Observation Data

OpenSearch: the data search API for everyone

GCMD’s New Keyword Search Interface ‘Alpha Version’

CWICSmart A programmatically-derived user interface for Open Search implementations WGISS-39 Doug Newman (NASA EOSDIS – Raytheon) This work was supported.

Search Relevancy in GEO Data Access Broker

M. Albani, P. Mougnaud, A. Della Vecchia (ESA)

NASA's Earth Science Gateway ESIP Meeting at College Park, Nov

CEOS OpenSearch conformance testing

WGISS Connected Data Assets Oct 24, 2018 Yonsook Enloe

ESIP Winter Meeting 2016 January 2016

NASA Earthdata Knowledge Base

Presentation transcript:

Discovery Best Practices ESIP Winter Meeting, 10:30am January 8, 2015 Doug Newman (NASA Earthdata – Raytheon) This work was supported by NASA/GSFC under Raytheon Co. contract number NNG10HP02C.

Agenda 1 Presentation on where we are Open discussion –Tell us what your discovery pain points are –Discuss how we can resolve them

Best practice goals 2 Application driven/friendly Simple Standards-based Interoperable Relevant Community buy-in

Candidates 3 Earth Data Open Search OGC Catalog Service for the Web (CSW) (Schema.org)

OPEN SEARCH 4

Outline 5 HTTP + REST Simple Single query API Keyword Value pair querying ATOM results Reduced metadata in results HATEOS navigation Baked in two-step searching

Best practice strengths 6 API covers > 93% of query needs according to ECHO metrics Two-step searching is the burden of the API ESIP/CWIC/CEOS best practices are dynamic Adoption rate is very promising

Best practice weaknesses 7 No facility for controlled vocabulary constraints Limited query palette has raised concerns about precision

CWICSmart 8

CATALOG SERVICE FOR THE WEB (CSW) 9

Outline 10 HTTP + SOAP GET, POST+form and POST+XML querying XML results Multiple query API GetRecords GetRecordsById

Best practice strengths 11 Relative maturity High precision through complex queries Controlled vocabulary support

Best practice weaknesses 12 Two-step is the burden of the client OGC augmentation process is extremely slow and cumbersome Complex Client developers HATE SOAP

CWICStart 13

SCHEMA.ORG 14

Google! 15 HTML views of your OpenSearch/CSW output can be marked up with schema.org tags to give you searchable pages.

Example 16

Under the hood 17 MODIS/Terra Calibrated Radiances 5-Min L1B Swath 250m (MOD02QKM, Collection 004 and 005) MOD02QKM

Current issues 18 Are the main players indexing based on this markup? Are they presenting this structured information to the user?

WHERE DOES IT HURT? 19