Relevancy Ranking of Satellite Dataset Search Results

Slides:

Advertisements

Similar presentations

OMI follow-on Project Toekomstige missies gericht op troposfeer en klimaat Pieternel Levelt, KNMI.

Advertisements

A New A-Train Collocated Product : MODIS and OMI cloud data on the OMI footprint Brad Fisher 1, Joanna Joiner 2, Alexander Vasilkov 1, Pepijn Veefkind.

Mars’ North and South Polar Hood Clouds Jennifer L. Benson Jet Propulsion Laboratory, California Institute of Technology July 22, 2010 Copyright 2010 California.

A U R A Satellite Mission T E S

Results from the OMPS Nadir Instruments on Suomi NPP Satellite

Variability of Total Column Ozone During JAN JUN 2011: Consistency Among Four Independent Multi-year Data Records E.W. Chiou ADNET Systems Inc.,

Data Quality Screening Service Christopher Lynnes, Richard Strub, Thomas Hearty, Bruce Vollmer Goddard Earth Sciences Data and Information Sciences Center.

 Provides integrated online access to:  Monitoring data: from over 3 dozen networks  Modeling data: from a variety of modeling scenarios  Emissions.

Cooperative Institute for Meteorological Satellite Studies University of Wisconsin - Madison Steve Ackerman Director, Cooperative Institute for Meteorological.

Chapter 2: Satellite Tools for Air Quality Analysis 10:30 – 11:15.

Obtaining MISR Data and Information Jeff Walter Atmospheric Science Data Center April 17, 2009.

Assessing Air Quality Using USDA Shadow-band Radiometers James Slusser USDA UV-B Monitoring and Research Program Natural Resource Ecology Laboratory Colorado.

Ben Gurion University Mission scientists (PI's) : Gérard Dedieu & Arnon Kanieli G. Dedieu 1, O. Hagolle 2, A. Karnieli 3, S. Cherchali 2 P. Ferrier 2 and.

Updates from EOSDIS -- as they relate to LANCE Kevin Murphy LANCE UWG, 23rd September

EARLINET and Satellites: Partners for Aerosol Observations Matthias Wiegner Universität München Meteorologisches Institut (Satellites: spaceborne passive.

Earth Observation Science Recent and potential scientific achievements of the (A)ATSR Series - and some possibilities for synergy with MERIS David Llewellyn-Jones.

1 Satellite Remote Sensing of Particulate Matter Air Quality ARSET Applied Remote Sensing Education and Training A project of NASA Applied Sciences Pawan.

OpenDAP Server-side Functions for Multi-Instrument Aggregation ESIP Session: Advancing the Power and Utility of Server-side Aggregation Jon C. Currey (NASA),

AMFIC on AIRSAT- a web data base for hosting and easy retrieval of atmospheric data from satellites Konstantinos Kourtidis 1, Aristeidis Georgoulias 1,

, Key Components of a Successful Earth Science Subsetter Architecture ASDC Introduction The Atmospheric Science Data Center (ASDC) at NASA Langley Research.

The Case for Data Stewardship: Agency Requirements: NASA Data Management Policies Ronald Weaver National Snow and Ice Data Center Version 1.0 June 28,

WGISS 37 CCMEO Data Provider Status Patrick King April 15, 2014.

Modern Era Retrospective-analysis for Research and Applications: Introduction to NASA’s Modern Era Retrospective-analysis for Research and Applications:

Aristeidis K. Georgoulias Konstantinos Kourtidis Konstantinos Konstantinidis AMFIC Web Data Base AMFIC Annual Meeting - Beijing October 2008 Democritus.

Aristeidis K. Georgoulias Contribution of Democritus University of Thrace-DUTH in AMFIC-Project Democritus University of Thrace Laboratory of Atmospheric.

Contents of the Site On the MY NASA DATA homepage you can find: Data Access Lesson Plans Computer Tools Science Focus E-Notes.

NASA Earth Observing System Visualization Tools ARSET - AQ Applied Remote SEnsing Training – Air Quality A project of NASA Applied Sciences Introduction.

Fog- and cloud-induced aerosol modification observed by the Aerosol Robotic Network (AERONET) Thomas F. Eck (Code 618 NASA GSFC) and Brent N. Holben (Code.

Obtaining MISR Data and Information Nancy Ritchey Atmospheric Science Data Center March 20, 2006.

Global Land Cover Mapping Looking Back, Looking Forward Alan Belward Head of Land Resource Management Unit, European Commisison, Joint Research Centre.

Ambiguity of Quality in Remote Sensing Data Christopher Lynnes, NASA/GSFC Greg Leptoukh, NASA/GSFC Funded by : NASA’s Advancing Collaborative Connections.

Status of requirements definition for the ACE multiangle, multispectral, polarimetric imager David J. Diner ACE workshop Salt Lake City, UT 6-7 November.

Task XX-0X Task ID-01 GEO Work Plan Symposium April 2014 Task ID-01 “ Advancing GEOSS Data Sharing Principles” Experiences related to data sharing.

ISCCP SO FAR (at 30) GOALS ►Facilitate "climate" research ►Determine cloud effects on radiation exchanges ►Determine cloud role in global water cycle ▬

SeaWiFS Calibration & Validation Strategy & Results Charles R. McClain SeaWiFS Project Scientist NASA/Goddard Space Flight Center February 11, 2004.

TNO Physics and Electronics Laboratory    J. Kusmierczyk-Michulec G. de Leeuw.

What is ECHO? ECHO Open Search ECHO Facts NASA’s Earth Observing System ClearingHOuse (ECHO) acts as the core metadata.

Goddard Earth Sciences Data and Information Services Center, NASA/GSFC, Code 902, Greenbelt, Maryland 20771, USA INTRODUCTION  NASA Goddard Earth Sciences.

Ocean Color Research Team Meeting May 1, 2008 NPOESS Preparatory Project (NPP) Status Jim Gleason NPP Project Scientist.

CGMS 44: EUM-WP-16.ppt (May 2016) Coordination Group for Meteorological Satellites - CGMS Action closure: MTG FCI and IRS Format Presented to CGMS-44 Working.

DataGrid France 12 Feb – WP9 – n° 1 WP9 Earth Observation Applications.

ULTRASONIC PHASED ARRAYS TESTING. ULTRASONIC PHASED ARRAYS  Use a multiple element probe  Output pulse from each element is time delayed to produce.

Date: 18/09/2016 RASS-R Coverage Map Calculator Jeroen Janssens.

Detecting Smoke from Forest Fires Using USDA Shadow-band Radiometers James Slusser USDA UV-B Monitoring and Research Program Natural Resource Ecology Laboratory.

UEE Seminar Series Lidar Sensing of Tropospheric Aerosols and Clouds

SADE Export Web Site Claire Tinel, Denis Blumstein, Patrice Henry - CNES Pascale Lafitte - CNES GSICS WG Meeting – Feb 2010 – Claire Tinel / CNES.

The Canadian OSIRIS instrument on the Odin Satellite

Modules should be 3-7 minutes long Ronald Weaver

Report to 8th GSICS Exec Panel

MERRA Data Access and Services

DETERMINATION OF PHOTOSYNTHETICALLY ACTIVE RADIATION

WGISS-41: IDN Report Michael Morahan CEOS WGISS-41 Meeting

Landsat Program The World’s Most Sophisticated Optical Observatories of the Earth The World’s Model for International Collaboration in Earth Observation.

NPOESS Airborne Sounder Testbed (NAST)

Hands on Satellite Data to Monitor Biomass

The Successor of the TOU

The GEO DAB possible contributions

Satellite Sensors – Historical Perspectives

Earth Data Search Tool Demo

NASA Earthdata Login Andrew Mitchell - NASA WGISS-44 Beijing, China

Looking to the Future: User-centric

Changchun Institute of Optics Fine Mechanics and Physics

HDF-EOS Aura File Format Guidelines

Recent Activities of Ocean Surface Topography Virtual Constellation (OST-VC) Remko Scharroo (EUMETSAT)

Soil Moisture Active Passive (SMAP) Satellite

Discovery of Interesting Spatial Regions

Chris Lynnes with contributions from Katie Baynes NASA/GSFC

Retrieval of SO2 Vertical Columns from SCIAMACHY and OMI: Air Mass Factor Algorithm Development and Validation Chulkyu Lee, Aaron van Dokelaar, Gray O’Byrne:

Recent Activities of Ocean Surface Topography Virtual Constellation (OST-VC) Remko Scharroo (EUMETSAT)

G16 vs. G17 IR Inter-comparison: Some Experiences and Lessons from validation toward GEO-GEO Inter-calibration Fangfang Yu, Xiangqian Wu, Hyelim Yoo and.

Presentation transcript:

Relevancy Ranking of Satellite Dataset Search Results WGISS 2017 Christopher Lynnes (NASA ESDIS) Patrick Quinn (Element 84) James Norton (Element 84)

The Variety problem in Big Data from Satellites

Variety = Choice Choice = Good (Right?)

The Earth Observing System Data and Information System (EOSDIS) Research distribute Applications Education data downlink Users archive capture and clean process

The Variety problem in Big Earth Data from Satellites

Earthdata Search

Too many datasets to sift manually

Where does Variety come from? Instruments Fundamental differences: sounders, limb sounders, imagers... Incremental evolution in instrument design Satellites “Same” instrument on different satellites Processing Level Calibrated -> Swath -> Grid -> Model Processing Algorithm Different basic principles Incremental evolution in algorithm development Temporal Resolution daily, 5-day, 8-day, monthly, yearly Spatial Resolution...

Example: Time Aggregation Aerosol Optical Depth at 555 nm from Multi-angle Imaging Spectro-Radiometer Daily Monthly

What to do? Emulate the best search engines: return the most relevant results at the top of the list

A la Wikipedia “how well a retrieved document or set of documents meets the information need of the user”

HOW?

Relevancy Ranking Heuristics Heuristic = “rule of thumb” Basis is 20+ years of serving satellite data to researchers

The Content Heuristic* Got ozone?

“New-and-improved” Heuristics

New-and-Improved Processing Version

New processing version is also more likely to be up to date

Newer instrument is usually better than previous instruments Total Ozone Mapping Spectrometer Ozone Monitoring Instrument

Region of Interest Overlap

Time Range Heuristic Datasets covering the user’s full time range are better than those covering just part of it 2005 2006 2007 2008 2009 2010 Time range of interest TOMS-Earth Probe Ozone Monitoring Inst. Meh. Yeah!

Spatial Heuristic Data covering the user’s full area are better than those covering just part of it. This is not as good as...

Spatial Heuristic This...