Presentation is loading. Please wait.

Presentation is loading. Please wait.

ESDRs Distribution and User Support – Miscellaneous Topics

Published byGarry Skinner Modified over 6 years ago

Similar presentations

Presentation on theme: "ESDRs Distribution and User Support – Miscellaneous Topics"— Presentation transcript:

1 ESDRs Distribution and User Support – Miscellaneous Topics
Science Review Panel Meeting Biosphere 2, Tucson, AZ - January 4-5, 2011 Vegetation Phenology and Vegetation Index Products from Multiple Long Term Satellite Data Records ESDRs Distribution and User Support – Miscellaneous Topics Calli Jenkerson ERT, USGS EROS Center NASA MEASURES #NNX08AT05A

2 MEaSUREs VIP Miscellaneous Topics
January 2011 Calli Jenkerson, ERT USGS EROS Center

3 Miscellaneous Topics Beta ESDR File Transfer Metrics GMCD Entry
ESDR Metadata Long Term Archive ESDR Access -3- MEASURES VIP ESDRs Science Review Panel

4 Beta ESDR File Transfer
Expectations Test data set characteristics Infrastructure Schedule Current test results Plans Questions -4- MEASURES VIP ESDRs Science Review Panel

5 Beta ESDR File Transfer
ESDR production at University of Arizona Storage and distribution at USGS EROS Expected final totals: Number of Files <=87,656 Uncompressed Volume ~5.7 TB Compressed Volume ~1.5 TB based on 30 year record 2 daily products (VI, Phenology) 4 data sets (AVHRR2, AVHRR3, MODIS, SPOT) ((30 years * 365 days per year) + 7 days for leap years) * 2 for VI & Phenology products = no more than 21,914 files per data set. -5- MEASURES VIP ESDRs Science Review Panel

6 Beta ESDR File Transfer
Beta collections available as of June 2010 Data Set File Format Time Range # Files Volume (GB) AVHRR V2 (from LTDR2) HDF 365 88 AVHRR V3 (from LTDR3) 63 MOD09CMG 359 121 SPOT_CMG 98 37 TOTAL 1,187 309 -6- MEASURES VIP ESDRs Science Review Panel

7 Beta ESDR File Transfer
Utilize FTP UofA pushes to public staging area at EROS ~2 TB disk Unique VIP user EROS moves files across firewall to VIP storage ~6 TB disk -7- MEASURES VIP ESDRs Science Review Panel

8 Beta ESDR File Transfer
Schedule Roughly once every year July 20 - August 3, 2009 June 7-11, 2010 June 2011 December 2011? June 2012? As data are available Behind the black box -8- MEASURES VIP ESDRs Science Review Panel

9 Beta ESDR File Transfer
Test results 2009 Transfer Test Alpha data collection Pushed 230 GB Obstructed by limited connections (5) to staging area <1 Mbs average throughput -9- MEASURES VIP ESDRs Science Review Panel

10 Beta ESDR File Transfer
2010 Transfer Test Beta data collection Pushed 309 GB Initiated multiple sessions to maximize number of connections to staging area ~1.7 Mbs continuous throughput Transfer Statistic June 7-11, 2010 Total FTP Transactions 1243 Total Transaction Time June 7 12:07:09 CST – June 11 17:20:19 Total Uploaded Gigabytes GB Total Continuous Upload Time Hours 61.66 Hr Average Continuous Upload Rate Kilobytes per second (3 connections) 1692 Kbs -10- MEASURES VIP ESDRs Science Review Panel

11 Beta ESDR File Transfer
Perform transfers to the EROS VIP environment as ESDR data are available Not likely to explore performance enhancement Timeliness of public product availability is not currently an issue for this historical collection Future plans to archive ESDRs in LP DAAC will not use the beta transfer model for ingest -11- MEASURES VIP ESDRs Science Review Panel

12 Beta ESDR File Transfer
Questions? -12- MEASURES VIP ESDRs Science Review Panel

13 Metrics Expectations Tools Record of Report ESDSWG-MPARWG Plans
Questions -13- MEASURES VIP ESDRs Science Review Panel

14 Metrics Report project metrics as appropriate to mark progress and results Ingest metrics: volume and number of files stored in EROS VIP systems Distribution metrics: Web site hits, distinct users, services invoked, file downloads User metrics: registered users, user services contacts, method of contact, subject of inquiry, escalation level, response time Web site hits; Distinct users (by platform, domain); Services invoked (subsetting, reformatting, reprojection); File downloads -14- MEASURES VIP ESDRs Science Review Panel

15 Metrics Earth Science Data Systems (ESDS) Metrics Collection Tool (MCT) Established for REASoN projects Carried over for MEaSUREs Earth Science Data and Information System (EOSDIS) Metrics System (EMS) Established for Earth Observing System (EOS) data centers Potential for implementation of EMS-MEaSUREs Development for EMS-MEaSUREs was abandoned and ESDS MCT enhanced instead. -15- MEASURES VIP ESDRs Science Review Panel

16 Metrics VIP Metrics Reporting Record: ESDS MCT entry 2009 July
2010 July, September, November Ingest and Distribution metrics only Describes primarily test community activity User metrics will be added as Project-specific after public release of ESDRs -16- MEASURES VIP ESDRs Science Review Panel

17 VIP Client Ingest Metrics (since June 2009)
Data Set Layers in Client Time Range Total # Files Total GB AVHRRV2 (from LTDR2) NDVI, EVI2 (daily) 365 88 AVHRRV3 (from LTDR3) 63 MOD09CMG (daily) 359 121 SPOT_CMG NDVI (daily) 98 37 MOD13C2 NDVI, EVI (monthly) 114 2 eMODIS CONUS (weekly) 457 180 TOTAL 1,758 files 491 GB -17- MEASURES VIP ESDRs Science Review Panel

18 VIP Client Distribution Metrics
(since June 2009) 38 Web Page Visitors 43 Distinct Users 31 Domain .gov 12 Domain .edu 49 Products Delivered 5.13 GB Delivered 18,547 Services Provided -18- MEASURES VIP ESDRs Science Review Panel

19 Metrics Solicitation requirement to participate in the Earth Science Data System Working Groups (ESDSWG) VIP has interested parties in Standards and Interfaces, Technology Infusion, Architecture and Reuse Working Groups VIP is a contributing member of the Metrics Planning and Reporting Working Group (MPARWG) -19- MEASURES VIP ESDRs Science Review Panel

20 Metrics Attended ESDSWG Meetings 2009, 2010
Participated in ESDSWG MPARWG Telecons 2009, 2010 Contributions: Experiences Goals Feedback Recommendations -20- MEASURES VIP ESDRs Science Review Panel

21 Metrics Continue membership in MPARWG
Respond as needed to MPARWG chairs Continue quarterly reporting in ESDS MCT Refine metrics collection methods to more precisely express services rendered -21- MEASURES VIP ESDRs Science Review Panel

22 Metrics Questions? -22- MEASURES VIP ESDRs Science Review Panel

23 GCMD Entry Global Change Master Directory
NASA sponsored repository for Earth and environmental science information Data sets Data services Intended to consolidate such things into a one-stop-find-everything-site -23- MEASURES VIP ESDRs Science Review Panel

24 GCMD Entry Uses keywords to navigate through a topical database
Platform Instrument Originating Center Data Center Distribution Contact Pubs/Refs Uses keywords to navigate through a topical database Every NASA product is described by Entry ID Summary Geographic Coverage Data Set Citation Temporal Coverage Location / Science Keywords ISO Topic Category -24- MEASURES VIP ESDRs Science Review Panel

25 GCMD Entry Adding a data set is a simple matter of completing a web form Approval for addition is at GCMD discretion Preference given to data sets with: Compliant metadata (ECS or ISO) Relevance to at least one of about 1,500 science topics -25- MEASURES VIP ESDRs Science Review Panel

26 GCMD Entry Sample GCMD Entry -26-
MEASURES VIP ESDRs Science Review Panel

Download ppt "ESDRs Distribution and User Support – Miscellaneous Topics"

Similar presentations

ASIAES Project Overview Satellite Image Network for Natural Hazard Management in ASEAN+3 region Pakorn Apaphant Geo-Informatics and Space Technology Development.

ASIAES Project Overview Satellite Image Network for Natural Hazard Management in ASEAN+3 region Pakorn Apaphant Geo-Informatics and Space Technology Development.
IDN Services and SERF Update Heather Weir. Earth Science Related Tools & Services Contains: –Descriptions of commercial and non-commercial, Earth science.

IDN Services and SERF Update Heather Weir. Earth Science Related Tools & Services Contains: –Descriptions of commercial and non-commercial, Earth science.
IDN Services and SERF Update Heather Weir

IDN Services and SERF Update Heather Weir
U.S. Department of the Interior U.S. Geological Survey MRTWeb: Enhanced MODIS data discovery and delivery services from the LP DAAC January 18, 2007 Tom.

U.S. Department of the Interior U.S. Geological Survey MRTWeb: Enhanced MODIS data discovery and delivery services from the LP DAAC January 18, 2007 Tom.
Product Quality and Documentation – Recent Developments H. K. Ramapriyan Assistant Project Manager ESDIS Project, Code 423, NASA GFSC

Product Quality and Documentation – Recent Developments H. K. Ramapriyan Assistant Project Manager ESDIS Project, Code 423, NASA GFSC
Metrics Planning Group (MPG) Report to Plenary Clyde Brown ESDSWG Nov 3, 2011.

Metrics Planning Group (MPG) Report to Plenary Clyde Brown ESDSWG Nov 3, 2011.
Introduction and Election of Co-Chair H. K. (Rama) Ramapriyan NASA/GSFC Metrics Planning and Reporting (MPAR) WG 8 th Earth Science Data Systems Working.

Introduction and Election of Co-Chair H. K. (Rama) Ramapriyan NASA/GSFC Metrics Planning and Reporting (MPAR) WG 8 th Earth Science Data Systems Working.
Earth Science Data and Information System (ESDIS) Project Update May 10-11, 2011 Goddard Earth Sciences Data and Information Services Center (GES DISC)

Earth Science Data and Information System (ESDIS) Project Update May 10-11, 2011 Goddard Earth Sciences Data and Information Services Center (GES DISC)
How to Download MODIS Images Dr. A.K.M. Saiful Islam, IWFM, BUET Dr. Sujit Kumar Bala, IWFM, BUET Mr. M. Golam Mahboob, BARI December 2007.

How to Download MODIS Images Dr. A.K.M. Saiful Islam, IWFM, BUET Dr. Sujit Kumar Bala, IWFM, BUET Mr. M. Golam Mahboob, BARI December 2007.
NOAA Metadata Update Ted Habermann. NOAA EDMC Documentation Directive This Procedural Directive establishes 1) a metadata content standard (International.

NOAA Metadata Update Ted Habermann. NOAA EDMC Documentation Directive This Procedural Directive establishes 1) a metadata content standard (International.
Prof. Vishnuprasad Nagadevara Indian Institute of Management Bangalore

Prof. Vishnuprasad Nagadevara Indian Institute of Management Bangalore
Data Ingest Automation GHRC Status and Plans Helen Conover GHRC DAAC Operations Manager Presented at ESIP Summer Meeting 2015.

Data Ingest Automation GHRC Status and Plans Helen Conover GHRC DAAC Operations Manager Presented at ESIP Summer Meeting 2015.
05 December, 2002HDF & HDF-EOS Workshop VI1 SEEDS Standards Process Richard Ullman SEEDS Standards Formulation Team Lead

05 December, 2002HDF & HDF-EOS Workshop VI1 SEEDS Standards Process Richard Ullman SEEDS Standards Formulation Team Lead
U.S. Department of the Interior U.S. Geological Survey Land Processes DAAC Update MODIS-VIIRS Science Team Meeting January 26-28, 2010 Dave Meyer LP DAAC.

U.S. Department of the Interior U.S. Geological Survey Land Processes DAAC Update MODIS-VIIRS Science Team Meeting January 26-28, 2010 Dave Meyer LP DAAC.
Proposed Post-processing and Referral Metrics Robert Wolfe (GSFC – MODAPS) and Tom Sohre (EDC – LP DAAC) Presented by Jason Werpy (EDC – LP DAAC) Earth.

Proposed Post-processing and Referral Metrics Robert Wolfe (GSFC – MODAPS) and Tom Sohre (EDC – LP DAAC) Presented by Jason Werpy (EDC – LP DAAC) Earth.
Earth Observing System Data and Information System (EOSDIS) provides access to more than 3,000 types of Earth science data products and specialized services.

Earth Observing System Data and Information System (EOSDIS) provides access to more than 3,000 types of Earth science data products and specialized services.
, Implementing GIS for Expanded Data Accessibility and Discoverability ASDC Introduction The Atmospheric Science Data Center (ASDC) at NASA Langley Research.

, Implementing GIS for Expanded Data Accessibility and Discoverability ASDC Introduction The Atmospheric Science Data Center (ASDC) at NASA Langley Research.
SCADM MEETING, SEPTEMBER 7, 2011 STATUS OF THE ANTARCTIC MASTER DIRECTORY.

SCADM MEETING, SEPTEMBER 7, 2011 STATUS OF THE ANTARCTIC MASTER DIRECTORY.
Status of the Antarctic Master Directory SCADM Meeting, August 22, 2014.

Status of the Antarctic Master Directory SCADM Meeting, August 22, 2014.
U.S. Department of the Interior U.S. Geological Survey Diving into the Data Pool with DAAC2Disk Kelly Lemig ERT, Inc., contractor to the U.S. Geological.

U.S. Department of the Interior U.S. Geological Survey Diving into the Data Pool with DAAC2Disk Kelly Lemig ERT, Inc., contractor to the U.S. Geological.

Similar presentations

Ads by Google