1. LP DAAC Overview – Land Processes Distributed Active Archive Center Chris Doescher LP DAAC Project Manager cdoesch@usgs.gov (605) 594-2649 Chris Torbert LP DAAC Mission Manager ctorbert@usgs.gov (605) 594-2825

2. Agenda NASA ESDIS and LP DAAC Ingest and Archive Processing Capability Access Methods 2

3. NASA LP DAAC at USGS EROS Part of a large distributed network of EOSDIS Data Centers Ingest, archive, process, and distribute ASTER and MODIS data – International relationship with Japan (METI) to support ASTER Data – Distribute large volume of data to research community Co-located at EROS to support the land remote sensing community – Data destined to transition to USGS Long Term Archive – Technical and scientific collaboration Operated under a NASA / DOI interagency agreement Support a broad user base – Casual User, Research Users, Applications Users (> 26,000 in FY11) – Interest in cross-dataset access (ASTER, MODIS, Landsat, etc) – Over 300 products in 2.1 PB archive (all on-line) 3 NASA Land Processes Distributed Active Archive (LP DAAC) 3

5. What is ESDIS?

6. 6

7. Central Reusability Capabilities Earthdata: The EOSDIS Website (HTTP://earthdata.nasa.gov) Metadata Services – ECHO: Searchable catalog of granule metadata for NASA datasets (OpenSearch, CSW, OGC interfaces) – Global Change Master Directory (GCMD): Searchable Catalog of over 26,000 NASA and international dataset collections – Common Metadata Repository (CMR): replacement of ECHO with adds granule, service, and bundle metadata User Tools (e.g.) – Reverb - Search and Order – Global Imagery Browse Services (GIBS) - Full resolution imagery derived from NASA products in a standardized manner to any web-connected client (open sourced) – Worldview - Highly responsive interface to explore GIBS imagery and download the underlying data – Giovanni - quick-Start Exploratory Data Analysis – Earthdata Search (beta) - future replacement of Reverb. Metrics System (EMS): Collects and reports on data ingest, production, archive, and distribution across all EOSDIS data centers. User Registration System (aka Earthdata login): provides a centralized and mechanism for user registration and account management for all EOSDIS system. 7

8. Archive VIIRS Sentinel 3 JPSS 2 JPSS 1 ECOSTRESS MEaSURES 2012  1 Petabyte: 5 years of EOS data (at 46 mbps)  2 Petabytes: All US academic research libraries

9. FY2014 Number of Products Distributed by Discipline 9 EOSDIS Yearly Total Data Volume (PB) and Number of Products (Billions) Distributed to End Users Data Distribution FY14

10. EOSDIS Data Products Distributed - FY14 10

11. Clients (EarthData Search) 11

12. Clients (Global WELD) 12

13. OSTP Big Earth Data Initiative (BEDI) Initiative: – “…improve the discoverability, accessibility, and usability of data and information derived from Federal civil Earth observations...” – “…making open and machine-readable the default for government data…” NASA Focus areas: – Catalog and data discovery improvements – Improve web services for direct data access (including visualization) – Implement throughout NASA centers on high-impact data Identifiers, metadata, cataloging, linking with services LP DAAC activities: – Standardize metadata across DAACs through implementation of Common Metadata Repository (CMR) – Data browse accessible through Global Image Browse Service (GIBS) Mobile application - Landcast – Assign Digital Object Identifiers (DOI) to all dataset – Operationalize services through standard protocols (OpenDAP) Middle-wear to simplify use of services and demonstrate relevance to Earth science. (“aggregator” for multi-source information and data). 13

14. OPeNDAP: Just give me what I want! Open Source Project for a Network Data Access Protocol OPeNDAP services allow users to request only the portion of the data files they are interested in. Application for Extracting and Exploring Analysis-Ready Samples (AppEEARS) – Middle-wear Python application suite to perform higher-level access and lower level analysis directly on archived data through OpenDAP. Pixel level example: “Extract time series of VI and LST from 10 flux tower locations from the beginning of Terra Mission through the current date” – Data are located in 7 different MODIS Level 3 tiles 8-day LST (686 date values), monthly VI (180 date values) 7 * (686 + 180) = 6,062 granules (212 GB) – Process through sample selector 1 hour, 10 minutes Downloaded ASCII file is 409 KB (7 orders of magnitude less!) 14

15. AppEEARS 15

16. LandCast: Phone Ap - Slider Comparison

17. Questions???