1. Steven Worley, NSF/NCAR/SCD
Research Data Archives Archiving, Maintenance, Access Steven Worley, Scientific Computing Division
23 February 2019
Steven Worley, NSF/NCAR/SCD

2. Steven Worley, NSF/NCAR/SCD
Data Archiving
Definition: Research data archive
Meteorological and physical oceanographic data
Built over 35+ years
500+ datasets, 25 TB
Eight data stewards (grad. degrees in met./ocn.)
23 February 2019
Steven Worley, NSF/NCAR/SCD

3. Steven Worley, NSF/NCAR/SCD
23 February 2019
Steven Worley, NSF/NCAR/SCD

4. Steven Worley, NSF/NCAR/SCD
Data Maintenance
Practices
Track lineage - Use change control system
Creation
File additions, fixes, replacement
Metadata updates
The data and metadata remain tightly linked
Keep user information current
Changes trigger web page updates
23 February 2019
Steven Worley, NSF/NCAR/SCD

5. Steven Worley, NSF/NCAR/SCD
Data Maintenance
Concerns
Fact: Huge collections of web based documentation.
Text, Images, Links
Embedded scripting (e.g. java script …)
HOW DO WE ARCHIVE WEB SITES?
Access content 20 years from now?
Data in DBMS’s
Software dependent
Not viable for long-term archive, technology trap
23 February 2019
Steven Worley, NSF/NCAR/SCD

6. Steven Worley, NSF/NCAR/SCD
Data Access
Discovery
Community Data Portal (NCAR/UCAR wide)
Standardized metadata
Divisional Section Server
Detailed metadata, all documentation
Four access modes
MSS
Only for users with MSS connection (NCAR/UCAR)
By individual request
Handled by data stewards
CDROM
Section Data Server
Popular data only, metadata (open to the public)
23 February 2019
Steven Worley, NSF/NCAR/SCD

7. Steven Worley, NSF/NCAR/SCD
23 February 2019
Steven Worley, NSF/NCAR/SCD

8. Steven Worley, NSF/NCAR/SCD
ERA-40 Data
Basic Facts
Global atmospheric reanalysis
T159, 60 level, 4x/day, ( 1.1° resolution)
1958  (45 years)
23 February 2019
Steven Worley, NSF/NCAR/SCD

9. Steven Worley, NSF/NCAR/SCD
ERA-40
23 February 2019
Steven Worley, NSF/NCAR/SCD

10. Steven Worley, NSF/NCAR/SCD
ERA-40
Monthly Mean Air Temperature at 2m
Odds and ends
2 to 3 FTE’s focused on ERA-40
SCD is ERA-40 archive backup for ECMWF
Primary U.S. source
NASA collaboration
CCSP Contribution, NASA Global Reanalysis, at GMAO/GSFC
Modern Era Reanalyses for Research and Applications (MERRA)
We will provide input data used in ERA-40
MERRA output at NCAR/UCAR?
23 February 2019
Steven Worley, NSF/NCAR/SCD