1. Data Discovery and Access to The International Surface Pressure Databank (ISPD) 1 Thomas Cram Gilbert P. Compo* Doug Schuster Chesley McColl* Steven Worley National Center for Atmospheric Research, Boulder, CO *NOAA/CIRES, Boulder, CO AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

2. 2 Research Data Archive (RDA) at NCAR rda.ucar.edu 1.600+ distinct datasets for climate and weather research 2.Collections: ocean & atmosphere observations, analyses, reanalyses, operational NWP outputs 3.Free and open access http://rda.ucar.edu AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

3. ISPD Overview 3 World’s largest collection of surface & sea level pressure observations  Land station  Marine observations (ICOADS)  Tropical cyclone best track (IBTrACS) Period (version 2): 1768 – 2010 Volume: 465 Gbyte Available since Aug 2010 AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

4. ISPD Overview 4 60+ Contributors o Atmospheric Circulation Reconstructions over the Earth (ACRE) o Australian Bureau of Meteorology o British Antarctic Survey o Cook Islands Meteorological Service o Danish Meteorological Institute o Deutscher Wetterdienst (DWD; German Weather Service) o European and North Atlantic Daily to Multidecadal Climate Variability (EMULATE) o ETH Zurich, Switzerland o GCOS/WCRP Working Group on Observational Data Sets for Reanalysis o MANY MANY MORE…. Assembled by NOAA/ESRL, CIRES (Univ. of Colorado), & NOAA/NCDC AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

5. 5 ISPD Sample Annual Station Distribution 1850 * Land stations only * No marine stations AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

6. 1850 6 1900 * Land stations only * No marine stations ISPD Sample Annual Station Distribution AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

7. 1850 7 1900 1950 * Land stations only * No marine stations ISPD Sample Annual Station Distribution AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

8. 1850 8 1900 1950 2000 * Land stations only * No marine stations ISPD Sample Annual Station Distribution

9. 9 ISPD Observations/Year Figure courtesy Chesley McColl, NOAA/ESRL 2010: 53 Million ~ 1.5 Billion total observations

10. Data Access: Problem Background Large computational/storage resources needed –Store data –Extract desired data from large grids/files –Convert data to desirable format(s) 10 Scientific data centers have these resources Individual researchers generally don’t AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

11. Goals –Make data more accessible and easier to use for individual researchers Reasonable access volumes Desired data formats User defined parameters/grids 11 Researchers stay focused on research Data Access: Problem Background AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

12. ISPD Data Access Services 12 Powerful computing resources @ NCAR Large disk storage (~ 0.5 PB) Rich and detailed metadata Direct file download via web Customized data sub-setting HDF-5 to ASCII software tools (NetCDF forthcoming)

13. 13 ISPD Metadata Features Both group- and file-level metadata Drive interfaces for file grouping and sub- setting tools Support efficient back-end processing Improve scalability Provide “quick look” at data samples AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

14. ISPD Metadata Interface Example 14 AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

15. 15 AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

16. 16 AGU 2012 Fall Meeting: IN44A-05

17. 17 AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

18. Data Access: ISPD Subset Interface 18 AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

19. ISPD Data Access Services 19 Temporal range sub- setting (daily) Spatial sub-setting Lat/Lon region Individual station ID

20. ISPD Data Access Services 20 Data sub-setting options (cont.) Observation type Land station Marine obs Radiosonde Dropsonde TC best track

21. ISPD Data Access Services 21 Subsetting processed in delayed mode E-mail notification Download via server-provided scripts (wget)

22. 22 ISPD 2012 Subset metrics Data accessed: ~ 6.5 TB Data served: ~ 46 GB AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

23. Summary & Future Directions 23 RDA – Supply “User Friendly” Data  Parameter & spatial sub-setting  Metadata discovery  Format conversion  Improved and additional services NWSC-Cheyenne opening – more computing power AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

24. 24 DOI assignment Geoscience Data Journal article ISPD v3 (1755-2010)  Spring 2013 ISPD Forthcoming AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2

25. 25 rda.ucar.edu/ds132.0 tcram@ucar.edu AMS 2013 Annual Meeting: 29EIPT/25CVC J1.2