VSO Integration with netDRMS Joseph A. Hourclé and the VSO Team HMI : 2009 Sept 08

For those unfamiliar with my slides …  Turn on a view where you can see the notes. I put talking points / citation details / etc in there.

The VSO Now  Standardized API Allow searching & retrieval of data from: Allow searching & retrieval of data from: SOHO, Hinode, TRACE, STEREO, SOLIS, GONG, TON, H  net, Nançay, Big Bear, Mt. Wilson, Mauna Loa, etc. SOHO, Hinode, TRACE, STEREO, SOLIS, GONG, TON, H  net, Nançay, Big Bear, Mt. Wilson, Mauna Loa, etc. Same interface for all data Same interface for all data Allows multiple clients to use VSO Allows multiple clients to use VSO Web interface; IDL; Helioviewer; HEK; Helio Web interface; IDL; Helioviewer; HEK; Helio

The VSO’s role  Making data available to the solar physics community Funded via NASA’s Solar Data Analysis Center Funded via NASA’s Solar Data Analysis Center Can be more responsive to the needs of the solar physics community Can be more responsive to the needs of the solar physics community If you want something … ask us! If you want something … ask us! NASA/GSFC : Joe Gurman, Joe Hourclé NASA/GSFC : Joe Gurman, Joe Hourclé NSO : Frank Hill, Igor Suárez-Solá NSO : Frank Hill, Igor Suárez-Solá SAO : Piet Martens, Alisdair Davey SAO : Piet Martens, Alisdair Davey Stanford : Rick Bogart, Jennifer Spencer Stanford : Rick Bogart, Jennifer Spencer

VSO IDL usage

IDL usage : warning  ‘vso_get’ can only retrieve direct URLs Cannot handle ‘staged’, ‘offline’ or ‘push’ Cannot handle ‘staged’, ‘offline’ or ‘push’ Can’t currently use for data from SHA Can’t currently use for data from SHA Until we finish the netDRMS integration to pull MDI data via netDRMS Until we finish the netDRMS integration to pull MDI data via netDRMS  ‘sample’ keyword is not support by all data providers

The VSO Now

Integration with netDRMS  Dealing with the flood of SDO data: Getting the data to the users Getting the data to the users  VSO “caching nodes” will store SDO data netDRMS / remote SUMS sites netDRMS / remote SUMS sites Try to reduce the load on Stanford: Try to reduce the load on Stanford: Pre-fetching data Pre-fetching data Caching the data in high-demand Caching the data in high-demand Distributing high-demand data across multiple sites Distributing high-demand data across multiple sites

Example SDO request

VSO pre-fetching

New Tools  ‘vget’ Parallel downloading tool Parallel downloading tool Input file can also be passed to ‘curl’ or ‘wget’ Input file can also be passed to ‘curl’ or ‘wget’