1. The Emerging Heliophysics Informatics Infrastructure J. Ireland ADNET Systems, Inc. / NASA-GSFC

2. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC Credit: NASA Scientific Visualization Studio; ENLIL Heliospheric Model; BATS-R-US Magnetospheric Model Space Weather

3. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC Credit: NASA Scientific Visualization Studio; ENLIL Heliospheric Model; BATS-R-US Magnetospheric Model Space Weather

4. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC Connect the physics along the Sun-Earth line. Data access - both observations and modeling - is key to progress. Tools to examine data - lots of data. Space Weather

5. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC Informatics infrastructure Informatics: a broad academic field encompassing information science, information technology, algorithms, and social science. Infrastructure is the basic physical and organizational structures needed for the operation of a society or enterprise.

6. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC Virtual Observatories (archives): simplified access to data from multiple instruments - Solar: www.virtualsolar.org - Magnetosphere: vmo.gsfc.nasa.gov - Heliosphere: vho.gsfc.nasa.gov - virtual archive for model output: ??? - SOTERIA (SODA): soteria-space.eu - HELIO: www.helio-vo.eu - NOAA: www.swpc.noaa.gov Emerging...

7. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC Feature/Event databases - European Grid of Solar Observations Solar Event catalog: sec.ts.astro.it/sec_ui.php - Heliophysics Knowledgebase: lmsal.com/hek - SOTERIA Online Solar Event Catalogue - NOAA SWPC - other catalogues at many different locations Emerging...

8. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC Locally IDL + Solarsoft + local FITS files = maximum flexibility Festival  IDL application Auchère et al, 2008 Sol. Phys., 248, 213 Looking at the heliosphere

9. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC www.solarmonitor.org - Very little of its own content - Relies on services - images, active region numbers - provided by others. - Narrowly focused on active regions/flares but it is a useful web application. Looking at the heliosphere Gallagher et al., Sol. Phys, 2002, 209, 171 Over the web

10. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC Looking at the heliosphere Over the web SOHO Movie Theater  full disk + coronagraphs  arbitrary time range http://sohodata.nascom.nasa.gov/cgi- bin/soho_movie_theater

11. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC Over the web http://www.lmsal.com/so larsoft/last_events/ http://www.lmsal.com/so larsoft/last_events/  active region / flares  near Sun field models  AIA, STEREO, ACE, GOES, Hinode A space weather web application Looking at the heliosphere

12. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC SOHO images Mobile Looking at the heliosphere solar monitor / space weather STEREO data

13. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC SDO: > 1.4 TB uncompressed image data /day. Model output: many terabytes per run (petaflop/exaflop machines) Advanced Technology Solar Telescope: ~ 42 TB / day How to let all users examine these data? Petabytes and beyond

14. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC JPEG2000 Compression Split original image into n x n pixel blocks. Encode each n x n pixel block using Discrete Wavelet Transform. ➡ Spatially localized Lossy or lossless encoding. More complex codec - but more flexible. Cohen-Daubechies-Feauveau 7/9 wavelet lossy n x n

15. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC JPEG2000 Compression All zoom levels are encoded in one file Wavelet transform naturally encodes multiple length-scales since wavelets subsample locally

16. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC JPIP = JPEG2000 Interactive Protocol JPIP provides a client−server architecture for transmitting JPEG2000 imagery over networks Can query arbitrary parts, quality levels of images and movies Transfer only needed data XML header stores FITS keywords Remote access to images

17. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC JPEG2000 file format Back-end: images of solar and heliospheric data in JPEG2000 format served to Helioviewer client applications. Well described API - anyone can use our images. Front-end: browse clients that display these images with other meta-data provided by other services. Open source (almost completely). ESA and NASA funded. Helioviewer Project

18. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC User makes request clien t JPEG20 00 service location times data Tiler HV JPIP JHV movies images Client / server Feature / event service feature meta data times catalog

19. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC www.helioviewer.org

20. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC JHelioviewer

21. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC examine the data your way

22. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC Helioviewer Project Core services solve the problem of examining large archives of large 2d images from multiple instruments over the web Web client: www.helioviewer.org Desktop client: www.jhelioviewer.org (release candidate now available) More information: www.helioviewer.org/wiki

23. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC Conclusion s Data are getting bigger faster. - transfer of science data still a problem Multiple organizational efforts are under way. New technology is allowing the creation of new visualization and data access tools. Connect solar tools to the rest of the heliosphere - HELIO (top-down) - VxO / Helioviewer (bottom-up)

24. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC Some thoughts from our experience Data must be made available to others so that they may build their own applications. - Separation of the archive from its delivery. - Well documented service oriented architecture. - Make easy accessibility to data a standard requirement for all contributors to Space Weather information. Shared standards.

25. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC End

26. J. IrelandSeventh European Space Weather Week ADNET Systems, Inc/ NASA GSFC Credit: NASA Scientific Visualization Studio; ENLIL Heliospheric Model; BATS-R-US Magnetospheric Model Space Weather