1. STCE annual meeting 7 June, 2011
Accessing and manipulating SDO data at STCE: wrap-up of the mini-workshop
Dans ssh : pour avoir de grands
caracteres: edit/settings/Font terminal : 14 pour avoir en grand
.reset_session if you get entangled
STCE annual meeting
7 June, 2011 1

2. Accessing and analysing SDO data at STCE
Summary mini-workshop:
~ 20 people attended
1st part: presentations
2nd part: hands-on tutorial on use with VSO, pseudo-file system, python, and condor
Feedback: a lot of thanks!
Material available at
- Past events
In this talk:
Accessing data
Data archive
Compute cluster
Intranet, internet
Analyzing AIA data
Motion and brightness variation estimation
Combine SWAP & AIA
Use in COMESEP project
Analyzing HMI data
Reconstruction of TSI

3. Accessing data : archive
208TB redundant storage array
HMI magnetogram and intensitygram 4K x 4K
AIA 94, 131, 171, 193, 211, 304, 335, 1600, 1700, 4500Å, 1K x 1K and 4K x 4K
Delays for availability
One hour for 1Kx1K
2 to 5 days for 4Kx4K science data
Retention time :
~ 6 months for whole AIA+HMI data.
Low-cadence data set (1 image /per hour) as well as often used data set are kept for a longer time

4. Compute cluster, intranet, internet
Compute cluster : cl0.sdodb.oma.be ,
closely linked to archive for fast access. Condor to manage various request, multiple jobs
12 TB High speed disk array, linked to it
Intranet :
Pseudo File System
directly from /pool/data/ within compute cluster
Internet:
Virtual Solar Observatory serves SDO data. Keyword site=‘rob’ from vso_get will fetch data from ROB.
Sdoget library for python

5. Analysis of AIA data
Motion estimation in SDO/AIA images using graphics processing units (GPU) – Samuel Gissot, ROB
Combining SDO & PROBA2 Data – Dan Seaton, ROB
Possible usage of SDO data in the FP7 COMESEP (COronal Mass Ejections and Solar Energetic Particles) project – Norma Crosby, BIRA

6. Motion estimation in SDO/AIA images using graphics processing units (GPU) – Samuel Gissot, ROB

9. Combining SDO & PROBA2 Data - Dan Seaton and SWAP team

11. Merging AIA and SWAP data

13. Links to SWAP data ACCESS to SWAP data: SWAP OBJECT INFORMATION:
SWAP OBJECT INFORMATION:
SWAP SSWIDL TOOLS
IDL> ssw_upgrade, /swap, /spawn, /loud
SWAP-AIA merge tool available soon

14. Possible usage of SDO data in the FP7 COMESEP (COronal Mass Ejections and Solar Energetic Particles) project – N. Crosby (BIRA)
One of the task is the Automatic CME detection and derivation of key parameters
On-disc signature of CME observed with SDO-AIA

15. Analysis using HMI
Modeling of Total Solar Irradiance from ground based magnetograms
-Steven Dewitte, Sabri Mekaoui (IRM)

16. Goal: modelling Total Solar Irradiance for studying influence sun on earth climate
SDO/HMI Magnetogram 2011/05/20
SDO/AIA

17. Currently: reconstruction from Mount Wilson ground- based magnetograms for long term TSI variation
B = magnitude magnetic field
Mount Wilson Plage Strength Index MPSI = S10 G > B > 100 G B / #pixels
Mount Wilson Sunspot Index MWSI = S B > 100 G B / #pixels
Regression model TSI = a + b * MPSI – c * MWSI

19. Possible improvements with SDO
Better model: characterize TSI as function of B and viewing angle
HMI mag & AIA 160 nm: characterize irradiance effect of fine magnetic structures
High temporal resolution to match with 3 min TSI measurements: strong reduction of instantaneous error
Benefit:
Climate studies: more accurate characterization mechanisms of variation TSI
Near-real time irradiance modeling/prediction service for space weather

20. Conclusion
SDO data centre at STCE has been working flawlessly (very few downtime) for more than a year now
More and more people are downloading data from our data center
either from STCE,
or from all around Europe (KULeuven, UK, Ireland, Germany, France, Croatia,…)
Helpful for many projects, including FP7 and space weather related projects
Beneficial to combine SDO-AIA and PROBA2-SWAP data