STCE annual meeting 7 June, 2011 Accessing and manipulating SDO data at STCE: wrap-up of the mini-workshop Dans ssh : pour avoir de grands caracteres: edit/settings/Font terminal : 14 pour avoir en grand .reset_session if you get entangled STCE annual meeting 7 June, 2011 1

Accessing and analysing SDO data at STCE Summary mini-workshop: ~ 20 people attended 1st part: presentations 2nd part: hands-on tutorial on use with VSO, pseudo-file system, python, and condor Feedback: a lot of thanks! Material available at http://wissdom.oma.be - Past events In this talk: Accessing data Data archive Compute cluster Intranet, internet Analyzing AIA data Motion and brightness variation estimation Combine SWAP & AIA Use in COMESEP project Analyzing HMI data Reconstruction of TSI

Accessing data : archive 208TB redundant storage array HMI magnetogram and intensitygram 4K x 4K AIA 94, 131, 171, 193, 211, 304, 335, 1600, 1700, 4500Å, 1K x 1K and 4K x 4K Delays for availability One hour for 1Kx1K 2 to 5 days for 4Kx4K science data Retention time : ~ 6 months for whole AIA+HMI data. Low-cadence data set (1 image /per hour) as well as often used data set are kept for a longer time http://wissdom.oma.be

Compute cluster, intranet, internet Compute cluster : cl0.sdodb.oma.be , closely linked to archive for fast access. Condor to manage various request, multiple jobs 12 TB High speed disk array, linked to it Intranet : Pseudo File System directly from /pool/data/ within compute cluster Internet: Virtual Solar Observatory serves SDO data. Keyword site=‘rob’ from vso_get will fetch data from ROB. Sdoget library for python http://sdoatsidc.oma.be/web/sdoatsidc/UsingData

Analysis of AIA data Motion estimation in SDO/AIA images using graphics processing units (GPU) – Samuel Gissot, ROB Combining SDO & PROBA2 Data – Dan Seaton, ROB Possible usage of SDO data in the FP7 COMESEP (COronal Mass Ejections and Solar Energetic Particles) project – Norma Crosby, BIRA

Motion estimation in SDO/AIA images using graphics processing units (GPU) – Samuel Gissot, ROB

Combining SDO & PROBA2 Data - Dan Seaton and SWAP team

Merging AIA and SWAP data

Links to SWAP data ACCESS to SWAP data: SWAP OBJECT INFORMATION: http://proba2.oma.be/swap SWAP OBJECT INFORMATION: http://grian.phy.tcd.ie/solarmonitor/objects/swap/ SWAP SSWIDL TOOLS IDL> ssw_upgrade, /swap, /spawn, /loud SWAP-AIA merge tool available soon

Possible usage of SDO data in the FP7 COMESEP (COronal Mass Ejections and Solar Energetic Particles) project – N. Crosby (BIRA) One of the task is the Automatic CME detection and derivation of key parameters On-disc signature of CME observed with SDO-AIA

Analysis using HMI Modeling of Total Solar Irradiance from ground based magnetograms -Steven Dewitte, Sabri Mekaoui (IRM)

Goal: modelling Total Solar Irradiance for studying influence sun on earth climate SDO/HMI Magnetogram 2011/05/20 SDO/AIA 1600 2011-05-20

Currently: reconstruction from Mount Wilson ground- based magnetograms for long term TSI variation B = magnitude magnetic field Mount Wilson Plage Strength Index MPSI = S10 G > B > 100 G B / #pixels Mount Wilson Sunspot Index MWSI = S B > 100 G B / #pixels Regression model TSI = a + b * MPSI – c * MWSI

Possible improvements with SDO Better model: characterize TSI as function of B and viewing angle HMI mag & AIA 160 nm: characterize irradiance effect of fine magnetic structures High temporal resolution to match with 3 min TSI measurements: strong reduction of instantaneous error Benefit: Climate studies: more accurate characterization mechanisms of variation TSI Near-real time irradiance modeling/prediction service for space weather

Conclusion SDO data centre at STCE has been working flawlessly (very few downtime) for more than a year now More and more people are downloading data from our data center either from STCE, or from all around Europe (KULeuven, UK, Ireland, Germany, France, Croatia,…) Helpful for many projects, including FP7 and space weather related projects Beneficial to combine SDO-AIA and PROBA2-SWAP data