1. MSDP data processing - Different data levels: advantages and limitations - How to solve problems: - when the code stops (channel geometry…) - when the results are distorted spatially (scanning problems…) - when clouds disturb the observations - when the results exhibit periodic fluctuations (profile interpolations) - improvement of telescope pointing in X-scans, signal/noise ratio. … - A few problems in more details: - Channel geometry and grid geometry - Cospatiality adjustment (2D) - Parameter files for THEMIS and other instruments over the years Pierre Mein, MSDP whorkshop, Tarbes 2006

2. THEMIS / MSDP Different data levels Raw datafits 3files t… 1) sequence.par + msdpauto (idl) 1 file for 1 window and 1 timefits 1 files b…… creates new directory + ms.par 2) new directory + ms.par + ms1 (f90) a) Calibrations (geometry, photometry) Superposable calibrated channelsmsdpfiles c…. b) Results with preliminary wavelength calibration Bisector for each observing timemsdpmsdpfiles d…. Bisector for full scanmsdpfiles q…. c) Results with internal wavelength calibration Line profiles for each timemsdpfiles r…. Line profiles for full scanmsdpfiles p….

3. I+V I-V Raw data Simultaneous 2D spectro-polarimetry - Example of 16 channels (alternate wavelengths) - Grid at first focus in front of polarization analyser Focus F1Focus Sp1Focus Sp2

4. Files t…raw datafits 3 Files b…1 file for 1 window and 1 timefits 1 t….b….b….b….Scan files t….x….b….x….Dark current t….y….b….y….Flat field t….z….b….z….Field stop

5. Line profile restoration (9 channels, without polar. analysis, VTT)

6. For each time, series of identical rectangles, at different Might be used for direct line profile inversion to specify parameters of a solar model without profile interpolations This would avoid interpolations and loss of accuracy (see corrections of periodic fluctuations…) Superposable calibrated channels files c….

7. - In case of series of exposures (bursts), allow seeing effects correction by destretching (Pic du Midi) - Provide the full data for 1 observing time without loss of field-of- view (overlaps mix successive observations in q- and p- files). - Can be used to investigate far line wings near the edges of channels (one wing near one edge) Results for each time Files d…preliminary wavelength calibration (mainly bisector computations) Files r…calibrated wavelengths (mainly line profiles)

8. Full scan results Files q….(bisector) Not corrected  0 Files p….(profiles) Corrected 0 -The standard processing provides Without polarization With Zeeman circular analysisanalysis Additional arrays - q-files with intensity near line centreStokes V near line centre sum of intensities +/-  Int. differences (cospatiality test) difference of intensities +/-  Stokes V at +/-  intensity from bisector +/-  velocity from bisector +/-  velocity from bisector +/-  B// from bisector +/-  - p-files with intensity line profileStokes V line profile In case of Q,U,V observations, separate files for +Q,-Q,+U,-U,+V,-V noted(param nqseul) 1 2 3 4 5 6 and beam-exchange results 7 8 9

9. 1) If the IDL interface « msdpauto » stops ? (the b- files are not created) - Check the directory name of data in msdpauto, ’…..directory….’ - Check the number bs of channels in « sequence.par » (the code divides the frames in 2 windows of 8 channels in the case of 16 channels beam-shifters) How to solve problems

10. 2) in all cases when the Fortran code « ms1 » stops ? - The most simple way to modify the parameters of « ms1 » is to edit and modify « ms.par », and to run again « ms1 » - To modify parameters automatically for a full campaign, it is necessary to modify « tyear.par » if the parameters are present in that file (t for Themis,year = 2002, 2003, … « pyear.par » for Pic du Midi, « myear.par » for Meudon,…) In that case, run again the IDL interface « msdpauto »

11. If the code stops before channel geometry determination ? (before any message including « milgeo ») Either the code does not read files with the good format: Check sundec and iswap in ms.par, or sd in sequence.par Or the code does not find the data files: Check that files y,z are present and also x if parameter idc=1 Check also that the directory name is correct in ms.par

12. If the code stops and asks for an « increase of milgeo » ? The code cannot determine the edges of channels. -1) If the geo.ps file is available -display it by ggv geo.ps And modify in ms.par the parameters after headers « bmg » such as thresholds si,sj,sgi,sgj,… (see param.txt for details)

14. If the code stops and asks for an « increase of milgeo » ? -2) If the geo.ps file is not available, - display the average field-stop file by IDL image = readmsdp(‘z………’) tvscl,im and check the location of channels (parameters i1, i2m), the sharpness (intvi,intvj)…

15. i2m=250

16. How to solve problems if the resulting q- and p-files exhibit strong spatial distortions ? Something is wrong in the parameters specifying symetries and scanning directions, or grid location. - Small rectangles: Some of the following parameters must be modified: inveri, inverj, xfirst Note also that invi, invj determine the final symetries of the maps invern, inverl, invers determine signs and orders of wavelengths and Stokes parameters

17. Xfirst = 0 Xfirst = 1 Xfirst = 1, norma = 0199 NaD1, intensity +/-40mA, 16 oct 2002

18. How to solve problems if the resulting q- and p-files exhibit strong spatial distortions ? - Lines parallel to the X-scanning direction: Display grid.ps and modify caldeb,ideb, igri, itgri (see param.txt) Automatic correction with caldeb = 1

19. How to correct cloud effects ? Intensities disturbed by clouds Velocities and B// not disturbed

20. Correction norma (norma=0289) Intensities corrected

21. How to solve problems if q- and p-files exhibit spatial periodic fluctuations ? The limited spectral resolution leads to slight periodic errors due to line profile interpolations, which produce kinds of fringes parallel to the longer edge of field- stop. Several ways can be used to correct them.

22. How to correct grooves due to interpolation between channels ? Themis, 16 channels, without correction I_0I_120 v_120B_120

23. P=  y  P y x Themis: 16 channelsP ~ 1.4 arcsec 9 channelsP ~ 4.1 arcsec  n  y * (  y)  Channel step For corrections, we assume that, locally,  does not depend on  y (we neglect the inclination and curvature of lines  = ct) Spatial wavelength P of fluctuations versus y

24. 1)Profile curvature deduced from neighbouring points curvd = 4 (curvr = 4) I’(3) I(3) I ’’(3) Z I’ I I’’ P/2 -P/2 Z(3)=I(3) Z(4)=I(4) Z(5)=I(5) Z(6)=I(6) Z(3.5)+Z(5.5)-2*Z(4.5) = (I’(4)+I’’(3)+I’(6)+I’’(5)-2*(I’(5)+I’’(4)))/2 Themis 16 channels0.7 ’’ 9 channels2’’ Interval 4-5: Z = polynomial degree 4 x y

25. 2) Fourier filtering Crecd(w1d)w2d(w3d) Crecr(w1r)w2r(w3r) 0/10/10/1 L =2P PP/2 M y x j i Correction = - Ct* -crecd,+crecd * cos(2  y/L)*apod(y)> -P,+P P crecd

26. Themis, 16 channels, Curvature curvd = 4, Fourier crecd = 2000, w2d = 1 I_0I_120 v_120B_120

27. Corrections without any loss of spatial resolution Power functionsI’=(I-I z )**aa= milalp / 1000 I z =I min * milzero / 1000 Interpolation I = I z + I’**(1/a) 1)  smoothingchannelsn-1, n, n+1 weights ¼, ½, ¼ nlisd = 2 nlisr = 2 (effect similar to Fourier filtering w1 = 1 (w1r = 1) which degrades slightly the spatial resolution instead of the spectral one) 2)

28. 3) Mean departures between successive scan steps lcrecq M y x Field of view of a d-file (1 t-value) Each quantity (I, v, Stokes..) of all files d (or r) from the same scan defines a function F(x,y,t) 1) Computation of the mean A of F over x,y,t after rejection ( departures > sigma * milsigq /1000 ) 2) For each pixel x,y, computation of the average D(x,y) of departures from A for all times t 3) Smoothing D' of D(x,y) versus x over –L,+L around M (L = lcrecq / 1000 arcsec) 4) The correction is - D' if crecq = 2 (folding with period P if crecq = 1) The correction depends only on x and y. It does not degrade the spatial resolution.

29. VTT, 23 oct 2002 H  without correction I_0 460 * 180 arcsec

30. I_290 Without correction

31. v_290 Without correction

32. quick.ps P Mean departures 2D correlations and pointing corrections

33. VTT H  2D Correlations lcorq = 2 icormq = 4000 copasq = 2000 milcoq = 300 ( 2d array) (4’’) (2’’) (0.3) Corrections by mean departures crecq = 2 lcrecq = 10000 milsigq = 2000 (10’’) (2 *  ) I_0

34. I_290

35. v_290 Disc centre

36. Some additional improvements Signal/noise ratio: can be improved by smoothing versus wavelength nlisd,nlisr versus x ilisdr versus y jlisdr Scattered lightrate = scatter /1000 (computed over each line at constant  Very large scansincrease the pixel = milsec /1000 arcsec

37. Cospatiality adjustment 0.5 arcsec error introduced manually (itana+500) Cospatiality test

38. Correctioncalana (calana=1, quadratic interpol.) between dx = +/-1’’ et dy = +/-0.5’’) Cospatiality test

39. Channel geometry Field stop (8 channels) Flat field Because of a shift between field-stop and flat-field, due to misadjustment of grating angles, too large to be corrected by the code, the flat-field must be used instead of the field- stop (calfs = -1) But channel edges are more difficult to determine because of the presence of lines in some channels. nleft, nright allow to locate some edges by similarity with neighbouring channels

40. calfs = -1 flat field used as field stop nright = 3 right edge of channel 3deduced from left edge +size of channel 4

41. Steps Corrections FilesOutput results geom calib Power fcts Scattered light Normalization Smoothing  Profile curvature Fourier filtering Cospatiality 2D - correl Average departures geo flat bmc cmd b c d q r p Aligned and calibrated channels Possible direct inversion avoiding interpolation corrections Individual maps I, v, B// Possible destretching Large maps I, v, B// Individual maps Profiles I, Q, U, V with calibrated central wavelength Large spectrohéliog. I,Q,U,V Inversions with constant quick cmr prof Like cmd except cospatiality Like quick except 2D - correl

42. Parameter files which specify MSDP instruments THEMISt2000.par, t2001.par,…t2005.par LJR at Pic du Midip2001.par,p2002.par,…p2005.par Meudon Solar Towerm2003.par,m2004.par,m2005.par processing msdpauto + ms1 VTT / DALSA camerasexample of ms.par processing dalsa + ms1 Wroclaw Large Coronagraphexamples of ms.par (?) processing similar to ms1