1. XMM-Newton Users Group Meeting #6 Science Support ESAC, 19 th. / 20 th. May 2005 L. Metcalfe SCI-SDX 1 Science Operations & Data Systems Division Research & Scientific Support Department Page 1 XMM-Newton

2. CONTENTS Significant Progress & Dates MOS1 Impact Event Avoiding Radiation General Calibration Points Data Processing User Support & Mission Planning XSA Miscellaneous 2 Science Operations & Data Systems Division Research & Scientific Support Department Page 2 XMM-Newton

3. SIGNIFICANT PROGRESS & DATES 3 Science Operations & Data Systems Division Research & Scientific Support Department Page 3 XMM-Newton

4. SIGNIFICANT PROGRESS to proceed with cross-calibration work at top priority major progress in calib. presentations (space/time dept. MOS Cal.)  there are stubborn areas to report on Slew Survey at next UG meeting see current results in R. Saxton’s talk to organise a 2005 Conference The X-ray Universe 2005 - Sep. 26-30, 2005: N. Schartel presentation to get RGS background accumulator into the next SAS was in SAS 6.1 to get RGS Superfluxer (merging spectra) into the folowing SAS tool is completed now and ready for the upcoming SAS release to pursue EPIC background modelling at second priority  see EPIC calibration presentation

5. SIGNIFICANT DATES AO4 Cycle: Call30 Aug.2004 Close Phase I08 Oct.2004 Open phase II10 Jan.2005 Close XRPS11 Feb.2005 AO5 Cycle: Call05 Sep.2005 Close Phase I14 Oct.2005 OTAC results public10 Jan.2006 Open phase II for first PI group23 Jan.2006 Close XRPS17 Feb.2005 Start AO5 observations May2006

6. SIGNIFICANT DATES (contd.) Users Group meeting #502/03Jun.2004 XMM-Newton 5-years in flight10 Dec.2004  all Calls over-subscription by x7 or more  >700 refereed papers then (now more than 800) 5th. SAS Workshop07/10June2005 The X-ray Universe 2005, El Escorial 26-30Sep.2005 ADASS, El Escorial 03-07Oct.2005 NB: An annular eclipse of the Sun will take place at Madrid at the interface between these last two conferences.

7. EPIC MOS1 MICROMETEOROID IMPACT 7 Science Operations & Data Systems Division Research & Scientific Support Department Page 7 XMM-Newton

8. 8 Science Operations & Data Systems Division Research & Scientific Support Department Page 8 XMM-Newton MOS1 MICROMETEOROID IMPACT  ~01:30 hrs.UT on 09/03/05, Rev. 961: event registered in EPIC MOS1 FP  similar to Sep.17, ‘01 MOS1, Aug. 12, ‘02 MOS2 & Oct. 19, ‘00 pn events  those attributed to micrometeoroid impacts scattering debris into the FP  in MOS cases saw bright flash & data buffer overflows across whole FP  always new hot or defective pixels subsequently mapped and masked  recent event more significant.  MOS1 CCD6 is dead  new hot pixels elsewhere in MOS1 focal plane (some effects near boresight)  Sci. obs. continue normally, including MOS1, but with CCD6 switched off  apart from disabling MOS1 CCD6, baseline was to maintain deliveries

9. 9 Science Operations & Data Systems Division Research & Scientific Support Department Page 9 XMM-Newton MOS1 MICROMETEOROID IMPACT The flash

10. 10 Science Operations & Data Systems Division Research & Scientific Support Department Page 10 XMM-Newton MOS1 focal plane post-Rev.961 event

11. MOS1 MICROMETEOROID IMPACT 11 Science Operations & Data Systems Division Research & Scientific Support Department Page 11 XMM-Newton  Eventually the pipeline crashed on affected ODFs requiring a 10 day fix SAS testing did not show it, and SAS processing remains unaffected  The new hot column appears to be cooling down it is being closely monitored detailed handling is under discussion oSetting of data reduction flags oAdjustment of on-board offset we propose - starting with AO5 - to apply the RGS boresight for all observations  Dedicated web page gives latest information to users re. handling this http://xmm.vilspa.esa.es/external/xmm_news/items/MOS1-CCD6/index.shtml DO YOU AGREE WITH THIS FRED ??

12. GENERAL CALIBRATION POINTS 12 Science Operations & Data Systems Division Research & Scientific Support Department Page 12 XMM-Newton

13. NRCOs 31 PN Large Window fast CTI determination 32 The absolute Flux calibration of OM 33 RGS “dithering” on line-rich Capella 34 Refinement of pn-CTI correction 35 EPIC soft-energy X-cal. on GD 153 36 XMM-Newton cross-calibration on H1426+428 37 Use of a single RGS2 ADC 38 4 pointing raster on 1ES0102 39 The absolute Flux calibration of OM 40 The OM UV red leaks 41 Sanity check of MOS filters 42 HZ 43 XMM/Swift cross-calibration 43 H1426+428 XMM/Swift cross-calibration 44 Rejected: PKS0537-286 XMM/Swift cross-calibration 45 HZ 43 XMM/Swift cross-calibration 46 XMM-Newton / Chandra X-calibration on H1426+428 47 Repetition of PN Large Window fast CTI determination 48 Further refinement of pn-CTI correction 49 EPIC pn SW noise below lower threshold 50 OM UBV Calibration Consistency check

14. CCF RELEASE NOTES IN PERIOD XMM-CCF-REL-169 EPIC MOS low energy response & QE05Aug2004 XMM-CCF-REL-170 MOS Filter Transmission14Jun2004 XMM-CCF-REL-171 RGS Instrumental Flourine Absorption24Jun2004 XMM-CCF-REL-172 Improving pn Window mode CTI correction 19Jul2004 & refining long term CTI corr. all pn Modes XMM-CCF-REL-173 RGS DARKFRAME normalisation 19Jul2004 XMM-CCF-REL-174 pn telescope effective area modification 09Jun2004 XMM-CCF-REL-175 EPIC PN Bad Pixels05Jul2004 XMM-CCF-REL-176 RGS QE Shortest Corr. Factors27Jul2004 XMM-CCF-REL-177 Low-E noise rejection refinement for pn15Sep2004 XMM-CCF-REL-178 Masking MOS bright patches: MOS1 CCD4 14Sep2004 XMM-CCF-REL-179 RGS Background Spectral Templates 15Oct2004 XMM-CCF-REL-180 EPIC PN masked mode parameters15Oct2004 XMM-CCF-REL-181 EPIC MOS fixed offset29Oct2004 XMM-CCF-REL-182 Ecorr for Extended Full Frame mode12Nov2004 XMM-CCF-REL-183 EPIC-pn spectral response11Nov2004 XMM-CCF-REL-184 EPIC MOS response10Dec2004 XMM-CCF-REL-185 CCF set for SciSim 25Jan2005 XMM-CCF-REL-186 EPIC-pn Filter Transmission 14Mar2005 XMM-CCF-REL-187Effective Area of the EPIC-pn X-Ray Telescope 18Mar2005 XMM-CCF-REL-189EPIC-pn spectral response 09 May 2005

15. 15 Science Operations & Data Systems Division Research & Scientific Support Department Page 15 XMM-Newton High Cal. Fraction: Reflects cross-cal. efforts & also includes SCOS 2000 test revs. Cal. Fraction will be reduced by 2-3% in future by putting EPIC calcloseds in slews.

16. DATA PROCESSING SAS aspects (C. Gabriel presentation) SSC/Pipe aspects (M. Watson presentation) 16 Science Operations & Data Systems Division Research & Scientific Support Department Page 16 XMM-Newton

17. PRODUCT GENERATION (see MGW talk) Delays from SSC system config. (Feb.8 to mid-April)  corruptions on NFS-mounted disks @ new reprocessing equipment MOS1 CCD6 caused some problems (add 10 days)  not seen in SAS-based tests  fixes were rapidly developed Affected users were informed  we decided that in future we will aim, seeking SSC support as needed, to explain any delay after 40 days  ODF usually available to PI in XSA within 2 weeks of observation 17 Science Operations & Data Systems Division Research & Scientific Support Department Page 17 XMM-Newton

18. UESR SUPPORT & MISSION PLANNING 18 Science Operations & Data Systems Division Research & Scientific Support Department Page 18 XMM-Newton

19. USER SUPPORT & MISSION PLANNING SCHEDULING  Nominal, with 3-4 weeks buffer  All requested coordinations done (even late ones not via OTAC)  All fixed-time details fulfilled  Triggered Observations & fast ToOs  need fast & careful reaction  instrument performance checked in real time by a USG scientist and reflected in telemetry allocation table (this is beyond the baseline)  Long Term Plan for AO4 issued 19 Science Operations & Data Systems Division Research & Scientific Support Department Page 19 XMM-Newton

20. SUPPORT TO EACH CALL Two phase Call support to PIs  means two epochs of heavy helpdesk load OTAC support  very tight schedule but went smoothly, with just over 2 months from Call closure to public release of OTAC decisions (4 weeks OTAC evaluation) Phase 2  distribute proposals in 3 sets by visibility &'criticality‘ Enhancement of proposals  95% of 231 AO4 proposals done  check Phase 2 obs. params. vs OTAC approved ones, check coordinates in simbad, instrument set up, bright nearby X-ray objects, specific enhancement requests), flag fixed-time observations, PA constraints or coordination, confirm visibility. Iterate with or notify Pis AO4 scheduling started only 3.5 weeks after Phase 2 closure 20 Science Operations & Data Systems Division Research & Scientific Support Department Page 20 XMM-Newton

21. USER SUPPORT - DOCUMENTATION  XMM-Newton News 23Mar2005#4815Mar2005#4701Feb2005#46 16Dec2004#4510Dec2004#4401Dec2004#43 19Oct2004#42 30Aug2004#4130Jul2004#40 28Oct2004X-ray Symposium: 1st announcement 14Apr2005X-ray Symposium: 2nd announcement  Quarterly Reports 31Mar200531Dec200430Sep 2004 30Jun2004  General oUHB and other docs.: update for AO-4, underway for AO5 oon-line HRPS help + XRPS Manual oPeriodically updated Calibration Status Documents oSAS Manual and other SAS docs.

22. AVOIDING RADIATION Plans implemented concerning adjusting to seasonal effects fully in AO4 22 Science Operations & Data Systems Division Research & Scientific Support Department Page 22 XMM-Newton

23. 23 Science Operations & Data Systems Division Research & Scientific Support Department Page 23 XMM-Newton I STILL NEED THE GOOD PLOT!

24.  XMM orbit intercepts radiation belts in cyclically varying way some seasons early/late parts of science window little affected by radiation other seasons hours of observation lost at both ends of rev. due to radiation  Ops. Supp. Team in IOT modelled seasonal radiation  To avoid science obs. in high radiation at both ends of the Rev. : nominal science window unchanged (> 46000 km above Earth) science observations manually scheduled following model predictions: start only when model predicts radiation will be low enough, end when model predicts radiation will become high on average, about 10000 sec per revolution discarded 24 Science Operations & Data Systems Division Research & Scientific Support Department Page 24 XMM-Newton Radiation Impacts Mitigation

25.  Obs. still possible in high rad. periods within science window obs. required purely to configure special S/C slew tracks OM calibration observations (no X-ray exposures) cal-closed on request of cal-team (e.g. bad pixel monitoring)  Implemented with AO4 observations (April 1st. onwards) visibility tool was updated before Call to include and apply model so PIs had the 'true' visibility information at proposal submission  It is avoided to schedule priority A observations & critical targets (e.g. coordinated or fixed-time obs.) at ends of sci. window exemption for targets with bad visibility 25 Science Operations & Data Systems Division Research & Scientific Support Department Page 25 XMM-Newton Radiation Impacts Mitigation

26. XSA 26 Science Operations & Data Systems Division Research & Scientific Support Department Page 26 XMM-Newton

27. 27 Science Operations & Data Systems Division Research & Scientific Support Department Page 27 XMM-Newton ACTIVE USERS Number of Active Users

28. 28 Science Operations & Data Systems Division Research & Scientific Support Department Page 28 XMM-Newton REGISTERED USERS Number of Registered Users

29. 29 Science Operations & Data Systems Division Research & Scientific Support Department Page 29 XMM-Newton REGISTERED USERS

30. 30 Science Operations & Data Systems Division Research & Scientific Support Department Page 30 XMM-Newton REQUESTS Number of Requests Still must find out what are the spikes for “other” ??

31. 31 Science Operations & Data Systems Division Research & Scientific Support Department Page 31 XMM-Newton REQUESTS Number of Requests

32. 32 Science Operations & Data Systems Division Research & Scientific Support Department Page 32 XMM-Newton VOLUME Volume in GB Still must find out what are the spikes for “other” ??

33. 33 Science Operations & Data Systems Division Research & Scientific Support Department Page 33 XMM-Newton VOLUME Volume in GB

34. 34 Science Operations & Data Systems Division Research & Scientific Support Department Page 34 XMM-Newton ACCESSES Number of Accesses

35. 35 Science Operations & Data Systems Division Research & Scientific Support Department Page 35 XMM-Newton QUERIES Number of Queries

36. XSA Data processing facilities in the XMM-Newton Science Archive (XSA) XSA v2.7 released November 2004 full suite of data proc. facilities can be triggered from XSA user interface  latest public SAS reprocessing of raw telemetry (ODF) for all XMM-Newton cameras through meta-tasks ("emproc", "epproc", "rgsproc", "omichain", "omfchain")  ftp retrieval of products  filtering of EPIC calibrated and concatenated event lists prior to retrieval  interactive extraction of spectra and light curves from sky regions in EPIC exposure images in the XSA FITS viewer tool  response matrices generated, & spectral products.  users can now monitor download or processing status through "Request Monitor" tool

37. XSA future XSA v2.8 (May-June 2005) First XID products accessible ~70 INT/WFC images with good photometric calibration Queriable on: Coordinates Time Optical filter/telescope/detector Observing quality (seeing, sky brightness) A few issues on the sky level subtraction are the main driver for the exact release date Data quality reports available, combination of: „New“ SOC ODF Qcheck reports „Old“ pre SASv6.5 PPS Delivery Notes (will be updated with reprocessed data) Query on an average backgrpund level during the observation Query on ODF production date Integration of Aladin in the XSA user interface XSA v3.0 (late 2005) Full support of reprocessed data: Source-specific products: Spectra (automatic download of spectral files with all necessary ancillary data) Light curves New imaging products 2XMM Automatic calculation of proprietary right expire dates (currently done manually by the USG) Integration of ds9 in the XSA user interface (?)

38. XSA and the Virtual Observatory The XSA is consistent with data access and protocols defined in the framework of the International Virtual Observatory Alliance: Simple Image Access Protocol (for EPIC images) Simple Spectra Access Protocol (for RGS spectra) o The XSA is therefore potentially already a „Virtual Observatory“ machine XMM-Newton data can be accessed through the Virtual Observatory prototype XMM-Newton data were used for the 2 nd AVO demo at ESO (January 2004) Future (long-term) goals: EPIC spectra shall be compatible with the SSAP as well Need for EPIC spectra to be expressed in physical units Database of RGS detected lines compatible for Data Line Access Protocol 38 Science Operations & Data Systems Division Research & Scientific Support Department Page 38 XMM-Newton

39. 39 Science Operations & Data Systems Division Research & Scientific Support Department Page 39 XMM-Newton END