SDS Staffing:  Welcome Nina Bonaventura on the Helpdesk team  All CIAO tickets now handled by SDS (Liz, Nick, Nina)‏ Focus this year has been (and will.

Slides:



Advertisements
Similar presentations
2 Oct 2003 UCL 2nd Year Talk 1 Crosstalk Removal to Improve Muon dE/dX Measurements Leo Jenner, UCL.
Advertisements

Chandra X-Ray Observatory CXC Paul Plucinsky EPIC Cal April ACIS Calibration: Recent Updates, Planned Updates, & Future Issues 2.E0102: Joint.
CAA 10th Cross Calibration Workshop, Paris, France, 2-4th Nov CLUSTER / STAFF Action items C. Burlaud, P. Robert, M. Maksimovic, N. Cornilleau-Wehrlin,
WELCOME TO THE ANALYSIS PLATFORM V4.1. HOME The updated tool has been simplified and developed to be more intuitive and quicker to use: 3 modes for all.
SDS Presentation Jonathan McDowell CXC 1 Chandra Users Committee Meeting, 25 January 2005 Science Data Systems (SDS) CUC Presentation Jan 2005.
25 Jan 2005CUC Meeting CXC-Sponsored Workshops & Symposia Paul Green For the Chandra Directors Office.
Chandra Users’ Committee CXC Manager’s Status Report For the period October 06 – March 07 Edward Mattison CXC Deputy Manager 25 April 2007.
Chandra Calibration Status ACIS 1.Gain corrections for epochs 28 and 29 (Nov – April 2007) were released in CALDB 3.4 on May 16, Gain corrections.
Chandra Users’ Committee CXC Manager’s Status Report For the period April 08 – September 08 Roger Brissenden CXC Manager 15 October 2008.
CUC Oct 2005 Science Data Systems Jonathan McDowell.
Chandra Calibration Status ACIS 1.Gain correction files for epochs 33 and 34 were released in CALDB (June 2008) and (Sep. 2008). HETG 1. An.
Chandra Calibration Status Calibration Updates Since Last CUC Meeting ACIS 1. New tgain files were released for epochs 23 and 24 (May 2005 – Nov 2005)
Chandra Calibration Status  Gain correction files for epochs 35 (Aug. – Oct. 2008) and 36 (Nov Jan.2009) were released in CALDB versions
CXC Manager’s Status Report For the period April 06 – September 06 Chandra Users’ Committee Meeting Roger Brissenden 17 October 2006.
CUC meeting Apr 2009 CXC-SDS Science Data Systems CIAO, Pipelines and Catalog Jonathan McDowell.
Chandra Users’ Committee CXC Manager’s Status Report For the period April 09 – October 09 Edward Mattison CXC Deputy Manager 29 October 2009.
Chandra Calibration Status Summary 1.The gratings and mirrors are very well calibrated at this time and there are no time-dependent effects as far as we.
Chandra Calibration Status  Recent releases  Current Calibration projects  Cross-Calibration between Chandra and other X-ray telescopes  Revisions.
Chandra Calibration Status Calibration Updates Since Last CUC Meeting ACIS 1. A full set of calibration products for S0, S4 and S5 at T=-120 C, including.
Chandra Calibration Status Calibration Updates Since Last CUC Meeting ACIS 2. New products were released in CALDB on Dec. 15, 2006 to properly handle.
CUC meeting Oct 2009 CXC-SDS Science Data Systems Jonathan McDowell.
1 XMM-Newton Extended Source Analysis Software Steve Snowden & Kip Kuntz  Publicly Released 5 April 2006  XMM-Newton Extended Source Analysis Software.
Chandra X-Ray Observatory CXC Paul Plucinsky EPIC Cal Nov ACIS Calibration: Planned Updates & Future Issues 2.ACIS Operations: Controlling the.
Chandra Calibration Status CUC Meeting Oct. 13, 2011.
Chandra X-Ray Observatory CXC Paul Plucinsky February A Comparison of Spectral Fit Results of E0102 from the Chandra and XMM CCDs Paul Plucinsky.
ADASS, London Sep 23-26, 2007 VOExplorer : Visualising Data Discovery in the Virtual Observatory Jonathan Tedds University of Leicester/AstroGrid/ EuroVO.
Wqed: A new tool for Abstract: We present a set of tools for processing time-series photometry. Observations of variable stars typically need to be corrected.
CXC CUC September SDS Page 1 CUC Sep 2007 Science Data Systems – Jonathan McDowell.
Introduction to Spitzer and some applications Data products Pipelines Preliminary work K. Nilsson, J.M. Castro Cerón, J.P.U. Fynbo, D.J. Watson, J. Hjorth.
Hubble Legacy Archive Lee Quick - TIPS meeting July 19, 2012 Goals Data History Current Work Demo.
Commissioning the NOAO Data Management System Howard H. Lanning, Rob Seaman, Chris Smith (National Optical Astronomy Observatory, Data Products Program)
X-ray Astronomy School 2007 Databases, software, etc. for X-ray astronomy Keith Arnaud NASA Goddard University of Maryland.
Not Your Advisor's CIAO... - an update on Chandra's CIAO analysis system Jonathan McDowell Doug Burke, Antonella Fruscione, Aneta Sieimiginowska and the.
6e-1 Science Data Products Daryl Swade DMS Systems Engineer S&OC System Design Review #1.
CUC Oct 2013 CXC CIAO Jonathan McDowell. I will report on CIAO (user software) and the standard processing pipeline software, which come into being thanks.
CXC CUC April SDS Page 1 Science Data Systems – Jonathan McDowell CUC April 2007 SCIENCE DATA SYSTEMS.
Dec 2, 2014 MAST Data Discovery Portal Tom Donaldson Tony Rogers.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
CUC Oct 2010 CXC-SDS CIAO Jonathan McDowell. CUC Oct 2010 CXC-SDS SDS team M. Noble left MIT team A. Fruscione now 50 percent time for CDO No other staff.
Nick Elias 2010 May 14 CASA Developers' Meeting1.
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 SPIRE Photometer Data Reprocessing Bernhard Schulz (NHSC/IPAC) on.
EÖTVÖS UNIVERSITY BUDAPEST Department of Physics of Complex Systems VO Spectroscopy Workshop, ESAC Spectrum Services 2007 László Dobos (ELTE)
CUC Oct 2014 CXC Jonathan McDowell. I will report on CIAO (user software) and the standard processing pipeline software, which come into being thanks.
SDS – Jonathan McDowell Chandra Users' Committee, Apr 2006 Chandra Source Catalog Repro 3 CIAO status Testing Data analysis issues.
Label Design Tool Management Council F2F Washington, D.C. November 29-30, 2006
PACS Hitchhiker’s Guide to Herschel Archive Workshop – Pasadena 6 th - 10 th Oct 2014 The PACS Photometer: Overview and Products Roberta Paladini NHSC/IPAC.
April , 2006 HEASARC Users Group Mike Corcoran HETE-2.
1 KFPA Critical Design Review – Fri., Jan. 30, 2009 KFPA Data Pipeline Bob Garwood- NRAO-CV.
ADMIT: ALMA Data Mining Toolkit  Developed by University of Maryland, University of Illinois, and NRAO (PI: L. Mundy)  Goal: First-view science data.
Pipeline Basics Jared Crossley NRAO NRAO. What is a data pipeline?  One or more programs that perform a task with reduced user interaction.  May be.
1 CEN 4072 Software Testing PPT3: Making the program fail.
CUC Apr 2010 CXC-SDS CIAO Jonathan McDowell. CUC Apr 2010 CXC-SDS CIAO Update – Jonathan McDowell Community support CIAO 4.2 released late 2009; CIAO.
ParaView III Software Methodology Update Where to now November 29, 2006 John Greenfield Sandia is a multiprogram laboratory operated by Sandia Corporation,
GLAST LAT Project 1S. Ritz Data Challenge Planning Overview Purpose Boundary conditions Plan: –scope and progression of data challenges –schedule summary.
Data Processing Workshop NHSC, Pasadena, CA 02 – 04 February 2011 Stephan Ott VG #1 PACS Overview and new developments in.
April , 2006 HEASARC Users Group Tom McGlynn The HEASARC On-line Services Tom McGlynn.
1 John Nousek & David Burrows (Penn State University) Alberto Moretti (Osservatorio Astronomico di Brera) X-Ray Telescope (XRT): Performance after Five.
PACS NHSC Data Processing Workshop Aug 26-30, 2013 Page 1 SPIRE Spectrometer Data: Calibration Updates, User Data Reprocessing, and Other Issues Nanyao.
X-ray Astronomy School 2005 Databases, software, etc. for X-ray astronomy Keith Arnaud NASA Goddard University of Maryland.
STIS Status TIPS, September 17, 2009 Charles Proffitt for the STIS team.
PDS4 Project Report PDS MC F2F University of Maryland Dan Crichton March 27,
Why do F77 always spoil the landscape ?. Several ideas … slide 2.
Application of a Charge Transfer Model to Space Telescope Data Paul Bristow Dec’03
Mantid Scientific Steering Committee Nick Draper 18/06/2010.
Tools Report Engineering Node August 2007
JWST Pipeline Overview
Single Object & Time Series Spectroscopy with JWST NIRCam
Overview – SOE PatchTT December 2013.
A one-dimensional look at the recent HETG data
Chandra Calibration Status
Presentation transcript:

SDS Staffing:  Welcome Nina Bonaventura on the Helpdesk team  All CIAO tickets now handled by SDS (Liz, Nick, Nina)‏ Focus this year has been (and will be) on source catalog Release of CIAO4 complete, planning for CIAO4.1

CIAO - current CIAO 4.0 released 2007 Dec 14  CIAO 3.4 (released 2006 Dec) still available CIAO patch released 2008 Feb 22 with enhancement to ObsVis CIAO patch April, for Leopard support on Mac Intel (not Mac PPC)‏ Fedora Core 8 now our SDS internal reference test  Solaris, Mac PPC, Mac Intel machines also used; will retain an FC4 CIAO 4 outreach (re suggestions of last CUC): session at HEAD meeting: presented data analysis review, did demos, created CIAO 1-pager handouts CIAO workshop tentatively planned for the fall Thread additions continuing

CIAO - downloads CIAO 4.0 released 2007 Dec 14 Since then:  376 downloads of CIAO4.0 Fedora Core 234 Intel Mac 88 Intel PPC 37 Solaris 17  Continued interest in CIAO3.4: 57 downloads in this period (even split Linux/Mac)‏  CIAO obsvis patch 88 downloads

CIAO - future CIAO 4.1 baselined for end of year  Not a major release  Move Sherpa, DM Ascii kernel out of beta status  Will include a few catalog tools adapted for users  Afterglow algorithm  Improvements to prism file viewer Longer term plan: themes (improvements to CIAO and Catalog in parallel)‏  Point and mildly extended sources: improvements to analysis (chip gaps, messy cases)‏  Coadded data for coaligned pointings: scripts to improve usability and characterization of calibration issues  Mosaics and other misaligned cases  Extended source analysis  MIT team will continue to improve gratings analysis software

Analysing Repro 3 ACIS imaging data Investigating easier way for users to see what corrections they need to do to archive data  Repro 3 data allows us to remove many of the messy footnotes in the thread Remove afterglow correction and run hot pixels - NOT NEEDED (but: new afterglow code in prototyping)‏ acis_process_events:  VFAINT data still needs check_vf_pha  TGAIN correction - especially for recent data CALDB TGAIN epoch 30: 2007 May 1- Jul 31 CALDB TGAIN epoch 31: 2007 Aug 1 - Oct 31 CALDB TGAIN epoch 32: 2007 Nov Jan 31 ( release imminent )‏  CTI correction - NOT NEEDED (already applied)‏ except for BI chips (some obsids)‏  Contam correction has not changed, 2004 extrapolation still used Aspect known processing offset correction NOT NEEDED (applying reproject_aspect to incorporate external astrometry can still be useful)‏ Eliminate high background times - still recommended (analyse_ltcrv.sl, soon to be upgraded)‏

Cosmic ray afterglow update acis_run_hotpix (in pipeline) misses some faint (4-7 count) afterglows that can then show up in wavdetect as spurious faint sources acis_detect_afterglow can be run to eliminate these, but it can also delete real x-ray events afterglow events will be close together in time - we can use this to distinguish them from a steady source - Glenn Allen is prototyping a new algorithm For more details, see the 'why topic' on afterglow: 

CUC MAR 2008 Improvements to Afterglow Correction G. Allen working on a time- dependent version. Uses sliding time window to search for events in the same pixel. Key is to flag afterglow, but leave astrophysical sources alone. Tests (right) show that one can tune the test to ~4 count events, down from ~8 with current, spatial-only algorithm.

Filtering text files: Data Model Ascii Kernel beta release Filtering columns:  dmcopy “sample.dat[col3=11:20][cols col4,col5]” copy.dat”[opt kernel=text/simple]” Making a FITS file from a text file  dmcopy sample.dat sample.fits Handling a variety of text formats  dmcopy 'data.csv[time=100:200][opt sep=”,”]' “data.tex[opt kernel=text,sep=&]” Support for a multi-table (multi-extension) text format equivalent to a FITS bintable file, “DTF' (Data Text Format)‏  TTYPE, TUNIT, etc. in header Support for fixed format files for Fortran fans: DTF-FIXED  TBCOLn and TDISPn header keywords See: ahelp dmascii

Gratings Analysis We want to make the gratings more accessible to users  Improved organization of existing material  Capture tricks and tips from MIT grating experts  Provide analysis scripts and prototype high level products to simplify the analysis process – the gratings equivalent of the psextract type script Existing introductory thread: Analysis guide for high resolution spectroscopy Existing detailed threads updated fro CIAO4.0 for each detector/grating combination. New proposal-oriented threads in development – John's talk Analysis threads for advanced (“tricky”) topics – John's talk TGCat - a first cut at the next level of products (processing script and calibrated spectra) – Joy's talk HEAD special session – Norbert's talk

CUC MAR 2008 Gratings Pileup Correction I M. Nowak created a simple S- lang script, which is in “Chandra ABC Guide” (and described & applied in Nowak et al. 2008)‏ Improvements made by grad student M. Hanke, & applied to Cyg X-1 data (peak pileup ~35%). Pileup fraction is a fit parameter. (Hanke et al. 2008)‏

CUC MAR 2008 Gratings Pileup Correction II J. Davis is finishing an “ab initio” model, that works to much higher pileup fractions. Pileup is calibrated against existing HETG observations (i.e., pileup fraction is calculated, not fit). Works on a per chip basis, with separate pileup calibrations by wavelength, order, arm, & frontside (blue residuals) / backside (green residuals) chips.

CUC MAR 2008 Pileup III D. Dewey created a simple imaging tool to view pileup in Chandra observations. ( otes/pileup/pileup_color.html) M. Nowak adapted it to use the S-lang module interface to DS9/XPA, and apply to Suzaku data. Goal is to create interactive region filter. D. Huenemoerder exploring similar concepts for gratings region filtering. Left: >1%, >2%, & >5% Pileup Levels Right: Data filtered using information on the left.

CUC MAR 2008 TGCat Related Development See presentation by Joy Nichols. D. Huenemoerder developing scripts for automated extraction, akin to psextract. Developing plotting scripts to combine arms/orders, & plot units “friendly” to IR, optical, & radio astronomers, & save data to simple ASCII files. Plot_Unit(“um”,”ergs”); unix% download_obsid 1234 unix% setup_obsdir Obs1234 unix% isis isis> run_tg_acis(“Obs1234”); isis> hetgs_summary(“Obs1234”, “plots”); isis> quit unix% display plots*ps Example Script Various diagnostic plots are displayed. Could be converted to a tool with a parameter file interface.