How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: 7016-23 :: 16:20 Wednesday 25.

Slides:



Advertisements
Similar presentations
Tango Meeting DESY Status Report Thorsten Kracht Grenoble, 13. May 2009.
Advertisements

Clusters as calibration tools S. Molendi (IASF-MI)
X-ray Astrostatistics Bayesian Methods in Data Analysis Aneta Siemiginowska Vinay Kashyap and CHASC Jeremy Drake, Nov.2005.
Modelling unknown errors as random variables Thomas Svensson, SP Technical Research Institute of Sweden, a statistician working with Chalmers and FCC in.
XMM EPIC Andy Read IACHEC 2013 Leicestershire, UK, 25-28/03/13 XMM-Newton EPIC Cross- Calibration Andy Read With contributions from Matteo.
Deriving and fitting LogN-LogS distributions An Introduction Andreas Zezas University of Crete.
Imaging Analysis Aneta Siemiginowska Chandra X-ray Center Harvard-Smithsonian Center for Astrophysics.
Fitting X-ray Spectra with Imperfect Models Nancy S. Brickhouse Harvard-Smithsonian Center for Astrophysics Acknowledgments to Randall Smith and Adam Foster.
Markov-Chain Monte Carlo
EPIC flux comparison from 2XMM sources S. Mateos, R. Saxton, S. Sembay & A. Read.
GLAST Science Support CenterAugust 9, 2004 Likelihood Analysis of LAT Data James Chiang (GLAST SSC – SLAC)
X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL 7/11/2007, Comparison of Observed and Theoretical Fe L Emission from CIE Plasmas Matthew.
25 Jan 2005CUC Meeting CXC-Sponsored Workshops & Symposia Paul Green For the Chandra Directors Office.
Principal Components Analysis Babak Rasolzadeh Tuesday, 5th December 2006.
Computing the Posterior Probability The posterior probability distribution contains the complete information concerning the parameters, but need often.
Andrea Caliandro 1 Andrea Caliandro (INFN - Bari) on behalf the FERMI-LAT collaboration PSR J : the youngest gamma-ray pulsar in the Galaxy?
“Real-time” Transient Detection Algorithms Dr. Kang Hyeun Ji, Thomas Herring MIT.
Probing the evolution of stellar systems Andreas Zezas Harvard-Smithsonian Center for Astrophysics.
Chandra Calibration Status  Recent releases  Current Calibration projects  Cross-Calibration between Chandra and other X-ray telescopes  Revisions.
XMM EPIC MOS Andy Read EPIC Calibration Meeting Leicester University 05/11/03 Update on refinement of the PSF - Spectral and spatial.
Dimensional reduction, PCA
XMM EPIC SOC Richard Saxton Background, Operations & Calibration (BOC) meeting Madrid, 23/03/10-24/03/10 Recent changes in Epic-related SAS spectral tasks.
Deriving and fitting LogN-LogS distributions Andreas Zezas Harvard-Smithsonian Center for Astrophysics.
X-ray Variability of AGN
Chandra X-Ray Observatory CXC Paul Plucinsky February A Comparison of Spectral Fit Results of E0102 from the Chandra and XMM CCDs Paul Plucinsky.
G. Cowan RHUL Physics Bayesian Higgs combination page 1 Bayesian Higgs combination using shapes ATLAS Statistics Meeting CERN, 19 December, 2007 Glen Cowan.
Biomedical Image Analysis and Machine Learning BMI 731 Winter 2005 Kun Huang Department of Biomedical Informatics Ohio State University.
Can people meet from 2:40 to 3:30 on Tuesday, September 5?
LSST CD-1 Review SLAC, Menlo Park, CA November 1 - 3, 2011 Analysis Overview Bhuv Jain and Jeff Newman.
GLAST Science Support Center June 29, 2005Data Challenge II Software Workshop GRB Analysis David Band GSFC/UMBC.
Title: Quién le pone el cascabel al gato ? J. F. Albacete Colombo Univ. de Rio Negro, Viedma, ARG & Ettore Flaccomio Osservatorio Astronomico di Palermo,
Three data analysis problems Andreas Zezas University of Crete CfA.
Quantifying the likelihood of substructure in Coronal Loops
Detector Monitoring as part of VLT Science and Data Flow Operations Wolfgang Hummel DMO/DFO/QC group Lander de Bilbao, SDD/pipeline group Andrea Modigliani,
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 MAP (Maximum A Posteriori) x is reduced state vector [SST(x), TCWV(w)]
Accurate gamma-ray spectrometry of environmental samples: a challenge O. Sima - Bucharest University D. Arnold - PTB Braunschweig C. Dovlete - ERL Bucharest.
Update to End to End LSST Science Simulation Garrett Jernigan and John Peterson December, 2004 Status of the Science End-to-End Simulator: 1. Sky Models.
Astrophysics working group - CERN March, 2004 Point source searches, Aart Heijboer 1 Point Source Searches with ANTARES Outline: reconstruction news event.
The Role of Interferometers in Future Space Astrophysics Missions Ron Allen Space Telescope Science Institute Synthesis Imaging Scientist Space Interferometry.
A taste of statistics Normal error (Gaussian) distribution  most important in statistical analysis of data, describes the distribution of random observations.
1 Japan-US collaboration to develop the “End-to-End simulator” Tsunefumi Mizuno Mar 12, 2003.
Nov Common Archive Observation Model What is CAOM and why should MAST use it? Brian McLean.
EBEx foregrounds and band optimization Carlo Baccigalupi, Radek Stompor.
HST ACS data LSST: ~40 galaxies per sq.arcmin. LSST CD-1 Review SLAC, Menlo Park, CA November 1 - 3, LSST will achieve percent level statistical.
Bob Jacobsen Aug 6, 2002 From Raw Data to Physics From Raw Data to Physics: Reconstruction and Analysis Introduction Sample Analysis A Model Basic Features.
A multiline LTE inversion using PCA Marian Martínez González.
MCMC reconstruction of the 2 HE cascade events Dmitry Chirkin, UW Madison.
Solving the Mystery of the Highest Energy Cosmic Rays : 1938 to 2007 cosmic rays: James W. Cronin Inaugural Conference: Institute for Gravitation and the.
1 John Nousek & David Burrows (Penn State University) Alberto Moretti (Osservatorio Astronomico di Brera) X-Ray Telescope (XRT): Performance after Five.
Metal abundance evolution in distant galaxy clusters observed by XMM-Newton Alessandro Baldi Astronomy Dept. - University of Bologna INAF - OABO In collaboration.
Jin Huang M.I.T. For Transversity Collaboration Meeting Jan 29, JLab.
Susan Burke DØ/University of Arizona DPF 2006 Measurement of the top pair production cross section at DØ using dilepton and lepton + track events Susan.
1 Tracker Software Status M. Ellis MICE Collaboration Meeting 27 th June 2005.
Muon Energy reconstruction in IceCube and neutrino flux measurement Dmitry Chirkin, University of Wisconsin at Madison, U.S.A., MANTS meeting, fall 2009.
Euclid Big Data Opportunities Tom Kitching (UCL MSSL) – Euclid Science Lead.
GLAST Science Support Center November 8, 2005 GUC Action Item #15 AI#15: Pre-Launch GI Proposal Tools David Band (GSSC/JCA-UMBC)
Other Trace Gases (a.k.a. HCHO, BrO, and OClO) Status & Outlook
Updating SF-Tree Speaker: Ho Wai Shing.
reduction data treatment for ARCS
Towards a CTA high-level science analysis framework
Deriving and fitting LogN-LogS distributions An Introduction
4th Coding Sprint Short intro into GammaLib and ctools concepts
Smithsonian Astrophysical Observatory
AstroStatistics Workshop
AN ANALYSIS OF TWO COMMON REFERENCE POINTS FOR EEGS
Distributions and Uncertainties
by Xiang Mao and Qin Chen
Susan Burke, University of Arizona
XSPEC and Response Modeling
Presentation transcript:

How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap SPIE 2008 :: Observatory Operations :: :: 16:20 Wednesday 25 June 2008

How to handle calibration uncertainties in high-energy astrophysics Vinay Kashyap CHASC Astrostatistical Collaboration Chandra X-ray Center Smithsonian Astrophysical Observatory Hyunsook Lee, Aneta Siemiginowska, Jonathan McDowell, Arnold Rots, Jeremy Drake, Pete Ratzlaff, Andreas Zezas, Doug Burke, Rima Izem, Alanna Connors, David van Dyk, Taeyoung Park SPIE 2008 :: Observatory Operations :: :: 16:20 Wednesday 25 June 2008

bottom line there is now a way to include calibration uncertainty in astrophysical data analysis in a flexible way for any instrument, mission, or detector.

Part I calibration uncertainty in data analysis Part II practical issues of storage, retrieval, flexibility

The three most important effects that affect data analysis astrophysical model uncertainty statistical uncertainty (measurement error) calibration uncertainty (systematic error)

examples of calibration uncertainty

power-law residuals with current calibration

power-law residuals with 20Å contamination overlayer

(E,p,t) : photon energy, location, arrival time (E’,p’) : detector channel, chip location S : astrophysical source model R : energy redistribution function (RMF) P : position redistribution function (PSF) A : effective area (ARF) M : predicted model counts general model of HEA data

effect on model parameter uncertainty  Probability density

but how exactly?

MCMC

DATACALIBRATION Draw parameters Update parameters Compute likelihood

DATACALIBRATION Draw parameters Compute likelihood Draw effective areas Update parameters

but where do the effective areas come from?

Principal Components

newnominalbias PCs ~N (0,1) residual eigenvalue eigenvector A = A 0 + bias + components + residual

Part II practical issues of storage, retrieval, flexibility A = A 0 + bias + components + residual

store in same format as A 0 case specific secondary FITS extension e.g., SPECRESP e.g., PCA1D SIMS POLY1D PCPC MULTISCALE

what have we got so far? realistic error bars implemented in BLoCXS 500x speed up in analysis Sherpa on the way unified file format for use in XSPEC/Sherpa 100x drop in storage generalize to any instrument extendable to model lacunae roll your own

summary there are a number of steps between a calibration scientist saying “the error on the effective area is X% at energy Y” to then have it fold into a spectral model fit and inflate the error bars on the parameters, and we believe that we have connected the dots.

uncertainty in energy response

one more thing..

what’s next? unified file format implemented in XSPEC/Sherpa other schemes of dimensionality reduction RMFs: 2D PCA, within and between PCA PSFs: multiscale residuals

Data { Calibration }