CXC CUC September 2007 - SDS Page 1 CUC Sep 2007 Science Data Systems – Jonathan McDowell.

Slides:



Advertisements
Similar presentations
High Energy Gamma Ray Group
Advertisements

NASSP Masters 5003F - Computational Astronomy Lecture 5: source detection. Test the null hypothesis (NH). –The NH says: let’s suppose there is no.
Basic Principles of X-ray Source Detection Or Who Stole All Our Photons?.....
Propagation of Error Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.
Aerosol radiative effects from satellites Gareth Thomas Nicky Chalmers, Caroline Poulsen, Ellie Highwood, Don Grainger Gareth Thomas - NCEO/CEOI-ST Joint.
GLAST Science Support CenterAugust 9, 2004 Likelihood Analysis of LAT Data James Chiang (GLAST SSC – SLAC)
Progress Report Ian Evans (CXCDS) On behalf of the Chandra Source Catalog Project Team Chandra Users’ Committee Meeting April 9, 2008.
Chandra Calibration Status ACIS 1.Gain corrections for epochs 28 and 29 (Nov – April 2007) were released in CALDB 3.4 on May 16, Gain corrections.
Progress Report Ian Evans (CXCDS) and Jonathan McDowell (SDS) Chandra Users ’ Committee Meeting September 19, 2007.
CUC Oct 2005 Science Data Systems Jonathan McDowell.
Error Propagation. Uncertainty Uncertainty reflects the knowledge that a measured value is related to the mean. Probable error is the range from the mean.
Chandra Calibration Status Calibration Updates Since Last CUC Meeting ACIS 1. A full set of calibration products for S0, S4 and S5 at T=-120 C, including.
Chandra Calibration Status Calibration Updates Since Last CUC Meeting ACIS 2. New products were released in CALDB on Dec. 15, 2006 to properly handle.
Introduction to experimental errors
Chandra X-Ray Observatory CXC Paul Plucinsky EPIC Cal Nov ACIS Calibration: Planned Updates & Future Issues 2.ACIS Operations: Controlling the.
A Two Level Monte Carlo Approach To Calculating
C&A 10April06 1 Point Source Detection and Localization Using the UW HealPixel database Toby Burnett University of Washington.
Effective Depletion Depth JC & Marina. 04/30/01Jianchun (JC) Wang2 Depletion Depth Methods FPIX0 pstop at 30° X inc Depth: d  XiXi.
The Calibration Process
G. Cowan Lectures on Statistical Data Analysis Lecture 10 page 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem 2Random variables and.
1 A MONTE CARLO EXPERIMENT In the previous slideshow, we saw that the error term is responsible for the variations of b 2 around its fixed component 
9 March 2004 GIFTS Blackbody Subsystem Critical Design Review Emissivity Modeling and Uncertainty Budget 09 March 2004.
NICMOS IntraPixel Sensitivity Chun Xu and Bahram Mobasher Space Telescope Science Institute Abstract We present here the new measurements of the NICMOS.
Model-fitting E. BertinDES Munich meeting 05/ Automated model fitting in DESDM E.Bertin (IAP)
Science Impact of Sensor Effects or How well do we need to understand our CCDs? Tony Tyson.
CXC CUC April SDS Page 1 Science Data Systems – Jonathan McDowell CUC April 2007 SCIENCE DATA SYSTEMS.
Texture. Texture is an innate property of all surfaces (clouds, trees, bricks, hair etc…). It refers to visual patterns of homogeneity and does not result.
A multi-colour survey of NGC253 with XMM-Newton Robin Barnard, Lindsey Shaw Greening & Ulrich Kolb The Open University.
Adam Zok Science Undergraduate Laboratory Internship Program August 14, 2008.
SHMS Optics Studies Tanja Horn JLab JLab Hall C meeting 18 January 2008.
Asteroids Image Calibration and Setup Making a Lightcurve What is a Lightcurve? Cole Cook  Physics and Astronomy  University of Wisconsin-Eau Claire.
PACS NHSC Data Processing Workshop – Pasadena 10 th - 14 th Sep 2012 Measuring Photometry from SPIRE Observations Presenter: David Shupe (NHSC/IPAC) on.
Propagation of Error Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.
K charged meeting 10/11/03 K tracking efficiency & geometrical acceptance :  K (p K,  K )  We use the tag in the handle emisphere to have in the signal.
COS signal to noise capabilities Limitation of COS S/N No good 2-D flat available. Fixed pattern noise dominates COS spectra. An uncalibrated COS spectrum.
Source catalog generation Aim: Build the LAT source catalog (1, 3, 5 years) Jean Ballet, CEA SaclayGSFC, 29 June 2005 Four main functions: Find unknown.
MPPC Measurements at LSU Brandon Hartfiel LSU Hardware Group Thomas Kutter, Jessica Brinson, Jason Goon, Jinmeng Liu, Jaroslaw Nowak Sam Reid January 2009.
Initial Results from the Chandra Shallow X-ray Survey in the NDWFS in Boötes S. Murray, C. Jones, W. Forman, A. Kenter, A. Vikhlinin, P. Green, D. Fabricant,
Fermi LAT Monash University Nov 21, 2009 R.DuboisFermi LAT Science Analysis Tutorial1 Issues in a Nutshell LS5039 Low stats: 4k photons in 1 yr Strong.
1 Value of information – SITEX Data analysis Shubha Kadambe (310) Information Sciences Laboratory HRL Labs 3011 Malibu Canyon.
PSF in-flight calibration - PN IFC/CNRRingberg, April 2-4, 2002 PSF in-flight calibration for PN camera Simona Ghizzardi Silvano Molendi.
G. Cowan RHUL Physics LR test to determine number of parameters page 1 Likelihood ratio test to determine best number of parameters ATLAS Statistics Forum.
MCMC reconstruction of the 2 HE cascade events Dmitry Chirkin, UW Madison.
Spatial Smoothing and Multiple Comparisons Correction for Dummies Alexa Morcom, Matthew Brett Acknowledgements.
GLAST LAT Project DC2 Closeout Workshop, GSFC, 31 May-2 June Comparisons of Searches for Sources in the DC2 Data S. W. Digel Stanford Linear Accelerator.
SCIAMACHY TOA Reflectance Correction Effects on Aerosol Optical Depth Retrieval W. Di Nicolantonio, A. Cacciari, S. Scarpanti, G. Ballista, E. Morisi,
Source catalog generation for DC2 Aim (in order of priority): 1.Improve on source detection algorithm and error box. 2.Provide a list of source identifications.
Proposal for the study to define what is really necessary and what is not when the data from beam, ND and SK are combined A.K.Ichikawa 2008/1/17.
, Dan Peterson Apparent inconsistencies and other issues in the xBSM measurements of IBS Scans We have studied the pinhole and CodedAperture.
Maximum likelihood estimators Example: Random data X i drawn from a Poisson distribution with unknown  We want to determine  For any assumed value of.
Digital Aperture Photometry ASTR 3010 Lecture 10 Textbook 9.5.
G. Cowan Lectures on Statistical Data Analysis Lecture 10 page 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem 2Random variables and.
18 Sep 2008Paul Dauncey 1 DECAL: Motivation Hence, number of charged particles is an intrinsically better measure than the energy deposited Clearest with.
In conclusion the intensity level of the CCD is linear up to the saturation limit, but there is a spilling of charges well before the saturation if.
All-sky source search Aim: Look for a fast method to find sources over the whole sky Selection criteria Algorithms Iteration Simulations Energy information.
TARGET FINDING WITH SAM AND BANDMAX Course: Special Topics in Remote Sensing & GIS Mirza Muhammad Waqar Contact:
From the NGSL to Absolute Flux Sara Heap, NASA/Goddard Space Flight Center Don Lindler, Sigma Space Corporation Phase 1: NGSL observations + in situ calibration.
A Measurement of the Ultra-High Energy Cosmic Ray Spectrum with the HiRes FADC Detector (HiRes-2) Andreas Zech (for the HiRes Collaboration) Rutgers University.
Overview Modern chip designs have multiple IP components with different process, voltage, temperature sensitivities Optimizing mix to different customer.
Two Interpretations of What it Means to Normalize the Low Energy Monte Carlo Events to the Low Energy Data Atms MC Atms MC Data Data Signal Signal Apply.
Jean Ballet, CEA Saclay GSFC, 31 May 2006 All-sky source search
Statistics Review ChE 477 Winter 2018 Dr. Harding.
Wavelet Analysis for Sources Detection
Source catalogue generation
Basics of Photometry.
UVIS Calibration Update
A Switching Observer for Human Perceptual Estimation
A Switching Observer for Human Perceptual Estimation
Volume 85, Issue 6, Pages (December 2003)
More on Maxent Env. Variable importance:
Presentation transcript:

CXC CUC September SDS Page 1 CUC Sep 2007 Science Data Systems – Jonathan McDowell

CXC CUC September SDS Page 2 Source Catalog - Science CHANDRA SOURCE CATALOG – SCIENCE UPDATES - Background Maps (M McCollough) - Limiting Sensitivity (F Primini) - Position Errors (J Davis) - Source Extent (J Houck) - Other issues resolved - Issues in work - Dither and variability (M Nowak)

CXC CUC September SDS Page 3 Background maps Mike McCollough led this effort Make low spatial frequency and high spatial frequency maps, then combine High spatial frequency derived from streak map – readout streaks from all sources Normalization is tricky when there are not many source-free image rows (e.g small subarray)

CXC CUC September SDS Page 4 Source Catalog - Science Obsid 786: improvement switching from wavdetect background (yellow regions) to new background algorithm (green regions)

CXC CUC September SDS Page 5 Closeup of streak region in 786

CXC CUC September SDS Page 6 ObsID 635

CXC CUC September SDS Page 7 ObsID 735

CXC CUC September SDS Page 8 Limiting sensitivity maps Frank Primini developed method Add Poisson noise to model background map Use tabulated PSF model to determine 90 percent aperture radius at each pixel Find count rate that gives SNR=3 for a point source at that pixel given the PSF size and background estimate.

CXC CUC September SDS Page 9 Limiting sensitivity maps

CXC CUC September SDS Page 10 Combining error ellipses – John Davis Improved estimate of position and error ellipse Adopted algorithm used for military targeting Unbiased estimate assuming no systematic error in positions Takes spherical geometry into account (works at poles) Math memo available

CXC CUC September SDS Page 11 Source extent comparison – John Houck Wavdetect approach introduces steps associated with the discrete wavelet scales used – hence discontinuities vs off axis angle. Extent estimates are not accurate; discontinuities in other properties too

CXC CUC September SDS Page 12 Source extent comparison New method (right) is scale free and has no discontinuities; figure shows 1000 simulated 150-count sources (blue line) and nominal SAOSAC PSF extent (red). Method post-processes wavdetect source regions, maximizing correlation with an elliptical wavelet

CXC CUC September SDS Page 13 Source extent evaluation – John Houck

CXC CUC September SDS Page 14 Black line: point sources with 35 counts Blue line: 2” radius disks with 35 counts Hatched regions give stat uncertainty range Distinguishable within 5' off-axis

CXC CUC September SDS Page 15 Science issues resolved Merge regions: had a problem with merging off axis sources – appears to be resolved by using 90 percent ECF regions from PSF as an indicator of possible overlap, instead of source position/extent estimates derived from data (Ian, Jonathan) Count rate errors and upper limits improved by rigorous calculation of Bayesian posterior probability distributions for both source and background apertures (Frank) Spectral fits – Aneta led spec, tested; simple rules (more than 250 counts; absorbed power law, absorbed blackbody models).

CXC CUC September SDS Page 16 Science issues remaining - examples Frank is working on combining posterior probability distributions for formally correct errors on merged source count rates Problem with exposure thresholding at edge of chips –can lead to incorrect wavedetect results (too many sources). Reviewing cases of spurious source detections (e.g issue with wrong background normalization on subarrays) – check if significant contribution to source catalog (must fix) or just small absolute number of cases (can live with for release 1?). QA will remove most of these false detections anyway Tweak variability tests to take exposure variations into account and incorporate background variability (M Nowak) Using Monte Carlo simulations to further characterize and calibrate position and extent uncertainties (Houck, Primini)

CXC CUC September SDS Page 17 Variability and dither Catalog will have KS, Kuiper variability tests as well as Gregory- Loredo algorithm Testing GL with dead-time/dead-area/dither taken into account Uses new dither_region tool gives fractional source area on chip versus time (including bad pixel correction) 635:

CXC CUC September SDS Page 18 Without dither correction: dither dominates light curve With dither correction: clear measurement of variability Algorithm automatically chooses binning for significance