X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL 7/11/2007, Comparison of Observed and Theoretical Fe L Emission from CIE Plasmas Matthew.

Slides:



Advertisements
Similar presentations
Applications of one-class classification
Advertisements

Divide-and-Conquer and Statistical Inference for Big Data
1-Way Analysis of Variance
X-ray Astrostatistics Bayesian Methods in Data Analysis Aneta Siemiginowska Vinay Kashyap and CHASC Jeremy Drake, Nov.2005.
Page 1 Cristina Chifor (a) Ken Phillips (b), Brian Dennis (c) a) DAMTP, University of Cambridge, UK b) Mullard Space Science Lab, UK c) NASA/GSFC, Maryland,
HMM II: Parameter Estimation. Reminder: Hidden Markov Model Markov Chain transition probabilities: p(S i+1 = t|S i = s) = a st Emission probabilities:
Fitting X-ray Spectra with Imperfect Models Nancy S. Brickhouse Harvard-Smithsonian Center for Astrophysics Acknowledgments to Randall Smith and Adam Foster.
Sampling Distributions (§ )
Markov-Chain Monte Carlo
Hidden Markov Models Theory By Johan Walters (SR 2003)
Computing the Posterior Probability The posterior probability distribution contains the complete information concerning the parameters, but need often.
Chapter 8 Estimation: Additional Topics
Characterizing Thermal and Non- Thermal Electron Populations in Solar Flares Using RHESSI Amir Caspi 1,2, Säm Krucker 2, Robert P. Lin 1,2 1 Department.
RHESSI/GOES Xray Analysis using Multitemeprature plus Power law Spectra. J.McTiernan (SSL/UCB)
Measuring the Temperature of Hot Solar Flare Plasma with RHESSI Amir Caspi 1,2, Sam Krucker 2, Robert P. Lin 1,2 1 Department of Physics, University of.
Bayesian Analysis of X-ray Luminosity Functions A. Ptak (JHU) Abstract Often only a relatively small number of sources of a given class are detected in.
RHESSI/GOES Xray Analysis using Multitemeprature plus Power law Spectra. J.McTiernan (SSL/UCB) ABSTRACT: We present spectral fits for RHESSI and GOES solar.
Simulation Modeling and Analysis
Atomic Emission - AES M* → M + hn Thermal excitation M → M*
Environmental Data Analysis with MatLab Lecture 24: Confidence Limits of Spectra; Bootstraps.
Chap 9-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 9 Estimation: Additional Topics Statistics for Business and Economics.
1 Validation and Verification of Simulation Models.
WG 1 Summary Techniques and Applications. WG1 sessions New algorithms: UV smooth, electron maps Source locations Source sizes Source fluxes (imaging spectroscopy)
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
1/49 EF 507 QUANTITATIVE METHODS FOR ECONOMICS AND FINANCE FALL 2008 Chapter 9 Estimation: Additional Topics.
Optimization of thermal processes2007/2008 Optimization of thermal processes Maciej Marek Czestochowa University of Technology Institute of Thermal Machinery.
GLAST Science Support Center June 29, 2005Data Challenge II Software Workshop GRB Analysis David Band GSFC/UMBC.
Overview G. Jogesh Babu. Probability theory Probability is all about flip of a coin Conditional probability & Bayes theorem (Bayesian analysis) Expectation,
Census A survey to collect data on the entire population.   Data The facts and figures collected, analyzed, and summarized for presentation and.
1 Validation & Verification Chapter VALIDATION & VERIFICATION Very Difficult Very Important Conceptually distinct, but performed simultaneously.
Impedance spectroscopy of composite polymeric electrolytes - from experiment to computer modeling. Maciej Siekierski Warsaw University of Technology, Faculty.
Topics: Statistics & Experimental Design The Human Visual System Color Science Light Sources: Radiometry/Photometry Geometric Optics Tone-transfer Function.
1 Institute of Engineering Mechanics Leopold-Franzens University Innsbruck, Austria, EU H.J. Pradlwarter and G.I. Schuëller Confidence.
Blue: Histogram of normalised deviation from “true” value; Red: Gaussian fit to histogram Presented at ESA Hyperspectral Workshop 2010, March 16-19, Frascati,
CS433: Modeling and Simulation Dr. Anis Koubâa Al-Imam Mohammad bin Saud University 15 October 2010 Lecture 05: Statistical Analysis Tools.
Provide tools for the statistical comparison of distributions  equivalent reference distributions  experimental measurements  data from reference sources.
A taste of statistics Normal error (Gaussian) distribution  most important in statistical analysis of data, describes the distribution of random observations.
Lecture 4: Statistics Review II Date: 9/5/02  Hypothesis tests: power  Estimation: likelihood, moment estimation, least square  Statistical properties.
Selecting Input Probability Distribution. Simulation Machine Simulation can be considered as an Engine with input and output as follows: Simulation Engine.
Lecture 3: Statistics Review I Date: 9/3/02  Distributions  Likelihood  Hypothesis tests.
Big Data, Computation and Statistics Michael I. Jordan February 23,
COSIRES 2004 © Matej Mayer Bayesian Reconstruction of Surface Roughness and Depth Profiles M. Mayer 1, R. Fischer 1, S. Lindig 1, U. von Toussaint 1, R.
Missing Values Raymond Kim Pink Preechavanichwong Andrew Wendel October 27, 2015.
Sampling and estimation Petter Mostad
Analysis of Nonlinearity Correction for CrIS SDR April 25, 2012 Chunming Wang NGAS Comparisons Between V32 and V33 Engineering Packets.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 12 More About Regression 12.1 Inference for.
Laboratory Astrophysics using an Engineering Model XRS Microcalorimeter Array NASA/GSFCLLNL. F. Scott PorterPeter Beiersdorfer Keith GendreauGreg Brown.
Lecture 3-Building a Detector (cont’d) George K. Parks Space Sciences Laboratory UC Berkeley, Berkeley, CA.
Metal abundance evolution in distant galaxy clusters observed by XMM-Newton Alessandro Baldi Astronomy Dept. - University of Bologna INAF - OABO In collaboration.
Characterizing Thermal and Non- Thermal Electron Populations in Solar Flares Using RHESSI Amir Caspi 1,2, Säm Krucker 2, Robert P. Lin 1,2 1 Department.
The 2p-3d Electron Transition Multiplet of Ar +13 : A Stellar Density Diagnostic Laura Heeter Kristina Naranjo-Rivera
Jan. 18, 2008 Hall C Meeting L. Yuan/Hampton U.. Outline HKS experimental goals HKS experimental setup Issues on spectrometer system calibration Calibration.
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
By Jyh-haw Yeh Department of Computer Science Boise State University.
Current Physics Results Gordon Thomson Rutgers University.
Electron Spectrometer: Status July 14 Simon Jolly, Lawrence Deacon 1 st July 2014.
DirectFit reconstruction of the Aya’s two HE cascade events Dmitry Chirkin, UW Madison Method of the fit: exhaustive search simulate cascade events with.
Kevin Stevenson AST 4762/5765. What is MCMC?  Random sampling algorithm  Estimates model parameters and their uncertainty  Only samples regions of.
Bootstrapping James G. Anderson, Ph.D. Purdue University.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 12 More About Regression 12.1 Inference for.
Overview G. Jogesh Babu. R Programming environment Introduction to R programming language R is an integrated suite of software facilities for data manipulation,
Confidence Interval Estimation
CHAPTER 12 More About Regression
Bootstrap - Example Suppose we have an estimator of a parameter and we want to express its accuracy by its standard error but its sampling distribution.
Distributions and Uncertainties
CHAPTER 12 More About Regression
The spectral evolution of impulsive solar X-ray flares
CHAPTER 12 More About Regression
Bootstrap Segmentation Analysis and Expectation Maximization
Chapter 9 Estimation: Additional Topics
Presentation transcript:

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL 7/11/2007, Comparison of Observed and Theoretical Fe L Emission from CIE Plasmas Matthew Carpenter UC Berkeley Space Sciences Laboratory Collaborators Lawrence Livermore National Lab Electron Beam Ion Trap (EBIT) Team P. Beiersdorfer G. Brown M. F. Gu H. Chen UC Berkeley Space Sciences Laboratory J. G. Jernigan

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Overview  Introduction to the Photon Clean Method (PCM)  An Example : XMM/RGS spectrum of Ab Dor  PCM algorithm internals  Analysis Modes: Phase I and Phase II solutions  Bootstrap Methods of error analysis  Summary

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Photon Clean Method: Principles Analysis uses individual photon events, not binned spectra Fitting models to data is achieved through weighted random trial-and- error with feedback Individual photons span parameter and model space, and are taken to be the parameters Iteration until quantitative convergence based on a Kolmogorov-Smirnov (KS) test Has analysis modes which allow divergence from strict adherence to model to estimate differences between model and observed data

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Photon Clean Method: Event-Mode Data and Model Both data and model are in form of Event Lists (photon lists) Monte-Carlo methods are used to generate simulated photons Generation parameters for each photon are recorded Each photon is treated as independent parameter Single simulated photon:

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 PCM analyzes Simulated Detected sim or E sim Observed Data (Event Form) Simulated Data Data representation inside program Target: AB Dor (K1 IV-V), a young active star and XMM/RGS calibration target

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Target: AB Dor (K1 IV-V), a young active star and XMM/RGS calibration target PCM analyzes Simulated Detected sim or E sim The Photon Clean Method algorithm analyzes and outputs models as event lists *** All histograms in this talk are for visualization only

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 PCM analyzes Simulated Detected sim or E sim Target: AB Dor (K1 IV-V), a young active star and XMM/RGS calibration target The Photon Clean Method algorithm analyzes and outputs models as event lists *** All histograms in this talk are for visualization only

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Spectral : “Perfect” information Each photon in a simulated observation has ideal (model) wavelength and the wavelength of detection == “spectral wavelength” from plasma model

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Spectral : “Perfect” information counts Each photon in a simulated observation has ideal (model) wavelength and the wavelength of detection == “spectral wavelength” from plasma model A histogram of the simulated photons’ spectral wavelengths produces sharp lines

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Adding detector response Photons are stochastically assigned a “detected wavelength” == “simulated wavelength,” includes redshift, detector and thermal broadening counts

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Distribution of Model Parameters Each photon has individual parameter values which may be taken as elements of the parameter distribution

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Distribution of Model Parameters Each photon has individual parameter values which may be taken as elements of the parameter distribution The temperature profile of AB Dor is complex; previous fits used 3-temperature or EMD models counts Histogram of PCM solution Three vertical dashed lines are 3-T XSPEC fit from Sanz-Forcada, Maggio and Micela (2003) AB Dor Emission Measure Distribution

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 PCM Algorithm Progression Start: Generate initial model + simulated detected photons from input parameter distribution

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 PCM Algorithm Progression Start: Generate initial model + simulated detected photons from input parameter distribution

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Photon Generator For CIE Plasma: Given a temperature (T), AtomDB generates spectral energy (E). Apply ARF test to determine whether photon is detected If photon is detected, apply RMF to determine detected energy (E ' ) Start: Model Parameter (T) Result: (T,E,E') + Ancillary Info

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 PCM Algorithm: Iterate with Feedback Iteration: Generate 1 detected photon Model E sim

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 PCM Algorithm: Iterate with Feedback Iteration: Generate 1 detected photon Replace 1 random photon from model with new photon (E,E',T) Model E sim

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 PCM Algorithm: Iterate with Feedback Iteration: Generate 1 detected photon Replace 1 random photon from model with new photon (E,E',T) Compute KS probability statistic Feedback Test: If KS probability improves with new photon, keep it; Otherwise, throw new photon away and keep old photon Model E sim

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 PCM Analysis Modes Phase I: Constrained Convergence “Re-constrain the Model” Generates a solution which is consistent with a physically realizable model

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 PCM Analysis Modes Phase II: Un-Constrained Convergence: Iterate until KS probability reaches cutoff value, with Monte-Carlo Markov Chain weighting Photon distribution is not constrained to model probabilities Allows individual spectral features to be modified to produce best- fit solution counts

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 PCM Analysis Modes Phase II: Un-Constrained Convergence: Iterate until KS probability reaches cutoff value, with Monte-Carlo Markov Chain weighting Photon distribution is not constrained to model probabilities Allows individual spectral features to be modified to produce best- fit solution counts

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Determining Variation in Many-Parameter Models Low-dimensionality models with few degrees of freedom may be quantified using Chi-square test which has a well-defined error methodology. PCM is appropriate for models of high dimensionality where every photon is a free parameter. For error determination we use distribution-driven re-sampling methods  Bootstrap Method counts PCM solution XPSEC solution

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Bootstrap Re-Sampling Method: 1) Randomly resample input data set with substitution to create new data set 2) Perform analysis on new data set to produce new outcome 3) Repeat for n >> 1 re-sampled data sets

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/ Bootstrap Re-Sampling Method: 1) Randomly resample input data set with substitution to create new data set 2) Perform analysis on new data set to produce new outcome 3) Repeat for n >> 1 re-sampled data sets

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/ Bootstrap Re-Sampling Method: 1) Randomly resample input data set with substitution to create new data set 2) Perform analysis on new data set to produce new outcome 3) Repeat for n >> 1 re-sampled data sets

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/ Bootstrap Re-Sampling Method: 1) Randomly resample input data set with substitution to create new data set 2) Perform analysis on new data set to produce new outcome 3) Repeat for n >> 1 re-sampled data sets

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Bootstrap Results AB Dor Emission Measure Distribution

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Bootstrap Results AB Dor Emission Measure Distribution

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Bootstrap Results AB Dor Emission Measure Distribution

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Bootstrap Results AB Dor Emission Measure Distribution

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Bootstrap Results AB Dor Emission Measure Distribution

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Interpreting the Bootstrap The variations in the bootstrap solutions estimate errors The Arithmetic mean of all distributions is plotted as solid line AB Dor Emission Measure Distribution

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Interpreting the Bootstrap The variations in the bootstrap solutions estimate errors The Arithmetic mean of all distributions is plotted as solid line Confidence levels are computed along vertical axis of distribution 90% confidence 68% confidence Mean AB Dor Emission Measure Distribution

X-Ray Spectroscopy Workshop Cambridge, MA Matthew Carpenter, UCB SSL, 7/11/2007 Summary The Photon Clean Method allows for complicated parameter distributions Phase I solution gives best-fit solution from existing models Phase II solution modifies model to quantify amount of departure from physical models Bootstrap re-sampling may determine variability of trivial and non-trivial solutions without assumptions about the underlying distribution of the data As a test of the PCM’s ability to simultaneously model Fe K and Fe L shell line emission, we are using it to model spectra produced by the LLNL EBIT’s Maxwellian plasma simulator mode. Thank You