Bayesian burst detection Antony Searle (ANU) with Patrick Sutton (Cardiff / LIGO Caltech), Massimo Tinto (JPL / LIGO Caltech), Shourov Chatterji (INFN.

Slides:



Advertisements
Similar presentations
Statistics Hypothesis Testing.
Advertisements

Bayesian Hypothesis Testing In Nested Models Harold Jeffreys Jeff Rouder.
Naïve Bayes. Bayesian Reasoning Bayesian reasoning provides a probabilistic approach to inference. It is based on the assumption that the quantities of.
Week 11 Review: Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution.
Bayesian inference “Very much lies in the posterior distribution” Bayesian definition of sufficiency: A statistic T (x 1, …, x n ) is sufficient for 
Chapter Seventeen HYPOTHESIS TESTING
Inferences About Process Quality
1 Inference About a Population Variance Sometimes we are interested in making inference about the variability of processes. Examples: –Investors use variance.
AM Recitation 2/10/11.
Business Statistics - QBM117 Introduction to hypothesis testing.
Chapter 8 Introduction to Hypothesis Testing
Coherent network searches for gravitational-wave bursts Patrick Sutton LIGO-Caltech.
1 CSI5388: Functional Elements of Statistics for Machine Learning Part I.
Statistical problems in network data analysis: burst searches by narrowband detectors L.Baggio and G.A.Prodi ICRR TokyoUniv.Trento and INFN IGEC time coincidence.
1 Characterising the Space of Gravitational-Wave Bursts Patrick J. Sutton California Institute of Technology.
S.Klimenko, G Z, December 21, 2006, GWDAW11 Coherent detection and reconstruction of burst events in S5 data S.Klimenko, University of Florida.
Chapter 21: More About Tests “The wise man proportions his belief to the evidence.” -David Hume 1748.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Silvia Poggi - GW burst detection strategy in non-homogeneus networks Detection strategies for bursts in networks of non-homogeneus gravitational waves.
A coherent null stream consistency test for gravitational wave bursts Antony Searle (ANU) in collaboration with Shourov Chatterji, Albert Lazzarini, Leo.
ECE 8443 – Pattern Recognition LECTURE 07: MAXIMUM LIKELIHOOD AND BAYESIAN ESTIMATION Objectives: Class-Conditional Density The Multivariate Case General.
Chapter 16 The Chi-Square Statistic
Hypotheses tests for means
LIGO-G Z The AURIGA-LIGO Joint Burst Search L. Cadonati, G. Prodi, L. Baggio, S. Heng, W. Johnson, A. Mion, S. Poggi, A. Ortolan, F. Salemi, P.
Week 71 Hypothesis Testing Suppose that we want to assess the evidence in the observed data, concerning the hypothesis. There are two approaches to assessing.
Bayesian vs. frequentist inference frequentist: 1) Deductive hypothesis testing of Popper--ruling out alternative explanations Falsification: can prove.
LIGO-G Z Coherent Analysis of Signals from Misaligned Interferometers M. Rakhmanov, S. Klimenko Department of Physics, University of Florida,
M. Principe, GWDAW-10, 16th December 2005, Brownsville, Texas Modeling the Performance of Networks of Gravitational-Wave Detectors in Bursts Search Maria.
LIGO-G Z A Coherent Network Burst Analysis Patrick Sutton on behalf of Shourov Chatterji, Albert Lazzarini, Antony Searle, Leo Stein, Massimo.
Solution of the Inverse Problem for Gravitational Wave Bursts Massimo Tinto JPL/CIT LIGO Seminar, October 12, 2004 Y. Gursel & M. Tinto, Phys. Rev. D,
Economics 173 Business Statistics Lecture 4 Fall, 2001 Professor J. Petry
S.Klimenko, August 2005, LSC, G Z Constraint likelihood analysis with a network of GW detectors S.Klimenko University of Florida, in collaboration.
Making sense of randomness
S.Klimenko, July 14, 2007, Amaldi7,Sydney, G Z Detection and reconstruction of burst signals with networks of gravitational wave detectors S.Klimenko,
A fully coherent analysis can be performed when data is available from three or more non-aligned detectors Generalization of collocated Hanford detector.
Searching for gravitational-wave bursts with the Q Pipeline Shourov K. Chatterji LIGO Science Seminar 2005 August 2.
LIGO- G Z Analyzing Event Data Lee Samuel Finn Penn State University Reference: T030017, T
A fully coherent analysis can be performed when data is available from three or more non-aligned detectors Generalization of collocated Hanford detector.
Inferential Statistics Inferential statistics allow us to infer the characteristic(s) of a population from sample data Slightly different terms and symbols.
Section 12.2: Tests for Homogeneity and Independence in a Two-Way Table.
LIGO-G Data Analysis Techniques for LIGO Laura Cadonati, M.I.T. Trento, March 1-2, 2007.
S.Klimenko, G Z, December 2006, GWDAW11 Coherent detection and reconstruction of burst events in S5 data S.Klimenko, University of Florida for.
Non-Parametric Distributional Tests for Gravitational Wave Transient Event Detection Yeming Shi 1, Erik Katsavounidis 1, Michele Zanolin 2 1 Massachusetts.
S.Klimenko, G Z, December 21, 2006, GWDAW11 Coherent detection and reconstruction of burst events in S5 data S.Klimenko, University of Florida.
LIGO-G v2 The Search For Continuous Gravitational Waves Gregory Mendell, LIGO Hanford Observatory on behalf of the LIGO Science Collaboration The.
S.Klimenko, G Z, March 20, 2006, LSC meeting First results from the likelihood pipeline S.Klimenko (UF), I.Yakushin (LLO), A.Mercer (UF),G.Mitselmakher.
Coherent network analysis technique for discriminating GW bursts from instrumental noise Patrick Sutton (CIT) in collaboration with Shourov Chatterji,
Robust Bayesian detection of unmodeled bursts of gravitational waves Antony Searle (ANU, Visitor in Physics LIGO-Caltech) in collaboration with Shourov.
15-18 December 2004 GWDAW-9 Annecy 1 All-Sky broad band search for continuous waves using LIGO S2 data Yousuke Itoh 1 for the LIGO Scientific Collaboration.
URBDP 591 A Lecture 16: Research Validity and Replication Objectives Guidelines for Writing Final Paper Statistical Conclusion Validity Montecarlo Simulation/Randomization.
LIGO- G Z August 17, 2005August 2005 LSC Meeting 1 Bayesian Statistics for Burst Search Results LIGO-T Keith Thorne and Sam Finn Penn State.
Chapter 9: Introduction to the t statistic. The t Statistic The t statistic allows researchers to use sample data to test hypotheses about an unknown.
LIGO-G ZSearle LSC Mtg Aug A Coherent Network Burst Analysis Antony Searle (ANU) in collaboration with Shourov Chatterji, Albert Lazzarini,
GWDAW11 – Potsdam Results by the IGEC2 collaboration on 2005 data Gabriele Vedovato for the IGEC2 collaboration.
Systematics in Hfitter. Reminder: profiling nuisance parameters Likelihood ratio is the most powerful discriminant between 2 hypotheses What if the hypotheses.
LIGO-G Z Searching for gravitational wave bursts with the new global detector network Shourov K. Chatterji INFN Sezioni di Roma / Caltech LIGO.
G08XXXX-00-Z S. Chatterji, Cascina, Italy, 2008 November 261 Gravitational-wave data analysis and supernovae Shourov K. Chatterji INFN Sezione di Roma.
LIGO-G Z The Q Pipeline search for gravitational-wave bursts with LIGO Shourov K. Chatterji for the LIGO Scientific Collaboration APS Meeting.
A 2 veto for Continuous Wave Searches
Hypothesis Testing I The One-sample Case
The Q Pipeline search for gravitational-wave bursts with LIGO
Coherent wide parameter space searches for gravitational waves from neutron stars using LIGO S2 data Xavier Siemens, for the LIGO Scientific Collaboration.
Igor Yakushin, LIGO Livingston Observatory
Searching for gravitational wave bursts with the new global detector network 2007 May 3 Searching for gravitational wave bursts with the new global detector.
LIGO Scientific Collaboration meeting
Targeted Searches using Q Pipeline
LISA Data Analysis & Sources
Inference Confidence Interval for p.
Shape from Shading and Texture
Presentation transcript:

Bayesian burst detection Antony Searle (ANU) with Patrick Sutton (Cardiff / LIGO Caltech), Massimo Tinto (JPL / LIGO Caltech), Shourov Chatterji (INFN Sezione di Roma / LIGO Caltech)

Bayesian inference Bayesian inference tells us the unique way to change the plausibility we assign hypotheses when we get new evidence – Therefore, we need to assign plausibilities to the hypotheses prior to receiving the evidence Priors are criticised as subjective from the perspective of the popular Frequentist paradigm – Bayesians note that Frequentist statistics are not free of priors; their priors are merely implicit, unexamined and sometimes contradict intent GRG/Amaldi 14/07/2007A Searle - G Z2

The detection problem Things about the observatories we assert – Number – Locations – Antenna patterns – Noise spectra – Sampling rates – Observation time –... Things about the gravitational wave we want to learn – Existence – Time of arrival – Direction of origin – Waveform We need priors distributions for these GRG/Amaldi 14/07/2007A Searle - G Z3

Toy model N white detectors each make a single measurement as a postulated strain h from direction (θ, ϕ ) sweeps over them GRG/Amaldi 14/07/20074A Searle - G Z

Uncontroversial priors How plausible is it that a gravitational wave is present? – This follows from the predicted event rate and is comparable to a Frequentist threshold When and from where? – Uniform over observation time and sky direction GRG/Amaldi 14/07/2007A Searle - G Z5

Waveform prior A plausibility distribution on the space of all possible strain waveforms Example: a population of white noise bursts with power-law distributed energies GRG/Amaldi 14/07/2007A Searle - G Z6

Marginalising away strain We can analytically marginalize away strain GRG/Amaldi 14/07/2007A Searle - G Z7 * (F· )=

Result We have to numerically marginalize over other parameters – (Not very expensive)...to get the Bayesian odds ratio GRG/Amaldi 14/07/2007A Searle - G Z8

Bayesian “sky map” GRG/Amaldi 14/07/2007A Searle - G Z9 SIMULATED DATA

Comparing with Gursel-Tinto “Optimal statistic is...” – Y. Gürsel and M. Tinto, PRD 40, 3884 (1989) – Implemented as xpipeline (ANU/Caltech/JPL) Bayesian sky map limits to this for GRG/Amaldi 14/07/2007A Searle - G Z10

Odd priors Gursel-Tinto is related to a Bayesian analysis with odd priors – Very (very) large signal energy! – Source directions distributed according to network sensitivity! These are consistent with GT’s observed failure modes The priors aren’t “incorrect”, but... They certainly don’t reflect Gursel and Tinto’s beliefs about the universe GRG/Amaldi 14/07/2007A Searle - G Z11 SIMULATED DATA

Other comparisons Soft constraint – S Klimekno et al, PRD 72, (2005); Coherent WaveBurst (UFL) – Limiting case of infinitely small signals, non-uniform direction prior Tikhonov regularization – M Rakhmanov, CQG (2006) S673-S685; RIDGE (UTB/PennState) – Looks for signals of a particular energy, non- uniform direction prior All these techniques work to varying degrees... – Enough evidence can always overwhelm a prior The most effective analysis is the one whose priors best reflect reality – (and can be computed; the Bayesian analysis cost is comparable to Gursel- Tinto, depending on choice of strain prior) GRG/Amaldi 14/07/2007A Searle - G Z12

Robust noise model In practice, coherent methods are easily fooled by incoherent glitches – The analysis can only explain any excess power as a gravitational wave – S Chatterji et al, Phys. Rev. D 74, (2006) demonstrates and proposes a more robust statistic GRG/Amaldi 14/07/2007A Searle - G Z13 Gursel-Tinto often mistakes glitches (shown) for gravitational waves from directions of poor sensitivity SIMULATED DATA

Robust noise model We can make a more realistic noise model where the detectors occasionally glitch – This requires a glitch model similar to the signal model, with physically motivated priors on glitch waveforms and occurrence – Easily integrated into Bayesian analysis at little extra cost GRG/Amaldi 14/07/2007A Searle - G Z14

Summary The Bayesian approach to bursts – Supersedes several previously proposed methods – Necessarily outperforms those methods Priors target more reasonable signals – Is an optimal test uniquely defined by making explicit assertions about the instruments and bursts – Is computationally tractable Cost is comparable to existing methods for comparable signal models – Can readily incorporate glitch models for robustness GRG/Amaldi 14/07/200715A Searle - G Z

Supplementary material

Toy model N white detectors each make a measurement as a postulated strain h from direction (θ, ϕ ) sweeps over them If no wave is present, the measurements are normally distributed around 0 GRG/Amaldi 14/07/200717A Searle - G Z

Towards a signal hypothesis If the wave is present, the measurements are normally distributed around the response Fh Unfortunately we don’t know the incoming strain, so this is not directly useful – Gursel & Tinto’s original insight was that, as the response is constrained to span F, any function of (null F) T x was independent of the unknown h – The Bayesian analysis instead uses a prior on h GRG/Amaldi 14/07/200718A Searle - G Z

Prior expectations of strain For detection (not characterization) we want to marginalize away the nuisance parameter h To do so, we need to specify how likely we think particular strains are to occur – A normal distribution is a conservative choice that also lets us solve the integral – We must specify the expected scale of the strain GRG/Amaldi 14/07/200719A Searle - G Z

Explicit signal hypothesis By making a weak assumption about the strain we obtain an explicit signal hypothesis GRG/Amaldi 14/07/200720A Searle - G Z

Bayesian odds ratio We have a prior expectation that signals are infrequent We can directly compute the relative plausibilities of the competing hypotheses GRG/Amaldi 14/07/200721A Searle - G Z

Relationship to other methods Very large signal prior is like Gursel-Tinto Very small signal prior is like soft constraint Physical meaning for Tikhonov regularizer Previous methods are like Bayesian searches with poorly chosen priors – Their prior expectations are unexamined, not absent! GRG/Amaldi 14/07/200722A Searle - G Z

Reverse-engineering priors Gursel-Tinto method: – Y. Gürsel and M. Tinto, PRD 40, 3884 (1989); xpipeline (ANU/Caltech/JPL) – “Optimal statistic is null energy ” Bayesian large signal limit – GT is limiting case of expecting infinitely large signals (from the network’s least sensitive directions!) These are consistent with GT’s observed failure modes These priors are not wrong, but they certainly weren’t Gursel and Tinto’s intent GRG/Amaldi 14/07/2007A Searle - G Z23

Gursel-Tinto for HLV Injection GRG/Amaldi 14/07/200724A Searle - G Z SIMULATED DATA

ln p(θ, ϕ | x, σ, H signal ) for HLV Injection GRG/Amaldi 14/07/200725A Searle - G Z SIMULATED DATA

Advanced noise models None of the above methods are good at rejecting ‘glitches’ – The models only have one way excess energy appears in a detector: a gravitational wave Generalize noise model for greater robustness – Consider a different kind of signal: infrequent uncorrelated bursts of noise – The Bayesian analysis can now prefer this hypothesis when appropriate GRG/Amaldi 14/07/2007A Searle - G Z26

Outcome An expression to enable us to compute the plausibility that a gravitational wave is present – “Sky maps” produced by previous methods are comparable to p(θ, ϕ | x): GRG/Amaldi 14/07/2007A Searle - G Z27 SIMULATED DATA