Feldman-Cousins Method

Slides:



Advertisements
Similar presentations
DO’S AND DONT’S WITH LIKELIHOODS Louis Lyons Oxford (CDF)
Advertisements

Unified approach to the classical statistical analysis of small signals Gary J. Feldman and Robert D. Cousins.
1 LIMITS Why limits? Methods for upper limits Desirable properties Dealing with systematics Feldman-Cousins Recommendations.
Statistics In HEP 2 Helge VossHadron Collider Physics Summer School June 8-17, 2011― Statistics in HEP 1 How do we understand/interpret our measurements.
8. Statistical tests 8.1 Hypotheses K. Desch – Statistical methods of data analysis SS10 Frequent problem: Decision making based on statistical information.
Difficulties in Limit setting and the Strong Confidence approach Giovanni Punzi SNS and INFN - Pisa Advanced Statistical Techniques in Particle Physics.
G. Cowan Statistics for HEP / NIKHEF, December 2011 / Lecture 3 1 Statistical Methods for Particle Physics Lecture 3: Limits for Poisson mean: Bayesian.
1 BAYES and FREQUENTISM: The Return of an Old Controversy Louis Lyons Oxford University CERN, October 2006 Lecture 4.
Basics of Statistical Estimation. Learning Probabilities: Classical Approach Simplest case: Flipping a thumbtack tails heads True probability  is unknown.
1 Nuisance parameters and systematic uncertainties Glen Cowan Royal Holloway, University of London IoP Half.
Credibility of confidence intervals Dean Karlen / Carleton University Advanced Statistical Techniques in Particle Physics Durham, March 2002.
G. Cowan Lectures on Statistical Data Analysis Lecture 12 page 1 Statistical Data Analysis: Lecture 12 1Probability, Bayes’ theorem 2Random variables and.
G. Cowan 2011 CERN Summer Student Lectures on Statistics / Lecture 41 Introduction to Statistics − Day 4 Lecture 1 Probability Random variables, probability.
G. Cowan Discovery and limits / DESY, 4-7 October 2011 / Lecture 3 1 Statistical Methods for Discovery and Limits Lecture 3: Limits for Poisson mean: Bayesian.
Everything You Always Wanted To Know About Limits* Roger Barlow Manchester University YETI06 *But were afraid to ask.
G. Cowan 2009 CERN Summer Student Lectures on Statistics1 Introduction to Statistics − Day 4 Lecture 1 Probability Random variables, probability densities,
MAS2317 Presentation Jake McGlen. Assuming vague prior knowledge, obtain the posterior distribution for µ and hence construct a 95% Bayesian confidence.
Practical Statistics for Particle Physicists Lecture 3 Harrison B. Prosper Florida State University European School of High-Energy Physics Anjou, France.
Statistics In HEP Helge VossHadron Collider Physics Summer School June 8-17, 2011― Statistics in HEP 1 How do we understand/interpret our measurements.
Statistical Methods for Data Analysis Introduction to the course Luca Lista INFN Napoli.
Measurement of the atmospheric lepton energy spectra with AMANDA-II presented by Jan Lünemann* for Kirsten Münich* for the IceCube collaboration * University.
1 Methods of Experimental Particle Physics Alexei Safonov Lecture #25.
BAYES and FREQUENTISM: The Return of an Old Controversy 1 Louis Lyons Imperial College and Oxford University CERN Summer Students July 2014.
Bayes Theorem. Prior Probabilities On way to party, you ask “Has Karl already had too many beers?” Your prior probabilities are 20% yes, 80% no.
Practical Statistics for Particle Physicists Lecture 2 Harrison B. Prosper Florida State University European School of High-Energy Physics Parádfürdő,
1 Methods of Experimental Particle Physics Alexei Safonov Lecture #24.
G. Cowan Lectures on Statistical Data Analysis Lecture 4 page 1 Lecture 4 1 Probability (90 min.) Definition, Bayes’ theorem, probability densities and.
G. Cowan Computing and Statistical Data Analysis / Stat 9 1 Computing and Statistical Data Analysis Stat 9: Parameter Estimation, Limits London Postgraduate.
2005 Unbinned Point Source Analysis Update Jim Braun IceCube Fall 2006 Collaboration Meeting.
The Unscented Particle Filter 2000/09/29 이 시은. Introduction Filtering –estimate the states(parameters or hidden variable) as a set of observations becomes.
MAT 3730 Complex Variables Section 1.6 Planar Sets
In Bayesian theory, a test statistics can be defined by taking the ratio of the Bayes factors for the two hypotheses: The ratio measures the probability.
G. Cowan Lectures on Statistical Data Analysis Lecture 12 page 1 Statistical Data Analysis: Lecture 12 1Probability, Bayes’ theorem 2Random variables and.
G. Cowan RHUL Physics Statistical Issues for Higgs Search page 1 Statistical Issues for Higgs Search ATLAS Statistics Forum CERN, 16 April, 2007 Glen Cowan.
Ivo van Vulpen Why does RooFit put asymmetric errors on data points ? 10 slides on a ‘too easy’ topic that I hope confuse, but do not irritate you
Practical Statistics for LHC Physicists Frequentist Inference Harrison B. Prosper Florida State University CERN Academic Training Lectures 8 April, 2015.
G. Cowan CERN Academic Training 2012 / Statistics for HEP / Lecture 21 Statistics for HEP Lecture 2: Discovery and Limits Academic Training Lectures CERN,
Objectives: Loss Functions Risk Min. Error Rate Class. Resources: DHS – Chap. 2 (Part 1) DHS – Chap. 2 (Part 2) RGO - Intro to PR MCE for Speech MCE for.
Bayesian Estimation and Confidence Intervals Lecture XXII.
Frequentist Confidence Limits and Intervals Roger Barlow SLUO Lectures on Statistics August 2006.
Giovanni Punzi SNS & INFN-Pisa
Frequentist approach Bayesian approach Statistics I.
BAYES and FREQUENTISM: The Return of an Old Controversy
Status of the Higgs to tau tau
arXiv:physics/ v3 [physics.data-an]
BAYES and FREQUENTISM: The Return of an Old Controversy
Confidence Intervals and Limits
A Simple Approach to Ranking Differentially Expressed Gene Expression Time Courses through Gaussian Process Regression By Alfredo A Kalaitzis and Neil.
Statistics for the LHC Lecture 3: Setting limits
TESTS OF HYPOTHESES.
Bayes for Beginners Stephanie Azzopardi & Hrvoje Stojic
Measuring Service in Multi-Class Networks
Lecture 4 1 Probability (90 min.)
Incorporating systematic uncertainties into upper limits
Chapter Review Problems
More about Posterior Distributions
Feldman and Cousin Paper
TAE 2018 / Statistics Lecture 3
Likelihood intervals vs. coverage intervals
3.0 Functions of One Random Variable
Lecture 4 1 Probability Definition, Bayes’ theorem, probability densities and their properties, catalogue of pdfs, Monte Carlo 2 Statistical tests general.
Statistical Tests and Limits Lecture 2: Limits
TAE 2017 / Statistics Lecture 2
Visualization and interpretation of the limit
Mathematical Foundations of BME
Introduction to Statistics − Day 4
Lecture 4 1 Probability Definition, Bayes’ theorem, probability densities and their properties, catalogue of pdfs, Monte Carlo 2 Statistical tests general.
Statistics for HEP Roger Barlow Manchester University
Everything You Always Wanted To Know About Limits*
Classical regression review
Presentation transcript:

Feldman-Cousins Method New method for confidence intervals/limits Improvements compared to Bayesian and classical constructions Unifies upper confidence limit (for null results) and confidence intervals (non-null results) Avoids unphysical confidence intervals Reduces problems with overly biased priors (as in Bayesian) and introduces improved ordering system for classical construction Antonia Hubbard

How it works Construct pdf: P(x|µ) X= observable, µ = true value we’re looking for Measeured x₀ has likelihood function L(x₀, µ) Find u’ that maximizes P(x₀ |µ): P(x₀ |u’) = Pmax Find ratio: R =P(x₀|u)/P(x₀ |µ’) For a given u, add values of x in order of highest R values until sum(P(x|µ)) = C.L. For measured x₀, we now have confidence limits [µ1, µ2] as in classical construction Antonia Hubbard

What to use it on Gaussian with bounded physical region Previous problems with, for example, a result of 2±3 unphysical results New construction implements boundary with a limitation on µ’ Upper limit decreases as 1/|x| for negative x Quickly decreases upper limits Poissonian process with background Low probabilites on absolute scale get better handled with ratio method Helps reduce conservatism from discreetness of n Eliminated “flip flopping” problems between upper limit and intervals Antonia Hubbard