G. Cowan RHUL Physics Bayesian Higgs combination page 1 Bayesian Higgs combination using shapes ATLAS Statistics Meeting CERN, 19 December, 2007 Glen Cowan.

Slides:



Advertisements
Similar presentations
Using the Profile Likelihood in Searches for New Physics / PHYSTAT 2011 G. Cowan 1 Using the Profile Likelihood in Searches for New Physics arXiv:
Advertisements

1 Bayesian statistical methods for parton analyses Glen Cowan Royal Holloway, University of London DIS 2006.
G. Cowan RHUL Physics Profile likelihood for systematic uncertainties page 1 Use of profile likelihood to determine systematic uncertainties ATLAS Top.
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem, random variables, pdfs 2Functions.
1 6 th September 2007 C.P. Ward Sensitivity of ZZ→llνν to Anomalous Couplings Pat Ward University of Cambridge Neutral Triple Gauge Couplings Fit Procedure.
G. Cowan Lectures on Statistical Data Analysis Lecture 2 page 1 Statistical Data Analysis: Lecture 2 1Probability, Bayes’ theorem 2Random variables and.
G. Cowan RHUL Physics Bayesian methods for HEP / DESY Terascale School page 1 Bayesian statistical methods for HEP Terascale Statistics School DESY, Hamburg.
1 Nuisance parameters and systematic uncertainties Glen Cowan Royal Holloway, University of London IoP Half.
Statistical Image Modelling and Particle Physics Comments on talk by D.M. Titterington Glen Cowan RHUL Physics PHYSTAT05 Glen Cowan Royal Holloway, University.
G. Cowan RHUL Physics Comment on use of LR for limits page 1 Comment on definition of likelihood ratio for limits ATLAS Statistics Forum CERN, 2 September,
G. Cowan Lectures on Statistical Data Analysis Lecture 12 page 1 Statistical Data Analysis: Lecture 12 1Probability, Bayes’ theorem 2Random variables and.
G. Cowan RHUL Physics Statistical Methods for Particle Physics / 2007 CERN-FNAL HCP School page 1 Statistical Methods for Particle Physics (2) CERN-FNAL.
G. Cowan RHUL Physics Higgs combination note status page 1 Status of Higgs Combination Note ATLAS Statistics/Higgs Meeting Phone, 7 April, 2008 Glen Cowan.
G. Cowan Lectures on Statistical Data Analysis Lecture 14 page 1 Statistical Data Analysis: Lecture 14 1Probability, Bayes’ theorem 2Random variables and.
G. Cowan Lectures on Statistical Data Analysis Lecture 10 page 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem 2Random variables and.
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 7 1Probability, Bayes’ theorem, random variables, pdfs 2Functions of.
Statistical aspects of Higgs analyses W. Verkerke (NIKHEF)
1 Glen Cowan Statistics Forum News Glen Cowan Eilam Gross ATLAS Statistics Forum CERN, 3 December, 2008.
G. Cowan SUSSP65, St Andrews, August 2009 / Statistical Methods 2 page 1 Statistical Methods in Particle Physics Lecture 2: Limits and Discovery.
G. Cowan Lectures on Statistical Data Analysis Lecture 3 page 1 Lecture 3 1 Probability (90 min.) Definition, Bayes’ theorem, probability densities and.
Harrison B. Prosper Workshop on Top Physics, Grenoble Bayesian Statistics in Analysis Harrison B. Prosper Florida State University Workshop on Top Physics:
G. Cowan Statistical Methods in Particle Physics1 Statistical Methods in Particle Physics Day 3: Multivariate Methods (II) 清华大学高能物理研究中心 2010 年 4 月 12—16.
1 Methods of Experimental Particle Physics Alexei Safonov Lecture #23.
G. Cowan Lectures on Statistical Data Analysis Lecture 1 page 1 Lectures on Statistical Data Analysis London Postgraduate Lectures on Particle Physics;
G. Cowan CLASHEP 2011 / Topics in Statistical Data Analysis / Lecture 21 Topics in Statistical Data Analysis for HEP Lecture 2: Statistical Tests CERN.
G. Cowan Statistical techniques for systematics page 1 Statistical techniques for incorporating systematic/theory uncertainties Theory/Experiment Interplay.
Sensitivity Prospects for Light Charged Higgs at 7 TeV J.L. Lane, P.S. Miyagawa, U.K. Yang (Manchester) M. Klemetti, C.T. Potter (McGill) P. Mal (Arizona)
G. Cowan RHUL Physics Bayesian statistics at the LHC / Cambridge seminar page 1 Bayesian Statistics at the LHC (and elsewhere) Cambridge HEP Seminar 7.
G. Cowan RHUL Physics Bayesian Higgs combination page 1 Bayesian Higgs combination based on event counts (follow-up from 11 May 07) ATLAS Statistics Forum.
1 Methods of Experimental Particle Physics Alexei Safonov Lecture #25.
G. Cowan RHUL Physics page 1 Status of search procedures for ATLAS ATLAS-CMS Joint Statistics Meeting CERN, 15 October, 2009 Glen Cowan Physics Department.
G. Cowan, RHUL Physics Discussion on significance page 1 Discussion on significance ATLAS Statistics Forum CERN/Phone, 2 December, 2009 Glen Cowan Physics.
G. Cowan RHUL Physics LR test to determine number of parameters page 1 Likelihood ratio test to determine best number of parameters ATLAS Statistics Forum.
G. Cowan CERN Academic Training 2010 / Statistics for the LHC / Lecture 41 Statistics for the LHC Lecture 4: Bayesian methods and further topics Academic.
G. Cowan RHUL Physics Input from Statistics Forum for Exotics page 1 Input from Statistics Forum for Exotics ATLAS Exotics Meeting CERN/phone, 22 January,
G. Cowan Lectures on Statistical Data Analysis Lecture 8 page 1 Statistical Data Analysis: Lecture 8 1Probability, Bayes’ theorem 2Random variables and.
1 Introduction to Statistics − Day 3 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Brief catalogue of probability densities.
Study of pair-produced doubly charged Higgs bosons with a four muon final state at the CMS detector (CMS NOTE 2006/081, Authors : T.Rommerskirchen and.
CMSSM and NUHM Analysis by BayesFITS Leszek Roszkowski* National Centre for Nuclear Research (NCBJ) Warsaw, Poland Leszek Roszkowski *On leave of absence.
G. Cowan Lectures on Statistical Data Analysis Lecture 4 page 1 Lecture 4 1 Probability (90 min.) Definition, Bayes’ theorem, probability densities and.
G. Cowan Computing and Statistical Data Analysis / Stat 9 1 Computing and Statistical Data Analysis Stat 9: Parameter Estimation, Limits London Postgraduate.
G. Cowan RHUL Physics Analysis Strategies Workshop -- Statistics Forum Report page 1 Report from the Statistics Forum ATLAS Analysis Strategies Workshop.
G. Cowan, RHUL Physics Statistics for early physics page 1 Statistics jump-start for early physics ATLAS Statistics Forum EVO/Phone, 4 May, 2010 Glen Cowan.
G. Cowan RHUL Physics Status of Higgs combination page 1 Status of Higgs Combination ATLAS Higgs Meeting CERN/phone, 7 November, 2008 Glen Cowan, RHUL.
G. Cowan CERN Academic Training 2012 / Statistics for HEP / Lecture 41 Statistics for HEP Lecture 4: Unfolding Academic Training Lectures CERN, 2–5 April,
G. Cowan Systematic uncertainties in statistical data analysis page 1 Systematic uncertainties in statistical data analysis for particle physics DESY Seminar.
G. Cowan SUSSP65, St Andrews, August 2009 / Statistical Methods 1 page 1 Statistical Methods in Particle Physics Lecture 1: Bayesian methods SUSSP65.
G. Cowan Lectures on Statistical Data Analysis Lecture 5 page 1 Statistical Data Analysis: Lecture 5 1Probability, Bayes’ theorem 2Random variables and.
G. Cowan Lectures on Statistical Data Analysis Lecture 12 page 1 Statistical Data Analysis: Lecture 12 1Probability, Bayes’ theorem 2Random variables and.
G. Cowan Lectures on Statistical Data Analysis Lecture 10 page 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem 2Random variables and.
G. Cowan RHUL Physics Statistical Issues for Higgs Search page 1 Statistical Issues for Higgs Search ATLAS Statistics Forum CERN, 16 April, 2007 Glen Cowan.
G. Cowan CERN Academic Training 2010 / Statistics for the LHC / Lecture 21 Statistics for the LHC Lecture 2: Discovery Academic Training Lectures CERN,
G. Cowan SOS 2010 / Statistical Tests and Limits -- lecture 31 Statistical Tests and Limits Lecture 3 IN2P3 School of Statistics Autrans, France 17—21.
G. Cowan SLAC Statistics Meeting / 4-6 June 2012 / Two Developments 1 Two developments in discovery tests: use of weighted Monte Carlo events and an improved.
Discussion on significance
Status of the Higgs to tau tau
Computing and Statistical Data Analysis / Stat 11
Comment on Event Quality Variables for Multivariate Analyses
Tutorial on Multivariate Methods (TMVA)
Graduierten-Kolleg RWTH Aachen February 2014 Glen Cowan
Computing and Statistical Data Analysis / Stat 8
W boson helicity measurement
Statistical Methods for the LHC
Statistics for Particle Physics Lecture 3: Parameter Estimation
Computing and Statistical Data Analysis / Stat 7
Statistical Methods for HEP Lecture 3: Discovery and Limits
Application of CLs Method to ATLAS Higgs Searches
Decomposition of Stat/Sys Errors
Computing and Statistical Data Analysis / Stat 10
Presentation transcript:

G. Cowan RHUL Physics Bayesian Higgs combination page 1 Bayesian Higgs combination using shapes ATLAS Statistics Meeting CERN, 19 December, 2007 Glen Cowan Physics Department Royal Holloway, University of London

G. Cowan RHUL Physics Bayesian Higgs combination page 2 Outline, etc. 4 Sep Bayesian Higgs combination based on event counts Background estimated using subsidiary measurement (sideband) Combination of several channels Systematics in signal efficiency, background (size of sideband) Today -- extend/modify this to use distribution of a variable ("shape") measured for each event (e.g. reconstructed Higgs mass). Use signal/background histograms for H→  supplied as sample inputs for Higgs combination exercise (Bruce Mellado, Yaquan Fang, Leonardo Carminati)

G. Cowan RHUL Physics Bayesian Higgs combination page 3 Inputs 10 fb  sisi bibi i = bin index m H = 130 GeV

G. Cowan RHUL Physics Bayesian Higgs combination page 4 Expected signal/background for bin i Expected numbers of signal/background events in bin i = total number  probability to be in bin i.  = "Global strength parameter", SM is  = 1. Shape pdfs f b, f s from MC, in general have some uncertainty. Vary shapes by parameterizing and varying the parameters according to appropriate priors.

G. Cowan RHUL Physics Bayesian Higgs combination page 5 Likelihood, Bayes factor Assume data in each bin is n i ~ Poisson (  i + b i ) The Bayes Factor (evidence for discovery) is where the integrals are over the internal parameters of the model(s).

G. Cowan RHUL Physics Bayesian Higgs combination page 6 Calculating the Bayes factor Bayes factors need marginalized likelihoods for numerator and denominator, both of form Compute these using importance sampling where f(  ) = multivariate Gaussian with mean, covariance determined from L(  )  (  ) by MINUIT.

G. Cowan RHUL Physics Bayesian Higgs combination page 7 Normalization of signal/background In principle SM + MC provides absolute predictions for s i, b i. But systematic uncertainty in background probably large compared to stat. fluctuation in number of background events, √ b tot So take a broad prior for b tot, e.g., Uniform[0,∞]. Alternatively, use e.g. Gaussian centred about MC prediction with best guess for error; result will not depend on this sensitively unless sys. error comparable to √ b tot. For signal use e.g. Gaussian centred about MC prediction with best estimate for error.

G. Cowan RHUL Physics Bayesian Higgs combination page 8 Most optimistic scenario No uncertainty in predicted signal, background Create test data set -- nearest integers to SM expectation For  = 1, B 10 = 625

G. Cowan RHUL Physics Bayesian Higgs combination page 9 Uncertainties in total rates Flat prior for b tot and varying uncertainties for total signal rate: For  = 1, B 10 ~ 307 Similar to study based on event counts (see Stat Forum 4 Sep 07)

G. Cowan RHUL Physics Bayesian Higgs combination page 10 Uncertainties in shapes.Parameterize shape pdfs and write down priors that reflect estimated uncertainty in the shapes. E.g. from signal shape, fit a Gaussian to MC prediction, write down prior for the mean and sigma marginalize over the nuisance parameters Attempted "simple" example of e.g. 10% uncertainty in width of signal, some computational glitches -- result next time.

G. Cowan RHUL Physics Bayesian Higgs combination page 11 Also for next time... Straightforward extension to get limits write down (flatish) prior for  sample full posterior with MCMC to find pdf of  and solve Exclude the tested m H if  up < 1, repeat for all m H. Also straightforward to extend to multiple channels, and to include subsidiary measurements that help constrain background. Investigate sampling distribution of B 10 (calibration relative to p-value).