G. Cowan RHUL Physics Status of Higgs combination page 1 Status of Higgs Combination ATLAS Higgs Meeting CERN/phone, 7 November, 2008 Glen Cowan, RHUL.

Slides:



Advertisements
Similar presentations
Using the Profile Likelihood in Searches for New Physics / PHYSTAT 2011 G. Cowan 1 Using the Profile Likelihood in Searches for New Physics arXiv:
Advertisements

27 th March CERN Higgs searches: CL s W. J. Murray RAL.
Recent Results on the Possibility of Observing a Standard Model Higgs Boson Decaying to WW (*) Majid Hashemi University of Antwerp, Belgium.
G. Cowan Statistics for HEP / LAL Orsay, 3-5 January 2012 / Lecture 2 1 Statistical Methods for Particle Physics Lecture 2: Tests based on likelihood ratios.
G. Cowan RHUL Physics Profile likelihood for systematic uncertainties page 1 Use of profile likelihood to determine systematic uncertainties ATLAS Top.
1 6 th September 2007 C.P. Ward Sensitivity of ZZ→llνν to Anomalous Couplings Pat Ward University of Cambridge Neutral Triple Gauge Couplings Fit Procedure.
G. Cowan RHUL Physics Comment on use of LR for limits page 1 Comment on definition of likelihood ratio for limits ATLAS Statistics Forum CERN, 2 September,
G. Cowan Statistical methods for HEP / Birmingham 9 Nov Recent developments in statistical methods for particle physics Particle Physics Seminar.
G. Cowan Lectures on Statistical Data Analysis Lecture 12 page 1 Statistical Data Analysis: Lecture 12 1Probability, Bayes’ theorem 2Random variables and.
1 24 th September 2007 C.P. Ward Sensitivity of ZZ→llνν to Anomalous Couplings Pat Ward University of Cambridge Neutral Triple Gauge Couplings Fit Procedure.
G. Cowan / RHUL Discovery Potential for the SM Higgs at ATLAS / La Thuile, 1-7 March Discovery Potential for the Standard Model Higgs at ATLAS La.
G. Cowan RHUL Physics Higgs combination note status page 1 Status of Higgs Combination Note ATLAS Statistics/Higgs Meeting Phone, 7 April, 2008 Glen Cowan.
G. Cowan Statistics for HEP / NIKHEF, December 2011 / Lecture 2 1 Statistical Methods for Particle Physics Lecture 2: Tests based on likelihood ratios.
G. Cowan Statistical Data Analysis / Stat 4 1 Statistical Data Analysis Stat 4: confidence intervals, limits, discovery London Postgraduate Lectures on.
G. Cowan Shandong seminar / 1 September Some Developments in Statistical Methods for Particle Physics Particle Physics Seminar Shandong University.
G. Cowan Discovery and limits / DESY, 4-7 October 2011 / Lecture 2 1 Statistical Methods for Discovery and Limits Lecture 2: Tests based on likelihood.
G. Cowan RHUL Physics Bayesian Higgs combination page 1 Bayesian Higgs combination using shapes ATLAS Statistics Meeting CERN, 19 December, 2007 Glen Cowan.
8. Hypotheses 8.2 The Likelihood ratio at work K. Desch – Statistical methods of data analysis SS10.
G. Cowan Statistics for HEP / NIKHEF, December 2011 / Lecture 4 1 Statistical Methods for Particle Physics Lecture 4: More on discovery and limits.
Statistical aspects of Higgs analyses W. Verkerke (NIKHEF)
Discovery Experience: CMS Giovanni Petrucciani (UCSD)
1 Glen Cowan Statistics Forum News Glen Cowan Eilam Gross ATLAS Statistics Forum CERN, 3 December, 2008.
G. Cowan SUSSP65, St Andrews, August 2009 / Statistical Methods 2 page 1 Statistical Methods in Particle Physics Lecture 2: Limits and Discovery.
Results of combination Higgs toy combination, within and across experiments, with RooStats Grégory Schott Institute for Experimental Nuclear Physics of.
1 Methods of Experimental Particle Physics Alexei Safonov Lecture #23.
G. Cowan CLASHEP 2011 / Topics in Statistical Data Analysis / Lecture 21 Topics in Statistical Data Analysis for HEP Lecture 2: Statistical Tests CERN.
G. Cowan Statistical techniques for systematics page 1 Statistical techniques for incorporating systematic/theory uncertainties Theory/Experiment Interplay.
1 Proposal to change limits for exclusion N.Andari, L. Fayard, M.Kado, F.Polci LAL- Orsay Y.Fang, Y.Pan, H.Wang, Sau Lan Wu University of Wisconsin-Madison.
Sensitivity Prospects for Light Charged Higgs at 7 TeV J.L. Lane, P.S. Miyagawa, U.K. Yang (Manchester) M. Klemetti, C.T. Potter (McGill) P. Mal (Arizona)
ROOT and statistics tutorial Exercise: Discover the Higgs, part 2 Attilio Andreazza Università di Milano and INFN Caterina Doglioni Université de Genève.
G. Cowan RHUL Physics Bayesian Higgs combination page 1 Bayesian Higgs combination based on event counts (follow-up from 11 May 07) ATLAS Statistics Forum.
1 Methods of Experimental Particle Physics Alexei Safonov Lecture #25.
G. Cowan Weizmann Statistics Workshop, 2015 / GDC Lecture 31 Statistical Methods for Particle Physics Lecture 3: asymptotics I; Asimov data set Statistical.
G. Cowan RHUL Physics page 1 Status of search procedures for ATLAS ATLAS-CMS Joint Statistics Meeting CERN, 15 October, 2009 Glen Cowan Physics Department.
G. Cowan, RHUL Physics Discussion on significance page 1 Discussion on significance ATLAS Statistics Forum CERN/Phone, 2 December, 2009 Glen Cowan Physics.
G. Cowan RHUL Physics LR test to determine number of parameters page 1 Likelihood ratio test to determine best number of parameters ATLAS Statistics Forum.
Search for the Higgs boson in H  ZZ (*) decay modes on ATLAS German D Carrillo Montoya, Lashkar Kashif University of Wisconsin-Madison On behalf of the.
G. Cowan RHUL Physics Input from Statistics Forum for Exotics page 1 Input from Statistics Forum for Exotics ATLAS Exotics Meeting CERN/phone, 22 January,
Easy Limit Statistics Andreas Hoecker CAT Physics, Mar 25, 2011.
Study of pair-produced doubly charged Higgs bosons with a four muon final state at the CMS detector (CMS NOTE 2006/081, Authors : T.Rommerskirchen and.
G. Cowan Lectures on Statistical Data Analysis Lecture 4 page 1 Lecture 4 1 Probability (90 min.) Definition, Bayes’ theorem, probability densities and.
G. Cowan Statistical methods for particle physics / Cambridge Recent developments in statistical methods for particle physics HEP Phenomenology.
G. Cowan RHUL Physics Analysis Strategies Workshop -- Statistics Forum Report page 1 Report from the Statistics Forum ATLAS Analysis Strategies Workshop.
G. Cowan, RHUL Physics Statistics for early physics page 1 Statistics jump-start for early physics ATLAS Statistics Forum EVO/Phone, 4 May, 2010 Glen Cowan.
G. Cowan Statistical methods for particle physics / Wuppertal Recent developments in statistical methods for particle physics Particle Physics.
Alexei Safonov (Texas A&M University) For the CDF Collaboration.
The Higgs boson Faster-than-light neutrino’s 09:00-12:3014:00-17:00 Aart Heijboer and Ivo van Vulpen Nikhef Topical lectures on Statistics (3 rd day)
G. Cowan Lectures on Statistical Data Analysis Lecture 12 page 1 Statistical Data Analysis: Lecture 12 1Probability, Bayes’ theorem 2Random variables and.
G. Cowan Statistical methods for HEP / Freiburg June 2011 / Lecture 2 1 Statistical Methods for Discovery and Limits in HEP Experiments Day 2: Discovery.
1 Studies on Exclusion Limits N.Andari, L. Fayard, M.Kado, F.Polci LAL- Orsay LAL meeting 23/07/2009.
G. Cowan RHUL Physics Statistical Issues for Higgs Search page 1 Statistical Issues for Higgs Search ATLAS Statistics Forum CERN, 16 April, 2007 Glen Cowan.
S. Ferrag, G. Steele University of Glasgow. RooStats and MClimit comparison Exercise to use RooStats by an MClimit-formatted person: – Use two programs.
G. Cowan CERN Academic Training 2010 / Statistics for the LHC / Lecture 21 Statistics for the LHC Lecture 2: Discovery Academic Training Lectures CERN,
Investigation on CDF Top Physics Group Ye Li Graduate Student UW - Madison.
G. Cowan SLAC Statistics Meeting / 4-6 June 2012 / Two Developments 1 Two developments in discovery tests: use of weighted Monte Carlo events and an improved.
G. Cowan CERN Academic Training 2012 / Statistics for HEP / Lecture 21 Statistics for HEP Lecture 2: Discovery and Limits Academic Training Lectures CERN,
Tevatron Combination of SM Higgs Searches and Fourth Generation Limits Satish Desai – Fermilab For the CDF and DØ Collaborations 19 th International Conference.
Discussion on significance
Bounds on light higgs in future electron positron colliders
Status of the Higgs to tau tau
Statistics for the LHC Lecture 3: Setting limits
Grégory Schott Institute for Experimental Nuclear Physics
Comment on Event Quality Variables for Multivariate Analyses
School on Data Science in (Astro)particle Physics
TAE 2018 / Statistics Lecture 3
Statistical Methods for the LHC
Statistical Methods for HEP Lecture 3: Discovery and Limits
Application of CLs Method to ATLAS Higgs Searches
TAE 2018 Centro de ciencias Pedro Pascual Benasque, Spain
Presentation transcript:

G. Cowan RHUL Physics Status of Higgs combination page 1 Status of Higgs Combination ATLAS Higgs Meeting CERN/phone, 7 November, 2008 Glen Cowan, RHUL Eilam Gross, Weizmann Instutite

G. Cowan RHUL Physics Status of Higgs combination page 2 Outline 1)Overview of HG11 goals, people involved, documents 2)Review of combination method 3)Validation of approximations used 4)Results of combination 5)Summary

G. Cowan RHUL Physics Status of Higgs combination page 3 CSC HG11 Overview Describes statistical methods for combination of search channels. Applies combination to (a subset of) Higgs channels: WW→e  (0-jet and 2-jet), , ,  ZZ(*)→4l Treats systematics by means of profile likelihood method. Considers fixed-mass hypothesis; look-elsewhere-effect must be studied separately. NB  and WW CSC notes describe floating-mass fits. Some approximations used for discovery/exclusion significance. Valid for L > 2 fb . For lower L need toy MC methods. Does not represent final word on methods -- other developments ongoing (Bayesian, CLs, look-elsewhere-effect,...)

G. Cowan RHUL Physics Status of Higgs combination page 4 CSC HG11 People Editors: Eilam Gross, Glen Cowan Contacts for individual channels: WWBill Quayle  Yaquan Fang  Kyle Cranmer 4lAndrea Di Simone Note referee:Fabiola Gianotti Chapter referees:Fabio Cerutti, Bruno Mansoulie Chapter editors:Rachid Mazini, Bill Murray + e.g. Louis Fayard, Aleandro Nisati, Karl Jakobs, Dave Charlton, Ofer Vitells...

G. Cowan RHUL Physics Status of Higgs combination page 5 HG11 Documents Source of note in CVS: AFS area for combination inputs: /afs/cern.ch/atlas/project/statistics/ The draft note circulated to collaboration (old WW numbers): ATL-COM-PHYS , higgs_combo_csc_3nov08.pdf The draft note (new WW numbers) 4 November 2008 version: higgs_combo_csc_4nov08.pdf

G. Cowan RHUL Physics Status of Higgs combination page 6 Reminder of combination method  represents all nuisance parameters, e.g., background rate, shapes  =1 is SM.  =0 is background only. The single-channel likelihood function uses Poisson model for events in signal and control histograms: There is a likelihood L i ( ,  i ) for each channel, i = 1, …, N. The full likelihood function is

G. Cowan RHUL Physics Status of Higgs combination page 7 Profile likelihood ratio To test hypothesized value of , construct profile likelihood ratio: Maximized L for given  Maximized L Equivalently use q  =  2 ln (  ): data agree well with hypothesized  → q  small data disagree with hypothesized  → q  large

G. Cowan RHUL Physics Status of Higgs combination page 8 p-value / significance of hypothesized  Test hypothesized  by giving p-value, probability to see data with ≤ compatibility with  compared to data observed: Equivalently use significance:

G. Cowan RHUL Physics Status of Higgs combination page 9 Sampling distribution of q  To compute p-value of hypothesized , need distribution f (q  |  ). For 5  discovery we need a p-value of 2.8 × 10  ; To estimate this using MC needs > 10 8 events. Wilk’s theorem: in large sample limit f (q  |  ) should approach with w = ½. (a “half-chi-square” distribution). Validation exercise shows approximation OK for L ≥ 2 fb . We use the half-chi-square approximation in the current note; for lower luminosities we will need MC to get f (q  |  ) (feasible for exclusion limits at 95% CL).

G. Cowan RHUL Physics Status of Higgs combination page 10 Example from validation exercise: ZZ (*) → 4l 5  level (One minus) cumulative distributions. Band gives 68% CL limits. ½2½2 ½2½2 ½2½2 ½2½2 Distributions of q 0 for 2, 10 fb  from MC compared to ½  2

G. Cowan RHUL Physics Status of Higgs combination page 11 Special treatment for WW+0j discovery For WW (→ Bill Quayle), further systematic studies were carried out that went beyond profile likelihood method. Parameter variations were considered to minimize the sensitivity of the q  distribution to variations in other fixed parameters such as QCD scale. For WW0j discovery (  =0), the parameter alterations led to a distribution of q 0 significantly different from expected form. original parameters altered parameters

G. Cowan RHUL Physics Status of Higgs combination page 12 Special treatment for WW+0j discovery (2) So for WW0j discovery (  =0), the p-values were determined by toy MC and transformed to effective q 0 values according to which was then used in the formula for the median significance.

G. Cowan RHUL Physics Status of Higgs combination page 13 Sensitivity Discovery: Generate data under s+b (  = 1) hypothesis; Test hypothesis  = 0 → p-value → Z. Exclusion: Generate data under background-only (  = 0) hypothesis; Test hypothesis . If  = 1 has p-value < 0.05 exclude m H at 95% CL. Estimate median significance by setting data equal to expectation values (Asimov data) or by using MC. For median, can combine significances of individual channels. For significance of e.g. a real data set, need global fit.

G. Cowan RHUL Physics Status of Higgs combination page 14 Combined discovery sensitivity No WW0j spin correlations With WW0j spin correlations

G. Cowan RHUL Physics Status of Higgs combination page 15 Combined discovery sensitivity No WW0j spin correlations With WW0j spin correlations

G. Cowan RHUL Physics Status of Higgs combination page 16 Combined discovery sensitivity No WW0j spin correlations With WW0j spin correlations Shaded band below 2 fb  indicates this region not accurate (but expected to be conservative).

G. Cowan RHUL Physics Status of Higgs combination page 17 p-value of  =1 (SM) versus m H No WW0j spin correlations With WW0j spin correlations

G. Cowan RHUL Physics Status of Higgs combination page 18 p-value of  =1 (SM) versus m H No WW0j spin correlations With WW0j spin correlations

G. Cowan RHUL Physics Status of Higgs combination page 19  p-value of  =1 (SM) versus L, m H No WW0j spin correlations With WW0j spin correlations Shaded band below 2 fb  indicates this region not accurate (but expected to be conservative).

G. Cowan RHUL Physics Status of Higgs combination page 20 Median 95% CL limit on  assuming no Higgs

G. Cowan RHUL Physics Status of Higgs combination page 21 Summary Combination method based on developed and applied to: WW→e  (0-jet and 2-jet), , ,  ZZ(*)→4l Systematics incorporated using profile likelihood ratio. Work represents a “snapshot” of combination activities; other areas still ongoing activity (Bayesian, CLs, look-elsewhere-effect…) Approximations used expected to be valid for L ≥ 2 fb . For 2 fb  : expected (median) sensitivity is ≥5  for discovery of a Higgs in the mass range between 143 and 179 GeV; expected upper limit at 95% CL on m H is 121 GeV.

G. Cowan RHUL Physics Status of Higgs combination page 22 Summary (2) Many comments by referees (and others) -- led to important improvements: More thorough explanation of mathematical approximations used and of their limitations. Comparison with methods used at LEP (appendix). Careful formulation of conclusions, e.g., results conservative as only subset of channels used; caveats concerning approximations; L < 2 fb  will need toy MC studies. Draft circulated to collaboration does not yet have WW spin correlations; these give improved sensitivity but no change in basic conclusions.

G. Cowan RHUL Physics Status of Higgs combination page 23 Extra slides

G. Cowan RHUL Physics Status of Higgs combination page 24 Expected discovery significance from WW0j with spin correlations no spin correlations

G. Cowan RHUL Physics Status of Higgs combination page 25 Luminosity for 5  discovery assuming SM Higgs

G. Cowan RHUL Physics Status of Higgs combination page 26 Luminosity for 95% CL exclusion

G. Cowan RHUL Physics Status of Higgs combination page 27 Median 95% CL limit on  assuming no Higgs