Using RooFit/RooStat in rare decay searches Serra, Storaci, Tuning Rare Decays WG.

Slides:



Advertisements
Similar presentations
Using the Profile Likelihood in Searches for New Physics / PHYSTAT 2011 G. Cowan 1 Using the Profile Likelihood in Searches for New Physics arXiv:
Advertisements

Probability and Statistics Basic concepts II (from a physicist point of view) Benoit CLEMENT – Université J. Fourier / LPSC
27 th March CERN Higgs searches: CL s W. J. Murray RAL.
Bayesian inference “Very much lies in the posterior distribution” Bayesian definition of sufficiency: A statistic T (x 1, …, x n ) is sufficient for 
An Answer and a Question Limits: Combining 2 results Significance: Does  2 give  2 ? Roger Barlow BIRS meeting July 2006.
1/15 Sensitivity to  with B  D(KK  )K Decays CP Working Group Meeting - Thursday, 19 th April 2007 Introduction B  DK  Dalitz Analysis Summary.
8. Statistical tests 8.1 Hypotheses K. Desch – Statistical methods of data analysis SS10 Frequent problem: Decision making based on statistical information.
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem, random variables, pdfs 2Functions.
Bayesian Analysis of X-ray Luminosity Functions A. Ptak (JHU) Abstract Often only a relatively small number of sources of a given class are detected in.
The new Silicon detector at RunIIb Tevatron II: the world’s highest energy collider What’s new?  Data will be collected from 5 to 15 fb -1 at  s=1.96.
Search for B     with SemiExclusive reconstruction C.Cartaro, G. De Nardo, F. Fabozzi, L. Lista Università & INFN - Sezione di Napoli.
G. Cowan Lectures on Statistical Data Analysis Lecture 12 page 1 Statistical Data Analysis: Lecture 12 1Probability, Bayes’ theorem 2Random variables and.
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 7 1Probability, Bayes’ theorem, random variables, pdfs 2Functions of.
G. Cowan RHUL Physics Bayesian Higgs combination page 1 Bayesian Higgs combination using shapes ATLAS Statistics Meeting CERN, 19 December, 2007 Glen Cowan.
Statistical aspects of Higgs analyses W. Verkerke (NIKHEF)
Discovery Experience: CMS Giovanni Petrucciani (UCSD)
1 Glen Cowan Statistics Forum News Glen Cowan Eilam Gross ATLAS Statistics Forum CERN, 3 December, 2008.
880.P20 Winter 2006 Richard Kass 1 Maximum Likelihood Method (MLM) Does this procedure make sense? The MLM answers this question and provides a method.
G. Cowan Lectures on Statistical Data Analysis Lecture 3 page 1 Lecture 3 1 Probability (90 min.) Definition, Bayes’ theorem, probability densities and.
 Candidate events are selected by reconstructing a D, called a tag, in several hadronic modes  Then we reconstruct the semileptonic decay in the system.
Results of combination Higgs toy combination, within and across experiments, with RooStats Grégory Schott Institute for Experimental Nuclear Physics of.
1 Methods of Experimental Particle Physics Alexei Safonov Lecture #23.
A statistical test for point source searches - Aart Heijboer - AWG - Cern june 2002 A statistical test for point source searches Aart Heijboer contents:
Sensitivity Prospects for Light Charged Higgs at 7 TeV J.L. Lane, P.S. Miyagawa, U.K. Yang (Manchester) M. Klemetti, C.T. Potter (McGill) P. Mal (Arizona)
Fermi LAT Monash University Nov 21, 2009 R.DuboisFermi LAT Science Analysis Tutorial1 Issues in a Nutshell LS5039 Low stats: 4k photons in 1 yr Strong.
1 Methods of Experimental Particle Physics Alexei Safonov Lecture #25.
G. Cowan RHUL Physics page 1 Status of search procedures for ATLAS ATLAS-CMS Joint Statistics Meeting CERN, 15 October, 2009 Glen Cowan Physics Department.
G. Cowan, RHUL Physics Discussion on significance page 1 Discussion on significance ATLAS Statistics Forum CERN/Phone, 2 December, 2009 Glen Cowan Physics.
Lukens - 1 Fermilab Seminar – July, 2011 Observation of the  b 0 Patrick T. Lukens Fermilab for the CDF Collaboration July 2011.
1 Introduction to Statistics − Day 4 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Lecture 2 Brief catalogue of probability.
G. Cowan Lectures on Statistical Data Analysis Lecture 8 page 1 Statistical Data Analysis: Lecture 8 1Probability, Bayes’ theorem 2Random variables and.
1 Introduction to Statistics − Day 3 Glen Cowan Lecture 1 Probability Random variables, probability densities, etc. Brief catalogue of probability densities.
Moritz Backes Measuring Correlations. Motivation e.g.: To use two-dimensional sidebands in data-driven background estimation techniques the control samples.
G. Cowan RHUL Physics Analysis Strategies Workshop -- Statistics Forum Report page 1 Report from the Statistics Forum ATLAS Analysis Strategies Workshop.
2005 Unbinned Point Source Analysis Update Jim Braun IceCube Fall 2006 Collaboration Meeting.
G. Cowan RHUL Physics Status of Higgs combination page 1 Status of Higgs Combination ATLAS Higgs Meeting CERN/phone, 7 November, 2008 Glen Cowan, RHUL.
Andrzej Bożek for Belle Coll. I NSTITUTE OF N UCLEAR P HYSICS, K RAKOW ICHEP Beijing 2004  3 and sin(2  1 +  3 ) at Belle  3 and sin(2  1 +  3 )
4/12/05 -Xiaojian Zhang, 1 UIUC paper review Introduction to Bc Event selection The blind analysis The final result The systematic error.
G. Cowan Lectures on Statistical Data Analysis Lecture 10 page 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem 2Random variables and.
1 The use of control channels in the analysis of the B s  μ + μ - decay Tuesday Meeting, 2 June 2009.
Charm Mixing and D Dalitz analysis at BESIII SUN Shengsen Institute of High Energy Physics, Beijing (for BESIII Collaboration) 37 th International Conference.
Density Estimation in R Ha Le and Nikolaos Sarafianos COSC 7362 – Advanced Machine Learning Professor: Dr. Christoph F. Eick 1.
S. Ferrag, G. Steele University of Glasgow. RooStats and MClimit comparison Exercise to use RooStats by an MClimit-formatted person: – Use two programs.
K. Holubyev HEP2007, Manchester, UK, July 2007 CP asymmetries at D0 Kostyantyn Holubyev (Lancaster University) representing D0 collaboration HEP2007,
Barbara Storaci, Nicola Serra, Niels Tuning Bs →μ+μ- Bfys-meeting, 15 th May
Referee Report on Open charm production results for summer conferences, 2010 Peter Clarke Marcel Merk “Observations” and “Comments” The referees thank.
Hands-on Session RooStats and TMVA Exercises
(Day 3).
Status of the Higgs to tau tau
Statistical Significance & Its Systematic Uncertainties
The expected confident intervals for triple gauge coupling parameter
Statistical Methods used for Higgs Boson Searches
Confidence Intervals and Limits
Grégory Schott Institute for Experimental Nuclear Physics
Strategy 6th December 2010 Bill Murray LHC-HCG
Multi-dimensional likelihood
Lecture 4 1 Probability (90 min.)
An Important thing to know.
W boson helicity measurement
B  at B-factories Guglielmo De Nardo Universita’ and INFN Napoli
Lecture 4 1 Probability Definition, Bayes’ theorem, probability densities and their properties, catalogue of pdfs, Monte Carlo 2 Statistical tests general.
Statistical Methods for the LHC
Application of CLs Method to ATLAS Higgs Searches
LHCb Rare Decays Status
LHCb Rare Decays Status
Top mass measurements at the Tevatron and the standard model fits
Lecture 4 1 Probability Definition, Bayes’ theorem, probability densities and their properties, catalogue of pdfs, Monte Carlo 2 Statistical tests general.
Introductory Statistics
Observation of non-BBar decays of (4S)p+p- (1S, 2S)
Presentation transcript:

Using RooFit/RooStat in rare decay searches Serra, Storaci, Tuning Rare Decays WG

Introduction (RooFit/WorkSpace) 1. RooFit is a tool for: ◦Modelling Pdfs; ◦Generate toy data ◦Performing likelihood fit to any dataset 2. RooWorkspace: ◦New object in RooFit/Root ◦Easy to use and useful for sharing Pdf, Dataset.. ◦Can be saved in a file.root

Goals Extracting the Branching ratio with an unbinned likelihood fit ◦Automatically propagate the error to the final answer ◦Increase the statistical power (partially already presented in Bs  µµ WG see ()) Assumption: ◦We have a control channel for describing the signal Pdfs ◦The sidebands perfectly describe the background under the peak

The Bs  µµ toy example Signal: flat polynomial Background: exponential e -11.7GL to match road map prediction in the sensitive region Signal: gaussian Background: flat polynomial

Toy description For each toy we produce three statistically independent samples (E.g. 1 year, BR=3.5·10 -9 ): 1.20K signal like events (control channel Bd  ππ like) 2.70K background like events (sidebands) peak like events (S+B) In reality all numbers are poisson fluctuating We extract BR using three different methods and we compare the result.

Cut based method GL cut optimization with FOM for 3σ sensitivity (Punzi method)

Binned MFA

Binned MFA II Road-Map recipit : Calculate Δχ 2 for different BR hypotheses

Unbinned likelihood fit 1.Fit: Use the sidebands to build the background Pdf Pdf_bg = GL(RooKeysPdf) Bs(Pol) Use control channel to build the signal Pdf Pdf_sg = GL(RooKeysPdf) Bs(gauss) 2. Build the Signal+ background Pdf: Pdf_peak = Ns Pdf_bg + Nb Pdf_bg 3. Simulneous fit of side-bands and peak to extract Ns Kernel estimation in High energy Physics (K. Cranmer): (non parametric Pdf) Kernel estimation in High energy Physics (K. Cranmer): (non parametric Pdf)

Pdfs used for generating/fitting Pdf peak : Ns Pdf signal (GL, Bs mass) + Nb Pdf background (GL, Bs mass) Fitting the shape from the control channel: In the experiment B d  ππ

Pdf peak : Ns Pdf signal (GL, Bs mass) + Nb Pdf background (GL, Bs mass) Fitting the shape from the control channel: In the experiment B s  ππ flatpolynomial esponential Keys Pdf Pdfs used for generating/fitting

Comparison between the resuls For more plots and comparison look at: () All three methods give a similar sensitivity. Unbinned method ~10% better.

Some more plots 2fb -1 of nominal data taking Assuming SM BR 1fb -1 of nominal data taking Assuming NUHM BR

RooStat Roostat is brand new package in RooFit aimed at: 1.Streamline statistical interpretation of measurement; 2.Facilitate future combination of measurements (e.g. Higgs measurement at ATLAS/CMS), using the RooWorkSpace. 3.So, RooFit enables to combine the information from various Pdfs, RooStat deals with the answer; It is developed by RooFit/Root/ATLAS/CMS (next tutorial in november) () RooStat is pratically a tool for computing and plotting confidence intervals enbedded in RooFit.

Nuissance parameters Other nuissance parameters for the Background: Nb number of Bg events (Poisson distribution) P0 (Bs mass Pdf shape parameter)  (Gaussian 10% error) All the parameters you measured in the experiment (Nb, p0, Br(Bd  JpsiK*) etc…) can be extracted by a likelihood fit and RooStat gives you back the Pdf of the parameters (posterior), which you would use as a prior for the nuissance paramters.

Some comments 1.There are two kind of nuissance parameters: those you get from the Pdg (type II), those you measure somewhere else in the experiment (typeI); 2. Using the posterior you got somewhere else in the experiment, for nuissance parameters (typeI) is equivalent of doing a simultaneous fit. 3. Probably we want to give the result as: Br = Br0+ stat error + syst1+ syst2+syst3… This is easy to do fixing the value of the nuissance parameters before the scan. 4. The advantage of this approach is that it is easy to combine the results and take into account systematycs even with no gaussian errors.

Profile likelihood 68% confidence interval. Fit your model twice: once with everything floating, once with signal = 0 Wilks’s theorem: This quantity approaches asymptotically a χ 2 distribution with a degree of freedom equals to the number of parameters.

Combining results Getting LHCb workspace Getting ATLAS workspace Plotting Combining Likelihoods LHCb ATLAS Combined It is easy to combine results! If we publish the workspace we can combine in the right way results with different systematics.

Cousins-Higland method(systematics) Called Hybrid-Calculator in RooStat You can compute CLs, CLb and significance. For instance for: Ns =160 Nb=70K (year of data taking) Result: Br= 13.4 · 10 -9, ~9 sigmas of significance ~4sigmas from SM You can think L(M|b) as a part of the model and L(b) as a prior. Many more statics methods than used in this talk… Look at:

The MCMC Chain Treating systematics: -Profile likelihood maximizes over nuissance parameters; -MCMC integrates the porterior over them (that’s the way you want to treat nuissance paramters of the second kind). Posterior for s MCMC is a technique which will produce a sampling of a parameter space which is proportional to a posterior. Nice for giving posteriors in many dimensions.

Constraining Wilson coefficients Replacing with BR with its expression as a function of the Wilson coefficients we can plot contours for Cp, Cs This could be useful for combining different measurements. Lot of nuissance parameters (but easy to implement)!

Constraining a particular 2HDM Function of the charged Higgs mass You can pick-up a particular model and constraining its parameters. Easy to combine results: E.g. you can insert a prior for tgβ (or Higgs mass) coming from other measurements (e.g. ATLAS/CMS) and take into account; You can give a Posterior for tgβ which theorists could use for their predictions.

Conclusion