1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford

Slides:



Advertisements
Similar presentations
SPM – introduction & orientation introduction to the SPM software and resources introduction to the SPM software and resources.
Advertisements

1 BAYES and FREQUENTISM: The Return of an Old Controversy Louis Lyons Oxford University LBL, January 2008.
Copula Regression By Rahul A. Parsa Drake University &
Notes Sample vs distribution “m” vs “µ” and “s” vs “σ” Bias/Variance Bias: Measures how much the learnt model is wrong disregarding noise Variance: Measures.
INTRODUCTION TO MACHINE LEARNING Bayesian Estimation.
Pattern Recognition and Machine Learning
RooUnfold unfolding framework and algorithms
Observers and Kalman Filters
1 χ 2 and Goodness of Fit Louis Lyons IC and Oxford SLAC Lecture 2’, Sept 2008.
1 Practical Statistics for Physicists Sardinia Lectures Oct 2008 Louis Lyons Imperial College and Oxford CDF experiment at FNAL CMS expt at LHC
1 χ 2 and Goodness of Fit Louis Lyons Oxford Mexico, November 2006 Lecture 3.
ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
Psychology 202b Advanced Psychological Statistics, II February 1, 2011.
Psychology 202b Advanced Psychological Statistics, II February 10, 2011.
1 Practical Statistics for Physicists LBL January 2008 Louis Lyons Oxford
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem, random variables, pdfs 2Functions.
GRA 6020 Multivariate Statistics The regression model OLS Regression Ulf H. Olsson Professor of Statistics.
Hypothesis Testing Steps of a Statistical Significance Test. 1. Assumptions Type of data, form of population, method of sampling, sample size.
Spatial autoregressive methods Nr245 Austin Troy Based on Spatial Analysis by Fortin and Dale, Chapter 5.
1 Practical Statistics for Physicists Dresden March 2010 Louis Lyons Imperial College and Oxford CDF experiment at FNAL CMS expt at LHC
Statistical Image Modelling and Particle Physics Comments on talk by D.M. Titterington Glen Cowan RHUL Physics PHYSTAT05 Glen Cowan Royal Holloway, University.
1 Practical Statistics for Physicists SLUO Lectures February 2007 Louis Lyons Oxford
Tracking using the Kalman Filter. Point Tracking Estimate the location of a given point along a sequence of images. (x 0,y 0 ) (x n,y n )
GRA 6020 Multivariate Statistics The regression model OLS Regression Ulf H. Olsson Professor of Statistics.
7. Least squares 7.1 Method of least squares K. Desch – Statistical methods of data analysis SS10 Another important method to estimate parameters Connection.
G. Cowan Lectures on Statistical Data Analysis Lecture 14 page 1 Statistical Data Analysis: Lecture 14 1Probability, Bayes’ theorem 2Random variables and.
ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
CHAPTER 4: Parametric Methods. Lecture Notes for E Alpaydın 2004 Introduction to Machine Learning © The MIT Press (V1.1) 2 Parametric Estimation X = {
CHAPTER 4: Parametric Methods. Lecture Notes for E Alpaydın 2004 Introduction to Machine Learning © The MIT Press (V1.1) 2 Parametric Estimation Given.
INTRODUCTION TO Machine Learning ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
Dealing with Heteroscedasticity In some cases an appropriate scaling of the data is the best way to deal with heteroscedasticity. For example, in the model.
Statistics 350 Lecture 17. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
1 Practical Statistics for Physicists Stockholm Lectures Sept 2008 Louis Lyons Imperial College and Oxford CDF experiment at FNAL CMS expt at LHC
TOPLHCWG. Introduction The ATLAS+CMS combination of single-top production cross-section measurements in the t channel was performed using the BLUE (Best.
Lecture 11: Kalman Filters CS 344R: Robotics Benjamin Kuipers.
INTRODUCTION TO MACHINE LEARNING 3RD EDITION ETHEM ALPAYDIN © The MIT Press, Lecture.
Chapter 12 Multiple Linear Regression Doing it with more variables! More is better. Chapter 12A.
© Cambridge University Press 2013 Thomson_alphaem.
© Cambridge University Press 2013 Thomson_Fig
INTRODUCTION TO MACHINE LEARNING 3RD EDITION ETHEM ALPAYDIN Modified by Prof. Carolina Ruiz © The MIT Press, 2014 for CS539 Machine Learning at WPI
Multivariate Statistics Confirmatory Factor Analysis I W. M. van der Veld University of Amsterdam.
1 Practical Statistics for Physicists CERN Latin American School March 2015 Louis Lyons Imperial College and Oxford CMS expt at LHC
Over-fitting and Regularization Chapter 4 textbook Lectures 11 and 12 on amlbook.com.
Introduction to Machine Learning Multivariate Methods 姓名 : 李政軒.
G. Cowan Computing and Statistical Data Analysis / Stat 9 1 Computing and Statistical Data Analysis Stat 9: Parameter Estimation, Limits London Postgraduate.
Geology 5670/6670 Inverse Theory 28 Jan 2015 © A.R. Lowry 2015 Read for Fri 30 Jan: Menke Ch 4 (69-88) Last time: Ordinary Least Squares: Uncertainty The.
8th December 2004Tim Adye1 Proposal for a general-purpose unfolding framework in ROOT Tim Adye Rutherford Appleton Laboratory BaBar Statistics Working.
Cognitive Computer Vision Kingsley Sage and Hilary Buxton Prepared under ECVision Specific Action 8-3
1 χ 2 and Goodness of Fit & L ikelihood for Parameters Louis Lyons Imperial College and Oxford CERN Summer Students July 2014.
© Cambridge University Press 2013 Thomson_Fig
VANET – Stochastic Path Prediction Motivations Route Discovery Safety Warning Accident Notifications Strong Deceleration of Tra ffi c Flow Road Hazards.
1 Practical Statistics for Physicists CERN Summer Students July 2014 Louis Lyons Imperial College and Oxford CMS expt at LHC
Probability and Statistics for Particle Physics Javier Magnin CBPF – Brazilian Center for Research in Physics Rio de Janeiro - Brazil.
Practical Statistics for Physicists
Chapter 3: Maximum-Likelihood Parameter Estimation
χ2 and Goodness of Fit & Likelihood for Parameters
(5) Notes on the Least Squares Estimate
Practical Statistics for Physicists
Practical Statistics for Physicists
© Cambridge University Press 2011
Special Topics In Scientific Computing
Thomson_eeWWtgc © Cambridge University Press 2013.
Computing and Statistical Data Analysis / Stat 8
Where did we stop? The Bayes decision rule guarantees an optimal classification… … But it requires the knowledge of P(ci|x) (or p(x|ci) and P(ci)) We.
Homework | Determine the Maximum Likelihood Estimator for the mean and variance of a Gaussian Distribution Jason Rebello | Waterloo Autonomous Vehicles.
Thomson_atlascmsEventsAlt
Pattern Recognition and Machine Learning
Thomson_CandP © Cambridge University Press 2013.
Topic 11: Matrix Approach to Linear Regression
Thomson_AFBCartoon © Cambridge University Press 2013.
Presentation transcript:

1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford

2 Topics 1) Introduction Learning to love the Error Matrix 2) Do’s and Dont’s with L ikelihoods 3) χ 2 and Goodness of Fit 4) Bayes, Frequentism and Limits 5) Discovery and p-values

3 Books Statistics for Nuclear and Particle Physicists Cambridge University Press, 1986 Available from CUP Errata in these lectures

4 Other Books

5

6

7

8

9

10

11

12 Relevant for Goodness of Fit

13

14

15

16 Gaussian = N(r, 0, 1) Breit Wigner = 1/{π * (r 2 + 1)}

17 Learning to love the Error Matrix Introduction via 2-D Gaussian Understanding covariance Using the error matrix Combining correlated measurements Estimating the error matrix

18 Element E ij - Diagonal E ij = variances Off-diagonal E ij = covariances

19

20

21

22

23

24

25

26

27

28

29

30 Small error Example: Lecture 3 x best outside x 1  x 2 y best outside y 1  y 2

31

32

33

34 Conclusion Error matrix formalism makes life easy when correlations are relevant

35 Next time: L ikelihoods What it is How it works: Resonance Error estimates Detailed example: Lifetime Several Parameters Extended maximum L Do’s and Dont’s with L