Practical Statistics for Physicists

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

Multilevel analysis with EQS. Castello2004 Data is datamlevel.xls, datamlevel.sav, datamlevel.ess.
Copula Regression By Rahul A. Parsa Drake University &
BA 275 Quantitative Business Methods
1 Practical Statistics for Physicists Sardinia Lectures Oct 2008 Louis Lyons Imperial College and Oxford CDF experiment at FNAL CMS expt at LHC
1 χ 2 and Goodness of Fit Louis Lyons Oxford Mexico, November 2006 Lecture 3.
1 Practical Statistics for Physicists LBL January 2008 Louis Lyons Oxford
G. Cowan Lectures on Statistical Data Analysis 1 Statistical Data Analysis: Lecture 10 1Probability, Bayes’ theorem, random variables, pdfs 2Functions.
GRA 6020 Multivariate Statistics The regression model OLS Regression Ulf H. Olsson Professor of Statistics.
1 Practical Statistics for Physicists Dresden March 2010 Louis Lyons Imperial College and Oxford CDF experiment at FNAL CMS expt at LHC
Statistics 350 Lecture 14. Today Last Day: Matrix results and Chapter 5 Today: More matrix results and Chapter 5 Please read Chapter 5.
M.apollonioCM17 -CERN- (22/2 - 25/2 2007)1 Single Particle Amplitude M. Apollonio – University of Oxford.
Statistical Image Modelling and Particle Physics Comments on talk by D.M. Titterington Glen Cowan RHUL Physics PHYSTAT05 Glen Cowan Royal Holloway, University.
1 Practical Statistics for Physicists SLUO Lectures February 2007 Louis Lyons Oxford
1 Practical Statistics for Particle Physicists CERN Academic Lectures October 2006 Louis Lyons Oxford
Detect Unknown Systematic Effect: Diagnose bad fit to multiple data sets Advanced Statistical Techniques in Particle Physics Grey College, Durham 18 -
Statistics 350 Lecture 17. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
1 Practical Statistics for Physicists Stockholm Lectures Sept 2008 Louis Lyons Imperial College and Oxford CDF experiment at FNAL CMS expt at LHC
Modern Navigation Thomas Herring
880.P20 Winter 2006 Richard Kass Propagation of Errors Suppose we measure the branching fraction BR(Higgs  +  - ) using the number of produced Higgs.
Chapter 15 Modeling of Data. Statistics of Data Mean (or average): Variance: Median: a value x j such that half of the data are bigger than it, and half.
Chapter 12 Multiple Linear Regression Doing it with more variables! More is better. Chapter 12A.
MTH 161: Introduction To Statistics
Thomas Knotts. Engineers often: Regress data  Analysis  Fit to theory  Data reduction Use the regression of others  Antoine Equation  DIPPR.
SUPA Advanced Data Analysis Course, Jan 6th – 7th 2009 Advanced Data Analysis for the Physical Sciences Dr Martin Hendry Dept of Physics and Astronomy.
Summary of introduced statistical terms and concepts mean Variance & standard deviation covariance & correlation Describes/measures average conditions.
Status of Reference Network Simulations John Dale TILC09 20 April 2009.
1 Practical Statistics for Physicists CERN Latin American School March 2015 Louis Lyons Imperial College and Oxford CMS expt at LHC
G. Cowan Computing and Statistical Data Analysis / Stat 9 1 Computing and Statistical Data Analysis Stat 9: Parameter Estimation, Limits London Postgraduate.
Lecture 4 Confidence Intervals. Lecture Summary Last lecture, we talked about summary statistics and how “good” they were in estimating the parameters.
Cognitive Computer Vision Kingsley Sage and Hilary Buxton Prepared under ECVision Specific Action 8-3
1 Practical Statistics for Physicists CERN Summer Students July 2014 Louis Lyons Imperial College and Oxford CMS expt at LHC
PatReco: Model and Feature Selection Alexandros Potamianos Dept of ECE, Tech. Univ. of Crete Fall
Data Modeling Patrice Koehl Department of Biological Sciences
χ2 and Goodness of Fit & Likelihood for Parameters
(5) Notes on the Least Squares Estimate
Practical Statistics for Physicists
Practical Statistics for Physicists
B&A ; and REGRESSION - ANCOVA B&A ; and
3.1 Examples of Demand Functions
Correlation, Regression & Nested Models
Introduction, class rules, error analysis Julia Velkovska
Linear Mixed Models in JMP Pro
CH 5: Multivariate Methods
Statistics 350 Lecture 4.
The Maximum Likelihood Method
Status of Reference Network Simulations
Part Three. Data Analysis
Parameter, Statistic and Random Samples
Simple Linear Regression - Introduction
Propagating Uncertainty In POMDP Value Iteration with Gaussian Process
CHAPTER 29: Multiple Regression*
Inference about the Slope and Intercept
Regression Models - Introduction
Inference about the Slope and Intercept
Where did we stop? The Bayes decision rule guarantees an optimal classification… … But it requires the knowledge of P(ci|x) (or p(x|ci) and P(ci)) We.
Simple Linear Regression
5.4 General Linear Least-Squares
Regression Statistics
Simple Linear Regression and Correlation
Computing and Statistical Data Analysis / Stat 7
Simple Linear Regression
Chapter 14 Monte Carlo Simulation
#21 Marginalize vs. Condition Uninteresting Fitted Parameters
Test #1 Thursday September 20th
Bonus Slide!!! Things to “Carefully Consider”
Causal Relationships with measurement error in the data
Topic 11: Matrix Approach to Linear Regression
Structural Equation Modeling
Regression Models - Introduction
Presentation transcript:

Practical Statistics for Physicists Louis Lyons Imperial College and Oxford CMS expt at LHC l.lyons@physics.ox.ac.uk CERN Latin American School March 2015

Extra Lecture: Learning to love the Error Matrix Introduction via 2-D Gaussian Understanding covariance Using the error matrix Combining correlated measurements Estimating the error matrix

Reminder of 1-D Gaussian or Normal y = 1 exp{-(x-µ)2/(22)} 2  Reminder of 1-D Gaussian or Normal

Correlations Basic issue: For 1 parameter, quote value and error For 2 (or more) parameters, (e.g. gradient and intercept of straight line fit) quote values + errors + correlations Just as the concept of variance for single variable is more general than Gaussian distribution, so correlation in more variables does not require multi-dim Gaussian But more simple to introduce concept this way

Element Eij - <(xi – xi) (xj – xj)> Diagonal Eij = variances Off-diagonal Eij = covariances

Towards the Error Matrix

Example from Particle Physics

Examples of correlated variables

Small error Example: Chi-sq Lecture xbest outside x1  x2 ybest outside y1  y2

b y a x

Conclusion Error matrix formalism makes life easy when correlations are relevant