Information and Statistics in Nuclear Experiment and Theory - Introduction D. G. Ireland 16 November 2015 ISNET-3, ECT* Trento.

Slides:



Advertisements
Similar presentations
Bayesian tools for analysing and reducing uncertainty Tony OHagan University of Sheffield.
Advertisements

Design of Experiments Lecture I
Rick Quax Postdoctoral researcher Computational Science University of Amsterdam EU FP7 projects: Nudge control through information processing.
INTRODUCTION TO MODELING
Managerial Decision Modeling with Spreadsheets
Measurements and Errors Introductory Lecture Prof Richard Thompson 4 th October 2007.
Probabilistic & Statistical Techniques Eng. Tamer Eshtawi First Semester Eng. Tamer Eshtawi First Semester
Protein- Cytokine network reconstruction using information theory-based analysis Farzaneh Farhangmehr UCSD Presentation#3 July 25, 2011.
Fundamental limits in Information Theory Chapter 10 :
Curve-Fitting Regression
Maximum likelihood (ML) and likelihood ratio (LR) test
Linear and generalised linear models
EXPERIMENTAL METHODS IN THERMAL ENGINEERING P M V Subbarao Professor Mechanical Engineering Department Man is the measure of All things.. Measurement is.
Role and Place of Statistical Data Analysis and very simple applications Simplified diagram of a scientific research When you know the system: Estimation.
Linear and generalised linear models
Causal Models, Learning Algorithms and their Application to Performance Modeling Jan Lemeire Parallel Systems lab November 15 th 2006.
Linear and generalised linear models Purpose of linear models Least-squares solution for linear models Analysis of diagnostics Exponential family and generalised.
Maximum likelihood (ML)
INFORMATION THEORY BYK.SWARAJA ASSOCIATE PROFESSOR MREC.
More About Inverse Problems: Another Example Inverting for density.
More Machine Learning Linear Regression Squared Error L1 and L2 Regularization Gradient Descent.
Least-Squares Regression
GEODETIC INSTITUTE LEIBNIZ UNIVERSITY OF HANNOVER GERMANY Ingo Neumann and Hansjörg Kutterer The probability of type I and type II errors in imprecise.
Overview course in Statistics (usually given in 26h, but now in 2h)  introduction of basic concepts of probability  concepts of parameter estimation.
Statistics for Data Miners: Part I (continued) S.T. Balke.
R. Kass/W03P416/Lecture 7 1 Lecture 7 Some Advanced Topics using Propagation of Errors and Least Squares Fitting Error on the mean (review from Lecture.
ATMS 451: Instruments and Observations MWF 11:30 AM – 12:20 PM 310c ATG TuTh 10:30 AM – 12:20 PM 108 or 610 ATG** (be prepared for changes)
Software Measurement & Metrics
MECN 3500 Inter - Bayamon Lecture 9 Numerical Methods for Engineering MECN 3500 Professor: Dr. Omar E. Meza Castillo
Curve-Fitting Regression
CS 782 – Machine Learning Lecture 4 Linear Models for Classification  Probabilistic generative models  Probabilistic discriminative models.
Physics I Significant Figures. Measurement necessary for science “I often say that when you can measure what you are speaking about, and express it in.
CS 3300 FALL 2015 Software Metrics. Some Quotes When you can measure what you are speaking about and express it in numbers, you know something about it;
Baryon Spectroscopy from JLab D. G. Ireland 17 September 2015 Hadron2015, Newport News, Virginia USA.
Computer Vision – Compression(1) Hanyang University Jong-Il Park.
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
CHEMISTRY ANALYTICAL CHEMISTRY Fall Lecture 6.
Introduction to Measurement. According to Lord Kelvin “When you can measure what you are speaking about and express it in numbers, you know something.
Mathematical Foundations Elementary Probability Theory Essential Information Theory Updated 11/11/2005.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Model Building and Model Diagnostics Chapter 15.
- 1 - Overall procedure of validation Calibration Validation Figure 12.4 Validation, calibration, and prediction (Oberkampf and Barone, 2004 ). Model accuracy.
CSCI 102: Introduction to Computational Modeling Chapter 1: The Modeling Process.
Constructs AKA... AKA... Latent variables Latent variables Unmeasured variables Unmeasured variables Factors Factors Unobserved variables Unobserved variables.
New approaches to variable stars data processing and interpretation Zdeněk Mikulášek Institute for Theoretical Physics and Astrophysics, Masaryk University,
DECISION TREE Ge Song. Introduction ■ Decision Tree: is a supervised learning algorithm used for classification or regression. ■ Decision Tree Graph:
Adaptive Trial Designs Global Forum on Bioethics in Research: Emerging Epidemic Infections and Experimental Treatments November 4, 2015.
Presented by Minkoo Seo March, 2006
BME 353 – BIOMEDICAL MEASUREMENTS AND INSTRUMENTATION MEASUREMENT PRINCIPLES.
Regression Analysis1. 2 INTRODUCTION TO EMPIRICAL MODELS LEAST SQUARES ESTIMATION OF THE PARAMETERS PROPERTIES OF THE LEAST SQUARES ESTIMATORS AND ESTIMATION.
Belief in Information Flow Michael Clarkson, Andrew Myers, Fred B. Schneider Cornell University 18 th IEEE Computer Security Foundations Workshop June.
1 Information Content Tristan L’Ecuyer. 2 Degrees of Freedom Using the expression for the state vector that minimizes the cost function it is relatively.
Statistical Methods. 2 Concepts and Notations Sample unit – the basic landscape unit at which we wish to establish the presence/absence of the species.
SCIENTIFIC DISCOVERY EXPERIMENT THEORY SCIENTIFIC COMPUTING 1.
Parameter Estimation. Statistics Probability specified inferred Steam engine pump “prediction” “estimation”
5 September 2002AIAA STC Meeting, Santa Fe, NM1 Verification and Validation for Computational Solid Mechanics Presentation to AIAA Structures Technical.
Computacion Inteligente Least-Square Methods for System Identification.
CORRELATION-REGULATION ANALYSIS Томский политехнический университет.
Introduction to emulators Tony O’Hagan University of Sheffield.
REC Savannah, Febr. 22, 2006 Title Outlier Detection in Geodetic Applications with respect to Observation Imprecision Ingo Neumann and Hansjörg.
Ch 1. Introduction Pattern Recognition and Machine Learning, C. M. Bishop, Updated by J.-H. Eom (2 nd round revision) Summarized by K.-I.
Chapter 9 Forecasting Copyright 2015 Health Administration Press.
Stochasticity and Probability. A new approach to insight Pose question and think of the answer needed to answer it. Ask: How do the data arise? What is.
Notes on Weighted Least Squares Straight line Fit Passing Through The Origin Amarjeet Bhullar November 14, 2008.
By Arijit Chatterjee Dr
Bayesian Monte-Carlo and Experimental Uncertainties
How to Analyse Data Martin Rusnak, MD, PhD prof. of Public Health
Introduction to Instrumentation Engineering
Aims Research aim to provide internally consistent, practically applicable, methodology of dynamic decision making (DM) Talk aims to provide DM-based.
LECTURE 23: INFORMATION THEORY REVIEW
Propagation of Error Berlin Chen
Presentation transcript:

Information and Statistics in Nuclear Experiment and Theory - Introduction D. G. Ireland 16 November 2015 ISNET-3, ECT* Trento

1 What are we doing here this week?

2 Key Questions to be addressed How can we estimate statistical uncertainties of calculated quantities? How we can assess the systematic errors arising from physical approximations? How can model-based extrapolations be validated and verified? How can we improve the predictive power of theoretical models? When is the application of statistical methods justified, and can they give robust results? What experimental data are crucial for better constraining current nuclear models? How can the uniqueness and usefulness of an observable be assessed, i.e., its information content with respect to current theoretical models? How can statistical tools of nuclear theory help planning future experiments and experimental programs? How to quantitatively compare the predictive power of different theoretical models?

3 Methods to be discussed Statistical methods and methods of statistical learning: parameter estimation, covariance analysis, robust techniques and least-squares alternatives, regression diagnostics, outliers detection Information theory Bayesian approaches and consistent inclusion of a priori expectations Uncertainty quantification and Monte-Carlo error propagation Computational techniques

4 Our Task Nature (QCD) Reactions manifests itself in are accessible to Theories help us understand inspire Measurements

5 Measurement “When you can measure what you are speaking about, and express it in numbers, you know something about it, when you cannot express it in numbers, your knowledge is of a meagre and unsatisfactory kind; it may be the beginning of knowledge, but you have scarcely, in your thoughts advanced to the stage of science.” ― William Thomson, 1st Baron Kelvin “When you can measure what you are speaking about, and express it in numbers, you know something about it, when you cannot express it in numbers, your knowledge is of a meagre and unsatisfactory kind; it may be the beginning of knowledge, but you have scarcely, in your thoughts advanced to the stage of science.” ― William Thomson, 1st Baron Kelvin

Scattering Experiments 6 “high p T event”

7 But... There is no such thing as a complete measurement!

8 Recall: Data Points summarise PDFs

9 Uncertainty “Uncertainty is an uncomfortable position. But certainty is an absurd one.” ― Voltaire

10 How we update our knowledge

Information Gain All models of reality Models consistent with data 11

Channel Noisy Channel Communication 12 {X}{Y} Input Symbols Measured Symbols

Experiment Experimental Measurement 13 {A x }{A y } Input Symbols Measured Symbols

Quantifying Information Information quantified with Shannon Entropy: For N discrete outcomes: Maximum Entropy is lnN Minimum Entropy is 0 14 Conditional Entropy of X given Y: Mutual Information between X and Y: Average uncertainty in x remaining when y is known Average reduction in uncertainty about x when y is known C. E. Shannon

Example: Monty Hall Problem Start: Maximum entropy = ln3 After door is opened: Entropy = ln3 – 2 / 3 ln2 So information gained is 2 / 3 ln2 [Checking this answer reveals the solution to the original problem!] 15

16 Required Accuracy

17 Take care if you have only partial data...

18

19 Thanks to IoP Publishing...

20 Thank you for participating