Laplace, Pierre Simon de ( )

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

(sfi) 2 lunch favourite statistician. The contest 16 statisticians (list prepared by Egil Ferkingstad and Anders Løland) 4 each lunch A final of 4.
Week11 Parameter, Statistic and Random Samples A parameter is a number that describes the population. It is a fixed number, but in practice we do not know.
1 Virtual COMSATS Inferential Statistics Lecture-7 Ossam Chohan Assistant Professor CIIT Abbottabad.
Statistics: Purpose, Approach, Method. The Basic Approach The basic principle behind the use of statistical tests of significance can be stated as: Compare.
Class notes for ISE 201 San Jose State University
1 Chap 5 Sums of Random Variables and Long-Term Averages Many problems involve the counting of number of occurrences of events, computation of arithmetic.
Chapter 6 Introduction to Sampling Distributions
SUMS OF RANDOM VARIABLES Changfei Chen. Sums of Random Variables Let be a sequence of random variables, and let be their sum:
Fall 2006 – Fundamentals of Business Statistics 1 Chapter 6 Introduction to Sampling Distributions.
Probability theory 2010 Outline  The need for transforms  Probability-generating function  Moment-generating function  Characteristic function  Applications.
Combinatorics. If you flip a penny 100 times, how many heads and tales do you expect?
Lesson #17 Sampling Distributions. The mean of a sampling distribution is called the expected value of the statistic. The standard deviation of a sampling.
Probability theory 2008 Conditional probability mass function  Discrete case  Continuous case.
MATH408: Probability & Statistics Summer 1999 WEEK 5 Dr. Srinivas R. Chakravarthy Professor of Mathematics and Statistics Kettering University (GMI Engineering.
Statistical Theory; Why is the Gaussian Distribution so popular? Rob Nicholls MRC LMB Statistics Course 2014.
Chapter 7 ~ Sample Variability
Discrete Mathematics with Applications Fourth Edition
Modern Navigation Thomas Herring
R. Kass/S07 P416 Lec 3 1 Lecture 3 The Gaussian Probability Distribution Function Plot of Gaussian pdf x p(x)p(x) Introduction l The Gaussian probability.
1 Gauss and the Method of Least Squares Teddy Petrou Hongxiao Zhu.
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
The Normal Distribution. History Abraham de Moivre (1733) – consultant to gamblers Pierre Simon Laplace – mathematician, astronomer, philosopher, determinist.
Business Statistics, A First Course (4e) © 2006 Prentice-Hall, Inc. Chap 8-1 Chapter 8 Confidence Interval Estimation Business Statistics, A First Course.
Distribution Function properties. Density Function – We define the derivative of the distribution function F X (x) as the probability density function.
Hamid R. Rabiee Fall 2009 Stochastic Processes Review of Elementary Probability Lecture I.
The Binomial, Poisson, and Normal Distributions Modified after PowerPoint by Carlos J. Rosas-Anderson.
Random Variables and Probability Distributions Modified from a presentation by Carlos J. Rosas-Anderson.
Sampling Theory Determining the distribution of Sample statistics.
8.5 Normal Distributions We have seen that the histogram for a binomial distribution with n = 20 trials and p = 0.50 was shaped like a bell if we join.
40S Applied Math Mr. Knight – Killarney School Slide 1 Unit: Statistics Lesson: ST-5 The Binomial Distribution The Binomial Distribution Learning Outcome.
Statistics for Data Miners: Part I (continued) S.T. Balke.
Permutations & Combinations and Distributions
1 G Lect 6b G Lecture 6b Generalizing from tests of quantitative variables to tests of categorical variables Testing a hypothesis about a.
Lecture 5a: Bayes’ Rule Class web site: DEA in Bioinformatics: Statistics Module Box 1Box 2Box 3.
Barnett/Ziegler/Byleen Finite Mathematics 11e1 Learning Objectives for Section 11.5 Normal Distributions The student will be able to identify what is meant.
Chapter 11 Data Descriptions and Probability Distributions Section 5 Normal Distribution.
The Gaussian (Normal) Distribution: More Details & Some Applications.
Chapter 6 Lecture 3 Sections: 6.4 – 6.5.
Chapter 10 – Sampling Distributions Math 22 Introductory Statistics.
Ch. 22 in the book by Giancoli
Chapter 7: Sample Variability Empirical Distribution of Sample Means.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 14: Probability Wrap-Up and Statistical.
Chapter 7 Sampling and Sampling Distributions ©. Simple Random Sample simple random sample Suppose that we want to select a sample of n objects from a.
Estimation Chapter 8. Estimating µ When σ Is Known.
 A probability function is a function which assigns probabilities to the values of a random variable.  Individual probability values may be denoted.
Chap 7-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 7 Estimating Population Values.
The Normal Distribution (Gaussian Distribution)
Chap 7-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 7 Estimating Population Values.
The final exam solutions. Part I, #1, Central limit theorem Let X1,X2, …, Xn be a sequence of i.i.d. random variables each having mean μ and variance.
Topic 5 - Joint distributions and the CLT
Point Estimation of Parameters and Sampling Distributions Outlines:  Sampling Distributions and the central limit theorem  Point estimation  Methods.
1 Probability and Statistical Inference (9th Edition) Chapter 5 (Part 2/2) Distributions of Functions of Random Variables November 25, 2015.
Chapter 6 Lecture 3 Sections: 6.4 – 6.5. Sampling Distributions and Estimators What we want to do is find out the sampling distribution of a statistic.
 A probability function is a function which assigns probabilities to the values of a random variable.  Individual probability values may be denoted.
Probability and Moment Approximations using Limit Theorems.
§2. The central limit theorem 1. Convergence in distribution Suppose that {X n } are i.i.d. r.v.s with d.f. F n (x), X is a r.v. with F(x), if for all.
The Normal Distribution (Gaussian Distribution) Honors Analysis Learning Target: I can analyze data using the normal distribution.
Sums of Random Variables and Long-Term Averages Sums of R.V. ‘s S n = X 1 + X X n of course.
L. ... L A P L A C E ? Pierre Simon Marquis de Laplace ( ), French astronomer and mathematician, best known for his successful application of.
R. Kass/W04 P416 Lec 3 1 Lecture 3 The Gaussian Probability Distribution Function Plot of Gaussian pdf x p(x)p(x) Introduction l The Gaussian probability.
ASV Chapters 1 - Sample Spaces and Probabilities
Probability Theory and Parameter Estimation I
Presented by: Karen Miller
The Gaussian Probability Distribution Function
Sample Mean Distributions
Gaussian (Normal) Distribution
Class Notes 12: Laplace Transform (1/3) Intro & Differential Equations
Gaussian (Normal) Distribution
5.6 The Central Limit Theorem
Presentation transcript:

Laplace, Pierre Simon de (1749-1827)

Agenda Biography History of The Central limit Theorem (CLT) Derivation of the CLT First Version of the CLT CLT for the Binomial Distribution Laplace and Bayesian ideas 4th and 5th Principles 6th Principle 7th Principle References

Biography Pierre Simon Laplace was born in Normandy on March 23, 1749, and died at Paris on March 5, 1827 French scientist, mathematician and astronomer; established mathematically the stability of the Solar system and its origin - without a divine intervention Professor of mathematics in the École militaire of Paris at the age of 19.

Biography (Cont’d) Under Napoleon, Laplace was a member, then chancellor, of the Senate, and received the Legion of Honour in 1805. Appointed Minister of the Interior, in 1799. Removed from office by Napoleon after six weeks only!! Named a Marquis in 1817 after the restoration of the Bourbons Main publications: Mécanique céleste (1771, 1787) Théorie analytique des probabilités 1812 – first edition dedicated to Napoleon

History Of Central Limit Theorem From De Moivre to Laplace De Moivre investigated the limits of the binomial distribution as the number of trials increases without bound and found that the function exp(-x2) came up in connection with this problem. The formulation of the normal distribution, (1/√2)exp(-x2/2), came with Thomas Simpson.

History Of CLT (Cont’d) This idea was was expanded upon by the German mathematician Carl Friedrich Gauss who then developed the principle of least squares. Independently, the French mathematicians Pierre Simon de Laplace and Legendre also developed these ideas. It was with Laplace's work that the first inklings of the Central Limit Theorem appeared. In France, the normal distribution is known as Laplacian Distribution; while in Germany it is known as Gaussian.

Derivation of the CLT Initial Work: Laplace was calculating the probability distribution of the sum of meteor inclination angles. He assumed that all the angles were r.v’s following a triangular distribution between 0 and 90 degrees Problems: The deviation between the arithmetic mean which was inflicted with observational errors, and the theoretical value The exact calculation was not achievable due to the considerable amount of celestrial bodies Solution: Find an approximation !!

First Version of the CLT Laplace introduced the m.g.f, which is known as Laplace Transform of f He then introduced the Characteristic function: If is a sample of i.i.d. obs., Assume that we have a discrete r.v. x, that takes on the values –m, -m+1,…,0,…,m-1,m with prob. p-m ,…,pm. Let Sn be the sum of the n possible errors.

CLT for the Binomial Distribution

Final Note on The Proof of The CLT It was Lyapunov's analysis that led to the modern characteristic function approach to the Central Limit Theorem. Where

Laplace & Bayesian ideas Overview “Philosophical essay on probabilities” by Laplace General principles on probability Expectation Analytical methods Applications

4th & 5th principles: conditional & marginal give the joint “Here the question posed by some philosophers concerning the influence of the past on the probability of the future, presents itself”

6th principle: “discrete” Bayes theorem “Fundamental principle of that branch of the analysis of chance that consists of reasoning a posteriori from events to causes” CAUSE EVENT

7th principle: probability of future based on observations “(…) the correct way of relating past events to the probability of causes and of future events (…)” CAUSE EVENT FUTURE EVENT

References Laplace, Pierre Simon De. “Philosophical essay on probabilities. Weatherburn, C.E. “A First Course in Mathematical Statistics”.