INTRODUCTION TO MAXIMUM LIKELIHOOD METHODS FOR ECOLOGY MIDIS NUMÉRIQUES APRIL 3 RD 2014 ALYSSA BUTLER.

Slides:



Advertisements
Similar presentations
ECE 8443 – Pattern Recognition LECTURE 05: MAXIMUM LIKELIHOOD ESTIMATION Objectives: Discrete Features Maximum Likelihood Resources: D.H.S: Chapter 3 (Part.
Advertisements

Sampling: Final and Initial Sample Size Determination
Estimation  Samples are collected to estimate characteristics of the population of particular interest. Parameter – numerical characteristic of the population.
SOLVED EXAMPLES.
A Short Introduction to Curve Fitting and Regression by Brad Morantz
Point estimation, interval estimation
Today Today: Chapter 9 Assignment: Recommended Questions: 9.1, 9.8, 9.20, 9.23, 9.25.
Statistical Inference Chapter 12/13. COMP 5340/6340 Statistical Inference2 Statistical Inference Given a sample of observations from a population, the.
Log-linear modeling and missing data A short course Frans Willekens Boulder, July
Estimation of parameters. Maximum likelihood What has happened was most likely.
Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.
CONTINUOUS RANDOM VARIABLES. Continuous random variables have values in a “continuum” of real numbers Examples -- X = How far you will hit a golf ball.
Today Today: Chapter 9 Assignment: 9.2, 9.4, 9.42 (Geo(p)=“geometric distribution”), 9-R9(a,b) Recommended Questions: 9.1, 9.8, 9.20, 9.23, 9.25.
2. Point and interval estimation Introduction Properties of estimators Finite sample size Asymptotic properties Construction methods Method of moments.
Lec 6, Ch.5, pp90-105: Statistics (Objectives) Understand basic principles of statistics through reading these pages, especially… Know well about the normal.
T-test.
Overview of STAT 270 Ch 1-9 of Devore + Various Applications.
8-1 Introduction In the previous chapter we illustrated how a parameter can be estimated from sample data. However, it is important to understand how.
7-1 Introduction The field of statistical inference consists of those methods used to make decisions or to draw conclusions about a population. These.
Statistics 350 Lecture 17. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
Maximum likelihood (ML)
1 Confidence Intervals for Means. 2 When the sample size n< 30 case1-1. the underlying distribution is normal with known variance case1-2. the underlying.
Standard error of estimate & Confidence interval.
Jeff Howbert Introduction to Machine Learning Winter Classification Bayesian Classifiers.
Overall agenda Part 1 and 2  Part 1: Basic statistical concepts and descriptive statistics summarizing and visualising data describing data -measures.
Chapter 4-5: Analytical Solutions to OLS
Stats for Engineers Lecture 9. Summary From Last Time Confidence Intervals for the mean t-tables Q Student t-distribution.
Exponential Distribution
Random Sampling, Point Estimation and Maximum Likelihood.
Maximum Likelihood Estimator of Proportion Let {s 1,s 2,…,s n } be a set of independent outcomes from a Bernoulli experiment with unknown probability.
7-1 Introduction The field of statistical inference consists of those methods used to make decisions or to draw conclusions about a population. These.
Chapter 7 Point Estimation
1 Schaum’s Outline PROBABILTY and STATISTICS Chapter 6 ESTIMATION THEORY Presented by Professor Carol Dahl Examples from D. Salvitti J. Mazumdar C. Valencia.
The Triangle of Statistical Inference: Likelihoood Data Scientific Model Probability Model Inference.
1 Lecture 16: Point Estimation Concepts and Methods Devore, Ch
Chapter 5 Parameter estimation. What is sample inference? Distinguish between managerial & financial accounting. Understand how managers can use accounting.
Probability = Relative Frequency. Typical Distribution for a Discrete Variable.
Methodology Solving problems with known distributions 1.
1 Standard error Estimated standard error,s,. 2 Example 1 While measuring the thermal conductivity of Armco iron, using a temperature of 100F and a power.
Confidence Interval & Unbiased Estimator Review and Foreword.
Statistical Estimation Vasileios Hatzivassiloglou University of Texas at Dallas.
CHAPTER 9 Inference: Estimation The essential nature of inferential statistics, as verses descriptive statistics is one of knowledge. In descriptive statistics,
Machine Learning 5. Parametric Methods.
CLASSICAL NORMAL LINEAR REGRESSION MODEL (CNLRM )
Maximum likelihood estimators Example: Random data X i drawn from a Poisson distribution with unknown  We want to determine  For any assumed value of.
ESTIMATION METHODS We know how to calculate confidence intervals for estimates of  and  2 Now, we need procedures to calculate  and  2, themselves.
The Probit Model Alexander Spermann University of Freiburg SS 2008.
Conditional Expectation
Statistics and probability Dr. Khaled Ismael Almghari Phone No:
The Probit Model Alexander Spermann University of Freiburg SoSe 2009
Stat 223 Introduction to the Theory of Statistics
4-1 Continuous Random Variables 4-2 Probability Distributions and Probability Density Functions Figure 4-1 Density function of a loading on a long,
MECH 373 Instrumentation and Measurements
Statistical Estimation
Statistical Modelling
Random Variable 2013.
Probability Theory and Parameter Estimation I
Random Variable.
Ch3: Model Building through Regression
Generalized Linear Models
Design and Data Analysis in Psychology I
Maximum Likelihood Find the parameters of a model that best fit the data… Forms the foundation of Bayesian inference Slide 1.
Probability & Statistics Probability Theory Mathematical Probability Models Event Relationships Distributions of Random Variables Continuous Random.
Covered only ML estimator
EC 331 The Theory of and applications of Maximum Likelihood Method
Lecture 2 Interval Estimation
Random Variable.
Stat 223 Introduction to the Theory of Statistics
Random Variables A random variable is a rule that assigns exactly one value to each point in a sample space for an experiment. A random variable can be.
Applied Statistics and Probability for Engineers
Presentation transcript:

INTRODUCTION TO MAXIMUM LIKELIHOOD METHODS FOR ECOLOGY MIDIS NUMÉRIQUES APRIL 3 RD 2014 ALYSSA BUTLER

A Method to Estimate Parameters Likelihood of a parameter (λ) given the observed data x Outline The Basics Example 1.1: How to estimate a mean Example 1.2: How to estimate a function Application Example 2: An example using a Poisson Regression

Known: Data Underlying Distribution ƒ(x|λ) Probability Density Function = ƒ(x|λ) A function f(x) that defines a probability distribution for continuous distributions Probability of observing data x given the parameter λ

The Poisson Distribution: Discrete probability of counts that occur randomly during a given time interval. Scenario: 5 = mean number of birds seen during one time interval (λ) What is the probability of observing 10 birds P(X=10)? ƒ(x|λ) = e -λ λ x x !

R 2 = Σ (i=1 -> n) (y i – yhat i ) 2

Simple, universal framework (well accepted foundation) Easy model comparison (AIC methods) Tend to be more robust and versatile relative to ordinary least-squares (especially for non-linear / non-normal data) Become unbiased as sample sizes increase Confidence limits easy to calculate Can have lower variance compared to other methods

The Poisson Distribution: Presence of birds in a forest What value of λ would make a dataset most probable? Collect a small dataset 10; x = (1,3,4,5,8,6,6,6,3,4)

The Poisson Distribution: Presence of birds in a forest x = (1,3,4,5,8,6,6,6,3,4) ƒ(x 1,…x 10 |λ) = e -λ λ x1 * … * e -λ λ x1 x 1 ! x 10 ! ƒ(x 1,…x 10 |λ) = Π e -λ λ xi x i ! ƒ(x|λ) = e -λ λ x x !

Solve for a Poisson Distribution L(λ)= Π e -λ λ x x! 1.Take Log 2.Simplify 3.Take negative Remember log rules… ln(y) + ln(x) = ln(y*x) ln(y) – ln(x) = ln(y/x) ln(x y ) = y*ln(x)

EXAMPLE 1.2: SOLVING FOR REGRESSION DATA Poisson Distribution; Replace; μ = yhat (our predicted values) σ = y i (our observed values)