3858 Tutorial Lecture 8 March 29, 2017 Yifan Li.

Slides:



Advertisements
Similar presentations
Image Modeling & Segmentation
Advertisements

Dealing with Uncertainty in Cost-Effectiveness Analyses
Lecture (11,12) Parameter Estimation of PDF and Fitting a Distribution Function.
LECTURE 11: BAYESIAN PARAMETER ESTIMATION
Maximum Likelihood And Expectation Maximization Lecture Notes for CMPUT 466/551 Nilanjan Ray.
Assuming normally distributed data! Naïve Bayes Classifier.
INTRODUCTION TO Machine Learning ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
Estimation A major purpose of statistics is to estimate some characteristics of a population. Take a sample from the population under study and Compute.
Confidence intervals. Population mean Assumption: sample from normal distribution.
Lecture 5: Learning models using EM
Programme in Statistics (Courses and Contents). Elementary Probability and Statistics (I) 3(2+1)Stat. 101 College of Science, Computer Science, Education.
CSE 221: Probabilistic Analysis of Computer Systems Topics covered: Confidence intervals.
Lecture 13: Review One-Sample z-test and One-Sample t-test 2011, 11, 1.
Stat 321 – Lecture 26 Estimators (cont.) The judge asked the statistician if she promised to tell the truth, the whole truth, and nothing but the truth?
Parametric Inference.
DEPENDENT SAMPLES t-TEST What is the Purpose?What Are the Assumptions?How Does it Work?
Lecture 7 1 Statistics Statistics: 1. Model 2. Estimation 3. Hypothesis test.
ECE 8443 – Pattern Recognition LECTURE 06: MAXIMUM LIKELIHOOD AND BAYESIAN ESTIMATION Objectives: Bias in ML Estimates Bayesian Estimation Example Resources:
Non-Parametric Learning Prof. A.L. Yuille Stat 231. Fall Chp 4.1 – 4.3.
CHAPTER 4: Parametric Methods. Lecture Notes for E Alpaydın 2004 Introduction to Machine Learning © The MIT Press (V1.1) 2 Parametric Estimation Given.
Chapter 7 Process Capability. Introduction A “capable” process is one for which the distributions of the process characteristics do lie almost entirely.
Ch15: Decision Theory & Bayesian Inference 15.1: INTRO: We are back to some theoretical statistics: 1.Decision Theory –Make decisions in the presence of.
ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
One Sample Mean Inference (Chapter 5)
Machine Learning 5. Parametric Methods.
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
Lecture 4 Confidence Intervals. Lecture Summary Last lecture, we talked about summary statistics and how “good” they were in estimating the parameters.
SOCW 671 #11 Correlation and Regression. Uses of Correlation To study the strength of a relationship To study the direction of a relationship Scattergrams.
Chi Square Test for Goodness of Fit Determining if our sample fits the way it should be.
Bias and Variability Lecture 27 Section 8.3 Wed, Nov 3, 2004.
Statistics -Continuous probability distribution 2013/11/18.
ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
Chapter 7 Estimation. Chapter 7 ESTIMATION What if it is impossible or impractical to use a large sample? Apply the Student ’ s t distribution.
Estimating standard error using bootstrap
FREQUENCY DISTRIBUTION
Statistical Estimation
Inference for the Mean of a Population
Standard Errors Beside reporting a value of a point estimate we should consider some indication of its precision. For this we usually quote standard error.
Advanced Higher Statistics
Psych 706: stats II Class #4.
Standard and non-standard
Statistics in SPSS Lecture 7
MATH Instructor: Dr. Saralees Nadarajah
The Normal Distribution…
Statistical Tool Boxes
Test for Mean of a Non-Normal Population – small n
Bootstrap Confidence Intervals using Percentiles
Bootstrap - Example Suppose we have an estimator of a parameter and we want to express its accuracy by its standard error but its sampling distribution.
CHAPTER 22: Inference about a Population Proportion
Sampling Distribution
Sampling Distribution
Lecture Slides Elementary Statistics Twelfth Edition
POINT ESTIMATOR OF PARAMETERS
Lecture Slides Elementary Statistics Twelfth Edition
إحصاء تربوي الفصل الأول: المفاهيم الأساسية الإحصائية
Parametric Estimation
Basic Concepts PhD Course.
8.3 – Estimating a Population Mean
Sampling Distribution of a Sample Proportion
Locomotive Test and CI for Two Proportions Sample X N Sample p
THE NORMAL DISTRIBUTION AND THE 68–95–99.7% RULE
The estimate of the proportion (“p-hat”) based on the sample can be a variety of values, and we don’t expect to get the same value every time, but the.
Stat Lab 9.
#21 Marginalize vs. Condition Uninteresting Fitted Parameters
Delta Distribution Relative Frequency Catch of Fish.
Chapter 10 Introduction to the Analysis of Variance
CS639: Data Management for Data Science
STA 291 Summer 2008 Lecture 15 Dustin Lueker.
ECE – Pattern Recognition Lecture 4 – Parametric Estimation
Presentation transcript:

3858 Tutorial Lecture 8 March 29, 2017 Yifan Li

Bootstrap (parametric & non-parametric) Our previous guess is not complete. I confused the var of MLE (Fisher information) with the var of the moment estimators (which is hard to compute). Delta method (two variables) tells us this limiting distrobution is also normal. Actually, they are both robust. Non-normal limiting distribution Small sample

Some interesting videos Bayes rules https://www.youtube.com/watch?v=BcvLAw-JRss bayes vs frequentist https://www.youtube.com/watch?v=r76oDIvwETI&t=56s