Estimation and Testing For Dominance Relations

Slides:



Advertisements
Similar presentations
Advanced topics in Financial Econometrics Bas Werker Tilburg University, SAMSI fellow.
Advertisements

Statistical Techniques I
Component Analysis (Review)
How Should We Assess the Fit of Rasch-Type Models? Approximating the Power of Goodness-of-fit Statistics in Categorical Data Analysis Alberto Maydeu-Olivares.
CHAPTER 21 Inferential Statistical Analysis. Understanding probability The idea of probability is central to inferential statistics. It means the chance.
Maximum likelihood (ML) and likelihood ratio (LR) test
Resampling techniques Why resampling? Jacknife Cross-validation Bootstrap Examples of application of bootstrap.
Machine Learning CUNY Graduate Center Lecture 7b: Sampling.
Maximum likelihood (ML) and likelihood ratio (LR) test
Development of Empirical Models From Process Data
Visual Recognition Tutorial1 Random variables, distributions, and probability density functions Discrete Random Variables Continuous Random Variables.
Linear and generalised linear models
Aaker, Kumar, Day Seventh Edition Instructor’s Presentation Slides
1 Inference About a Population Variance Sometimes we are interested in making inference about the variability of processes. Examples: –Investors use variance.
Linear and generalised linear models
BCOR 1020 Business Statistics
Modern Navigation Thomas Herring
Principles of the Global Positioning System Lecture 10 Prof. Thomas Herring Room A;
Separate multivariate observations
AM Recitation 2/10/11.
Aaker, Kumar, Day Ninth Edition Instructor’s Presentation Slides
Hypothesis Testing.
1 STATISTICAL HYPOTHESES AND THEIR VERIFICATION Kazimieras Pukėnas.
Review of Statistical Inference Prepared by Vera Tabakova, East Carolina University ECON 4550 Econometrics Memorial University of Newfoundland.
Fundamentals of Data Analysis Lecture 7 ANOVA. Program for today F Analysis of variance; F One factor design; F Many factors design; F Latin square scheme.
Inference for the mean vector. Univariate Inference Let x 1, x 2, …, x n denote a sample of n from the normal distribution with mean  and variance 
Dominance Relationships The empirical examination of partial orderings via various forms of dominance relationships.
Prof. Dr. S. K. Bhattacharjee Department of Statistics University of Rajshahi.
Topics: Statistics & Experimental Design The Human Visual System Color Science Light Sources: Radiometry/Photometry Geometric Optics Tone-transfer Function.
Random Sampling, Point Estimation and Maximum Likelihood.
1 Lesson 3: Choosing from distributions Theory: LLN and Central Limit Theorem Theory: LLN and Central Limit Theorem Choosing from distributions Choosing.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
An Empirical Likelihood Ratio Based Goodness-of-Fit Test for Two-parameter Weibull Distributions Presented by: Ms. Ratchadaporn Meksena Student ID:
Module 1: Statistical Issues in Micro simulation Paul Sousa.
1 SMU EMIS 7364 NTU TO-570-N Inferences About Process Quality Updated: 2/3/04 Statistical Quality Control Dr. Jerrell T. Stracener, SAE Fellow.
Stats Probability Theory Summary. The sample Space, S The sample space, S, for a random phenomena is the set of all possible outcomes.
Lecture 3: Statistics Review I Date: 9/3/02  Distributions  Likelihood  Hypothesis tests.
The generalization of Bayes for continuous densities is that we have some density f(y|  ) where y and  are vectors of data and parameters with  being.
Review of Probability. Important Topics 1 Random Variables and Probability Distributions 2 Expected Values, Mean, and Variance 3 Two Random Variables.
Brief Review Probability and Statistics. Probability distributions Continuous distributions.
Parametric Approaches to Welfare Measurement. Background Up until now our examination of welfare has been essentially non-parametric in a statistical.
Statistical Inference for the Mean Objectives: (Chapter 8&9, DeCoursey) -To understand the terms variance and standard error of a sample mean, Null Hypothesis,
Part 3: Estimation of Parameters. Estimation of Parameters Most of the time, we have random samples but not the densities given. If the parametric form.
Fundamentals of Data Analysis Lecture 11 Methods of parametric estimation.
Modeling and Simulation CS 313
Inference concerning two population variances
Continuous Probability Distributions
DTC Quantitative Methods Bivariate Analysis: t-tests and Analysis of Variance (ANOVA) Thursday 20th February 2014  
12. Principles of Parameter Estimation
Chapter 4. Inference about Process Quality
Math 4030 – 10b Inferences Concerning Variances: Hypothesis Testing
The binomial applied: absolute and relative risks, chi-square
Distributions cont.: Continuous and Multivariate
Parameter Estimation 主講人:虞台文.
Hypothesis Testing and Confidence Intervals (Part 1): Using the Standard Normal Lecture 8 Justin Kern October 10 and 12, 2017.
Inference for the mean vector
Statistical inference: distribution, hypothesis testing
CONCEPTS OF HYPOTHESIS TESTING
Chapter 9 Hypothesis Testing.
LECTURE 05: THRESHOLD DECODING
REMOTE SENSING Multispectral Image Classification
REMOTE SENSING Multispectral Image Classification
Discrete Event Simulation - 5
5.2 Least-Squares Fit to a Straight Line
What are their purposes? What kinds?
Parametric Methods Berlin Chen, 2005 References:
Chapter Nine: Using Statistics to Answer Questions
Last Update 12th May 2011 SESSION 41 & 42 Hypothesis Testing.
12. Principles of Parameter Estimation
Incorporating the sample correlation between two test statistics to adjust the critical points for the control of type-1 error Dror Rom and Jaclyn McTague.
Presentation transcript:

Estimation and Testing For Dominance Relations Partial but unambiguous rankings of distributions.

Anderson’s Method (can also be used for FGT indices). Based upon Trapezoidal Rule for approximating integrals Anderson (1996) Proposed a technique for estimating and testing differences between higher order integrals. Consider f(x) and f(y) the distributions of two independent variables x and y each defined over the common range (a,b), partition this range into k mutually exclusive and exhaustive intervals of size d1, d2,…, dk and consider the k long vectors p(x) and p(y) of sample proportions falling into the pre-defined k intervals.

Form the following Integrating Matrices

The Testing Procedure N’th order dominance of x over y can be examined via the non-positivity of all of the elements of the vector IF(N-1)If(p(x)-p(y)). Inference is facilitated by noting that under a null of no difference between the two distributions the vector IF(N-1)If(p(x)-p(y)) is normally distributed since (p(x)-p(y)) ~ N(0,Ω) where Ω is of a well known form. Testing the joint non-positivity of the individual elements of IF(N-1)If(p(x)-p(y)) can be tricky (Stoline and Ury maximum modulus distribution or Wolak’s simulation method).

Incomplete Moments Method [note these can also be used for FGT indices and can also deal with data dependent cuttoffs. (Davidson and Duclos (2002))]

Incomplete Moments Method Continued

Integrated Squared Difference Method (Hall and Yatchew (2004))

K-S Methods An Alternative approach, first advocated by McFadden and followed by Barrett and Donald () and Maasoumi, Linton and Wang () is based upon the Kolmonogorov-Smirnov approach to comparing two distributions. K-S compared two empirical cumulative densities over their whole range and considered the maximum vertical (absolute) distance between them and derived their distributions. McFadden and others did the same for Fi-Gi i>1 and used various simulation techniques to derive their distributions.

The K-S Results

The Test Inconsistency Issue The Anderson and Davidson – Duclos methods choose a selection of points in the domain of x at which to evaluate and compare Fi(x) and Gi(x), the K-S and Hall - Yatchew methods compare Fi(x) and Gi(x) over all values of x. Leads to the criticism that the first class of tests could be inconsistent. An inconsistent test is one which, under certain circumstances, has a probability of 0 of rejecting a false null asymptotically. Imagine Fi(x) and Gi(x) intersect at two points on the interior of their range and that x* is chosen so that the integral of the difference between them up to x* and the integral of the difference between them from x* up to ∞ both equal 0. If x* and ∞ are chosen as the evaluation points, Anderson and Davidson and Duclos tests will be inconsistent. Problem can be circumvented by choosing a sufficient number of comparison points.

Poverty Tests An attractive feature of the Anderson and Davidson and Duclos approaches (not available with the expected squared difference and K-S based approaches) when considering poverty analysis is that if one of the elements chosen in the vector of cut off points corresponds to the poverty cut off x* then Fi(x*) and Gi(x*) and their corresponding variances correspond to the FGT poverty measures for the respective value of i. Thus (Fi(x*)-Gi(x*))/(VAR(Fi(x*)-Gi(x*))0.5 corresponds to the ‘t’ test for a headcount ratio comparison when i=1, to a depth of poverty comparison when i=2, to an intensity of poverty comparison when i=3.

Multivariate Dominance Problems Multivariate Poverty, Inequality, Polarization and mobility indices have all been developed in the literature and practically implemented with little problem, however dominance comparisons have not received the same coverage in the literature. When considering dominance issues with many dimensions the non-parametric “curse of dimensionality” problem rears its ugly head. Essentially for Anderson’s and Davidson and Duclos methods the # of comparison points or cells (n) increases by the power of the # of dimensions (k) as in nk The K-S method turns out to be a way out since it does not depend upon cell probability calculations but merely upon the maximal and minimal distance between two surfaces. Unfortunately the distribution of D is not known when k > 1, though P(√nD > d) for k=1 does provide a conservative (i.e. larger) estimate when k > 1.