1 Multivariate Normal Distribution Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute of Networking.

Slides:



Advertisements
Similar presentations
STATISTICS Joint and Conditional Distributions
Advertisements

AP Statistics Course Review.
Forecasting Using the Simple Linear Regression Model and Correlation
Inference for Regression
Week11 Parameter, Statistic and Random Samples A parameter is a number that describes the population. It is a fixed number, but in practice we do not know.
Sampling: Final and Initial Sample Size Determination
Learning Objectives Copyright © 2004 John Wiley & Sons, Inc. Bivariate Correlation and Regression CHAPTER Thirteen.
A Short Introduction to Curve Fitting and Regression by Brad Morantz
II. The Multivariate Normal Distribution “…it is not enough to know that a sample could have come from a normal population; we must be clear that it is.
QUANTITATIVE DATA ANALYSIS
Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.
Correlation. Two variables: Which test? X Y Contingency analysis t-test Logistic regression Correlation Regression.
1 Econ 240A Power Outline Review Projects 3 Review: Big Picture 1 #1 Descriptive Statistics –Numerical central tendency: mean, median, mode dispersion:
Visual Recognition Tutorial1 Random variables, distributions, and probability density functions Discrete Random Variables Continuous Random Variables.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 6-1 Chapter 6 The Normal Distribution and Other Continuous Distributions.
© 2000 Prentice-Hall, Inc. Chap Forecasting Using the Simple Linear Regression Model and Correlation.
Simple Linear Regression and Correlation
Slide 1 Detecting Outliers Outliers are cases that have an atypical score either for a single variable (univariate outliers) or for a combination of variables.
Chapter 5 DESCRIBING DATA WITH Z-SCORES AND THE NORMAL CURVE.
Lecture II-2: Probability Review
The Multivariate Normal Distribution, Part 1 BMTRY 726 1/10/2014.
The Multivariate Normal Distribution, Part 2 BMTRY 726 1/14/2014.
Normal and Sampling Distributions A normal distribution is uniquely determined by its mean, , and variance,  2 The random variable Z = (X-  /  is.
Correlation and Regression
Population All members of a set which have a given characteristic. Population Data Data associated with a certain population. Population Parameter A measure.
Probabilistic and Statistical Techniques 1 Lecture 24 Eng. Ismail Zakaria El Daour 2010.
1 Comparison of Several Multivariate Means Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute.
Introduction to Summary Statistics
● Final exam Wednesday, 6/10, 11:30-2:30. ● Bring your own blue books ● Closed book. Calculators and 2-page cheat sheet allowed. No cell phone/computer.
Sampling Distributions & Standard Error Lesson 7.
Production Planning and Control. A correlation is a relationship between two variables. The data can be represented by the ordered pairs (x, y) where.
1 Multivariate Linear Regression Models Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute of.
Correlation and Regression Chapter 9. § 9.3 Measures of Regression and Prediction Intervals.
11 Comparison of Several Multivariate Means Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute.
Chapter 10 – Sampling Distributions Math 22 Introductory Statistics.
Regression Analysis Week 8 DIAGNOSTIC AND REMEDIAL MEASURES Residuals The main purpose examining residuals Diagnostic for Residuals Test involving residuals.
Sampling Error SAMPLING ERROR-SINGLE MEAN The difference between a value (a statistic) computed from a sample and the corresponding value (a parameter)
1 Sample Geometry and Random Sampling Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute of Networking.
Problem: 1) Show that is a set of sufficient statistics 2) Being location and scale parameters, take as (improper) prior and show that inferences on ……
Stats Probability Theory Summary. The sample Space, S The sample space, S, for a random phenomena is the set of all possible outcomes.
1 Matrix Algebra and Random Vectors Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute of Networking.
1 Inferences about a Mean Vector Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute of Networking.
Review Lecture 51 Tue, Dec 13, Chapter 1 Sections 1.1 – 1.4. Sections 1.1 – 1.4. Be familiar with the language and principles of hypothesis testing.
Correlation. Correlation is a measure of the strength of the relation between two or more variables. Any correlation coefficient has two parts – Valence:
Appendix B: Statistical Methods. Statistical Methods: Graphing Data Frequency distribution Histogram Frequency polygon.
IE 300, Fall 2012 Richard Sowers IESE. 8/30/2012 Goals: Rules of Probability Counting Equally likely Some examples.
1 Factor Analysis and Inference for Structured Covariance Matrices Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/
Regression Analysis. 1. To comprehend the nature of correlation analysis. 2. To understand bivariate regression analysis. 3. To become aware of the coefficient.
Advanced Statistical Methods: Continuous Variables REVIEW Dr. Irina Tomescu-Dubrow.
Chapter 5 Joint Probability Distributions and Random Samples  Jointly Distributed Random Variables.2 - Expected Values, Covariance, and Correlation.3.
Beginning Statistics Table of Contents HAWKES LEARNING SYSTEMS math courseware specialists Copyright © 2008 by Hawkes Learning Systems/Quant Systems, Inc.
Math 4030 – 7b Normality Issues (Sec. 5.12) Properties of Normal? Is the sample data from a normal population (normality)? Transformation to make it Normal?
1 Canonical Correlation Analysis Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute of Networking.
1 Principal Components Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute of Networking and Multimedia.
Lecture 7: Bivariate Statistics. 2 Properties of Standard Deviation Variance is just the square of the S.D. If a constant is added to all scores, it has.
AP Statistics Review Day 1 Chapters 1-4. AP Exam Exploring Data accounts for 20%-30% of the material covered on the AP Exam. “Exploratory analysis of.
Statistics and probability Dr. Khaled Ismael Almghari Phone No:
1 Multivariate Normal Distribution 朱永军信息管理学院. 2 Generalized from univariate normal densityGeneralized from univariate normal density Base of many multivariate.
Principal Components Shyh-Kang Jeng
Inference for the mean vector
Sampling Distributions
Basic Estimation Techniques
The Multivariate Normal Distribution, Part 2
Matrix Algebra and Random Vectors
Ch11 Curve Fitting II.
Multivariate Linear Regression Models
Checking the data and assumptions before the final analysis.
(Approximately) Bivariate Normal Data and Inference Based on Hotelling’s T2 WNBA Regular Season Home Point Spread and Over/Under Differentials
The Multivariate Normal Distribution, Part I
What’s your New Year’s Resolution?
Presentation transcript:

1 Multivariate Normal Distribution Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute of Networking and Multimedia

2 Multivariate Normal Distribution Generalized from univariate normal density Base of many multivariate analysis techniques Useful approximation to “ true ” population distribution Central limit distribution of many multivariate statistics Mathematical tractable

3 Univariate Normal Distribution

4 Table 1, Appendix

5 Square of Distance (Mahalanobis distance)

6 p-dimensional Normal Density

7 Example 4.1 Bivariate Normal

8 Example 4.1 Squared Distance

9 Example 4.1 Density Function

10 Example 4.1 Bivariate Distribution  11 =  22,  12 = 0

11 Example 4.1 Bivariate Distribution  11 =  22,  12 = 0.75

12 Contours

13 Result 4.1

14 Example 4.2 Bivariate Contour

15 Example 4.2 Positive Correlation

16 Probability Related to Squared Distance

17 Probability Related to Squared Distance

18 Result 4.2

19 Example 4.3 Marginal Distribution

20 Result 4.3

21 Proof of Result 4.3: Part 1

22 Proof of Result 4.3: Part 2

23 Example 4.4 Linear Combinations

24 Result 4.4

25 Example 4.5 Subset Distribution

26 Result 4.5

27 Example 4.6 Independence

28 Result 4.6

29 Proof of Result 4.6

30 Proof of Result 4.6

31 Example 4.7 Conditional Bivariate

32 Example 4.1 Density Function

33 Example 4.7

34 Result 4.7

35  2 Distribution

36  2 Distribution Curves

37 Table 3, Appendix

38 Proof of Result 4.7 (a)

39 Proof of Result 4.7 (b)

40 Result 4.8

41 Proof of Result 4.8

42 Example 4.8 Linear Combinations

43 Example 4.8 Linear Combinations

44 Multivariate Normal Likelihood

45 Maximum-likelihood Estimation

46 Trace of a Matrix

47 Result 4.9

48 Proof of Result 4.9 (a)

49 Proof of Result 4.9 (b)

50 Likelihood Function

51 Result 4.10

52 Proof of Result 4.10

53 Result 4.11 Maximum Likelihood Estimators of  and 

54 Proof of Result 4.11

55 Invariance Property

56 Sufficient Statistics

57 Distribution of Sample Mean

58 Sampling Distribution of S

59 Wishart Distribution

60 Univariate Central Limit Theorem

61 Result 4.12 Law of Large Numbers

62 Result 4.12 Multivariate Cases

63 Result 4.13 Central Limit Theorem

64 Limit Distribution of Statistical Distance

65 Evaluating Normality of Univariate Marginal Distributions

66 Evaluating Normality of Univariate Marginal Distributions

67 Q-Q Plot

68 Example 4.9

69 Example 4.9

Histogram of MidTerm Scores of Students of This Course in

Q-Q Plot of MidTerm Scores of Students of This Course in n = 33, r Q =

72 Example 4.10 Radiation Data of Closed-Door Microwave Oven

73 Measurement of Straightness

74 Table 4.2 Q-Q Plot Correlation Coefficient Test

75 Example 4.11

76 Evaluating Bivariate Normality

77 Example 4.12

78 Example 4.12

79 Chi-Square Plot

80 Example 4.13 Chi-Square Plot for Example 4.12

81 Example 4.13 Chi-Square Plot for Example 4.12

82 Chi-Square Plot for Computer Generated 4-variate Normal Data

83 Steps for Detecting Outliers Make a dot plot for each variable Make a scatter plot for each pair of variables Calculate the standardized values. Examine them for large or small values Calculated the squared statistical distance. Examine for unusually large values. In chi-square plot, these would be points farthest from the origin.

84 Helpful Transformation to Near Normality Original Scale Transformed Scale Counts, y Proportions, Correlations, r

85 Box and Cox’s Univariate Transformations

86 Example 4.16 ( ) vs. Example 4.16 ( ) vs.

87 Example 4.16 Q-Q Plot

88 Transforming Multivariate Observations

89 More Elaborate Approach

90 Example 4.17 Original Q-Q Plot for Open-Door Data

91 Example 4.17 Q-Q Plot of Transformed Open-Door Data

92 Example 4.17 Contour Plot of for Both Radiation Data

93 Transform for Data Including Large Negative Values