1 Applied Multivariate Analysis Introduction 2 Nature of Multivariate Analysis ► Typically exploratory, not confirmatory ► Often focused on simplification.

Slides:



Advertisements
Similar presentations
An Introduction to Multivariate Analysis
Advertisements

Exploratory Factor Analysis
Multivariate distributions. The Normal distribution.
Lecture 7: Principal component analysis (PCA)
1 Multivariate Statistics ESM 206, 5/17/05. 2 WHAT IS MULTIVARIATE STATISTICS? A collection of techniques to help us understand patterns in and make predictions.
Logistic Regression Principal Component Analysis Sampling TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAA A A A.
Principal Component Analysis
Principal Components An Introduction Exploratory factoring Meaning & application of “principal components” Basic steps in a PC analysis PC extraction process.
Dimensional reduction, PCA
Statistics 350 Lecture 14. Today Last Day: Matrix results and Chapter 5 Today: More matrix results and Chapter 5 Please read Chapter 5.
Exploring Microarray data Javier Cabrera. Outline 1.Exploratory Analysis Steps. 2.Microarray Data as Multivariate Data. 3.Dimension Reduction 4.Correlation.
Goals of Factor Analysis (1) (1)to reduce the number of variables and (2) to detect structure in the relationships between variables, that is to classify.
Techniques for studying correlation and covariance structure
Multivariate Analysis Techniques
Stats & Linear Models.
Multivariate Methods EPSY 5245 Michael C. Rodriguez.
Factor Analysis Psy 524 Ainsworth.
Business Research Methods William G. Zikmund Chapter 24 Multivariate Analysis.
Multivariate Statistics Principal Components/Factor Analysis Structural Equation Modeling.
The Tutorial of Principal Component Analysis, Hierarchical Clustering, and Multidimensional Scaling Wenshan Wang.
Presented By Wanchen Lu 2/25/2013
Principal Components Analysis BMTRY 726 3/27/14. Uses Goal: Explain the variability of a set of variables using a “small” set of linear combinations of.
A biologist and a matrix The matrix will follow. Did you know that the 20 th century scientist who lay the foundation to the estimation of signals in.
Chapter 24 Multivariate Statistical Analysis © 2010 South-Western/Cengage Learning. All rights reserved. May not be scanned, copied or duplicated, or posted.
Randall E. Schumacker University of Alabama SAGE Publications Contents Background Persons of Interest Factors Affecting Statistics R Software Web Resources.
Chapter 9 Factor Analysis
Multivariate Statistics Matrix Algebra I W. M. van der Veld University of Amsterdam.
Classification Course web page: vision.cis.udel.edu/~cv May 12, 2003  Lecture 33.
Thursday AM  Presentation of yesterday’s results  Factor analysis  A conceptual introduction to: Structural equation models Structural equation models.
Factor Analysis Revealing the correlational structure among variables Understanding & Reducing Complexity.
STAT 3610/5610 – Time Series Analysis Topics to be covered Chapters 1 – 8 Chapter 9 – Skip Chapters 10 – 12.
Available at Chapter 13 Multivariate Analysis BCB 702: Biostatistics
Stats Multivariate Data Analysis. Instructor:W.H.Laverty Office:235 McLean Hall Phone: Lectures: M W F 9:30am - 10:20am McLean Hall.
Canonical Correlation Psy 524 Andrew Ainsworth. Matrices Summaries and reconfiguration.
1 Sample Geometry and Random Sampling Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute of Networking.
Techniques for studying correlation and covariance structure Principal Components Analysis (PCA) Factor Analysis.
ECE 8443 – Pattern Recognition LECTURE 08: DIMENSIONALITY, PRINCIPAL COMPONENTS ANALYSIS Objectives: Data Considerations Computational Complexity Overfitting.
Chapter 7 Multivariate techniques with text Parallel embedded system design lab 이청용.
Multivariate Data Analysis Chapter 1 - Introduction.
Manifold learning: MDS and Isomap
March 7, 2006Lecture 8aSlide #1 Matrix Algebra, or: Is this torture really necessary?! What for? –Permits compact, intuitive depiction of regression analysis.
Multivariate Analysis and Data Reduction. Multivariate Analysis Multivariate analysis tries to find patterns and relationships among multiple dependent.
Module III Multivariate Analysis Techniques- Framework, Factor Analysis, Cluster Analysis and Conjoint Analysis Research Report.
Principle Component Analysis and its use in MA clustering Lecture 12.
MACHINE LEARNING 7. Dimensionality Reduction. Dimensionality of input Based on E Alpaydın 2004 Introduction to Machine Learning © The MIT Press (V1.1)
STA302: Regression Analysis. Statistics Objective: To draw reasonable conclusions from noisy numerical data Entry point: Study relationships between variables.
Unit 7 Statistics: Multivariate Analysis of Variance (MANOVA) & Discriminant Functional Analysis (DFA) Chat until class starts.
Canonical Correlation. Canonical correlation analysis (CCA) is a statistical technique that facilitates the study of interrelationships among sets of.
Chapter 10 Canonical Correlation Analysis. Introduction Canonical correlation analysis focuses on the correlation between a linear combination of the.
MANOVA Lecture 12 Nuance stuff Psy 524 Andrew Ainsworth.
Multivariate statistical methods. Multivariate methods multivariate dataset – group of n objects, m variables (as a rule n>m, if possible). confirmation.
McGraw-Hill/Irwin © 2003 The McGraw-Hill Companies, Inc.,All Rights Reserved. Part Four ANALYSIS AND PRESENTATION OF DATA.
Methods of multivariate analysis Ing. Jozef Palkovič, PhD.
Dynamic graphics, Principal Component Analysis Ker-Chau Li UCLA department of Statistics.
Machine Learning Supervised Learning Classification and Regression K-Nearest Neighbor Classification Fisher’s Criteria & Linear Discriminant Analysis Perceptron:
JMP Discovery Summit 2016 Janet Alvarado
MANOVA Dig it!.
Information Management course
Exploring Microarray data
Multivariate Data Analysis
Dimension Reduction via PCA (Principal Component Analysis)
A principled way to principal components analysis
Descriptive Statistics vs. Factor Analysis
Introduction to Comparative Effectiveness Course (HAP 823)
Principal Components Analysis
Factor Analysis (Principal Components) Output
Item & Test Statistics Psych DeShon.
Exploratory Factor Analysis. Factor Analysis: The Measurement Model D1D1 D8D8 D7D7 D6D6 D5D5 D4D4 D3D3 D2D2 F1F1 F2F2.
Techniques and Applications of Multivariate Statistics (II)
Presentation transcript:

1 Applied Multivariate Analysis Introduction

2 Nature of Multivariate Analysis ► Typically exploratory, not confirmatory ► Often focused on simplification ► Often focused on revealing structure in dimensions that our eyes and imaginations don’t fully support.

3 Adequate Preparation? ► Basic course in statistical science ► STA 671 ► SAS exposure ► Linear algebra (?)

4 Begin Reviewing and Reading ► Basic data steps in SAS ► Chapter 1 in AMD ► Chapter 2 in AMD ► We’ll begin with Chapter 4

5 Potential Topics Covered ► Principal Components Analysis (PCA) ► Factor Analysis (FA) ► Discriminant Analysis (DA) ► Multidimensional Scaling (MDS) ► Cluster Analysis (CA) ► Canonical Correlations Analysis (CCA) ► Multivariate Analysis of Variance (MANOVA)

6 Why Multivariate? ► Typically more than one measurement is taken on a given experimental unit ► Need to consider all the measurements together so that one can understand how they are related ► Need to consider all the measurements together so that one can extract essential structure

7 In Chromatography one observation

8 In Neuroimaging one observation

9 In Social Science Research Education level Your opinion on welfare Your opinion on social security Your opinion on …. one (joint) observation

10 Distinguishing Midges ► Suppose we are interested in measuring the wing length and the antenna length.

11 Distinguishing Midges ► What can you do with both variables that you can’t do with just one of them?

12 Measuring Heads ► Are these data truly two-dimensional? Not the usual regression line ….

13 Our Approach in STA 677 ► Emphasize  Intuition  SAS  Geometry  Interpretations  Data Analysis ► De-emphasize  Theoretical  Theoretical basis  Formal  Formal proofs

14 Getting on the Computers Here

15 Personal SAS License ► ► Lorinda Wang ► ► ► ► SStars Lab ► ► 213d M I King 0039 ► ► Phone ► ► Fax

16 Organizational Details ► Please get the textbook (required) ► Look at Readme.txt on the text CD ► Notes posted on the class website ► Take a look at the syllabus

17 Basic Vocabulary ► Variance ► Covariance ► Correlation More than one kind of variability will emerge.

18 Additional Vocabulary ► Eigenvalues ► Eigenvectors ► Projections ► Matrix Notation

19 Discovering Linear Combinations ► Log on to the computer in front of you and access our course web site. ► Find the data set helmet.xls and open it. ► Compute (.707*LTN)+(.707*LTG) (use Excel) ► What did you just do geometrically?

20 Discovering Linear Combinations Equal Wts On LTG, LTN LTG is WTD > LTN

21 Discovery Exercise Continued ► Find the variance of LTN, LTG (use Excel). ► Find the variance of (.707*LTN)+(.707*LTG) --- equal weights. ► Find the variance of (.50*LTN)+(.85*LTG) --- unequal weights with LTG weighted more.

22 Discovery Exercise ► What did you find and does it make sense?  Var(LTN)=  Var(LTG)=  Var(707)=  Var(5085)= ► This is no accident. And this is what Principal Components is all about.

23 Encounter With SAS ► Save the helmet file to your hard disk. ► Exit Excel and start up SAS. ► Watch the demonstration on how to bring the Excel file into SAS. ► Repeat this yourself.

24 Encounter With SAS ► It is easy to transfer the AMD.txt data to Excel files. If you don’t know how and want to know, just ask. ► So you can always bring your data in as Excel files if you want. ► That is what I’ll do in front of the class.

25 Coming Up Principal Components Analysis