Multivariate analysis (Machine learning) Supervised True answer is known Classification Answer is categorical Regression Answer is continuous (ordered.

Slides:



Advertisements
Similar presentations
Notes Sample vs distribution “m” vs “µ” and “s” vs “σ” Bias/Variance Bias: Measures how much the learnt model is wrong disregarding noise Variance: Measures.
Advertisements

Lecture 28 Categorical variables: –Review of slides from lecture 27 (reprint of lecture 27 categorical variables slides with typos corrected) –Practice.
LECTURE 11: BAYESIAN PARAMETER ESTIMATION
A (very) brief introduction to multivoxel analysis “stuff” Jo Etzel, Social Brain Lab
What is Statistical Modeling
Multivariate Methods Pattern Recognition and Hypothesis Testing.
Introduction to Predictive Learning
Statistical Methods Chichang Jou Tamkang University.
ML ALGORITHMS. Algorithm Types Classification (supervised) Given -> A set of classified examples “instances” Produce -> A way of classifying new examples.
Part I: Classification and Bayesian Learning
Guidelines on Statistical Analysis and Reporting of DNA Microarray Studies of Clinical Outcome Richard Simon, D.Sc. Chief, Biometric Research Branch National.
Jeff Howbert Introduction to Machine Learning Winter Machine Learning Feature Creation and Selection.
General Linear Model & Classical Inference
Crash Course on Machine Learning
General Linear Model & Classical Inference Guillaume Flandin Wellcome Trust Centre for Neuroimaging University College London SPM M/EEGCourse London, May.
Introduction to Machine Learning for Information Retrieval Xiaolong Wang.
Brain Mapping Unit The General Linear Model A Basic Introduction Roger Tait
Chapter Fourteen Statistical Analysis Procedures Statistical procedures that simultaneously analyze multiple measurements on each individual or.
● Final exam Wednesday, 6/10, 11:30-2:30. ● Bring your own blue books ● Closed book. Calculators and 2-page cheat sheet allowed. No cell phone/computer.
Current work at UCL & KCL. Project aim: find the network of regions associated with pleasant and unpleasant stimuli and use this information to classify.
Multivariate Data Analysis Chapter 5 – Discrimination Analysis and Logistic Regression.
Discriminant Analysis Discriminant analysis is a technique for analyzing data when the criterion or dependent variable is categorical and the predictor.
Chapter 11 Statistical Techniques. Data Warehouse and Data Mining Chapter 11 2 Chapter Objectives  Understand when linear regression is an appropriate.
–The shortest distance is the one that crosses at 90° the vector u Statistical Inference on correlation and regression.
General Linear Model.
C O R P O R A T E T E C H N O L O G Y Information & Communications Neural Computation Machine Learning Methods on functional MRI Data Siemens AG Corporate.
Dimensionality Reduction in Unsupervised Learning of Conditional Gaussian Networks Authors: Pegna, J.M., Lozano, J.A., Larragnaga, P., and Inza, I. In.
ReCap Part II (Chapters 5,6,7) Data equations summarize pattern in data as a series of parameters (means, slopes). Frequency distributions, a key concept.
Nonparametric Statistics
1 Statistics & R, TiP, 2011/12 Multivariate Methods  Multivariate data  Data display  Principal component analysis Unsupervised learning technique 
Week 7: General linear models Overview Questions from last week What are general linear models? Discussion of the 3 articles.
General Information Course Id: COSC6342 Machine Learning Time: TU/TH 1-2:30p Instructor: Christoph F. Eick Classroom:AH301
General Linear Model & Classical Inference London, SPM-M/EEG course May 2016 Sven Bestmann, Sobell Department, Institute of Neurology, UCL
General Linear Model & Classical Inference Short course on SPM for MEG/EEG Wellcome Trust Centre for Neuroimaging University College London May 2010 C.
Nonparametric Statistics
Logic of Hypothesis Testing
AP Statistics Chapter 14 Section 1.
CHAPTER 10 Comparing Two Populations or Groups
General Linear Model & Classical Inference
The general linear model and Statistical Parametric Mapping
Predictive Learning from Data
Announcements.
Machine Learning Feature Creation and Selection
STAT120C: Final Review.
Predictive Learning from Data
Nonparametric Statistics
Contrasts & Statistical Inference
Supervised vs. unsupervised Learning
Classification and Prediction
CHAPTER 10 Comparing Two Populations or Groups
LECTURE 07: BAYESIAN ESTIMATION
CHAPTER 10 Comparing Two Populations or Groups
CHAPTER 10 Comparing Two Populations or Groups
Contrasts & Statistical Inference
MfD 04/12/18 Alice Accorroni – Elena Amoruso
Bayesian Inference in SPM2
Models, parameters and GLMs
CHAPTER 10 Comparing Two Populations or Groups
CHAPTER 10 Comparing Two Populations or Groups
Machine Learning – a Probabilistic Perspective
CHAPTER 10 Comparing Two Populations or Groups
CHAPTER 10 Comparing Two Populations or Groups
CHAPTER 10 Comparing Two Populations or Groups
Models, parameters and GLMs
Statistics for genomics
Bayesian Model Selection and Averaging
Contrasts & Statistical Inference
CHAPTER 10 Comparing Two Populations or Groups
What is Artificial Intelligence?
Presentation transcript:

Multivariate analysis (Machine learning) Supervised True answer is known Classification Answer is categorical Regression Answer is continuous (ordered ) BinaryMulticlass Unsupervised similarities/structure in the data Clustering Data grouping incl. hierarchy Dimension reduction Feature grouping Discriminative (difference)Generative (data) Bayesian (full distribution)VS.Frequentist (estimates) Identical independently distributed (iid)Structured data SVM classification: supervised, binary classification, discriminative, frequentist, iid DCM: unsupervised, generative, Bayesian, structured Bayesian linear regression: supervised, regression, generative, Bayesian, iid

 Data points: trials, subjects,…  Features: activity of voxel subsets, GLM coefficients, DCM parameters, questionnaire data, …  Labels: stimulus, behavioral model state (i.e. learning rate), diagnoses, questionnaire score, …  Model: clustering, hierarchy, effective connectivity, …  Feature selection & preprocessing!!! Multivariate analysis (Neuroscience) Features Data points Label/target method or model

Interpretation of results:  Prediction: BCI, diagnostics, treatment outcome  Hypothesis comparison by performance comparison: subsets of voxels, model structures, number of clusters etc.  Performance significance as an evidence of information being encoded in the data  Interpretation of parameters: feature weights, clustering centroids, most prominent dimensions, etc… Multivariate analysis (Neuroscience) Features Data points Label/target method or model

K-fold cross-validation

Accuracy vs. balanced accuracy actual +actual – predicted + predicted – Brodersen, Ong, Stephan, Buhmann (2010) ICPR Accuracy Balanced accuracy

empirical distribution parametric model based on true labels voxel weight based on permuted labels frequency We assessed the informativeness of each voxel by comparing its coefficient to an empirical null distribution. Statistical inference on voxel coefficients