Spatial Dynamic Factor Analysis Hedibert Freitas Lopes, Esther Salazar, Dani Gamerman Presented by Zhengming Xing Jan 29,2010 * tables and figures are.

Slides:



Advertisements
Similar presentations
Sampling Design, Spatial Allocation, and Proposed Analyses Don Stevens Department of Statistics Oregon State University.
Advertisements

Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.
Online Multi-camera Tracking with a Switiching State-Space Model Wojciech Zajdel, A. Taylan Cemgil, and Ben KrÄose ICPR 2004.
NORMAL OR GAUSSIAN DISTRIBUTION Chapter 5. General Normal Distribution Two parameter distribution with a pdf given by:
Bayesian dynamic modeling of latent trait distributions Duke University Machine Learning Group Presented by Kai Ni Jan. 25, 2007 Paper by David B. Dunson,
Combining Information from Related Regressions Duke University Machine Learning Group Presented by Kai Ni Apr. 27, 2007 F. Dominici, G. Parmigiani, K.
Kriging.
Computer vision: models, learning and inference Chapter 8 Regression.
Budapest May 27, 2008 Unifying mixed linear models and the MASH algorithm for breakpoint detection and correction Anders Grimvall, Sackmone Sirisack, Agne.
Sharing Features among Dynamical Systems with Beta Processes
Markov-Chain Monte Carlo
Gaussian Processes I have known
Introduction to Sampling based inference and MCMC Ata Kaban School of Computer Science The University of Birmingham.
Gaussian process emulation of multiple outputs Tony O’Hagan, MUCM, Sheffield.
Predictive Automatic Relevance Determination by Expectation Propagation Yuan (Alan) Qi Thomas P. Minka Rosalind W. Picard Zoubin Ghahramani.
Arizona State University DMML Kernel Methods – Gaussian Processes Presented by Shankar Bhargav.
4. Testing the LAI model To accurately fit a model to a large data set, as in the case of the global-scale space-borne LAI data, there is a need for an.
Space-time Modelling Using Differential Equations Alan E. Gelfand, ISDS, Duke University (with J. Duan and G. Puggioni)
Bayesian Analysis for Extreme Events Pao-Shin Chu and Xin Zhao Department of Meteorology School of Ocean & Earth Science & Technology University of Hawaii-
Multivariate Probability Distributions. Multivariate Random Variables In many settings, we are interested in 2 or more characteristics observed in experiments.
A Primer on the Exponential Family of Distributions David Clark & Charles Thayer American Re-Insurance GLM Call Paper
Tracking Pedestrians Using Local Spatio- Temporal Motion Patterns in Extremely Crowded Scenes Louis Kratz and Ko Nishino IEEE TRANSACTIONS ON PATTERN ANALYSIS.
The horseshoe estimator for sparse signals CARLOS M. CARVALHO NICHOLAS G. POLSON JAMES G. SCOTT Biometrika (2010) Presented by Eric Wang 10/14/2010.
Bivariate Regression Analysis The most useful means of discerning causality and significance of variables.
Bayesian Extension to the Language Model for Ad Hoc Information Retrieval Hugo Zaragoza, Djoerd Hiemstra, Michael Tipping Presented by Chen Yi-Ting.
Bayesian Analysis and Applications of A Cure Rate Model.
A Bayesian Matrix Factorization Model for Relational Data UAI 2010 Authors: Ajit P. Singh & Geoffrey J. Gordon Presenter: Xian Xing Zhang Relational Learning.
The Dirichlet Labeling Process for Functional Data Analysis XuanLong Nguyen & Alan E. Gelfand Duke University Machine Learning Group Presented by Lu Ren.
Bayesian Multivariate Logistic Regression by Sean O’Brien and David Dunson (Biometrics, 2004 ) Presented by Lihan He ECE, Duke University May 16, 2008.
Bayesian Generalized Kernel Mixed Models Zhihua Zhang, Guang Dai and Michael I. Jordan JMLR 2011.
Problem: 1) Show that is a set of sufficient statistics 2) Being location and scale parameters, take as (improper) prior and show that inferences on ……
Gaussian Processes Li An Li An
Learning In Bayesian Networks. General Learning Problem Set of random variables X = {X 1, X 2, X 3, X 4, …} Training set D = { X (1), X (2), …, X (N)
Analyzing wireless sensor network data under suppression and failure in transmission Alan E. Gelfand Institute of Statistics and Decision Sciences Duke.
MCMC in structure space MCMC in order space.
Esri UC 2014 | Technical Workshop | Concepts and Applications of Kriging Eric Krause Konstantin Krivoruchko.
BMTRY 763. Space-time (ST) Modeling (BDM13, ch 12) Some notation Assume counts within fixed spatial and temporal periods: map evolutions Both space and.
Lecture 2: Statistical learning primer for biologists
Efficient Gaussian Process Regression for large Data Sets ANJISHNU BANERJEE, DAVID DUNSON, SURYA TOKDAR Biometrika, 2008.
Lecture #9: Introduction to Markov Chain Monte Carlo, part 3
by Ryan P. Adams, Iain Murray, and David J.C. MacKay (ICML 2009)
Human and Optimal Exploration and Exploitation in Bandit Problems Department of Cognitive Sciences, University of California. A Bayesian analysis of human.
Gaussian Processes For Regression, Classification, and Prediction.
Effect of the Reference Set on Frequency Inference Donald A. Pierce Radiation Effects Research Foundation, Japan Ruggero Bellio Udine University, Italy.
DM-MEETING Bijaya Adhikari OUTLINE From Micro to Macro: Uncovering and Predicting Information Cascading Process with Behavioral Dynamics 
Bayesian Density Regression Author: David B. Dunson and Natesh Pillai Presenter: Ya Xue April 28, 2006.
Learning Photographic Global Tonal Adjustment with a Database of Input / Output Image Pairs.
1 Chapter 8: Model Inference and Averaging Presented by Hui Fang.
Multi-label Prediction via Sparse Infinite CCA Piyush Rai and Hal Daume III NIPS 2009 Presented by Lingbo Li ECE, Duke University July 16th, 2010 Note:
Sparse Approximate Gaussian Processes. Outline Introduction to GPs Subset of Data Bayesian Committee Machine Subset of Regressors Sparse Pseudo GPs /
Introduction: Metropolis-Hasting Sampler Purpose--To draw samples from a probability distribution There are three steps 1Propose a move from x to y 2Accept.
Institute of Statistics and Decision Sciences In Defense of a Dissertation Submitted for the Degree of Doctor of Philosophy 26 July 2005 Regression Model.
A Collapsed Variational Bayesian Inference Algorithm for Latent Dirichlet Allocation Yee W. Teh, David Newman and Max Welling Published on NIPS 2006 Discussion.
I. Statistical Methods for Genome-Enabled Prediction of Complex Traits OUTLINE THE CHALLENGES OF PREDICTING COMPLEX TRAITS ORDINARY LEAST SQUARES (OLS)
Prediction and Missing Data. Summarising Distributions ● Models are often large and complex ● Often only interested in some parameters – e.g. not so interested.
Introduction to Sampling based inference and MCMC
Why Model? Make predictions or forecasts where we don’t have data.
Chapter 7 The Normal Probability Distribution
BINARY LOGISTIC REGRESSION
William Greene Stern School of Business New York University
Variational Bayes Model Selection for Mixture Distribution
Chapter Six Normal Curves and Sampling Probability Distributions
Bayesian Inference for Small Population Longevity Risk Modelling
Introduction to particle filter
Using Informative Priors to Enhance Wisdom in Small Crowds
Introduction to particle filter
Ch11 Curve Fitting II.
Robust Full Bayesian Learning for Neural Networks
Generally Discriminant Analysis
Chapter 7: Introduction to Sampling Distributions
Presentation transcript:

Spatial Dynamic Factor Analysis Hedibert Freitas Lopes, Esther Salazar, Dani Gamerman Presented by Zhengming Xing Jan 29,2010 * tables and figures are directly copied from the original paper.

Outline Introduction Spatial Dynamic Factor Analysis Model Inference and Application Experiment Future direction

Basic factor analysis Spatial dynamic FA model Locations:Times: key idea: Temporal dependence is modeled by latent factor score and spatial dependence is modeled by the factor loadings Factor loading matrix Factor score observations introduction

Spatial Dynamic Factor Analysis Model:

Covariate effects 1.Constant mean 2.Regression model 3.Dynamic coefficient model Mean level of the spatio-time process Mean level of Gaussian process

Prior information Recall: Priors:

Seasonal dynamic factors Goal: capture the periodic or cyclical behavior Example : p=52 for weekly data and annual cycle

Spatio-temporal separability Random process indexed by space and time Assume if thenseparable Choose for convenience rather than for the ability to fit the data SDFA model m=1 m>1

MCMC Inference Assume: Posterior distribution: Full conditional distribution of all parameters can be found in appendix Model in matrix notation

Number of factors Reverse jump MCMC accept With probability Collect samples Proposal distribution:

Applications Prediction Interpolation

Experiment Sulfur dioxide concentration in eastern US 24 stations 342 observations (from the first week of 1998 to the 30th week of 2004) 2 station left out for interpolation and the last 30 weeks left out for prediction Dataset available online: Data description

Experiment Spatial dynamic factor models Benchmark model

Experiment

Future direction Time varying factor loadings Allow binomial and Poisson response Non-diagonal covariance matrix and more general dynamic structure.