Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt, Joel Hirschi and Bablu Sinha National Oceanography.

Slides:



Advertisements
Similar presentations
Original Figures for "Molecular Classification of Cancer: Class Discovery and Class Prediction by Gene Expression Monitoring"
Advertisements

2806 Neural Computation Self-Organizing Maps Lecture Ari Visa.
Self Organization of a Massive Document Collection
Neural Networks Chapter 9 Joost N. Kok Universiteit Leiden.
Unsupervised learning. Summary from last week We explained what local minima are, and described ways of escaping them. We investigated how the backpropagation.
Self-Organizing Map (SOM). Unsupervised neural networks, equivalent to clustering. Two layers – input and output – The input layer represents the input.
X0 xn w0 wn o Threshold units SOM.
Self Organizing Maps. This presentation is based on: SOM’s are invented by Teuvo Kohonen. They represent multidimensional.
UNIVERSITY OF JYVÄSKYLÄ Yevgeniy Ivanchenko Yevgeniy Ivanchenko University of Jyväskylä
Review of Northern Winter 2010/11
Teleconnections. Background… …on correlations… Consider a simple function of time, such as the daily T(t) Construct a new time series consisting of T(t-n.
Self-Organizing Hierarchical Neural Network
El Niño, La Niña and ENSO La NiñaEl Niño Time mean.
Contemporaneous and Antecedent Links of Atlantic and Pacific Circulation Features with North American Hydroclimate: Structure and Interannual Variability.
The dominant patterns of climate variability John M. Wallace Department of Atmospheric Sciences University of Washington.
1 Image Filtering Readings: Ch 5: 5.4, 5.5, 5.6,5.7.3, 5.8 (This lecture does not follow the book.) Images by Pawan SinhaPawan Sinha formal terminology.
KNN, LVQ, SOM. Instance Based Learning K-Nearest Neighbor Algorithm (LVQ) Learning Vector Quantization (SOM) Self Organizing Maps.
Image Analysis Preprocessing Arithmetic and Logic Operations Spatial Filters Image Quantization.
1 Image filtering Hybrid Images, Oliva et al.,
November 24, 2009Introduction to Cognitive Science Lecture 21: Self-Organizing Maps 1 Self-Organizing Maps (Kohonen Maps) In the BPN, we used supervised.
A Hybrid Self-Organizing Neural Gas Network James Graham and Janusz Starzyk School of EECS, Ohio University Stocker Center, Athens, OH USA IEEE World.
A Link between Tropical Precipitation and the North Atlantic Oscillation Matt Sapiano and Phil Arkin Earth Systems Science Interdisciplinary Center, University.
1 NOAA’s National Climatic Data Center April 2005 Climate Observation Program Blended SST Analysis Changes and Implications for the Buoy Network 1.Plans.
Project reminder Deadline: Monday :00 Prepare 10 minutes long pesentation (in Czech/Slovak), which you’ll present on Wednesday during.
Spatial Statistics Applied to point data.
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology Advisor : Dr. Hsu Student : Sheng-Hsuan Wang Department.
Self-organizing Maps Kevin Pang. Goal Research SOMs Research SOMs Create an introductory tutorial on the algorithm Create an introductory tutorial on.
Speaker/ Pei-Ning Kirsten Feng Advisor/ Yu-Heng Tseng
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology Adaptive nonlinear manifolds and their applications to pattern.
Recent studies on the Adriatic long-term oceanographic changes Ivica Vilibić Institute of Oceanography and Fisheries, Split, Croatia,
Self-Organizing Maps Corby Ziesman March 21, 2007.
1 Hadley Centre The Atlantic Multidecadal Oscillation: A signature of persistent natural thermohaline circulation cycles in observed climate Jeff Knight,
Self-organizing maps (SOMs) and k-means clustering: Part 1 Steven Feldstein The Pennsylvania State University Trieste, Italy, October 21, 2013 Collaborators:
An analysis of Russian Sea Ice Charts for A. Mahoney, R.G. Barry and F. Fetterer National Snow and Ice Data Center, University of Colorado Boulder,
Simulated and Observed Atmospheric Circulation Patterns Associated with Extreme Temperature Days over North America Paul C. Loikith California Institute.
Synthesizing Natural Textures Michael Ashikhmin University of Utah.
So, what’s the “point” to all of this?….
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology Rival-Model Penalized Self-Organizing Map Yiu-ming Cheung.
2010/ 11/ 16 Speaker/ Pei-Ning Kirsten Feng Advisor/ Yu-Heng Tseng
CUNY Graduate Center December 15 Erdal Kose. Outlines Define SOMs Application Areas Structure Of SOMs (Basic Algorithm) Learning Algorithm Simulation.
Unsupervised Learning Networks 主講人 : 虞台文. Content Introduction Important Unsupervised Learning NNs – Hamming Networks – Kohonen’s Self-Organizing Feature.
Semiconductors, BP&A Planning, DREAM PLAN IDEA IMPLEMENTATION.
Modeling North Pacific Decadal Variations and Their Teleconnection Patterns Speaker/ Pei-Ning Kirsten Feng Advisor/ Yu-Heng Tseng.
Modes of the Adriatic long-term variability as seen on half-centurial Palagruža Sill series Ivica Vilibić, Hrvoje Mihanović, Jadranka Šepić, Natalija Dunić.
Advances in Fundamental Climate Dynamics John M. Wallace et al.
CHAPTER 14 Competitive Networks Ming-Feng Yeh.
COSC 4426 AJ Boulay Julia Johnson Artificial Neural Networks: Introduction to Soft Computing (Textbook)
Basic Message Coding 《 Digital Watermarking: Principles & Practice 》 Chapter 3 Multimedia Security.
The impact of tropical convection and interference on the extratropical circulation Steven Feldstein and Michael Goss The Pennsylvania State University.
A westerly circulation index based on marine data between 1685 and 2008: Implications for the atmospheric variability in the Mediterranean. Gallego, D.
Great Lakes Ice Database, 1973-present 1/15 Great Lakes Ice & Climate Research, Modeling, and Applications Jia Wang Integrated Physical & Ecological Modeling.
Machine Learning 12. Local Models.
Self-Organizing Network Model (SOM) Session 11
Data Mining, Neural Network and Genetic Programming
Spatial Modes of Salinity and Temperature Comparison with PDO index
Self Organizing Maps: Parametrization of Parton Distribution Functions
Unsupervised Learning Networks
Other Applications of Energy Minimzation
* EGU: 25Apr2012, Wed Structural Interrelationships of the Evaporation-Precipitation Satellite-based Fields: Application of the.
1.2 Design of Periodic, Clustered-Dot Screens
Continous-Action Q-Learning
Self-Organizing Maps Corby Ziesman March 21, 2007.
Fast Pattern Simulation Using Multi‐Scale Search
Source: Pattern Recognition Vol. 38, May, 2005, pp
Jozsef Csicsvari, Hajime Hirase, Akira Mamiya, György Buzsáki  Neuron 
Figure 2 Atlantic sector of the first rotated EOF of non-ENSO global SST variability for 1870–2000 referred to as the “Atlantic multidecadal mode” (38,
Comparison ofMyc-induced zebrafish liver tumors with different stages of human HCC and seven mouse HCC models. Comparison ofMyc-induced zebrafish liver.
by Stanley B. Goldenberg, Christopher W. Landsea, Alberto M
Fig. 1 Fractional coverage of the mapping method used in this study.
Presentation transcript:

Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt, Joel Hirschi and Bablu Sinha National Oceanography Center, Southampton, UK 8 th April 2011 EGU General Assembly Vienna

Correlation Maps Wallace & Gutzler 1981 Correlate a grid point with every other grid point on the map for all grid points Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt

Self Organizing Maps (SOMs) What is a SOM? An unsupervised non-linear neural network Finds representative patterns in the data Results are arranged topologically Similar results are close together, different results are far apart Examples of SOMs in teleconnections Leloup et al 2008 ENSO, Johnson et al 2008 NAO Simple example Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt

Current data from a moored buoy in Loch Shieldaig, Scotland Actual data will be shown in RED SOM data will be shown in BLUE Data courtesy of the British Oceanographic Data Centre Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt How do Self Organizing Maps work?

Initialization How many patterns? Starting patterns Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt How do Self Organizing Maps work?

How do SOMs work? 2.Locate SOM pattern most similar to data pattern 1.Present each data pattern to SOM 2.Locate BMU 3.Update BMU – learning rate 4.Update neighbors - neighborhood function 5.Learning rate and neighborhood function reduce over time BMU Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt

How do SOMs work? 3.Update BMU to more closely resemble the data pattern 1.Present each data pattern to SOM 2.Locate BMU 3.Update BMU – learning rate 4.Update neighbors - neighborhood function 5.Learning rate and neighborhood function reduce over time BMU Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt

How do SOMs work? 4.Update neighboring SOM patterns 1.Present each data pattern to SOM 2.Locate BMU 3.Update BMU – learning rate 4.Update neighbors - neighborhood function 5.Learning rate and neighborhood function reduce over time Neighborhood function Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt

How do SOMs work? 1.Present each data pattern to SOM 2.Locate BMU 3.Update BMU – learning rate 4.Update neighbors - neighborhood function 5.Learning rate and neighborhood function reduce over time 1.Iteratively present each data pattern to SOM Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt

Comparison Compare original data patterns with SOM patterns For each data pattern find its BMU Add up number of times each SOM pattern is BMU to get ‘hits’ Frequency of occurrence Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt How do Self Organizing Maps work?

Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt Percentage frequency occurrence of each SOM pattern in the original data How do Self Organizing Maps work?

Correlation Map SOMs Gridded data set Point correlation maps for each grid point nx by ny correlation maps Present correlation maps to SOM rather than raw data Advantages: Correlation maps already highlight related regions SOM summarizes patterns No requirement for orthogonality Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt

Idealized Self Organizing Maps Rectangular domain Simple north-south oscillation Plus east-west oscillation in northern half Add noise Construct point correlation maps for each grid point Present to 4 x 4 SOM Also SOM from raw data Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt

Idealized SOM N-S oscillation, + E-W oscillation, no noise Red = positive Blue = negative Green = zero Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt

Idealized SOM N-S oscillation, + E-W oscillation, + white noise Red = positive Blue = negative Green = zero Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt

Idealized SOM N-S oscillation, + E-W oscillation, + random walk Red = positive Blue = negative Green = zero Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt

Temperature SOM 20 x 40 SOM - NCEP/NCAR monthly 2m temperature anomalies to Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt ENSO Type NAO Type

Conclusions Correlation maps + SOMs effectively identify and summarize teleconnections Advantage over raw data as relationships already defined Advantage over EOFs as no orthogonality Flexible method – use comparison stage in many different ways to get different insights into large datasets Validating model behavior Identifying Teleconnection Patterns from Point Correlation Maps using Self Organizing Maps Freja Hunt