Image cryptosystems based on PottsNICA algorithms Meng-Hong Chen Jiann-Ming Wu Department of Applied Mathematics National Donghwa University.

Slides:



Advertisements
Similar presentations
Independent Component Analysis
Advertisements

Independent Component Analysis: The Fast ICA algorithm
University of Joensuu Dept. of Computer Science P.O. Box 111 FIN Joensuu Tel fax Gaussian Mixture.
Machine Learning and Data Mining Linear regression
CS 678 –Boltzmann Machines1 Boltzmann Machine Relaxation net with visible and hidden units Learning algorithm Avoids local minima (and speeds up learning)
Laboratory for Social & Neural Systems Research (SNS) PATTERN RECOGNITION AND MACHINE LEARNING Institute of Empirical Research in Economics (IEW)
Independent Component Analysis & Blind Source Separation
Blind Source Separation of Acoustic Signals Based on Multistage Independent Component Analysis Hiroshi SARUWATARI, Tsuyoki NISHIKAWA, and Kiyohiro SHIKANO.
REAL-TIME INDEPENDENT COMPONENT ANALYSIS IMPLEMENTATION AND APPLICATIONS By MARCOS DE AZAMBUJA TURQUETI FERMILAB May RTC 2010.
Independent Component Analysis (ICA)
Application of Statistical Techniques to Neural Data Analysis Aniket Kaloti 03/07/2006.
Independent Component Analysis & Blind Source Separation Ata Kaban The University of Birmingham.
Information Theory and Learning
Subband-based Independent Component Analysis Y. Qi, P.S. Krishnaprasad, and S.A. Shamma ECE Department University of Maryland, College Park.
Exploring Network Inference Models Math-in-Industry Camp & Workshop: Michael Grigsby: Cal Poly, Pomona Mustafa Kesir: Northeastern University Nancy Rodriguez:
Independent Component Analysis (ICA) and Factor Analysis (FA)
ICA Alphan Altinok. Outline  PCA  ICA  Foundation  Ambiguities  Algorithms  Examples  Papers.
Linear and Non-Linear ICA-BSS I C A  Independent Component Analysis B S S  Blind Source Separation Carlos G. Puntonet Dept.of Architecture.
CompuCell Software Current capabilities and Research Plan Rajiv Chaturvedi Jesús A. Izaguirre With Patrick M. Virtue.
Chapter 15 Modeling of Data. Statistics of Data Mean (or average): Variance: Median: a value x j such that half of the data are bigger than it, and half.
Natural Gradient Works Efficiently in Learning S Amari (Fri) Computational Modeling of Intelligence Summarized by Joon Shik Kim.
Pulsed Neural Networks Neil E. Cotter ECE Department University of Utah.
Principal Component Analysis and Independent Component Analysis in Neural Networks David Gleich CS 152 – Neural Networks 11 December 2003.
“A fast method for Underdetermined Sparse Component Analysis (SCA) based on Iterative Detection- Estimation (IDE)” Arash Ali-Amini 1 Massoud BABAIE-ZADEH.
Independent Component Analysis Zhen Wei, Li Jin, Yuxue Jin Department of Statistics Stanford University An Introduction.
Blind Source Separation by Independent Components Analysis Professor Dr. Barrie W. Jervis School of Engineering Sheffield Hallam University England
Discriminant Functions
Learning Lateral Connections between Hidden Units Geoffrey Hinton University of Toronto in collaboration with Kejie Bao University of Toronto.
Markov Random Fields Probabilistic Models for Images
CHAPTER 5 S TOCHASTIC G RADIENT F ORM OF S TOCHASTIC A PROXIMATION Organization of chapter in ISSO –Stochastic gradient Core algorithm Basic principles.
ECE 8443 – Pattern Recognition LECTURE 10: HETEROSCEDASTIC LINEAR DISCRIMINANT ANALYSIS AND INDEPENDENT COMPONENT ANALYSIS Objectives: Generalization of.
September 2007 IW-SMI2007, Kyoto 1 A Quantum-Statistical-Mechanical Extension of Gaussian Mixture Model Kazuyuki Tanaka Graduate School of Information.
An Introduction to Blind Source Separation Kenny Hild Sept. 19, 2001.
2010/12/11 Frequency Domain Blind Source Separation Based Noise Suppression to Hearing Aids (Part 2) Presenter: Cian-Bei Hong Advisor: Dr. Yeou-Jiunn Chen.
Computational Intelligence: Methods and Applications Lecture 8 Projection Pursuit & Independent Component Analysis Włodzisław Duch Dept. of Informatics,
Lecture 2: Statistical learning primer for biologists
Multi-target Detection in Sensor Networks Xiaoling Wang ECE691, Fall 2003.
Review of Spectral Unmixing for Hyperspectral Imagery Lidan Miao Sept. 29, 2005.
ECE 8443 – Pattern Recognition ECE 8527 – Introduction to Machine Learning and Pattern Recognition LECTURE 12: Advanced Discriminant Analysis Objectives:
Principal Component Analysis (PCA)
Independent Component Analysis Independent Component Analysis.
Introduction to Independent Component Analysis Math 285 project Fall 2015 Jingmei Lu Xixi Lu 12/10/2015.
An Introduction of Independent Component Analysis (ICA) Xiaoling Wang Jan. 28, 2003.
The Chinese University of Hong Kong
Spatial vs. Blind Approaches for Speaker Separation: Structural Differences and Beyond Julien Bourgeois RIC/AD.
Solving Systems of Linear equations with 3 Variables To solve for three variables, we need a system of three independent equations.
CSC321: Introduction to Neural Networks and Machine Learning Lecture 17: Boltzmann Machines as Probabilistic Models Geoffrey Hinton.
ECE 8443 – Pattern Recognition ECE 8527 – Introduction to Machine Learning and Pattern Recognition LECTURE 09: Discriminant Analysis Objectives: Principal.
Numerical Analysis – Data Fitting Hanyang University Jong-Il Park.
Intelligent Numerical Computation1 Graph bisection  Problem statement  Mathematical framework  Methods  Numerical results.
CSC 2535: Computation in Neural Networks Lecture 10 Learning Deterministic Energy-Based Models Geoffrey Hinton.
By: Soroosh Mariooryad Advisor: Dr.Sameti 1 BSS & ICA Speech Recognition - Spring 2008.
Intelligent Numerical Computation1 MFA for constrained optimization  Mean field annealing  Overviews  Graph bisection problem  Traveling salesman problem.
Basics of Multivariate Probability
Information Geometry and Neural Netowrks
LECTURE 11: Advanced Discriminant Analysis
Adavanced Numerical Computation
CSC321: Neural Networks Lecture 19: Boltzmann Machines as Probabilistic Models Geoffrey Hinton.
The Chinese University of Hong Kong
Blind Source Separation with a Time-Varying Mixing Matrix
Unfolding Problem: A Machine Learning Approach
Differential Equations
Find 4 A + 2 B if {image} and {image} Select the correct answer.
Pulsed Neural Networks
The Sound of the Original Sentences
A Fast Fixed-Point Algorithm for Independent Component Analysis
Independent Factor Analysis
Unfolding with system identification
Solving a System of Linear Equations
How to win big by thinking straight about relatively trivial problems
Presentation transcript:

Image cryptosystems based on PottsNICA algorithms Meng-Hong Chen Jiann-Ming Wu Department of Applied Mathematics National Donghwa University

Blind Source Separation (BSS) Sources Observations Unknown Mixing Structure

BSS by PottsICA Observations Recovered sources PottsNICA

The ICA problem Unknown mixing structure: Unkown statistical independent sources: S= Observations:

The goal of ICA The goal is to find W to recover independent sources by The joint distribution is as close as possible to the product of the marginal distributions such that

The criterion on independency of components of y can be quantified by he Kullback-Leibler divergence The Kullback-Leibler Divergence

Then The Kullback-Leibler Divergence

Partition the range of each output component …… Potts Modeling

Energy function for ICA To minimize L’ is to solve a mixed integer and linear programming

Annealed neural dynamics Boltzmann distribution Use mean field equations to find the mean configuration at each

Derivation of mean field equations Free energy by

Mean field equations

A hybrid of mean field annealing MFE ( 1 ) ( 2 )

Natural gradient descent method W’W ( 3 )

The PottsNICA algorithm

Simulations We test the PottsICA method using facial images where the last one is a noise image. The parameters for the PottsICA algorithm are K=10, c ₁ =8, c ₂ =2 and η=0.001; the β parameter has an initial value of and each time it is increased to β by the scheduling process. The diagonal and last column of the mixing matrix A are lager than others. As follows,

Figure1 Original images Mixtures of the sources by the mixing matrix A(4x4) Recovered images by PossNICA N = 4

Figure2 N = 5

Figure3 N = 8

Performance evaluations by Amari

Table The performance of the three algorithms for tests by Amari evaluation JadeICAFastICAPottsICA K=10 PottsNICA K=10 N= N= N= N= sigularity