The information contained in this document pertains to software products and services that are subject to the controls of the Export Administration Regulations.

Slides:



Advertisements
Similar presentations
Population-based metaheuristics Nature-inspired Initialize a population A new population of solutions is generated Integrate the new population into the.
Advertisements

Particle Swarm Optimization
Hongliang Li, Senior Member, IEEE, Linfeng Xu, Member, IEEE, and Guanghui Liu Face Hallucination via Similarity Constraints.
HPC - High Performance Productivity Computing and Future Computational Systems: A Research Engineer’s Perspective Dr. Robert C. Singleterry Jr. NASA Langley.
Particle Swarm Optimization (PSO)  Kennedy, J., Eberhart, R. C. (1995). Particle swarm optimization. Proc. IEEE International Conference.
PARTICLE SWARM OPTIMISATION (PSO) Perry Brown Alexander Mathews Image:
Particle Swarm Optimization PSO was first introduced by Jammes Kennedy and Russell C. Eberhart in Fundamental hypothesis: social sharing of information.
Patch-based Image Deconvolution via Joint Modeling of Sparse Priors Chao Jia and Brian L. Evans The University of Texas at Austin 12 Sep
Histogram Analysis to Choose the Number of Clusters for K Means By: Matthew Fawcett Dept. of Computer Science and Engineering University of South Carolina.
Self Organization of a Massive Document Collection
Machine Learning and Data Mining Clustering
Firefly Algorithm By Rasool Tavakoli.
Lecture 6 Image Segmentation
Prénom Nom Document Analysis: Linear Discrimination Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Cliff Rhyne and Jerry Fu June 5, 2007 Parallel Image Segmenter CSE 262 Spring 2007 Project Final Presentation.
Tal Mor  Create an automatic system that given an image of a room and a color, will color the room walls  Maintaining the original texture.
Optimization Using Broyden-Update Self-Adjoint Sensitivities Dongying Li, N. K. Nikolova, and M. H. Bakr McMaster University, 1280 Main Street West, Hamilton,
1 PSO-based Motion Fuzzy Controller Design for Mobile Robots Master : Juing-Shian Chiou Student : Yu-Chia Hu( 胡育嘉 ) PPT : 100% 製作 International Journal.
Particle Swarm Optimization Algorithms
 C. C. Hung, H. Ijaz, E. Jung, and B.-C. Kuo # School of Computing and Software Engineering Southern Polytechnic State University, Marietta, Georgia USA.
Introduction to Parallel Programming MapReduce Except where otherwise noted all portions of this work are Copyright (c) 2007 Google and are licensed under.
ENDA MOLLOY, ELECTRONIC ENG. FINAL PRESENTATION, 31/03/09. Automated Image Analysis Techniques for Screening of Mammography Images.
1 Hybrid methods for solving large-scale parameter estimation problems Carlos A. Quintero 1 Miguel Argáez 1 Hector Klie 2 Leticia Velázquez 1 Mary Wheeler.
Exploring the Parameter Space of Image Segmentation Algorithms Talk at NCHU p 1 TexPoint fonts used in EMF. Read the TexPoint manual before you.
Test Of Distributed Data Quality Monitoring Of CMS Tracker Dataset H->ZZ->2e2mu with PileUp - 10,000 events ( ~ 50,000 hits for events) The monitoring.
Multimodal Optimization (Niching) A/Prof. Xiaodong Li School of Computer Science and IT, RMIT University Melbourne, Australia
Improved Search for Local Optima in Particle Swarm Optimization May 6, 2015 Huidae Cho Water Resources Engineer, Dewberry Consultants Part-Time Assistant.
Hierarchical Distributed Genetic Algorithm for Image Segmentation Hanchuan Peng, Fuhui Long*, Zheru Chi, and Wanshi Siu {fhlong, phc,
Swarm Intelligence 虞台文.
Scientific Writing Abstract Writing. Why ? Most important part of the paper Number of Readers ! Make people read your work. Sell your work. Make your.
Optimization Problems - Optimization: In the real world, there are many problems (e.g. Traveling Salesman Problem, Playing Chess ) that have numerous possible.
(Particle Swarm Optimisation)
The Particle Swarm Optimization Algorithm Nebojša Trpković 10 th Dec 2010.
1 IE 607 Heuristic Optimization Particle Swarm Optimization.
Topics in Artificial Intelligence By Danny Kovach.
EECS 274 Computer Vision Segmentation by Clustering II.
PSMS for Neural Networks on the Agnostic vs Prior Knowledge Challenge Hugo Jair Escalante, Manuel Montes and Enrique Sucar Computer Science Department.
IIIT Hyderabad Scalable Clustering using Multiple GPUs K Wasif Mohiuddin P J Narayanan Center for Visual Information Technology International Institute.
Particle Swarm Optimization James Kennedy & Russel C. Eberhart.
QCAdesigner – CUDA HPPS project
Compiler and Runtime Support for Enabling Generalized Reduction Computations on Heterogeneous Parallel Configurations Vignesh Ravi, Wenjing Ma, David Chiu.
 Genetic Algorithms  A class of evolutionary algorithms  Efficiently solves optimization tasks  Potential Applications in many fields  Challenges.
Particle Swarm Optimization by Dr. Shubhajit Roy Chowdhury Centre for VLSI and Embedded Systems Technology, IIIT Hyderabad.
Vision-based SLAM Enhanced by Particle Swarm Optimization on the Euclidean Group Vision seminar : Dec Young Ki BAIK Computer Vision Lab.
October 1, 2013Computer Vision Lecture 9: From Edges to Contours 1 Canny Edge Detector However, usually there will still be noise in the array E[i, j],
Faculty of Information Engineering, Shenzhen University Liao Huilian SZU TI-DSPs LAB Aug 27, 2007 Optimizer based on particle swarm optimization and LBG.
Particle Swarm Optimization (PSO)
Application of the GA-PSO with the Fuzzy controller to the robot soccer Department of Electrical Engineering, Southern Taiwan University, Tainan, R.O.C.
Can small quantum systems learn? NATHAN WIEBE & CHRISTOPHER GRANADE, DEC
Non-parametric Methods for Clustering Continuous and Categorical Data Steven X. Wang Dept. of Math. and Stat. York University May 13, 2010.
In conclusion the intensity level of the CCD is linear up to the saturation limit, but there is a spilling of charges well before the saturation if.
Journal of Computational and Applied Mathematics Volume 253, 1 December 2013, Pages 14–25 Reporter : Zong-Dian Lee A hybrid quantum inspired harmony search.
Multi-cellular paradigm The molecular level can support self- replication (and self- repair). But we also need cells that can be designed to fit the specific.
Grid-Based Genetic Algorithm Approach to Colour Image Segmentation Marco Gallotta Keri Woods Supervised by Audrey Mbogho.
A Presentation on Adaptive Neuro-Fuzzy Inference System using Particle Swarm Optimization and it’s Application By Sumanta Kundu (En.R.No.
Breeding Swarms: A GA/PSO Hybrid 簡明昌 Author and Source Author: Matthew Settles and Terence Soule Source: GECCO 2005, p How to get: (\\nclab.csie.nctu.edu.tw\Repository\Journals-
Stut 11 Robot Path Planning in Unknown Environments Using Particle Swarm Optimization Leandro dos Santos Coelho and Viviana Cocco Mariani.
Genetic Algorithm in TDR System
Evolutionary Algorithms Jim Whitehead
The 2st Chinese Workshop on Evolutionary Computation and Learning
Alan P. Reynolds1. , Asaad Abdollahzadeh2, David W
Goal We present a hybrid optimization approach for solving global optimization problems, in particular automated parameter estimation models. The hybrid.
AEEICB-2016 PAPER ID- 187 Voltage Stability Enhancement and Voltage Deviation Minimization Using Ant-Lion Optimizer Algorithm Indrajit N. Trivedi 1 Siddharth.
Particle Swarm Optimization
PSO -Introduction Proposed by James Kennedy & Russell Eberhart in 1995
آموزش شبکه عصبی با استفاده از روش بهینه سازی PSO
metaheuristic methods and their applications
Xin-She Yang, Nature-Inspired Optimization Algorithms, Elsevier, 2014.
Histogram Probability distribution of the different grays in an image.
Metaheuristic methods and their applications. Optimization Problems Strategies for Solving NP-hard Optimization Problems What is a Metaheuristic Method?
Presentation transcript:

The information contained in this document pertains to software products and services that are subject to the controls of the Export Administration Regulations (EAR). The recipient is responsible for ensuring compliance to all applicable U.S. Export Control laws and regulations. Ron Kneusel ITT Visual Information Solutions Development of Advanced Algorithms for AstroMed Applications AstroMed 2009 Sydney

Visual Information Solutions Outline Image enhancement via the generalized histogram Curve fitting via Particle Swarm Optimization

Visual Information Solutions Generalized Histogram Enhancement Motivation Locally adaptive histogram equalization often results in “unnatural” images in which contrast is over enhanced. Key Concepts Image enhancement can be based on a histogram built using non- integer values. The value added to the histogram from a particular pixel is based on the local environment of that pixel. “Image contrast enhancement based on the generalized histogram” B. Yoon, W. Song, Journal of Electronic Imaging, Vol 16(3), 2007

Visual Information Solutions Generalized Histogram Enhancement y = f(x) f ij (m) =  w ij (k), m = 0,1,…, Q-1 ; k = 0,1,…,m w ij (k) = h ij (k) / N ij, k = 0,1,…,Q-1 h ij (k) =   (x uv,k), k = 0,1,…,Q-1 ; u,v  A ij But, we can replace h ij (k) with g ij (k): g ij (k) =  (r uv  (x uv,k) + (1-r uv )/Q), k = 0,1,…,Q-1 Mapping function Contrast gain function Generalized histogram Standard histogram

Visual Information Solutions Generalized Histogram Enhancement where r uv is the fractional count for the pixel at (u,v) r uv =  (1 – e -  s uv ) s uv = | x nm – x uv | / x, x = mean intensity in 3x3 region Effectively,  affects brightness,  = 0,…,1  affects contrast,  = 0,… g ij (k) =  (r uv  (x uv,k) + (1-r uv )/Q), k = 0,1,…,Q-1

Visual Information Solutions Generalized Histogram Enhancement Original Global Contrast Enhanced  = 1,  = 300

Visual Information Solutions Generalized Histogram Enhancement The generalized histogram still considers all pixels in an image It is reasonable to apply the generalized histogram to smaller image regions as in locally adaptive histogram equalization Therefore… Create an adaptive generalized histogram equalization by applying GH to a region and updating the center pixel value as in convolution.

Visual Information Solutions Generalized Histogram Equalization Original Locally Adaptive (145x145 pixels)  = 1,  = 300 unsharp mask, radius 3 (both)

Visual Information Solutions Particle Swarm Optimization PSO is a genetic algorithm for exploring a parameter space Key concepts: The parameter space is randomly populated by a swarm of “particles” Each particle evaluates the fitness function and stores its own best position Each new step of the algorithm moves the particles according to its own best position and the best overall position of the swarm (the global best) Iteration continues until some convergence criterion has been met “Particle swarm optimization”, J. Kennedy, R. Eberhart, in Proc. of the IEEE Int. Conf. on Neural Networks, Piscataway, NJ, pp. 1942–1948, 1995.

Visual Information Solutions Particle Swarm Optimization

Visual Information Solutions Particle Swarm Optimization In order to do curve fitting with PSO, the fitness function becomes the  2 between the measured points and the fit function with the current particle parameter values. For the examples here, the fit function is a 2D Gaussian: z i = p 0 + p 1 * exp(-0.5 * (((x i – p 4 )/p 2 ) 2 + ((y i -p 5 )/p 3 ) 2 )) The goal is to fit 11x11 images of “peaks” during 3D PALM reconstruction. There are 2 to 6 million peaks to be fit. PALM = “Photo-activated Localization Microscopy” “Interferometric fluorescent super-resolution microscopy resolves 3D cellular ultrastructure”, G. Shtengel, et. al. PNAS March 3, 2009, vol 106, no 9,

Visual Information Solutions Particle Swarm Optimization PSO is very computationally expensive On a single CPU it is about 1000x slower than gradient search (which IDL uses) So, why use it in this case? The answer lies in the fact that there are millions of images to be fit: PSO is straightforward to implement in CUDA In this case, convergence is reached in 25 to 30 iterations The CUDA architecture enables thousands of simultaneous fits Added benefit: fits always converge, no failures, no initial guesses

Visual Information Solutions Particle Swarm Optimization CUDA programming is in low-level C code, still difficult IDL provides the framework Visualization in 3D Easy implementation of advanced reconstruction algorithms Easy interface to CUDA CUDA provides the computational engine for time-critical tasks beyond what can be reasonably done with optimized code using multiple CPUs (IDL and C)

Visual Information Solutions Particle Swarm Optimization Number of images Fit time (s) IDL CUDA

Visual Information Solutions Particle Swarm Optimization Initialize seeds for the PRNGs (hybrid Tausworthe, CPU) On the GPU: Each image fit by single block of threads Each thread is one particle (256 particles/image) Canonical algorithm iterated set number of times (25-30) Per thread PRNG – Park & Miller MINSTD with CPU seed Parameter uncertainties estimated from the standard deviation of the last 5 global best positions Parameters, uncertainties and reduced  2 returned to IDL Block test for multi-stream PRNG demonstrates that the hybrid Tausworthe seeds work well for the MINSTD generator (Jarque-Bera 94%).

Visual Information Solutions Particle Swarm Optimization Number of Swarm Iterations Euclidean Distance (swarm to CURVEFIT) 30

Visual Information Solutions Conclusion IDL provides researchers with a powerful array processing language combined with superb 2D and 3D visualizations enabling rapid and sophisticated analysis of data CUDA adds raw “supercomputing” power to desktop IDL + CUDA enable researchers to accomplish with an inexpensive PC what in the past would have been impossible or required a large mainframe or cluster.

Visual Information Solutions A final example… home-grown in Australia!