2010 IEEE International Conference on Systems, Man, and Cybernetics (SMC2010) A Hybrid Particle Swarm Optimization Considering Accuracy and Diversity.

Slides:



Advertisements
Similar presentations
Particle Swarm Optimization (PSO)
Advertisements

Particle Swarm optimisation. These slides adapted from a presentation by - one of main researchers.
Particle Swarm Optimization
Particle Swarm Optimization (PSO)  Kennedy, J., Eberhart, R. C. (1995). Particle swarm optimization. Proc. IEEE International Conference.
PARTICLE SWARM OPTIMISATION (PSO) Perry Brown Alexander Mathews Image:
Particle Swarm Optimization PSO was first introduced by Jammes Kennedy and Russell C. Eberhart in Fundamental hypothesis: social sharing of information.
Particle Swarm Optimization Particle Swarm Optimization (PSO) applies to concept of social interaction to problem solving. It was developed in 1995 by.
Bart van Greevenbroek.  Authors  The Paper  Particle Swarm Optimization  Algorithm used with PSO  Experiment  Assessment  conclusion.
Evolutionary Computational Intelligence Lecture 10a: Surrogate Assisted Ferrante Neri University of Jyväskylä.
EMBIO – Cambridge Particle Swarm Optimization applied to Automated Docking Automated docking of a ligand to a macromolecule Particle Swarm Optimization.
Department of Engineering, Control & Instrumentation Research Group 22 – Mar – 2006 Optimisation Based Clearance of Nonlinear Flight Control Laws Prathyush.
Modified Particle Swarm Algorithm for Decentralized Swarm Agent 2004 IEEE International Conference on Robotic and Biomimetics Dong H. Kim Seiichi Shin.
1 A hybrid particle swarm optimization algorithm for optimal task assignment in distributed system Peng-Yeng Yin and Pei-Pei Wang Department of Information.
1 Hybrid Agent-Based Modeling: Architectures,Analyses and Applications (Stage One) Li, Hailin.
L/O/G/O Ant Colony Optimization M1 : Cecile Chu.
1 PSO-based Motion Fuzzy Controller Design for Mobile Robots Master : Juing-Shian Chiou Student : Yu-Chia Hu( 胡育嘉 ) PPT : 100% 製作 International Journal.
Particle Swarm Optimization Algorithms
Suriya, A. September 19, 2015, Slide 0 Atipong Suriya School of MIME March 16, 2011 FE 640 : Term Project Presentation RFID Network Planning using Particle.
Particle Swarm Optimization and Social Interaction Between Agents Kenneth Lee TJHSST 2008.
Swarm Intelligence 虞台文.
1 Evaluation of parallel particle swarm optimization algorithms within the CUDA™ architecture Luca Mussi, Fabio Daolio, Stefano Cagnoni, Information Sciences,
PSO and its variants Swarm Intelligence Group Peking University.
(Particle Swarm Optimisation)
The Particle Swarm Optimization Algorithm Nebojša Trpković 10 th Dec 2010.
4 Fundamentals of Particle Swarm Optimization Techniques Yoshikazu Fukuyama.
1 IE 607 Heuristic Optimization Particle Swarm Optimization.
Robin McDougall Scott Nokleby Mechatronic and Robotic Systems Laboratory 1.
Particle Swarm optimisation. These slides adapted from a presentation by - one of main researchers.
The Application of The Improved Hybrid Ant Colony Algorithm in Vehicle Routing Optimization Problem International Conference on Future Computer and Communication,
PSMS for Neural Networks on the Agnostic vs Prior Knowledge Challenge Hugo Jair Escalante, Manuel Montes and Enrique Sucar Computer Science Department.
Controlling the Behavior of Swarm Systems Zachary Kurtz CMSC 601, 5/4/
Sparse Signals Reconstruction Via Adaptive Iterative Greedy Algorithm Ahmed Aziz, Ahmed Salim, Walid Osamy Presenter : 張庭豪 International Journal of Computer.
Particle Swarm Optimization James Kennedy & Russel C. Eberhart.
Cooperative Q-Learning Lars Blackmore and Steve Block Multi-Agent Reinforcement Learning: Independent vs. Cooperative Agents Tan, M Proceedings of the.
Regrouping Particle Swarm Optimization: A New Global Optimization Algorithm with Improved Performance Consistency Across Benchmarks George I. Evers Advisor:
Biologically inspired algorithms BY: Andy Garrett YE Ziyu.
Particle Swarm Optimization by Dr. Shubhajit Roy Chowdhury Centre for VLSI and Embedded Systems Technology, IIIT Hyderabad.
Particle Swarm Optimization † Spencer Vogel † This presentation contains cheesy graphics and animations and they will be awesome.
SwinTop: Optimizing Memory Efficiency of Packet Classification in Network Author: Chen, Chang; Cai, Liangwei; Xiang, Yang; Li, Jun Conference: Communication.
1 Motion Fuzzy Controller Structure(1/7) In this part, we start design the fuzzy logic controller aimed at producing the velocities of the robot right.
1 Seema Thakur (st107641) Advisor: Dr. Weerakorn Ongsakul Optimal Generation Scheduling of Cascaded Hydro-thermal and Wind Power Generation By Particle.
Faculty of Information Engineering, Shenzhen University Liao Huilian SZU TI-DSPs LAB Aug 27, 2007 Optimizer based on particle swarm optimization and LBG.
Particle Swarm Optimization (PSO)
Application of the GA-PSO with the Fuzzy controller to the robot soccer Department of Electrical Engineering, Southern Taiwan University, Tainan, R.O.C.
An Improved Quantum-behaved Particle Swarm Optimization Algorithm Based on Culture V i   v i 1, v i 2,.. v iD  Gao X. Z 2, Wu Ying 1, Huang Xianlin.
Parallel Simulated Annealing using Genetic Crossover Tomoyuki Hiroyasu Mitsunori Miki Maki Ogura November 09, 2000 Doshisha University, Kyoto, Japan.
Breeding Swarms: A GA/PSO Hybrid 簡明昌 Author and Source Author: Matthew Settles and Terence Soule Source: GECCO 2005, p How to get: (\\nclab.csie.nctu.edu.tw\Repository\Journals-
On the Computation of All Global Minimizers Through Particle Swarm Optimization IEEE Transactions On Evolutionary Computation, Vol. 8, No.3, June 2004.
 Introduction  Particle swarm optimization  PSO algorithm  PSO solution update in 2-D  Example.
Swarm Intelligence. Content Overview Swarm Particle Optimization (PSO) – Example Ant Colony Optimization (ACO)
Advanced Computing and Networking Laboratory
Particle Swarm Optimization (2)
Particle Swarm Optimization with Partial Search To Solve TSP
A Novel Set-Based Particle Swarm Optimization Method for Discrete Optimization Problems Wei-Neng Chen, Student Member, IEEE, Jun Zhang, Senior Member,
Scientific Research Group in Egypt (SRGE)
Discrete ABC Based on Similarity for GCP
Cluster formation based comparison of Genetic algorithm and Particle Swarm Optimization in Wireless Sensor Network Ms.Amita Yadav.
Scientific Research Group in Egypt (SRGE)
Adnan Quadri & Dr. Naima Kaabouch Optimization Efficiency
Particle Swarm Optimization
PSO -Introduction Proposed by James Kennedy & Russell Eberhart in 1995
Ana Wu Daniel A. Sabol A Novel Approach for Library Materials Acquisition using Discrete Particle Swarm Optimization.
آموزش شبکه عصبی با استفاده از روش بهینه سازی PSO
Multi-objective Optimization Using Particle Swarm Optimization
Multi-band impedance matching using an evolutionary algorithm
A weight-incorporated similarity-based clustering ensemble method based on swarm intelligence Yue Ming NJIT#:
Xin-She Yang, Nature-Inspired Optimization Algorithms, Elsevier, 2014
Particle Swarm Optimization
SWARM INTELLIGENCE Swarms
Particle Swarm Optimization and Social Interaction Between Agents
Presentation transcript:

2010 IEEE International Conference on Systems, Man, and Cybernetics (SMC2010) A Hybrid Particle Swarm Optimization Considering Accuracy and Diversity of Solutions Takeya Matsui1 Masato Noto1 Masanobu Numazawa2 1Kanagawa University, Japan 2Otaru University of Commerce, Japan 11, Oct., 2010

Outline Introduction Particle Swarm Optimization (PSO) Proposed Method Simulation Experiments Conclusion and Future Work 11, Oct., 2010 SMC2010 in Istanbul,TURKEY

Introduction Particle Swarm Optimization (PSO) An optimization method that emulates the behavior of creatures such as a flock of birds or a school of fish. Each of a number of candidate points (particles) has information about its own position and velocity. That information is shared within the swarm, and the search proceeds while information on the best solution is shared. A characteristic of PSO The PSO algorithms are extremely simple. PSO is applied to various different types of problem and its validity has been confirmed. 11, Oct., 2010 SMC2010 in Istanbul,TURKEY

Particle Swarm Optimization (PSO) Gbest model The best solution discovered by the entire swarm is shared by the entire swarm. The most basic model for PSO. This model can converge quickly on a solution and may become trapped at a local solution. Lbest model Divides the swarm into a number of groups. Shares the best solution that is discovered by each group within that group. This model converges slowly on the solution but its global search capability is better. 11, Oct., 2010 SMC2010 in Istanbul,TURKEY

In this study We propose a hybrid PSO algorithm. In order to resolve the drawback of PSO in that it can easily get trapped at a local solution. The initial stages of the search maintain the diversity of the search by using the Lbest model. Then the method intensifies the search in the later stages by switching to the Gbest model. The method searches the optimal solution candidates vicinity carefully by limiting update of the shared information. 11, Oct., 2010 SMC2010 in Istanbul,TURKEY

PSO (Gbest model) algorithm Each Particle in the -dimension space Current position: Current velocity: Own best solutions: Evaluation value: ( is the Particle number, is the number of iterations) Shared by the entire swarm Best solutions discovered by the entire swarm: 11, Oct., 2010 SMC2010 in Istanbul,TURKEY

Travel of Particle in Gbest model Updating velocities Updating positions 11, Oct., 2010 SMC2010 in Istanbul,TURKEY

Lbest model Each Particle forms a group consisting of itself and neighboring Particles. Shares the best solution that is discovered by each group as within that group. Each group search regions that are mutually different. The global search capability is increased. Since the particles are formed into groups with overlapping portions, this means that there is some sharing of information within the entire swarm. The processing eventually converges on the best value within the values. 11, Oct., 2010 SMC2010 in Istanbul,TURKEY

Degree of activity of swarm The degree of activity of the swarm has been proposed as an indicator for quantitively comprehending the search situation in PSO. The degree of activity of the swarm is defined as the root mean square of the velocities of the particles. Use of the degree of activity of the swarm makes it possible to know the activity state of the entire swarm. When the degree of activity is large --> Expanding When the degree of activity is small --> Converging : Number of Particles : Number of dimensions of the problem : -dimensional element of the velocity of the th particle in iterations 11, Oct., 2010 SMC2010 in Istanbul,TURKEY

Proposed method By using the degree of activity of the swarm to monitor the diversity of the search. The initial stages of the search maintain the diversity of the search by using the Lbest model. The final stages of the search intensifies the search by switching to the Gbest model. Furthermore, the method is adopting the lowest number of iterations of the shared information. Updating the shared information of the swarm, and then searching carefully in the vicinity of the optimal solution candidates without further updating the shared information until is reached. 11, Oct., 2010 SMC2010 in Istanbul,TURKEY

Simulation experiments 2nminima function Subj. to Globally optimal solution: Rastrigin function Subj. to Globally optimal solution: 2nminima function ( ) Rastrigin function ( ) 11, Oct., 2010 SMC2010 in Istanbul,TURKEY

Simulation Parameters Dimension of the problem Number of Particles Weighting parameters Maximum number of iterations Threshold degree of activity for switching the search model Lowest number of iterations for sharing information Number of trials 100 : The maximum value of the degree of activity of the swarm during the iterations. 11, Oct., 2010 SMC2010 in Istanbul,TURKEY

Simulation Results Gbest model Average Best Worst Lbest model 2nminima function Rastrigin function Gbest model Average -735.2585 8.9745 Best -783.3233 1.9899 Worst -641.9561 26.8639 Lbest model -749.9607 7.7748 0.9950 -698.5030 39.5371 Proposed method -767.7719 5.8604 3.7373E-9 12.9350 11, Oct., 2010 SMC2010 in Istanbul,TURKEY

Transitions in degree of activity 2nminima function Rastrigin function The proposed method maintains the degree of activity of the swarm right up to the end. This is thought to be because the diversity of the search is maintained for a long while with the proposed method. By using the Lbest model to search in different ranges for each group, until the degree of activity falls to a certain amount. 11, Oct., 2010 SMC2010 in Istanbul,TURKEY

Transitions in best values 2nminima function Rastrigin function The proposed method took longer to converge on the solution than the Gbest model. Uses the Lbest model in the initial stages of the search. The adoption of delays the convergence on the solution. No great difference in convergence on the solution was seen in comparison with the Lbest model. The search is intensified by switching to the Gbest model in the final stages of the search. 11, Oct., 2010 SMC2010 in Istanbul,TURKEY

Conclusion and Future Work In this study, we proposed a hybrid method in order to resolve the drawback of PSO in that it can easily get trapped by a local solution. We have confirmed from the results of simulation experiments that the proposed method has superior search capabilities. Future work Optimization of and . Evaluations of various different benchmark problems. Verification of the validity of the method in real-life systems. 11, Oct., 2010 SMC2010 in Istanbul,TURKEY

Thank you for your kind attention!