On comparison of different approaches to the stability radius calculation Olga Karelkina Department of Mathematics University of Turku MCDM 2011.

Slides:



Advertisements
Similar presentations
Topic Outline ? Black-Box Optimization Optimization Algorithm: only allowed to evaluate f (direct search) decision vector x objective vector f(x) objective.
Advertisements

Non-dominated Sorting Genetic Algorithm (NSGA-II)
13-Optimization Assoc.Prof.Dr. Ahmet Zafer Şenalp Mechanical Engineering Department Gebze Technical.
Ali Husseinzadeh Kashan Spring 2010
MOEAs University of Missouri - Rolla Dr. T’s Course in Evolutionary Computation Matt D. Johnson November 6, 2006.
1 An Adaptive GA for Multi Objective Flexible Manufacturing Systems A. Younes, H. Ghenniwa, S. Areibi uoguelph.ca.
Elitist Non-dominated Sorting Genetic Algorithm: NSGA-II
Spie98-1 Evolutionary Algorithms, Simulated Annealing, and Tabu Search: A Comparative Study H. Youssef, S. M. Sait, H. Adiche
Date:2011/06/08 吳昕澧 BOA: The Bayesian Optimization Algorithm.
Adaptive Multi-objective Differential Evolution with Stochastic Coding Strategy Wei-Ming Chen
3 -1 Chapter 3 The Greedy Method 3 -2 The greedy method Suppose that a problem can be solved by a sequence of decisions. The greedy method has that each.
A New Evolutionary Algorithm for Multi-objective Optimization Problems Multi-objective Optimization Problems (MOP) –Definition –NP hard By Zhi Wei.
Multi-Objective Evolutionary Algorithms Matt D. Johnson April 19, 2007.
A new crossover technique in Genetic Programming Janet Clegg Intelligent Systems Group Electronics Department.
Problem statement; Solution structure and defining elements; Solution properties in a neighborhood of regular point; Solution properties in a neighborhood.
Dean H. Lorenz, Danny Raz Operations Research Letter, Vol. 28, No
Torcs Simulator Presented by Galina Volkinshtein and Evgenia Dubrovsky.
Fuzzy Evolutionary Algorithm for VLSI Placement Sadiq M. SaitHabib YoussefJunaid A. Khan Department of Computer Engineering King Fahd University of Petroleum.
The Pareto fitness genetic algorithm: Test function study Wei-Ming Chen
Genetic Algorithms Nehaya Tayseer 1.Introduction What is a Genetic algorithm? A search technique used in computer science to find approximate solutions.
Genetic Algorithm What is a genetic algorithm? “Genetic Algorithms are defined as global optimization procedures that use an analogy of genetic evolution.
Chapter 6: Transform and Conquer Genetic Algorithms The Design and Analysis of Algorithms.
A New Algorithm for Solving Many-objective Optimization Problem Md. Shihabul Islam ( ) and Bashiul Alam Sabab ( ) Department of Computer Science.
Important Problem Types and Fundamental Data Structures
Evolutionary Multi-objective Optimization – A Big Picture Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical.
Genetic Algorithm.
Efficient Model Selection for Support Vector Machines
© The McGraw-Hill Companies, Inc., Chapter 3 The Greedy Method.
Intro. ANN & Fuzzy Systems Lecture 36 GENETIC ALGORITHM (1)
Efficient and Scalable Computation of the Energy and Makespan Pareto Front for Heterogeneous Computing Systems Kyle M. Tarplee 1, Ryan Friese 1, Anthony.
Zorica Stanimirović Faculty of Mathematics, University of Belgrade
Boltzmann Machine (BM) (§6.4) Hopfield model + hidden nodes + simulated annealing BM Architecture –a set of visible nodes: nodes can be accessed from outside.
Genetic algorithms Charles Darwin "A man who dares to waste an hour of life has not discovered the value of life"
Omni-Optimizer A Procedure for Single and Multi-objective Optimization Prof. Kalyanmoy Deb and Santosh Tiwari.
Optimization of the ESRF upgrade lattice lifetime and dynamic aperture using genetic algorithms Nicola Carmignani 11/03/2015.
Simulation in Wind Turbine Vibrations: A Data Driven Analysis Graduate Students: Zijun Zhang PI: Andrew Kusiak Intelligent Systems Laboratory The University.
1 A New Method for Composite System Annualized Reliability Indices Based on Genetic Algorithms Nader Samaan, Student,IEEE Dr. C. Singh, Fellow, IEEE Department.
A genetic approach to the automatic clustering problem Author : Lin Yu Tseng Shiueng Bien Yang Graduate : Chien-Ming Hsiao.
A New Evolutionary Approach for the Optimal Communication Spanning Tree Problem Sang-Moon Soak Speaker: 洪嘉涓、陳麗徽、李振宇、黃怡靜.
Exact and heuristics algorithms
DIVERSITY PRESERVING EVOLUTIONARY MULTI-OBJECTIVE SEARCH Brian Piper1, Hana Chmielewski2, Ranji Ranjithan1,2 1Operations Research 2Civil Engineering.
Edge Assembly Crossover
Genetic Algorithms What is a GA Terms and definitions Basic algorithm.
Chapter 12 FUSION OF FUZZY SYSTEM AND GENETIC ALGORITHMS Chi-Yuan Yeh.
2/29/20121 Optimizing LCLS2 taper profile with genetic algorithms: preliminary results X. Huang, J. Wu, T. Raubenhaimer, Y. Jiao, S. Spampinati, A. Mandlekar,
Foundation of Computing Systems
STABILITY ANALYSIS IN MULTICRITERIA OPTIMIZATION Tallinn 2010 Karelkina Olga University of Turku Department of Mathematics.
Diversity Loss in General Estimation of Distribution Algorithms J. L. Shapiro PPSN (Parallel Problem Solving From Nature) ’06 BISCuit 2 nd EDA Seminar.
Multi-objective Evolutionary Algorithms (for NACST/Seq) summarized by Shin, Soo-Yong.
Evolutionary multi-objective algorithm design issues Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical.
Application of the GA-PSO with the Fuzzy controller to the robot soccer Department of Electrical Engineering, Southern Taiwan University, Tainan, R.O.C.
Onlinedeeneislam.blogspot.com1 Design and Analysis of Algorithms Slide # 1 Download From
Genetic Algorithm Dr. Md. Al-amin Bhuiyan Professor, Dept. of CSE Jahangirnagar University.
Artificial Intelligence By Mr. Ejaz CIIT Sahiwal Evolutionary Computation.
1 Comparative Study of two Genetic Algorithms Based Task Allocation Models in Distributed Computing System Oğuzhan TAŞ 2005.
Genetic Algorithms And other approaches for similar applications Optimization Techniques.
Genetic Algorithm. Outline Motivation Genetic algorithms An illustrative example Hypothesis space search.
Hirophysics.com The Genetic Algorithm vs. Simulated Annealing Charles Barnes PHY 327.
A MapReduced Based Hybrid Genetic Algorithm Using Island Approach for Solving Large Scale Time Dependent Vehicle Routing Problem Rohit Kondekar BT08CSE053.
ZEIT4700 – S1, 2016 Mathematical Modeling and Optimization School of Engineering and Information Technology.
Power Magnetic Devices: A Multi-Objective Design Approach
An Evolutionary Approach
Bulgarian Academy of Sciences
Path Coupling And Approximate Counting
ME 521 Computer Aided Design 15-Optimization
Chapter 5. Optimal Matchings
Multi-Objective Optimization
Chen-Yu Lee, Jia-Fong Yeh, and Tsung-Che Chiang
Boltzmann Machine (BM) (§6.4)
Important Problem Types and Fundamental Data Structures
Presentation transcript:

On comparison of different approaches to the stability radius calculation Olga Karelkina Department of Mathematics University of Turku MCDM 2011

Slide 2 of 25 Outline  Preliminaries  Problem statement  Exact method for calculation stability radius proposed by Chakravarti and Wagelmans  NSGA-II adaptation for calculation stability radius  Illustration and comparison of two approaches

Slide 3 of 25 Two major directions of investigation can be single out  quantitative bounds for feasible changes in initial data, which preserve some pre-assigned properties of optimal solutions deriving algorithms for the bounds calculation  qualitative conditions under which the set of optimal solutions of the problem possesses a certain pre-assigned property of invariance to external influence on initial data of the problem

Slide 4 of 25 Shortest path problem (SP) Given a directed graph and – a nonnegative cost associated with each edge Problem: find a directed path from a source node to a distinguished terminal node, with the minimum total cost. The feasible set is the set of all sequences, these sequences are directed paths from to in.

Slide 5 of 25 SP as LP Vector of ordered edges costs

Slide 6 of 25 Perturbation of the problem We define norms and in for any finite dimension The perturbation of the problem parameters is modeled by adding to the cost vector perturbing vector The set of the perturbing vectors is denoted by

Slide 7 of 25 Stability radius Let be the set of feasible solutions to the shortest path problem Let be the set of optimal solutions to the shortest path problem with cost vector. An optimal solution is called stable if Stability radius of an optimal solution

Slide 8 of 25 Stability radius (1) The largest such that for V. A. Emelichev, D.P. Podkopaev, Quantitative stability analysis for vector problems of 0 – 1 programming, Discrete Optimization. 7 (2010) 48 – 63

Slide 9 of 25 Calculating the stability radii of an optimal solution to the linear problem of 0-1 programming Theorem Let be an optimal solution to (2). The stability radius of is the maximum number satisfying the following inequality : (2) (3)

Slide 10 of 25 is the maximal satisfying the inequality : From here taking into account we get

Slide 11 of 25 Let us denote is a continuous, piecewise linear and concave function of Lemma The number of linear pieces of is D. Gusfield, Parametric combinatorial computing and a problem of program module distribution, J. Assoc. Comput. Mach. 30 (1983) 551 – 563

Slide 12 of 25 Chakravarti and Wagelmans polinomial algorithm Construction of on  Compute and  The optimal solutions associated with these values each defines a linear function on  If these functions are identical, then is simply this linear function  Otherwise, we have two linear functions which intersect at a unique value  If coincides with the intersection point, then is the concave lower envelope of the two linear functions  Otherwise, the optimal solution associated with defines a third linear function which intersects each of the other linear functions on

Slide 13 of 25 Chakravarti and Wagelmans polinomial algorithm

Slide 14 of 25 A fast and elitist multi-objective genetic algorithm: NSGA-II Modules A.A fast non-dominated sorting approach B.Diversity presentation Density estimation Crowded comparison operator C.The main loop

Slide 15 of 25 Begin Initialize Population gen=0 EvaluationAssign Fitness Cond ? Reproduction Crossover Mutation gen=gen+1 Stop No Yes

Slide 16 of 25 Implementation of NSGA-II into calculation stability radius Pareto set

Slide 17 of 25 Representation  Graph is represented by costs matrix (vector)  Every variable (feasible solution) is coded in a fixed length binary string Initialization  Breadth First Search Evaluation  A fast non-dominated sorting approach find-nondominated-front(P) include first member in for each take one soltion at a time include in temporarily for each compare with other members of if, then if dominates a member of, delete it else if, then if is dominated by other members of, do not include in

Slide 18 of 25 Assign fitness  Density estimation Crowding distance is an estimate of the size of the largest cuboid enclosing the point without including any other point in the population  Crowded comparison operator

Slide 19 of 25 Reproduction  The tournament selection scheme The strings with minimum front number and minimum value of ratios are selected to the mating pool. A directed graph on 10 nodes

Slide 20 of 25 Crossovers  One-Node crossover 5 is a common node for both parents  One-Edge crossover Edges (2,3) and (1,7) are used as links

Slide 21 of 25  One-Node-Two-Edges crossover Nodes 4 and 8 do not belong to any of the parents, subpaths ((3,4),(4,6)) and ((6,8),(8,7)) are used as links

Slide 22 of 25 Mutation The search of genetic algorithm is mainly guided by crossover operators, even though mutation operator is also used to maintain diversity in the population.  Scheme of two mutation types

Slide 23 of 25 Pareto fronts 5 generations 10 generations 20 generations 15 generations

Slide 24 of 25 Simulation results We consider a family of randomly generated directed graphs on 100 vertices and with approximately 5000 edges. Weight range is [1, 50]. Calculation results were compared with solutions obtained by exact method proposed by N. Chakravarti and A. P. M. Wagelmans in Calculation of stability radii for combinatorial optimization problems, OR Letters. 23 (1998) 1 – 7. The population size is set to 100 (number of vertices), while the probabilities of the one-node, one-edge and one-node-two-edges crossovers are 0.2, 0.3 and 0.5 correspondingly, mutation probability increases with the number of generations. Tests show that in average NSGA-II converges in 80% cases and gives the exact solution after 5 – 20 generations. Complexity of the exact method is NSGA-II complexity is Here n is the number of vertices and k is the number of generations.

Slide 25 of 25 References 1.V.A. Emelichev, V.N. Krichko, D.P. Podkopaev, On the radius of stability of a vector problem of linear Boolean programming, Discrete Math. Appl. 10 (2000) 103 – N. Chakravarti, A. P.M. Wagelmans, Calculation of stability radii for combinatorial optimization problems, OR Letters. 23 (1998) 1 – 7 3.D. Gusfield, Parametric combinatorial computing and a problem of program module distribution, J. Assoc. Comput. Mach. 30 (1983) 551 – V. A. Emelichev, D.P. Podkopaev, Quantitative stability analysis for vector problems of 0 – 1 programming, Discrete Optimization. 7 (2010) 48 – 63 5.K. Deb, A. Pratap, S. Agarwal, T. Meyarivan, A fast and elitist multi- objective genetic algorithm: NSGA-II, Evolutionary Computation. 6 (2) (2002), 182 – 197

Thank You for Your interest