Advisor: Yeong-Sung Lin Presented by Chi-Hsiang Chan 2011/5/23 1.

Slides:



Advertisements
Similar presentations
Answering Approximate Queries over Autonomous Web Databases Xiangfu Meng, Z. M. Ma, and Li Yan College of Information Science and Engineering, Northeastern.
Advertisements

Minimum Clique Partition Problem with Constrained Weight for Interval Graphs Jianping Li Department of Mathematics Yunnan University Jointed by M.X. Chen.
Topic Outline ? Black-Box Optimization Optimization Algorithm: only allowed to evaluate f (direct search) decision vector x objective vector f(x) objective.
Lect.3 Modeling in The Time Domain Basil Hamed
Multi‑Criteria Decision Making
1 An Adaptive GA for Multi Objective Flexible Manufacturing Systems A. Younes, H. Ghenniwa, S. Areibi uoguelph.ca.
Support Vector Machines
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
Computational Methods for Management and Economics Carla Gomes Module 8b The transportation simplex method.
Assessment. Schedule graph may be of help for selecting the best solution Best solution corresponds to a plateau before a high jump Solutions with very.
CUSTOMER NEEDS ELICITATION FOR PRODUCT CUSTOMIZATION Yue Wang Advisor: Prof. Tseng Advanced Manufacturing Institute Hong Kong University of Science and.
Spring, 2013C.-S. Shieh, EC, KUAS, Taiwan1 Heuristic Optimization Methods Pareto Multiobjective Optimization Patrick N. Ngatchou, Anahita Zarei, Warren.
Prénom Nom Document Analysis: Linear Discrimination Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Decision Tree Algorithm
1 Classification: Definition Given a collection of records (training set ) Each record contains a set of attributes, one of the attributes is the class.
Prénom Nom Document Analysis: Data Analysis and Clustering Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
1 Introduction to System Engineering G. Nacouzi ME 155B.
1 Swiss Federal Institute of Technology Computer Engineering and Networks Laboratory Classical Exploration Methods for Design Space Exploration (multi-criteria.
1 Seventh Lecture Error Analysis Instrumentation and Product Testing.
Scaling and Attitude Measurement in Travel and Hospitality Research Research Methodologies CHAPTER 11.
MADM Y. İlker TOPCU, Ph.D twitter.com/yitopcu.
Radial Basis Function Networks
Reliability-Redundancy Allocation for Multi-State Series-Parallel Systems Zhigang Tian, Ming J. Zuo, and Hongzhong Huang IEEE Transactions on Reliability,

Evolutionary Multi-objective Optimization – A Big Picture Karthik Sindhya, PhD Postdoctoral Researcher Industrial Optimization Group Department of Mathematical.
Exploratory Data Analysis. Computing Science, University of Aberdeen2 Introduction Applying data mining (InfoVis as well) techniques requires gaining.
Introduction to variable selection I Qi Yu. 2 Problems due to poor variable selection: Input dimension is too large; the curse of dimensionality problem.
Presented by Tienwei Tsai July, 2005
Marketing Research Aaker, Kumar, Day Seventh Edition Instructor’s Presentation Slides.
Roles of Economists and New Analytical Requirements
Machine Learning CSE 681 CH2 - Supervised Learning.
Classifying Attributes with Game- theoretic Rough Sets Nouman Azam and JingTao Yao Department of Computer Science University of Regina CANADA S4S 0A2
Linear Programming An Example. Problem The dairy "Fior di Latte" produces two types of cheese: cheese A and B. The dairy company must decide how many.
A two-stage approach for multi- objective decision making with applications to system reliability optimization Zhaojun Li, Haitao Liao, David W. Coit Reliability.
Stochastic Linear Programming by Series of Monte-Carlo Estimators Leonidas SAKALAUSKAS Institute of Mathematics&Informatics Vilnius, Lithuania
Introduction A GENERAL MODEL OF SYSTEM OPTIMIZATION.
Universit at Dortmund, LS VIII
Data Reduction. 1.Overview 2.The Curse of Dimensionality 3.Data Sampling 4.Binning and Reduction of Cardinality.
EDGE DETECTION IN COMPUTER VISION SYSTEMS PRESENTATION BY : ATUL CHOPRA JUNE EE-6358 COMPUTER VISION UNIVERSITY OF TEXAS AT ARLINGTON.
ECE 8443 – Pattern Recognition LECTURE 10: HETEROSCEDASTIC LINEAR DISCRIMINANT ANALYSIS AND INDEPENDENT COMPONENT ANALYSIS Objectives: Generalization of.
Linear Programming Erasmus Mobility Program (24Apr2012) Pollack Mihály Engineering Faculty (PMMK) University of Pécs João Miranda
O PTIMAL SERVICE TASK PARTITION AND DISTRIBUTION IN GRID SYSTEM WITH STAR TOPOLOGY G REGORY L EVITIN, Y UAN -S HUN D AI Adviser: Frank, Yeong-Sung Lin.
CHAPTER 5 SIGNAL SPACE ANALYSIS
Statistical Decision Theory Bayes’ theorem: For discrete events For probability density functions.
Software Architecture Evaluation Methodologies Presented By: Anthony Register.
Introduction Many organizations use decision rules to alleviate incentive problems as opposed to incentive contracts The principal typically retains some.
OPERATING SYSTEMS CS 3530 Summer 2014 Systems and Models Chapter 03.
Multi-objective Optimization
Multiobjective Optimization for Locating Multiple Optimal Solutions of Nonlinear Equation Systems and Multimodal Optimization Problems Yong Wang School.
1 Optimization Techniques Constrained Optimization by Linear Programming updated NTU SY-521-N SMU EMIS 5300/7300 Systems Analysis Methods Dr.
Neural and Evolutionary Computing - Lecture 9 1 Evolutionary Multiobjective Optimization  Particularities of multiobjective optimization  Multiobjective.
Evolutionary Computing Chapter 12. / 26 Chapter 12: Multiobjective Evolutionary Algorithms Multiobjective optimisation problems (MOP) -Pareto optimality.
Presented by Yu-Shun Wang Advisor: Frank, Yeong-Sung Lin Near Optimal Defense Strategies to Minimize Attackers’ Success Probabilities for networks of Honeypots.
May 2003 SUT Color image segmentation – an innovative approach Amin Fazel May 2003 Sharif University of Technology Course Presentation base on a paper.
OPTIMIZATION PROBLEMS OF ELECTRIC POWER SUPPLY Томский политехнический университет.
Failure Modes, Effects and Criticality Analysis
Methods of multivariate analysis Ing. Jozef Palkovič, PhD.
1 Minimum Bayes-risk Methods in Automatic Speech Recognition Vaibhava Geol And William Byrne IBM ; Johns Hopkins University 2003 by CRC Press LLC 2005/4/26.
OPERATING SYSTEMS CS 3502 Fall 2017
Data Transformation: Normalization
K Nearest Neighbor Classification
REMOTE SENSING Multispectral Image Classification
Heuristic Optimization Methods Pareto Multiobjective Optimization
Multi-Objective Optimization
Cluster Analysis.
Text Categorization Berlin Chen 2003 Reference:
MOEA Testing and Analysis
Information Theoretical Analysis of Digital Watermarking
Implementation of Learning Systems
Multiobjective Optimization
Presentation transcript:

Advisor: Yeong-Sung Lin Presented by Chi-Hsiang Chan 2011/5/23 1

 Introduction  Level Diagrams representation of Pareto Fronts and Sets  Redundancy allocation in a multistate system  Visualization with the Level Diagrams  Applying preferences on the Pareto solutions  Conclusions 2011/5/23 2

 Introduction  Level Diagrams representation of Pareto Fronts and Sets  Redundancy allocation in a multistate system  Visualization with the Level Diagrams  Applying preferences on the Pareto solutions  Conclusions 2011/5/23 3

 Multiobjective problems arise in many reliability-based and risk-informed activities of system design, operation, maintenance and regulation.  There is not a unique, optimal solution satisfying all objectives, but a set of possible solutions because of the conflicting of the several specifications.  The set of optimal solutions in the space of the decision variables is called the Pareto Set.  The region in the space of the values of all objectives defined by all Pareto Set points is called the Pareto Front. 2011/5/23 4

 The solution of a multiobjective optimization problem is found in terms of a discrete approximation of the Pareto Front. DM has to select one or more of preference within the front.  In many instances, the final decision is obtained by group deliberation involved stakeholders and decision makers with technical plus other values.(social and political)  There are some approaches to introduce the DM preferences which guide the solutions selection  Priori  Posteriori  Interactively during the search 2011/5/23 5

 The DM preferences are inserted in the mathematical definition of the decision problem itself in a way to bias the search for optimal solutions in priori methods.  Changing the definition of dominance like in modern MultiObjective Evolutionary Algorithms  Weighting differently the objectives  Assigning reference values and priority levels to the objectives  Assuming a utility function describing the DM behavior and interest in the alternative solutions 2011/5/23 6

 In interactive methods, the DM intervenes during the search  Iterative trial and error  Steering the development of the search by ranking and eliminating alternatives based on indicated preference strengths  Bounding the utility functions based on preference while accounting for uncertainties  In a posteriori methods, the DM applies the preferences at the end of the multiobjective optimization search, after the optimal solutions of the Pareto Front have been found. 2011/5/23 7

 Some examples for the visualization of the Pareto Front and Set:  Scatter diagrams  Parallel coordinates  Interactive decision maps  Level diagrams provide a geometrical visualization of the Pareto Front and Set based on metric distance from an ideal solution point which optimizes all objectives simultaneously. 2011/5/23 8

 In this paper, author apply the Level diagrams analyze the Pareto Front and Set obtained in a system redundancy allocation problem which considered 3 conflicting objectives: system availability to be maximized, system cost and weight to be minimized.  The decision variables define the system redundant configurations by taking discrete values which indicate the numbers of components of the different types in the configuration.  This is the first time that Level Diagrams are applied to a problem with discrete decision variables. 2011/5/23 9

 Introduction  Level Diagrams representation of Pareto Fronts and Sets  Redundancy allocation in a multistate system  Visualization with the Level Diagrams  Applying preferences on the Pareto solutions  Conclusions 2011/5/23 10

 The concept of Level Diagrams is illustrated, taking as reference the relevant literature  Given the vector of decision variables (1) where D is the decision space, and the vector of objective functions, (2) 2011/5/23 11

 The multiobjective problem is stated in the form (3)  Without loss of generality, a multiobjective minimization problem has been considered in (3); a maximization problem can be transformed into a minimization one as follows: (4) 2011/5/23 12

 Dominance and non-dominance is determined by pairwise vector comparisons of the multiobjective values corresponding to the pair of solutions under comparison; specifically, dominates another solution if (5)  The set θ p of non-dominated solutions is called the Pareto Set; the vector J(θ) of the values of the objective functions in correspondence of the solutions θ of the Pareto Set θ p, defines the Pareto Front. 2011/5/23 13

 It is quite difficult to let DM choose the best solution for high dimensional problems. The task can be aided by effectively visualizing the results of the multiobjective optimization.  Level Diagrams represent an interesting visualization tool, which allow classifying the Pareto solutions according to their distance from the ideal solution. 2011/5/23 14

 In general, consider a multiobjective problem in which l objectives are to be minimized and m maximized, with s=l+m. Each objective can be normalized with respect to its minimum or maximum values on the Pareto Front: (6) (7) where 2011/5/23 15

 So that now, (8)  Where: means that the solution θ has the best value for the ith objective. means that the solution θ has the worst value for the ith objective. 2011/5/23 16

 To evaluate the distance to the ideal point, a suitable norm must be introduced. In this paper two norms are considered:  1-norm: (9)  Infinite norm: (10)  The 1-norm takes into account all the objectives; the infinite norm considers only the worst objective. 2011/5/23 17

 The plot of Level Diagrams is done as follows:  Each objective and each decisional variable is plotted separately.  The X-axis corresponds to the objective or the decsional variable in physical units of measurement, Y-axis corresponds to the value of norm. This means that all the plots are synchronized with respect to the Y-axis. 2011/5/23 18

 Introduction  Level Diagrams representation of Pareto Fronts and Sets  Redundancy allocation in a multistate system  Visualization with the Level Diagrams  Applying preferences on the Pareto solutions  Conclusions 2011/5/23 19

 Many system designs require the allocation of redundancies to meet high reliability, but also high cost, weight, etc.  From the system engineering view, the problem is formulated with respect to a number of subsystems, for each of which there are multiple component choices to be allocated in redundancy.  This leads to the well-known redundancy allocation problem (RAP) of which some recent formulations and solution approaches are given. 2011/5/23 20

 A system reliability design problem with three conflicting objectives: system availability to be maximized; system cost and weight to be minimized.  The system is made of u=5 units(subsystems); each unit can be provided with redundancy by selecting components from m i types available in the market, i=1,…,5.  Each component can be 2 states: functioning at nominal capacity or fail.  The types of components available are characterized by their availability, nominal capacity, cost and weight in arbitrary unit. 2011/5/23 21

 Three objective functions:  Availability: (11)  Cost: (12)  Weight: (13) 2011/5/23 22

 The problem has been solved using the MOMS-GA algorithm. The Universal Moment Generating Function(UMGF) was used to compute the multistate system availability (14) where W is the specified demand given, K is the number of possible output performances, p k is the probability of each state of performance, G k is the performance in the kth state, and (15) 2011/5/23 23

 As a result, the system availability depends not only on the components individual reliability, but also on their capacity.  The Pareto Front of 118 points found is replicated in the fig in the objective functions space. 2011/5/23 24

 Introduction  Level Diagrams representation of Pareto Fronts and Sets  Redundancy allocation in a multistate system  Visualization with the Level Diagrams  Applying preferences on the Pareto solutions  Conclusions 2011/5/23 25

2011/5/23 26

 System design configurations of low availability are characterized by small costs and weights and as a result, the values of norms are large; for values of the system availability increasing towards the optimal with respect to all three objectives, after which the increase of cost and weight is such that the norms increase as the point in the Pareto Front moves away form the ideal one, optimal with respect to all three objectives. 2011/5/23 27

 the Level Diagrams of the solutions of the Pareto Front on the right of the minimum are represented. The objectives have been normalized with respect to the minimum values, to compare a range-based sensitivity coefficient defined as (16)  Availability =  Cost =  Weight = /5/23 28

 In the Level Diagram of system availability and 1-norm values, the data present clusters, which shows that same availability can be with different costs and weight. 2011/5/23 29

 The representation of the Pareto Front by means of Level Diagrams has identified the presence of system design configurations of similar values of availability but different cost and weight values. The observations thereby obtained suggest a Pareto Front reduction through the suppression of the configurations with higher values of 1-norm among those with similar values of one objective. 2011/5/23 30

 The analysis of the Pareto Set solutions in terms of the values of the decision variables can provide the DM with information on how system performance can be affected by particular component choices.  In the case study, the configuration is contained in a vector of 29 discrete decision variables; each variable indicates the number of components of that particular type present in the configuration. 2011/5/23 31

2011/5/23 32

 To further analyze those configurations of high availability, to possibly identify relations between components types and system performance, author choose those solution on the right of the ideal point and with ∞-norm above 0.8 of subsystem /5/23 33

 Take component θ 31 for example, as increase of the number of components θ 31 leads to larger values of 1- norm, high capacity but expensive. So that using less capacitated components in subsystem 3 and other high capacity components in other subsystem will be better choice for less cost and maybe same availability.  Indeed, different performances of the selected high- availability configuration solutions can be attributed mainly to the system cost because this objective (12) and (6) presents values in a much wider range than the normalized weight objective (13)and (6). 2011/5/23 34

 Dually, considering the solution on the left of the ideal point and with ∞-norm above 0.8, we focus on low availability configurations; the number of components of the same type is rarely larger than one and almost only the components with the highest capacities are present in these configurations, in order to achieve reasonably high availabilities keeping system weight and cost low. 2011/5/23 35

 A Pareto Front less crowded of solutions can be beneficial to the DM who must analyze the different solutions and evaluate the preferred one.  One way of proceeding to a reduction of the solutions represented in the Front is that of focusing on the values of one objective function and reduce to few solutions the clusters of solutions of approximately equal availability and different cost and weight. 2011/5/23 36

 To systematically perform the Pareto Front reduction, a criterion must be established to define when two solutions on the Level Diagrams can be considered vertically aligned in a cluster of equal value of an objective.  To this purpose, consider a vectorJ 1 of length n j containing all the values of the availability objective of the Front sorted in ascending order, i min be J 1 of the optimal, ideal point. norm1 be the vector containing the values of the 1- norm for each solution. 2011/5/23 37

 Since the difference of the availability values of two successively ranked solution, two distinct criteria are needed to decide whether two solutions can be considered vertically aligned in a cluster on the left and right of the minimum value of the norm.  Then, in the vertical cluster alignment solutions with a higher value of the 1-norm are discarded. 2011/5/23 38

 In the work, the solution θ(i+1) corresponding to J 1 (i+1) and to norm1(i+1), belongs to a vertical cluster alignment if the previous solution,θ(i) is such that (17) (18)  The solution θ(i) is discarded if norm 1(i+1) < norm 1(i) (19) Discarded θ(i+1) if norm 1 (i+1) > norm 1(i) (20) 2011/5/23 39

 The Pareto Front is reduced from 118 to 52, with the clusters indeed reduced to individual best points. The reduced Pareto Front can serve as starting point for applying preferences on the solutions, guiding the selection to the final system configuration. 2011/5/23 40

 Introduction  Level Diagrams representation of Pareto Fronts and Sets  Redundancy allocation in a multistate system  Visualization with the Level Diagrams  Applying preferences on the Pareto solutions  Conclusions 2011/5/23 41

 To verify the usability of the reduced Pareto Front for preference assignment and solution selection, it has to investigate whether applying DM preferences on the original Front and the reduced one produces comparable results.  To apply preferences, on the l objective to be minimized the solutions are classified by assigning thresholds 2011/5/23 42

 And m objectives to be maximized, the classification is  To evaluate each solution, a scoring procedure is established according to the “one vs. others” objective rule: full reduction for one objective across a given region is preferred over full reduction for all the other objective across the next best region. i.e. (U U U) vs (D D HU) 2011/5/23 43

 The numerical scoring procedure used to qualify the solutions with respect to the level of preference of the objective value they achieve: (21) s=3 is the number of objectives and k=6 is the number of class  Score=(0,1,4,13,40,121)  (0.951, , 322.4) => =134  The lowest the best 2011/5/23 44

 To compare the results of applying preferences on the original and reduced Pareto Front, we consider the 5 best points (with smallest score) in the 2 cases.  Showing that the reduction process does not compromise significantly the result of applying preferences. 2011/5/23 45

 Introduction  Level Diagrams representation of Pareto Fronts and Sets  Redundancy allocation in a multistate system  Visualization with the Level Diagrams  Applying preferences on the Pareto solutions  Conclusions 2011/5/23 46

 In this paper, we have applied Level Diagrams to visualize and analyze the Pareto Front and Set resulting from the solution of redundancy allocation for a system to be designed for maximum availability with minimum cost and weight.  The contribution of the work include:  Application of Level Diagrams to a reliability problem.  Implementation of the Level Diagrams in a problem with discrete decision variables.  Sensitivity analysis of the Pareto Front whose findings can aid the DM in choosing the best trade-off solution.  Partitioning procedure aimed at identifying relationships among the decision values and objective functions  Procedure for Pareto Front reduction. 2011/5/23 47

2011/5/23 48