S ystems Analysis Laboratory Helsinki University of Technology Using Intervals for Global Sensitivity and Worst Case Analyses in Multiattribute Value Trees Mats Lindstedt Raimo P. Hämäläinen Jyri Mustajoki Systems Analysis Laboratory Helsinki University of Technology

S ystems Analysis Laboratory Helsinki University of Technology Outline Multiattribute value tree analysis (MAVT) Framework for interval sensitivity analysis Use of Preference Programming for interval sensitivity analysis in MAVT Preference Programming framework Practical issues related to the analysis An example on nuclear emergency management Conclusions

S ystems Analysis Laboratory Helsinki University of Technology Multiattribute Value Tree Analysis (MAVT) Analysis of problems with m alternatives and n attributes Overall value of alternative x: w i is the weight of attribute i, and  w i = 1 v i (x i ) is the rating (or score) of alternative x with respect to attribute i Attributes can be structured hierarchically

S ystems Analysis Laboratory Helsinki University of Technology Value tree

S ystems Analysis Laboratory Helsinki University of Technology Sensitivity analyses in MAVT One-way sensitivity analysis Imprecision in a single parameter at a time Simulation approach Imprecision in multiple parameters simultaneously Distributions over parameters needed Need of conceptually simple multi- parameter analysis  Interval sensitivity analysis

S ystems Analysis Laboratory Helsinki University of Technology Interval sensitivity analysis General framework (Rios Insua and French, 1991) : Variation allowed in several model parameters simultaneously Constraints on the parameters to set the range of allowed variation Changes in dominance relations studied to see how sensitive the model is to variation Worst case analysis All the possible parameter combinations within the given constraints allowed

S ystems Analysis Laboratory Helsinki University of Technology Preference Programming A family of methods to include imprecision in MAVT with constraints on model parameters Provides tools to apply interval sensitivity analysis in hierarchical multi-attribute value trees

S ystems Analysis Laboratory Helsinki University of Technology The PAIRS method (Salo and Hämäläinen, 1992) A Preference Programming method Imprecise statements with intervals on Attribute weight ratios On any level of the value tree E.g. 1  w 1 / w 2  5  Feasible region for the weights, S The ratings of the alternatives E.g. 0.6  v 1 (x 1 )  0.8

S ystems Analysis Laboratory Helsinki University of Technology The PAIRS method  Intervals for the overall values Lower bound for the overall value of x: Linear programming (LP) problem Upper bound correspondingly Overall value interval for x: [v(x), v(x)]

S ystems Analysis Laboratory Helsinki University of Technology Dominance Alternative x dominates alternative y if x has higher overall value than y on each allowed combination of weights and ratings, i.e. if Can also exist on overlapping overall value intervals

S ystems Analysis Laboratory Helsinki University of Technology Possible loss of value Indicates how much the DM can at most lose in the overall value when choosing alternative x * : where X is the set of all alternatives To support analysis between non- dominated alternatives

S ystems Analysis Laboratory Helsinki University of Technology Computational efficiency In PAIRS, LP problems are separately solved on each branch of the value tree LP problems need to be solved only on the those branches in which the changes are made, and upwards thereof Usually only a few attributes on each branch of the value tree (seldom over 10)  Overall value intervals and dominance relations can be quickly updated  Makes interactive analysis possible

S ystems Analysis Laboratory Helsinki University of Technology WINPRE Software (Hämäläinen and Helenius, 1997)

S ystems Analysis Laboratory Helsinki University of Technology Different ways to assign intervals Worst case analysis Intervals to cover all the possible values It may happen that only few or no alternatives become dominated What-if analysis What would be the overall intervals and dominances, if these intervals were applied Interactive software needed E.g. to study how the dominance relations change when varying the intervals

S ystems Analysis Laboratory Helsinki University of Technology Different ways to assign intervals Error ratios on all the weights ratios Each weight ratio is allowed to be at maximum e.g. 2 times as much as the initial ratio Quick way to set intervals Confidence intervals E.g. 95% confidence intervals Interpretation of the overall intervals difficult Overall intervals are not true confidence intervals Distributions of values are needed to get these  Simulation approach

S ystems Analysis Laboratory Helsinki University of Technology Origins of imprecision should be considered Any allowed changes within the rating intervals assumed to be independent of each other Weight ratio intervals describe imprecision in the relative importances between the related attribute ranges E.g. we know that A costs twice as much as B, but we do not know the magnitude of the costs  Imprecision should be related into the weight of this attribute

S ystems Analysis Laboratory Helsinki University of Technology An example (Mustajoki et al. 2004) Countermeasures for milk production in a case of a hypothetical nuclear accident

S ystems Analysis Laboratory Helsinki University of Technology Alternatives Combinations of different countermeasures for weeks 2-5 and 6-12 after the accident: - - -= Do nothing Fod=Provide clean fodder to cattle Prod=Production change from milk to e.g. cheese Ban=Ban the milk E.g. Fod+Fod = providing clean fodder for both periods

S ystems Analysis Laboratory Helsinki University of Technology No imprecision  Pointwise overall values Fod+Fod is the most preferred alternative

S ystems Analysis Laboratory Helsinki University of Technology Imprecision in weight assessment Error ratio 2 on each weight ratio Fod+Fod still dominates all the other alternatives

S ystems Analysis Laboratory Helsinki University of Technology Imprecision in value estimation ±10 % of the rating interval in each socio- psychological attribute Fod+Fod dominates all the other alternatives except Prod+Fod

S ystems Analysis Laboratory Helsinki University of Technology Imprecision both in weight assessment and value estimation is the only dominated alternative

S ystems Analysis Laboratory Helsinki University of Technology Results Imprecision in either weights or ratings  No considerable effects on dominances Imprecision simultaneously in both  Almost all the dominances disappear The analysis can be continued by interactively studying with which intervals the dominance relations change The DM can e.g. tighten the intervals and study in which points some alternative becomes dominated

S ystems Analysis Laboratory Helsinki University of Technology Conclusions Interval sensitivity analysis with Preference Programming: Imprecision simultaneously in all the model parameters Conceptually simple Computationally efficient Flexible  different ways to assign imprecision intervals WINPRE software available for interactive analyses

S ystems Analysis Laboratory Helsinki University of Technology References Hämäläinen, R.P., Decisionarium - Aiding Decisions, Negotiating and Collecting Opinions on the Web, Journal of Multi-Criteria Decision Analysis 12, Hämäläinen, R.P., Decisionarium – Global Space for Decision Support. Systems Analysis Laboratory, Helsinki University of Technology. ( Hämäläinen, R.P., Helenius, J., WINPRE - Workbench for Interactive Preference Programming. Computer software. Systems Analysis Laboratory, Helsinki University of Technology. (Downloadable at Lindstedt, M., Hämäläinen, R.P., Mustajoki, J Using Intervals for Global Sensitivity Analyses in Multiattribute Value Trees, in M. Köksalan and S. Zionts (eds.), Lecture Notes in Economics and Mathematical Systems 507, Mustajoki, J., Hämäläinen, R.P., Sinkko, K., Interactive Computer Support in Decision Conferencing: Two Cases on Off-site Nuclear Emergency Management. Manuscript.

S ystems Analysis Laboratory Helsinki University of Technology References Proll, L.G., Salhi, A., Rios Insua, D., Improving an optimization-based framework for sensitivity analysis in multi-criteria decision-making. Journal of Multi-Criteria Decision Analysis 10, 1-9. Rios Insua, D., French, S., A framework for sensitivity analysis in discrete multi-objective decision-making. European Journal of Operational Research 54, Salo, A., Hämäläinen, R.P., Preference assessment by imprecise ratio statements. Operations Research 40(6), Salo, A., Hämäläinen, R.P., Preference programming through approximate ratio comparisons. European Journal of Operational Research 82, Salo, A., Hämäläinen, R.P., Preference Ratios in Multiattribute Evaluation (PRIME) - Elicitation and Decision Procedures under Incomplete Information, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 31(6), Salo, A., Hämäläinen, R.P., Preference Programming. Manuscript. (Downloadable at