Decision support by interval SMART/SWING Methods to incorporate uncertainty into multiattribute analysis Ahti Salo Jyri Mustajoki Raimo P. Hämäläinen.

Slides:



Advertisements
Similar presentations
Teknillinen korkeakoulu Systeemianalyysin laboratorio 1 Graduate school seminar Rank-Based DEA-Efficiency Analysis Samuli Leppänen Systems.
Advertisements

Multi‑Criteria Decision Making
1 Helsinki University of Technology Systems Analysis Laboratory Robust Portfolio Modeling for Scenario-Based Project Appraisal Juuso Liesiö, Pekka Mild.
Multiobjective Value Analysis.  A procedure for ranking alternatives and selecting the most preferred  Appropriate for multiple conflicting objectives.
1 Ratio-Based Efficiency Analysis Antti Punkka and Ahti Salo Systems Analysis Laboratory Aalto University School of Science P.O. Box 11100, Aalto.
1PRIME Decisions - An Interactive Tool for Value Tree Analysis Helsinki University of Technology Systems Analysis Laboratory PRIME Decisions - An Interactive.
Helsinki University of Technology Systems Analysis Laboratory RPM – Robust Portfolio Modeling for Project Selection Pekka Mild, Juuso Liesiö and Ahti Salo.
Multiobjective Analysis. An Example Adam Miller is an independent consultant. Two year’s ago he signed a lease for office space. The lease is about to.
Helsinki University of Technology Systems Analysis Laboratory RICHER – A Method for Exploiting Incomplete Ordinal Information in Value Trees Antti Punkka.
1 Helsinki University of Technology Systems Analysis Laboratory Multi-Criteria Capital Budgeting with Incomplete Preference Information Pekka Mild, Juuso.
MIS 463 Analytic Hierarchy Process. 2 The Analytic Hierarchy Process (AHP) It is popular and widely used method for multi-criteria decision making. Allows.
S ystems Analysis Laboratory Helsinki University of Technology 1 We have the tools How to attract the people? Creating a culture of Web-based participation.
Elementary hypothesis testing
Problem Solving. References  Smart Choices, John S. Hammond, Ralph L. Keeney and Howard Raiffa, Harvard Business School Press, 1999  The Thinking Manager’s.
Elementary hypothesis testing Purpose of hypothesis testing Type of hypotheses Type of errors Critical regions Significant levels Hypothesis vs intervals.
1 Mutli-Attribute Decision Making Eliciting Weights Scott Matthews Courses: /
Using ranking and DCE data to value health states on the QALY scale using conventional and Bayesian methods Theresa Cain.
S ystems Analysis Laboratory Helsinki University of Technology A Preference Programming Approach to Make the Even Swaps Method Even Easier Jyri Mustajoki.
S ystems Analysis Laboratory Helsinki University of Technology Decision Support for the Even Swaps Process with Preference Programming Jyri Mustajoki Raimo.
S ystems Analysis Laboratory Helsinki University of Technology Using Intervals for Global Sensitivity and Worst Case Analyses in Multiattribute Value Trees.
1 Helsinki University of Technology Systems Analysis Laboratory Robust Portfolio Selection in Multiattribute Capital Budgeting Pekka Mild and Ahti Salo.
1 S ystems Analysis Laboratory Helsinki University of Technology Decision and Negotiation Support in Multi-Stakeholder Development of Lake Regulation Policy.
Introduction to Value Tree Analysis
ELearning / MCDA Systems Analysis Laboratory Helsinki University of Technology Introduction to Value Tree Analysis eLearning resources / MCDA team Director.
Helsinki University of Technology Systems Analysis Laboratory Ahti Salo and Antti Punkka Systems Analysis Laboratory Helsinki University of Technology.
1 Helsinki University of Technology Systems Analysis Laboratory Rank-Based Sensitivity Analysis of Multiattribute Value Models Antti Punkka and Ahti Salo.
1 1 Slide © 2004 Thomson/South-Western Chapter 17 Multicriteria Decisions n Goal Programming n Goal Programming: Formulation and Graphical Solution and.
1 Helsinki University of Technology Systems Analysis Laboratory RPM-Explorer - A Web-based Tool for Interactive Portfolio Decision Analysis Erkka Jalonen.
Helsinki University of Technology Systems Analysis Laboratory Determining cost-effective portfolios of weapon systems Juuso Liesiö, Ahti Salo and Jussi.
S ystems Analysis Laboratory Helsinki University of Technology 1 Raimo P. Hämäläinen Systems Analysis Laboratory Helsinki University of Technology
Human Resource Management Lecture 14 MGT 350. Last Lecture Holland Vocational Preferences Three major components – People have varying occupational preferences.
S ystems Analysis Laboratory Helsinki University of Technology Observations from computer- supported Even Swaps experiments using the Smart-Swaps software.
1 Raimo P. Hämäläinen Systems Analysis Laboratory Aalto University, School of Science December, 2010 Aiding Decisions, Negotiating and.
S ystems Analysis Laboratory Helsinki University of Technology 1 Raimo P. Hämäläinen Jyri Mustajoki Systems Analysis Laboratory Helsinki University of.
1 Helsinki University of Technology Systems Analysis Laboratory Selecting Forest Sites for Voluntary Conservation in Finland Antti Punkka and Ahti Salo.
S ystems Analysis Laboratory Helsinki University of Technology Practical dominance and process support in the Even Swaps method Jyri Mustajoki Raimo P.
Multi-Criteria Analysis - preference weighting. Defining weights for criteria Purpose: to express the importance of each criterion relative to other criteria.
Helsinki University of Technology Systems Analysis Laboratory Antti Punkka and Ahti Salo Systems Analysis Laboratory Helsinki University of Technology.
Helsinki University of Technology Systems Analysis Laboratory 1DAS workshop Ahti A. Salo and Raimo P. Hämäläinen Systems Analysis Laboratory Helsinki.
Helsinki University of Technology Systems Analysis Laboratory Portfolio and Scenario Analysis in the Cost-Effectiveness Evaluation of Weapon Systems Jussi.
S ystems Analysis Laboratory Helsinki University of Technology 1 Decision Analysis Raimo P. Hämäläinen Systems Analysis Laboratory Helsinki University.
Helsinki University of Technology Systems Analysis Laboratory Incomplete Ordinal Information in Value Tree Analysis Antti Punkka and Ahti Salo Systems.
1 S ystems Analysis Laboratory Helsinki University of Technology Master’s Thesis Antti Punkka “ Uses of Ordinal Preference Information in Interactive Decision.
1 Ratio-Based Efficiency Analysis (REA) Antti Punkka and Ahti Salo Systems Analysis Laboratory Aalto University School of Science and Technology P.O. Box.
S ystems Analysis Laboratory Helsinki University of Technology 15th MCDM conference - Ankara Mats Lindstedt / 1 Using Intervals for Global.
Helsinki University of Technology Systems Analysis Laboratory EURO 2009, Bonn Supporting Infrastructure Maintenance Project Selection with Robust Portfolio.
ON ELICITATION TECHNIQUES OF NEAR-CONSISTENT PAIRWISE COMPARISON MATRICES József Temesi Department of Operations Research Corvinus University of Budapest,
Mustajoki, Hämäläinen and Salo Decision support by interval SMART/SWING / 1 S ystems Analysis Laboratory Helsinki University of Technology Decision support.
Public transport quality elements – What really matters for users? By Dimitrios Papaioannou and Luis Miguel Martinez Presentation for the 20 th ECOMM in.
Path Dependence in Operational Research
Analysis Manager Training Module
preference statements
Mikko Harju*, Juuso Liesiö**, Kai Virtanen*
Flexible and Interactive Tradeoff Elicitation Procedure
Aiding Decisions and Collecting Opinions on the Web
Tuomas J. Lahtinen, Raimo P. Hämäläinen, Cosmo Jenytin
Role and Potential of TAs for Industrial Scheduling Problems
Improvement Selection:
MBA, PhD student Behavioral studies of Decision making
Aiding Decisions and Collecting Opinions on the Web
Constructive Cost Model
Incomplete ordinal information in value tree analysis and comparison of DMU’s efficiency ratios with incomplete information Antti Punkka supervisor Prof.
D E C I S I O N A R I U M g l o b a l s p a c e f o r d e c i s i o n s u p p o r t group decision making multicriteria decision analysis group.
Raimo P. Hämäläinen Systems Analysis Laboratory
Games with Incomplete Preferences
Juuso Liesiö, Pekka Mild and Ahti Salo Systems Analysis Laboratory
Introduction to Value Tree Analysis
Chapter 12 Analyzing Semistructured Decision Support Systems
FITradeoff Method (Flexible and Interactive Tradeoff)
Presentation transcript:

Decision support by interval SMART/SWING Methods to incorporate uncertainty into multiattribute analysis Ahti Salo Jyri Mustajoki Raimo P. Hämäläinen Systems Analysis Laboratory Helsinki University of Technology www.sal.hut.fi

Multiattribute value tree analysis Value of an alternative x: wi is the weight of attribute i vi(xi) is the component value of an alternative x with respect to attribute i

Ratio methods in weight elicitation SWING 100 points to the most important attribute range change from lowest level to the highest level Fewer points to other attributes reflecting their relative importance Weights by normalizing the sum to one SMART 10 points to the least important attribute otherwise similar

Questions of interest Role of the reference attribute What if other than worst/best = SMART/SWING? How to incorporate preferential uncertainty? Uncertain replies modelled as intervals of ratios instead of pointwise estimates Are there behavioral or procedural benefits?

Generalized SMART and SWING Allow: 1. the reference attribute to be any attribute 2. the DM to reply with intervals instead of exact point estimates 3. also the reference attribute to have an interval  A family of Interval SMART/SWING methods Mustajoki, Hämäläinen and Salo, 2001

Generalized SMART and SWING

Some interval methods Preference Programming (Interval AHP) Arbel, 1989; Salo and Hämäläinen 1995 PAIRS (Preference Assessment by Imprecise Ratio Statements) Salo and Hämäläinen, 1992 PRIME (Preference Ratios In Multiattribute Evaluation) Salo and Hämäläinen, 1999

Classification of ratio methods

Interval SMART/SWING = Simple PAIRS Constraints on any weight ratios  Feasible region S Interval SMART/SWING Constraints from the ratios of the points

1. Relaxing the reference attribute Reference attribute allowed to be any attribute Compare to direct rating Weight ratios calculated as ratios of the given points  Technically no difference to SMART and SWING Possibility of behavioral biases How to guide the DM? Experimental research needed

2. Interval judgments about ratio estimates Interval SMART/SWING The reference attribute given any (exact) number of points Points to non-reference attributes given as intervals

Interval judgments about ratio estimates Max/min ratios of points constrain the feasible region of weights Can be calculated with PAIRS Pairwise dominance A dominates B pairwisely, if the value of A is greater than the value of B for every feasible weight combination

Choice of the reference attribute Only the weight ratio constraints including the reference attribute are given  Feasible region depends on the choice of the reference attribute Example Three attributes: A, B, C 1) A as reference attribute 2) B as reference attribute

Example: A as reference A given 100 points Point intervals given to the other attributes: 50-200 points to attribute B 100-300 points to attribute C Weight ratio between B and C not yet given by the DM

Feasible region S

Example: B as reference A given 50-200 points Ratio between A and B as before The DM gives a pointwise ratio between B and C = 200 points for C Less uncertainty in results  smaller feasible region

Feasible region S'

Which attribute to choose as a reference attribute? Attribute agaist which one can give the most precise comparisons Easily measurable attribute, e.g. money The aim is to eliminate the remaining uncertainty as much as possible

3. Using an interval on the reference attribute Meaning of the intervals Uncertainty related to the measurement scale of the attribute not to the ratio between the attributes (as when using an pointwise reference attribute) Ambiguity of the attribute itself Feasible region from the max/min ratios Every constraint is bounding the feasible region

Interval reference A: 50-100 points B: 50-100 points C: 100-150 points

Implies additional constraints Feasible region S:

Using an interval on the reference attribute Are DMs able to compare against intervals? Two helpful procedures: 1. First give points with pointwise reference attribute and then extend these to intervals 2. Use of external anchoring attribute, e.g. money

WINPRE software Weighting methods Interactive graphical user interface Preference programming PAIRS Interval SMART/SWING Interactive graphical user interface Instantaneous identification of dominance  Interval sensitivity analysis Available free for academic use: www.decisionarium.hut.fi

Vincent Sahid's job selection example (Hammond, Keeney and Raiffa, 1999)

Consequences table

Imprecise rating of the alternatives

Interval SMART/SWING weighting

Value intervals Jobs C and E dominated  Can be eliminated Process continues by narrowing the ratio intervals of attribute weights Easier as Jobs C and E are eliminated

Conclusions Interval SMART/SWING An easy method to model uncertainty by intervals Linear programming algorithms involved Computational support needed WINPRE software available for free How do the DMs use the intervals? Procedural and behavioral aspects should be addressed

References Arbel, A., 1989. Approximate articulation of preference and priority derivation, European Journal of Operational Research 43, 317-326. Hammond, J.S., Keeney, R.L., Raiffa, H., 1999. Smart Choices. A Practical Guide to Making Better Decisions, Harvard Business School Press, Boston, MA. Mustajoki, J., Hämäläinen, R.P., Salo, A., 2005. Decision support by interval SMART/SWING – Incorporating imprecision in the SMART and SWING methods, Decision Sciences, 36(2), 317-339. Salo, A., Hämäläinen, R.P., 1992. Preference assessment by imprecise ratio statements, Operations Research 40 (6), 1053-1061. Salo, A., Hämäläinen, R.P., 1995. Preference programming through approximate ratio comparisons, European Journal of Operational Research 82, 458-475. Salo, A., Hämäläinen, R.P., 2001. Preference ratios in multiattribute evaluation (PRIME) - elicitation and decision procedures under incomplete information. IEEE Trans. on SMC 31 (6), 533-545. Downloadable publications at www.sal.hut.fi/Publications