SOME PRACTICAL ISSUES IN COMPOSITE INDEX CONSTRUCTION Lino Briguglio and Nadia Farrugia Department of Economics, University of Malta Prepared for the INTERNATIONAL.

Slides:



Advertisements
Similar presentations
Autocorrelation and Heteroskedasticity
Advertisements

Random Assignment Experiments
Operations Management For Competitive Advantage © The McGraw-Hill Companies, Inc., 2001 C HASE A QUILANO J ACOBS ninth edition 1Forecasting Operations.
Marketing Research Aaker, Kumar, Day and Leone Tenth Edition Instructor’s Presentation Slides 1.
ECONOMIC VULNERABILITY AND RESILIENCE OF SMALL STATES By Lino Briguglio and Gordon Cordina University of Malta Prepared for the conference “Small States.
CONCEPTUAL ISSUES IN CONSTRUCTING COMPOSITE INDICES Nadia Farrugia Department of Economics, University of Malta Paper prepared for the INTERNATIONAL CONFERENCE.
Chapter 10 Simple Regression.
Regression with a Binary Dependent Variable. Introduction What determines whether a teenager takes up smoking? What determines if a job applicant is successful.
Aaker, Kumar, Day Ninth Edition Instructor’s Presentation Slides
Chapter 11 Multiple Regression.
Edpsy 511 Homework 1: Due 2/6.
1 Econometric Load Forecasting Peak and Energy Forecast 06/14/2005 Econometric Load Forecasting Peak and Energy Forecast 06/14/2005.
1 1 Slide © 2003 South-Western/Thomson Learning™ Slides Prepared by JOHN S. LOUCKS St. Edward’s University.
VARIABILITY. PREVIEW PREVIEW Figure 4.1 the statistical mode for defining abnormal behavior. The distribution of behavior scores for the entire population.
Correlation and Regression Analysis
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Slides by JOHN LOUCKS & Updated by SPIROS VELIANITIS.
Understanding Research Results
Marketing Research Aaker, Kumar, Day Seventh Edition Instructor’s Presentation Slides.
CSCI Research Methods HO 6 © Houman Younessi 2012 Lecture 6 Quantitative Procedures(1) Research variables: Every research project – irrespective.
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Simple Linear Regression Analysis Chapter 13.
ANCOVA Lecture 9 Andrew Ainsworth. What is ANCOVA?
Hypothesis Testing in Linear Regression Analysis
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 12 Describing Data.
Descriptive Statistics Used to describe the basic features of the data in any quantitative study. Both graphical displays and descriptive summary statistics.
THE VULNERABILITY INDEX Lino Briguglio University of Malta Inter-regional Preparatory Meeting for the World Summit for Sustainable Development Singapore,
Portfolio Management-Learning Objective
Lecture Presentation Software to accompany Investment Analysis and Portfolio Management Seventh Edition by Frank K. Reilly & Keith C. Brown Chapter 7.
Some Background Assumptions Markowitz Portfolio Theory
Discriminant Function Analysis Basics Psy524 Andrew Ainsworth.
BPS - 3rd Ed. Chapter 211 Inference for Regression.
1 1 Slide © 2005 Thomson/South-Western Slides Prepared by JOHN S. LOUCKS St. Edward’s University Slides Prepared by JOHN S. LOUCKS St. Edward’s University.
1 1 Slide © 2007 Thomson South-Western. All Rights Reserved OPIM 303-Lecture #9 Jose M. Cruz Assistant Professor.
1 1 Slide © 2007 Thomson South-Western. All Rights Reserved Chapter 13 Multiple Regression n Multiple Regression Model n Least Squares Method n Multiple.
1 1 Slide © 2012 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole.
1 1 Slide Multiple Regression n Multiple Regression Model n Least Squares Method n Multiple Coefficient of Determination n Model Assumptions n Testing.
Introduction Multilevel Analysis
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Chapter 15 Multiple Regression n Multiple Regression Model n Least Squares Method n Multiple.
Instrumentation (cont.) February 28 Note: Measurement Plan Due Next Week.
Chapter 13 Analysis of Variance (ANOVA) PSY Spring 2003.
Correlation & Regression
Operations Management For Competitive Advantage 1Forecasting Operations Management For Competitive Advantage Chapter 11.
Investment Analysis and Portfolio Management First Canadian Edition By Reilly, Brown, Hedges, Chang 6.
Handbook on Residential Property Price Indices Chapter 5: Methods Jan de Haan UNECE/ILO Meeting, May 2010.
Forecasting Operations Management For Competitive Advantage.
© Copyright McGraw-Hill 2000
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
Chapter 13 Multiple Regression
Lecture 12: Cox Proportional Hazards Model
Eurostat – Unit D5 Key indicators for European policies Third International Seminar on Early Warning and Business Cycle Indicators Annotated outline of.
© 2011 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part, except for use as permitted in a license.
DEVELOPED BY MARY BETH FURST ASSOCIATE PROFESSOR, BUCO DIVISION AMY CHASE MARTIN DIRECTOR OF FACULTY DEVELOPMENT AND INSTRUCTIONAL MEDIA UNDERSTANDING.
BPS - 5th Ed. Chapter 231 Inference for Regression.
Chapter 4 Variability PowerPoint Lecture Slides Essentials of Statistics for the Behavioral Sciences Seventh Edition by Frederick J Gravetter and Larry.
Welcome to MM305 Unit 5 Seminar Dr. Bob Forecasting.
Stats Methods at IC Lecture 3: Regression.
MATH-138 Elementary Statistics
CORRELATION.
Aaker, Kumar, Day Ninth Edition Instructor’s Presentation Slides
Kakhramon Yusupov June 15th, :30pm – 3:00pm Session 3
Introduction to the General Linear Model (GLM)
Stats Club Marnie Brennan
CHAPTER 29: Multiple Regression*
Prepared by Lee Revere and John Large
Regression Models - Introduction
1/18/2019 ST3131, Lecture 1.
Basic Practice of Statistics - 3rd Edition Inference for Regression
Regression & Correlation (1)
3.2. SIMPLE LINEAR REGRESSION
Correlation & Regression
Data analysis LO: Identify and apply different methods of measuring central tendencies and dispersion.
Presentation transcript:

SOME PRACTICAL ISSUES IN COMPOSITE INDEX CONSTRUCTION Lino Briguglio and Nadia Farrugia Department of Economics, University of Malta Prepared for the INTERNATIONAL CONFERENCE ON SMALL STATES AND ECONOMIC RESILIENCE Organised by the Commonwealth Secretariat, London and the Islands and Small States Institute of the Foundation for International Studies at the University of Malta VALLETTA, MALTA April 2007

Layout 1. Introduction 2. Normalisation: Rescaling Formula 3. Weighting: Regression Method 4. Imputation of Missing Data 5. Scoring on a Multi-Point Mapping Scale 6. Conclusion

1. Introduction This presentation discusses some of the methodological approaches commonly used in constructing composite indices. This presentation discusses some of the methodological approaches commonly used in constructing composite indices. The main problems encountered relate to: (1) normalisation procedures (2) weighting procedures (3) missing data, and (4) unavailability of quantitative observations. The main problems encountered relate to: (1) normalisation procedures (2) weighting procedures (3) missing data, and (4) unavailability of quantitative observations. There are variant methodologies, other than the ones described in this presentation. There are variant methodologies, other than the ones described in this presentation.

2. Normalisation: The Rescaling Formula Components (sub-indices) of a composite index are often measured in different units and so straightforward summation would not be valid. Components (sub-indices) of a composite index are often measured in different units and so straightforward summation would not be valid. The Re-scaling formula for a particular observation is: The Re-scaling formula for a particular observation is:R=(X-MinX)/(MaxX-MinX) Where: R is the rescaled observation X is the actual observation Min and Max are the Minimum and Maximum In this way the observation is rescaled to take a value between 0 and 1. This is done for all the observations of a particular component of the index. In this way the observation is rescaled to take a value between 0 and 1. This is done for all the observations of a particular component of the index. The sub-indices are then summed up using a weighting system. The sub-indices are then summed up using a weighting system.

Example: Rescaling Formula

Comments on the Rescaling Formula This procedure is commonly used. This procedure is commonly used. It is the procedure used in the Economic Resilience. Index computed by the University of Malta. It is the procedure used in the Economic Resilience. Index computed by the University of Malta. It is also used in the Human Development Index. It is also used in the Human Development Index. Its main defect is that the distribution of the normalised variables are heavily influenced by outlier observations. Its main defect is that the distribution of the normalised variables are heavily influenced by outlier observations.

3. Weighting Very often the components (sub-indices) are assigned equal weights to compute an average. Very often the components (sub-indices) are assigned equal weights to compute an average. Sometimes unequal weights are assigned on the basis of prior knowledge or expert views. Sometimes unequal weights are assigned on the basis of prior knowledge or expert views. It is often difficult to use a scientific method to assign weights in composite indices. It is often difficult to use a scientific method to assign weights in composite indices. Atkins et al use the regression method approach as described in the next slide. Atkins et al use the regression method approach as described in the next slide.

Weighting: Regression Method Weighting: Regression Method The basic assumption is that a dependent variable can be found as a proxy for the composite index. The basic assumption is that a dependent variable can be found as a proxy for the composite index. This is then regressed on a number of explanatory variables which represent the index components. This is then regressed on a number of explanatory variables which represent the index components. It lets the data produce the weights and does not require normalisation of the observations. It lets the data produce the weights and does not require normalisation of the observations. The weights for averaging the components of the index are taken as the coefficients on the explanatory variables of the estimated equation. The weights for averaging the components of the index are taken as the coefficients on the explanatory variables of the estimated equation. This procedure is used in the computation of the Commonwealth Vulnerability Index. This procedure is used in the computation of the Commonwealth Vulnerability Index.

Example: Weighting Regression Method Income volatility = Susceptibility to environmental events and hazards + Economic Exposure + Diversification Incvol= (a regression constant) Hazards Economic exposure Diversification

4. Imputation of Missing Data Sometimes data for certain countries is missing. One approach is to use the regression method to impute the missing data. One approach is to use the regression method to impute the missing data. A cross section regression is run among the countries for which complete data is available. A cross section regression is run among the countries for which complete data is available. Two variables are used in the regression, namely (a) the average of all the components and (b) the average of all the components less that where data is missing. Two variables are used in the regression, namely (a) the average of all the components and (b) the average of all the components less that where data is missing. This is done in order to find out how the omission of the survey data affects the area rating. This is done in order to find out how the omission of the survey data affects the area rating.

Imputation of Missing Data The regression estimates are then used to adjust the averages for countries with a missing component. The regression estimates are then used to adjust the averages for countries with a missing component. While these statistical adjustments enhance the overall comparability among the countries, comparisons between the nations that have the complete data set and the nations that do not should be made with a degree of caution. While these statistical adjustments enhance the overall comparability among the countries, comparisons between the nations that have the complete data set and the nations that do not should be made with a degree of caution. This approach is used by the Economic Freedom of the World Index. This approach is used by the Economic Freedom of the World Index.

Example: Imputing Missing Observation The regression equation is The regression equation is AVGX1-5 = AVGX1-4

Comment on Missing Data The main defect of this approach is that for every country the missing observation is conditioned by the observations in other countries.

5. Scoring on a Mapping Scale This involves categorising an occurrence (in terms of intensity or frequency) along a scale of say 1 to 7 with 1 being the lowest possible occurrence and 7 the highest possible. This involves categorising an occurrence (in terms of intensity or frequency) along a scale of say 1 to 7 with 1 being the lowest possible occurrence and 7 the highest possible. The wider the spread of the scale, the more possible it will be to derive meaningful standard deviations of the averages obtained. Usually 5- or 7-point scale is used. The wider the spread of the scale, the more possible it will be to derive meaningful standard deviations of the averages obtained. Usually 5- or 7-point scale is used Absent Very Rare RareAverage Moderately higher than average frequency Markedly higher than average frequency Highest possible frequency

Scoring on a Mapping Scale This approach is very useful when data is qualitative, and when the researcher desires to transform it into a quantitative format. This approach is very useful when data is qualitative, and when the researcher desires to transform it into a quantitative format. It also permits non-linearity (exponential, U- or S-shaped) e.g. Calorie intake is very bad in small and in big doses It also permits non-linearity (exponential, U- or S-shaped) e.g. Calorie intake is very bad in small and in big doses This approach is used by Kaly et al in the construction of the Environmental Vulnerability Index. This approach is used by Kaly et al in the construction of the Environmental Vulnerability Index. Its main defect relates to the subjectivity of the category groupings and the choice between linear and non-linear relationships. Its main defect relates to the subjectivity of the category groupings and the choice between linear and non-linear relationships.

Example: Multi-Point Mapping Scale VolcanoesX=01X<55X<1010X<1515X<2020X3535X Toxic Industries X55<X1010<X2020<X5050<X100100<X200X>200 Land Slides X=00<X0.50.5<X11<X < X 22<X2.5X>2.5 Selected Variables from Kaly et al (2003): Environmental Vulnerability Index

6. Conclusion Composite indices construction involves subjective decisions. Composite indices construction involves subjective decisions. It is important that one fully understands the implications of a methodological procedure used as this has serious implications on the quality of the results of the composite index, its reliability and its operationality. It is important that one fully understands the implications of a methodological procedure used as this has serious implications on the quality of the results of the composite index, its reliability and its operationality.

Thank you for your attention