Cost-Benefit / Cost-Effectiveness Analysis in the Context of Impact Evaluations MC Evaluation Workshop and Operations Meeting January 18-23, 2010 Johannesburg,

Slides:



Advertisements
Similar presentations
Types of Analysis Some experts divide Budget Analysis into these types, which deal with different questions:
Advertisements

MACROECONOMICS What is the purpose of macroeconomics? to explain how the economy as a whole works to understand why macro variables behave in the way they.
AP macroeconomics Unit 4: Long Run Economic growth and loanable funds
Correcting Market Distortions: Shadow Prices, Shadow Wages and Discount Rates Chapter 6.
Capital Investment. Lecture Outline Define Capital Budgeting. Explain the importance of Capital Budgeting. Examine the method of implementing and managing.
Finance Fundamentals Fundamentals of Business Workshop 2006 Professor David J. Denis.
Unit V Costs and Marginal Analysis (Chapter 9). In this chapter, look for the answers to these questions:  Why are implicit as well as explicit costs.
Aggregate Demand.
Contemporary Models of Development and Underdevelopment
BUSINESS ECONOMICS Class 6 1 and 2 December, 2009.
INFLATION AND CAPITAL BUDGETING INFLATION IS THE INCREASE IN THE GENERAL LEVEL OF PRICES FOR ALL GOODS AND SERVICES IN AN ECONOMY.
1 Microfoundations: Concepts for Making Consumer Decisions What is the difference between microeconomics and macroeconomics?
1 Aggregate Expenditure Components Chapter 24 © 2006 Thomson/South-Western.
Presenting the Socioeconomic Benefits of Suffolk County Community College.
VI-Economic Evaluation of Facility Investments 1. Project Life Cycle and Economic Feasibility 2.Basic Concepts of Economic Evaluation 3.Costs and Benefits.
Chapter 11: Cost-Benefit Analysis Econ 330: Public Finance Dr
Investment, the Capital Market, and the Wealth of Nations
Basic Tools of Finance Finance is the field that studies how people make decisions regarding the allocation of resources over time and the handling of.
Micro and Macro- the difference?
Source: Mankiw (2000) Macroeconomics, Chapter 3 p Determinants of Demand for Goods and Services Examine: how the output from production is used.
McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 15: Saving, Capital Formation, and Financial Markets.
Copyright © 2001 by The McGraw-Hill Companies, Inc. All rights reserved. Slide Saving and Capital Formation.
Aggregate Demand and Supply. Aggregate Demand (AD)
TECHNIQUES FOR COMPARING ALTERNATIVE EDUCATION INVESTMENTS EDUARDO VELEZ AFTH1 December 1998.
Chapter 5 Valuation Concepts. 2 Basic Valuation From “The Time Value of Money” we realize that the value of anything is based on the present value of.
Principles of Microeconomics & Principles of Macroeconomics: Ch. 2 Second Canadian Edition Chapter 2 Thinking Like an Economist © 2002 by Nelson, a division.
©2002 Prentice Hall Business Publishing, Introduction to Management Accounting 12/e, Horngren/Sundem/Stratton Chapter 11 Capital Budgeting.
Chapter 1 Overview of a Financial Plan
Aggregate Demand: Introduction and Determinants Jeniffer Blanco Patricia Padron Nataly Gonzalez Franchesca De Jesus.
Normative Criteria for Decision Making Applying the Concepts
Economic Issues: An introduction
Spending, Income, and Interest Rates Chapter 3 Instructor: MELTEM INCE
Macro Chapter 14 Modern Macroeconomics and Monetary Policy.
Input Demand: The Capital Market and the Investment Decision.
11.1 Ch. 11 General Equilibrium and the Efficiency of Perfect Competition.
Essential Standard 1.00 Understand the role of business in the global economy. 1.
6.02 Understand economic indicators to recognize economic trends and conditions Understand economics trends and communication.
Chapter 3 Arbitrage and Financial Decision Making
Macro Chapter 14 Modern Macroeconomics and Monetary Policy.
Chapter 10 Choices Involving Time Copyright © 2014 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written.
Conceptual Tools The creation of new and improved financial products through innovative design or repackaging of existing financial instruments. Financial.
Principles of Macroeconomics: Ch. 20 Second Canadian Edition Chapter 20 The Influence of Monetary and Fiscal Policy on Aggregate Demand © 2002 by Nelson,
10.1 Input Demand: The Capital Market and the Investment Decision Capital are those goods produced by the economic system that are used as inputs to produce.
McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 19: Monetary Policy and the Federal Reserve 1.Describe.
CAPITAL BUDGETING_LECT 091 The Concept of Opportunity Cost The concept of opportunity cost is used in CBA to place a dollar value on the inputs required.
Ch. 11 General Equilibrium and the Efficiency of Perfect Competition
McGraw-Hill/Irwin © 2008 The McGraw-Hill Companies, Inc., All Rights Reserved. 1-1 McGraw-Hill/Irwin © 2008 The McGraw-Hill Companies, Inc., All Rights.
Chapter 11: Capital, Investment and Depreciation.
Chapter 8 Capital Asset Selection and Capital Budgeting.
Topic 8 Aggregate Demand I: Building the IS-LM model
©2005 Prentice Hall Business Publishing, Introduction to Management Accounting 13/e, Horngren/Sundem/Stratton ©2008 Prentice Hall Business Publishing,
Capital, Investment, and DepreciationCapitalInvestment and DepreciationThe Capital MarketCapital Income: Interest and ProfitsFinancial Markets in ActionCapital.
Africa RISING M&E Expert Meeting Addis Ababa, 5-7 September 2012.
MACROECONOMICS © 2011 Worth Publishers, all rights reserved S E V E N T H E D I T I O N PowerPoint ® Slides by Ron Cronovich N. Gregory Mankiw C H A P.
124 Aggregate Supply and Aggregate Demand. 125  What is the purpose of the aggregate supply-aggregate demand model?  What determines aggregate supply.
Financial Planning Skills By: Associate Professor Dr. GholamReza Zandi
There are some basic economic terms that we need to be aware of for our upcoming Econ test.
1 Cost-Benefit Analysis Public Economics Minda DC. Eduarte.
©2005 Prentice Hall Business Publishing, Introduction to Management Accounting 13/e, Horngren/Sundem/Stratton Capital Budgeting Chapter 11.
Microfoundations: Concepts for Making Consumer Decisions What is the difference between microeconomics and macroeconomics?
Copyright © 2012 Pearson Addison-Wesley. All rights reserved. Chapter 3 Income and Interest Rates: The Keynesian Cross Model and the IS Curve.
© 2007 Prentice Hall Business Publishing Principles of Economics 8e by Case and Fair Prepared by: Fernando & Yvonn Quijano 6 Chapter Household Behavior.
Chapter Capital Budgeting C H A P T E R. Chapter Objectives Define capital budgeting. Distinguish between the various techniques of capital budgeting.
The Aggregate Expenditures Model. Aggregate Expenditure Model (Also known as the “Keynesian cross model” The amount of goods and services produced and.
Chapter 1 Overview of a Financial Plan. Copyright ©2014 Pearson Education, Inc. All rights reserved.1-2 Chapter Objectives Explain how you benefit from.
Introduction to Economics Dr. Dnyandev C. Talule Professor Dept. of Economics, Shivaji University, Kolhapur Professor of Economics Yashwantrao Chavan Academy.
Presented by: Sergio Bautista
Sergio Bautista-Arredondo National Institute of Public Health Mexico
Introduction to Economics
L11200 Introduction to Macroeconomics 2009/10
Presentation transcript:

Cost-Benefit / Cost-Effectiveness Analysis in the Context of Impact Evaluations MC Evaluation Workshop and Operations Meeting January 18-23, 2010 Johannesburg, South Africa Presented by: Sergio Bautista

2 Impact Evaluation and Efficiency Analysis Topics Adding a costing component to our impact evaluation Defining and measuring efficiency Cost-effectiveness, cost-benefit and Technical Efficiency

3 Impact Evaluation and Efficiency Analysis Topics Adding a costing component to our impact evaluation Defining and measuring efficiency Cost-effectiveness, cost-benefit and Technical Efficiency

4 Why evaluate? Are we doing the right thing?  Are the results we see due to our intervention?  What would have happened in the absence of our intervention? Are we doing it right?  Can we do things more effectively and efficiently?  What are the constraints to efficient production?

5 Focus on outcomes and impact What is effect of a specific program on specific outcomes? How much better off are beneficiaries because of the intervention? How would outcomes differ under alternative program designs? Does the program affect different people differently?

Efficiency? What are the costs associated with the program / alternative program designs? Is this “technology” the most efficient alternative we have to achieve the desire results? 6

7 From Betcherman’s youth labour review (14 of 289) From WDR review of youth HIV evaluations (6 of 300+) Why evaluate?

8 Basic ingredients To start:  a clear goal,  a diagnosis of the problem, and  a solid theory of change. Then use whatever tools necessary to solve the fundamental evaluation problem: How can we know that differences in outcome are due to our intervention?

Measuring costs appropriately Adding a costing component to the evaluation does not represent a significant additional burden  Most of the information already exists  Additional information needed can be collected through the instruments used for the impact evaluation (community, facility, household) Adding a costing component allows to discuss efficiency issues, in addition to effectiveness issues 9

10 Impact Evaluation and Efficiency Analysis Topics Adding a cost component to our impact evaluation Defining and measuring efficiency Cost-effectiveness, cost-benefit and Technical Efficiency

Production efficiency If an economy (public sector) is not efficient in producing a given service (outcome), it can produce more without reducing the production of other services It’s about producing using available resources the best way possible In the context of public services, it means reaching more people 11

Production frontier y x y=f(x)

Technical efficiency y x y=f(x) A B

Distance from perfect efficiency y x y=f(x) A B input distance output distance

What do we need to do efficiency analysis? Measuring efficiency We have a few options:  CEA  CBA  Technical Efficiency Analysis (production/cost functions) All of them imply different approaches to deal with the question of efficiency All of them need basically the same type of information:  Production of outputs / outcomes  Costs 15

Why should we measure efficiency? Resources are limited: How do we know it is worthwhile to spend scarce tax resources on a particular strategy or program? How can we choose among alternatives? Is any intervention always better than none? Strong equity and ethical implications… 16

17 Impact Evaluation and Efficiency Analysis Topics Adding a cost component to our impact evaluation Defining and measuring efficiency Cost-effectiveness, cost-benefit and Technical Efficiency

What is the difference between them? CBA: What is the social benefit achieved with intervention/program A? CEA: What is the cost per unit of output/impact that can be bought by intervention A?  Cost per youth trained  Cost per life saved  Cost per children without nutrition problems  Cost per DALY / QALY 18

How? CBA:  Measure impact  Value impact in monetary terms  Measure costs  Take difference CEA:  Measure incremental impact(s)  Measure incremental costs  Take CE ratio: costs/impact

20 Costs Which costs should you measure?  Everything the program purchases  Any other resources the program uses, even things the program gets for free: Volunteer labour Donated equipment and supplies Why measure the cost of free stuff? Isn’t it free? NO. FREE INPUTS ARE NOT FREE.

21 Costs Why are free things not really free? Because they have an opportunity cost:  Each free thing can be used for a different purpose  Free things make resources available that would otherwise have been used to obtain them free labour means lower wage payments; free medicines means lower expenditure on medicines

22 Costs So how can you measure the cost of free things?  The financial or accounting cost method: Get estimates of similar inputs. What does input X cost, on average, in this place? What does someone with these skills and experience usually earn?

23 Costs So how can you measure the cost of free things?  The economic or shadow cost method: Estimate a production function where Y = output, and and are the returns to paid and unpaid inputs (X and Z), respectively, in terms of physical output. These estimates can be denominated in value terms.

24 Costs What difference does it make which method I use?  The accounting method gives estimates of the average cost.  The economic method gives estimates of the marginal cost. Marginal cost estimates are preferred for programming.

25 Costs Marginal costs vs Average costs:  What is the average cost of the input, or what does an average amount of expenditure (dollar, euro) buy?  What will be the cost of the next unit of output, or how much of the output can I get for the next amount I spend?  How much will it cost to scale up from A to B? scale unit costs constant (avg costs) falling rising rising or falling, depending on scale A B

26 Discounting in principle Why discount?  Acknowledge that resources have a cost (in real terms of borrowing and in terms of alternative investments) Which discount rate should you use?  Whichever accurately reflects the cost of capital. What would it cost if you had to borrow money to finance your project? In general:  Higher discount rates give greater value to costs and benefits that occur more quickly.  Projects that have delayed benefits relative to costs will have lower net returns.  Consider both long-term and short-term costs and benefits.

27 Discounting example Project costs over time

28 Discounting example Project costs and benefits over time At 0% (nominal): PV costs = -175 PV benefits = 200 Net PV = 25

29 Discounting example Project costs and benefits over time At 3% discount rate: PV costs = PV benefits = Net PV = 14.06

30 Discounting example Project costs and benefits over time At 10% discount rate: PV costs = PV benefits = Net PV = -5.61

31 Cost-effectiveness analysis What outcomes or impact do you get for each dollar’s worth of program expenditure?  The number of HIV cases averted.  The number of young people employed.  The number of disability-adjusted life-years (DALYs) saved. Can be used to compare alternative methods of achieving a specific objective.

Cost-effectiveness analysis Natural units of output/impact  Lives saved  Vaccinated children  Trained teenagers Composite units of impact  QUALYs and DALYs  Useful to compare with other interventions  Useful to aggregate different outcomes 32

33 Cost-effectiveness example (Knowles and Behrman 2005, Table 11)

34 Cost benefit example De-worming in rural primary schools in Kenya.  Randomized the timing of the introduction of de- worming treatment across 75 schools.  The treatment significantly reduced disease prevalence, and increased school attendance by about seven percent.  The study estimated discounted lifetime benefits over US$30 per treated child, primarily from gains in lifetime income.  Benefits are more than 60 times greater than costs, based on an estimated cost of US$0.49 per treated pupil. (Miguel and Kremer 2004)

35 Efficiency within a program: technical efficiency analysis

The Public Sector… Firms are not profit-maximizing Firms may not be cost-minimizing Firms produce more than one output  Aggregation, valuing outputs  Jointness in production, economies of scope Firms may not know how much demand there is for their services

Production Function and Allocative Efficiency X Y X1 Y1 Y2 Benefit Investment Intervention 1 Intervention 2

Allocative Efficiency Cost-effectiveness analyses typically assume:  Results are reproducible in different contexts and scales  Interventions are implemented at their efficiency frontier A “cost-effective” intervention can become very “cost-ineffective” if implemented inefficiently

X Y X1 Y1 Y2 Y3 Benefit Investment Production Function and Technical Efficiency

40 Scale and Average Unit Cost of VCT programs in 5 countries , ,00010,000100,000 Annual clients receiving VCT MexicoUgandaRussiaIndiaSouth Africa US$ Average Unit Costs Source: Preliminary analysis of PANCEA data. Unpublished data. 2006

, ,00010,000100,000 Annual clients receiving VCT US$ Average Unit Costs Mexico Scale and Average Unit Cost of VCT programs in 5 countries Source: Preliminary analysis of PANCEA data. Unpublished data. 2006

To conclude – Why measure efficiency?  Budget allocation decisions  Fiscal responsibility  Facility performance monitoring and management How can you measure it?  Add a costing component to your IE study  Choose an appropriate method – depends on the question you want to answer Evaluate technical efficiency  Public sector / NGOs are not like for-profit firms  Robust methods preferable – DEA or SFA  Try to understand why facilities differ