1. Appraising result framework
Maki I. TSUMAGARI, PhD; Shiva Hari ADHIKARI

2. Module at a Glance: Components of Development Mgt Module
Development Perspective
Policy
Actors
Result Frame-work
Finance
Procure-ment
Safe-guards
M&E

3. Module at a Glance: Why these components?
Pertinent information of
Appraisal
Report
Policy
Finance
Actors
Result Frame-work
Procure-ment
M&E
Safe-guards
Development Perspective
Project Appraisal Report
…..
…... ……
Appraise examine

4. Parts within “Appraising Result Framework” sessions
To understand project management (previous session)
To analyze project’s result framework
To identify issues in project management

5. Why result framework ? It’s only a part of appraisal documents
Typically, appraisal document is prepared by a special task force team, to be approved by the organization’s top management.
The approver depends on who shoulders the cost: e.g. World Bank – Board
Then, implementing agencies will play the role of “ensuring the soundness of the project design” by checking the result framework, because it is a condensed summary of project structure and contents.

6. Terminology Logical Framework (Log Frame) Results Framework
How logical build up of the framework leads to the achievement of Project objective.
Logical Framework (Log Frame)
Results Framework
Indicators
Means of Verification
Assumptions/
Risks
Goal
Project Objective
Output
Activities

7. What is a Result and What is Not?
Consecutive triumphs between 2011/12 and 2017/18

8. What is a Result and What is Not?
"What these people need are toilets"
There health status will definitely improve
Photos Google Images

9. What is a Result and What is Not?

10. On June 4, 2018 about three dozen shops were monitored
Case: “Agriculture Minister Assures to End Syndicate System in Kalimati Vegetable Market”
On June 4, 2018 about three dozen shops were monitored
To manage the market properly
To end the existence of syndicates

11. Preamble: Results Based Monitoring and Evaluation Guidelines, 2010, NPC

12. Result
Result means the output, production or outcomes/effect achieved from the implementation of any programme.
-(NPC, 2010, Results Based Monitoring and Evaluation Guidelines 2067/2010)
Any change that comes from the intervention
short-term/long-term
positive/negative
Planned/unplanned.

13. Results Framework
A results framework represents the underlying logic that explains how the development objective of a project is to be achieved.
It is an explicit articulation (graphic display, matrix, or summary) of the different levels or chains of results expected from a particular intervention - project, program, or development strategy (WB, 2012).

14. Logics in Result Frameworks
Safe and reliable transportation system
Bus service improved
Frequency of bus accident reduced
Drivers trained
# new bus operational and warehouse store equipped
Maintenance routine established
Undertake training programme
Procure buses and tools and spare-parts
Develop maintenance routines

15. Logics… Project Elements Indicators MoV Assump. 1. Goal
Safe and reliable transportation system
Traffic records
NEPSE
departure and arrival on time
market share increase
2. Project Purpose
1. Bus service improved
2. Frequency of bus accident reduced
Road conditions are improved
accidents and injury reduced by X %
3. Outputs
1. Drivers trained
2. # new bus operational
3. Maintenance workshop equipped
4. Maintenance routine established
# of trained drivers
# of new bus equipments in w. s.
maintenance routine
Trained drivers remain with the bus company
5. Inputs
1. Driving instructor X months
2. Funds for buses
3. Funds for tools and spare-parts
4. Maintenance instructor Y months
Buses, its tools and spares supplied and cleared in time
4. Activities
1. Undertake training programme
2. Procure buses
3. Procure tools and spare-parts
4. Develop maintenance routines

16. The Results Chain
Output
Outcome
Goal
Result
Risk
Activities
Inputs

17. How Result Framework Works?
National/sector area
National/sector area
Goal
Purpose
Project/ Program
Project/Program
Outputs
Inputs
Activities
Present situation
Expected situation

18. How Results Framework Works?
आयोजना प्रभाब
Project/Program Outcomes
Project/Program Outputs
Project/Program Activity
Inputs
National Goal
Sectoral Goal
Regional/International Goal
More
Impact
Collective
Accountability
Less

19. Origin and Development
Pre 2000 AD
Post 2000 AD
Command and control, management
Management by objectives, SMART objective
Logical Framework Approach, shift of line item budgets to budgeting around objectives
Development and humanitarian communities
Results based management
Paris Declaration (OAHRM)
Accra Agenda for Action (OIDC)

20. Managing for Development Results
An alternative “change management” approach that focuses on the whole results chain (ADB, 2012).
It is about
defining outcomes and outputs with measurable indicators and time-bound targets;
allocating resources for activities;
implementing activities and monitoring progress and targets; and
evaluating performance against targets.

21. NPC, Logical Framework Result Chain and its description
Performance Indicator
Means of Verification
Risk and Assumptions
Goal
Objective
Output
Activity
Inputs

22. ADB, Design and Monitoring Framework
Design Summary
Performance Target/Indicators
Data Sources/
Reporting Mechanisms
Assumptions and Risks
Impact
Outcome
Output
Activity with milestone
Inputs

23. WB, Results Framework Impact OC1 OP1 OP2 … Programs/
Indicators
Baseline (YYYY)
Targets
MoV
Responsible Agency
Assump. /Risks
YYYY
Impact
OC1
OP1
OP2 …
Programs/
S. Programs (Inputs)

24. Appraising Result Framework
Case (Emergency Earthquake Assistance Project’s Design and Monitoring Framework)
Individual work (15 min):
How is the hierarchy of change in design?
What about indicators? Are they measurable?
How sure are you in achieving results?
Group Work (15 min) and 5 min each for Presentation:
Discuss in group and consolidate the findings.
List issues/challenges regarding this project in terms of planning and implementation.

25. Issues: RB Project Planning and Implementation
Inclusive participation
Focusing the dialogue on results at all phases of the development process
Aligning programming, monitoring and evaluation with results
Keeping measurement and reporting simple
Managing for, not by results; and
Using results information for learning and decision-making

26. Issues… Difficulty in applying causal logic Difficulty in learning
Difficulty in integrating
Difficulty in revising
Difficulty in measuring
Difficulty in ‘accrediting’

27. Further Readings
National Planning Commission (NPC), 2010, Results Based Monitoring and Evaluation Guidelines 2067/2010, Kathmandu, NPC.
World Bank (WB), 2012, designing a results framework for achieving results: a how-to guide, Washington DC, WB.
Asian Development Bank (ADB), 2012, Managing for Development Result: Relevance, Responsiveness and Result Orientation, Manila, ADB.

28. Thank you ?