1. Concept of Monitoring and Evaluation and Its Application in Nepal Krishna Prasad Dhakal Program Director National Planning Commission Secretariat

2. Public Sector Management MANAGEMENT

3. What is Monitoring and Evaluation? The term “monitoring and evaluation” tends to get run together as if it is only one thing. In fact, these are two distinct sets of organizational activities. M and E are related (both are ultimately about measurement) but not identical.

4. Divorce of M&E Divorce between Monitoring and Evaluation is needed to understand and use it in appropriate way.

5. What is Monitoring? Monitoring is a continuous process of collecting and analyzing information to compare how well a project, program or policy is performing against expected results. It is aimed at improving the efficiency and effectiveness of a project or organization. It is based on targets set and activities planned during the planning phases of work.

6. What is Monitoring? It helps to keep the work on track, and can let management know when things are going wrong. it is an invaluable tool for good management, and it provides a useful base for evaluation.

7. What is Monitoring? It enables you to determine-  whether the resources you have available are sufficient and are being well used,  whether the capacity you have is sufficient and appropriate, and  whether you are doing what you planned to do?

8. What is Monitoring? gLlt, of]hgf, sfo{qmd÷cfof]hgfdf nufgL tyf ;fwgsf] k|jfx ;d"lrt (ª\un] ePsf] %÷%}g / lqmofsnfkx?sf] sfof{Gjog sfo{tflnsf cg';f/ eO{ nlIft k|ltkmn k|fKt ePsf] %÷%}g egL ljleGg txsf] Joj:yfkg jf Joj:yfkgn] tf]s]sf] JolQm, lgsfoaf^ lg/Gt/ / cfjlws ?kdf lgu/fgL /fVg] sfo{ cg'udg xf]. -cg'udg tyf d"NofÍg sfo{ljlw, 2069 sf] d:of}baf^_

9. s] x]%{ s] x]%{ cg'udgn] -s_ cfof]hgfsf] ;|f]t, ;fwgx?sf] k|flKt / k|of]u :jLs[t ah]^ / ;dotflnsfcg';f/ ePsf] 5, 5}g < -v_ cfof]hgfsf ck]lIft k|ltkmnx? ;dod} / nfut k|efjsf/L ?kdf xfl;n ePsf] 5, 5}g < -u_ cfof]hgfsf] sfof{Gjog Ifdtf s], s:tf] 5< -cg'udg tyf d"NofÍg sfo{ljlw, 2069 sf] d:of}baf^_

10. cg' + udg of] sfo{s|d cjlwe/ lg/Gt/ ul/g] k|ls|of xf]. o;nfO{ cfof]hgfsf] Pp6f cfGtl/s sfo{sf] ¿kdf klg lnO{G5. cg'udg ;fdfGotof sfof{Gjogsf] cj:yfdf b]lvPsf sdL, sdhf]/Lx¿nfO{ ;'wf/ ug]{ ;+:yfut k|ls|of xf]. cg'udg sfo{ cfof]hgfsf] k|ls|of, nufgL / k|ltkmn;Fu k|ToIf ¿kdf ;DalGwt x'G5. cg'udg Joj:yfkgsf] k|0ffnLsf] Pp6f c+u xf].

11. glthfd"ns cg'udgsf ljlwx¿ ! nIo / k|ultsf] t'ngf ljlw nIocg';f/ sfo{ eP gePsf] tyf sfo{qmdsf] ;du| l:ylt -ef}lts k|ult, ljQLo k|ult / JotLt ;do_ ljj/0f sfo{qmd,cfof]hgfaf6 x/]s rf}dfl;s cjlwdf ul/g] k|ltj]bgaf6 ul/g] cg'udg. ;"rsnIo k|ul t nIo k|ult ljrsf] cGt/ sf/0f ;d:of ;dfwfgsf k|of;x? nIo / k|ultsf] t'ngf

12. glthfd"ns cg'udgsf ljlwx¿ @= :ynut cg'udg ljlw sfo{qmd, cfof]hgfdf ePsf ljleGg lqmofsnfkx? cfof]hgf:ynd} uP/ cjnf]sg u/L ul/g] cg'udg. o;df ;DalGwt sfo{qmd,cfof]hgfsf] lgDg b:tfj]h ;d]t k|of]u ug{' kb{5. != nlhsn k|m]djs{ @= aflif{s ljsf; sfo{qmd #= rf}dfl;s k|ult k|ltj]bg $= ;"rsx¿ %= jflif{s ljsf; sfo{qmd -efu !_ ^= lhNnf:t/Lo jflif{s ljsf; sfo{qmd -efu @_ #= t];|f] kIf cg'udg ljlw s'g} vf; bIftf tyf sfo{s'zntfsf] dfWodaf6 cg'udg u/fpg k/]df :jtGq lgsfo tyf JolQmx?af6 u/fOg] ljlw.

13. What is Evaluation? Evaluation is an assessment, based on detailed data collection and careful analysis, of the results of a policy or program. Evaluation is research, but not just any research. It is the comparison of actual project impacts against the agreed strategic plans. It looks at what you set out to do, at what you have accomplished, and how you accomplished it.

14. What is Evaluation? It can be formative (taking place during the life of a project or organization, with the intention of improving the strategy or way of functioning of the project or organization). It can also be summative (drawing learning from a completed project or an organization that is no longer functioning). Someone once described this as the difference between a check-up and an postmortem. Process evaluation A study of the implementation of a program or policy focusing on inputs, activities, and outputs and often used to assess the performance of implementers. Program evaluation A study, using research methods to collect and analyze data, of the outcomes of a program—that is, whether and how well a program is working and why.

15. What is Evaluation? sfof{Gjog ul/Psf gLlt, sfo{qmd÷cfof]hgf xfnsf] ;dodf s]slt ;fGble{s, nfebfoL / k|efjsf/L /x]sf 5g\ tyf s]s:tf pknlJw Pjd\ k|efjx? xfl;n ePsf 5g\ eGg] s'/fsf] cfGtl/s / afXo d"NofÍgstf{af6 p2]Zok"0f{ / Jojl:yt tl/sfn] n]vfhf]vf ug]{ sfo{ d"NofÍg xf] -cg'udg tyf d"NofÍg sfo{ljlw, 2069 sf] d:of}baf^_

16. -;fef/– >L tLy{/fh 9sfn, ;x;lrj, /fof]cf;_

17. cg'udg tyf d"NofÍgsf k|sf/ p2]Zo lg/Gt/ cg'udg  sfo{qmd |cfof]hgf lgdf{0f r/0fdf nufgL, lqmofsnfk, k|lqmof / k|ltkmn ;"rsx?sf] cfwf/df sfo{;Dkfbg eP gePsf] lgwf{/0f ug{. lbuf]kgf cg'udg  sfo{qmd, cfof]hgfsf] lgdf{0f r/0f ;DkGg kZrft pQm sfo{qmd, cfof]hgfsf] lgwf{l/t cfo";Dd lg/Gt/ ;~rfngsf] nflu cfjZos kg]{ ;|f]t;fwg tyf dd{t;Def/ lglZrt ug{. sfo{qmd÷cfof]hgfdf ul/g] cg'udg tyf d"NofÍgsf p@]Zo

18. k"j{ d"NofÍg (Ex-ante)  sfo{qmd, cfof]hgfsf] cfjZostf tyf ;'lglZrttf lgwf{/0f ug{  sfo{qmd, cfof]hgfsf] k"0f{ ljj/0f :ki6 ug{ / ;"rsx? lgwf{/0f ug{ rfn" d"NofÍg (Ongoing)  sfo{qmd, cfof]hgfsf] k|ult cfFsng ug{  k"j{ lgwf{l/t sfo{of]hgfdf kl/dfh{g ug{ jf ;~rfng 9fFrfdf cfjZos kl/jt{g ug{ clGtd d"NofÍg (Terminal)  sfo{qmd, cfof]hgfsf] sfo{Ifdtf, k|efjsfl/tf / bLuf]kgfnfO{ Wofgdf /fv]/ ;dLIff ug{  sfo{qmd, cfof]hgf ;DkGg ePkl5 yk sfo{ (follow- up) cfjZos /x]sf] jf g/x]sf] lgSof}{n ug{ k|efj d"NofÍg (Ex-post)  sfo{qmd, cfof]hgfsf] k|efj / bLuf]kgfnfO{ Wofgdf /fv]/ ;dLIff ug{  eljiodf sfo{qmd, cfof]hgfsf] th"{df / sfof{Gjog ubf{ ;'wf/ ug{sf nflu l;sfO / ;'emfjx? k|fKt ug{ -cg'udg tyf d"NofÍg sfo{ljlw, 2069 sf] d:of}baf^_

19. d"NofÍgsf kfFr cfwf/x¿ d"NofÍgsf cfwf/x? kl/efiff ;fGble{stf (Relevance) nlIft ju{sf cfjZostf / k|fyldstf tyf /fli6«o, If]qut ljsf; nIox? jf gLltx? ;fy} bft[ lgsfosf ;xfotf gLlt;Fusf] ;fGble{stf. k|efjsfl/tf ( Effectiveness ) nIox? s'g, s], slt k|fKt eP jf k|fKt x'g] ;Defjgfsf 5g\ eGg] klxrfg ug]{ sfo{bIftf ( Efficiency ) nufgLsf] cg'kftdf k|ltkmn k|fKt eP jf gePsf] dfkg ub{5. k|efj,c;/ ( Impact ) k|ToIf jf ck|ToIf, lgwf{l/t jf clgWff{l/t, ;sf/fTds jf gsf/fTds kl/jt{gnfO{ dfkg ug]{ bLuf]kgf ( Sustainability ) ;DkGg ePkZrft k|fKt kmfObf / k|ltkmnx?n] lg/Gt/tf kfpF5g\ jf kfpFb}gg\.

20. d"NofÍg ljlwx¿ != kl/df0ffTds ljlw (Quantitative Method) nfO{sfo{qmd, cfof]hgfn] kf/]sf] jf kfg]{ k|efj jf c;/nfO{ ;+Vof jf k|ltztdf k|:t't u/L ck]lIft glthf;Fu t'ngf u/L d"NofÍg ug]{ ljlw kl/df0fTds ljlw xf]. kl/df0ffTds tYofÍ k|fKt ug]{ tl/sfx¿ k|ZgfjnL / ;j]{If0f ljlw ljBdfg 8f6fa];x?— EMIS, HMIS, FMIS etc

21. d"NofÍg ljlwx¿ tYofÍ ljZn]if0f  nfut–nfe tyf nfut–sfo{bIftf  sfo{qmd, cfof]hgf ;~rfng x'g'cl3 / ;~rfng eO;s]kl5sf] cj:yf t'ngf (Pre/Post Test)  sfo{qmd, cfof]hgf …;~rfng ePsf] If]qÚ (with) / …;~rfng gePsf]Ú (without) p:t} k|s[ltsf If]qaLrsf] t'ngfTds ljZn ]if0f

22. d"NofÍg ljlw @= u'0ffTds ljlw (Qualitative Method) kl/df0fTds ?kdf dfkg ug{ g;lsg] ;]jfu|fxLx?sf] afgLJojxf/, wf/0ff, ;fj{hlgs ;]jfk|ltsf] ;Gt'li6h:tf ljljw kIfx?nfO{ dfkg ug{ o;sf] k|of]u ul/G5. Uf'0ffTds tYofÍ k|fKt ug]{ tl/sfx?  k|ToIf cjnf]sg ljlw  nlIft ;d"x ljlw  cGtjf{tf{ ljlw  gd"gf ljlw  SWOT Analysis ljlw  b:tfj]h cWoog

23. d"NofÍg ljlw #= ldl>t ljlw (Mixed Method) -kl/df0ffTds / u'0ffTds ljlwsf] ld>0f_ kl/df0ffTds ljlw / u'0ffTds ljlwsf cf}hf/ (tools) / lgrf]8 (fact findings) nfO{ ;Tofkg (triangulate) ug]{ p2]Zon] ldl>t ljlw (Mixed method) ckgfOG5. o; ljlwn] kl/df0ffTds ljlw / u'0ffTds ljlwx?sf] ;sf/fTds kIf / ;Ldf (Limitations) nfO{ Wofg lbO{ k|fKt lgrf]8x?sf] j}wtf / ljZj;gLotf (Validity and Reliability) kl/If0f u/L lg0f{o ug{ ;xof]u u5{.

24. Facilitating Vs Conducting Evaluation Facilitating  Selection of policy, programs projects for evaluation  Preparing TOR  Bidding Process  Getting reports in various stages such as inception report, field report, draft report and final report.  Providing feedback and suggestions  Implementing and Using Evaluation report for establishing accountability and lesson learning. Conducting

25. Ways of Evaluation? Self-evaluation It is a way of self-reflective, learning and improving practice. Participatory evaluation This is an internal evaluation involving s takeholders such as project staf f and beneficiaries Interactive evaluation This involves a very active interaction between an outside evaluator or evaluation team and the organization or project being evaluated.

26. What is Evaluation? Rapid Participatory Appraisal This is a qualitative way of doing evaluations by an interdisciplinary team over a short time especially applied in rural areas. It involves the use of secondary data review, direct observation, semi-structured interviews, key informants, group interviews, games, diagrams, maps and calendars. External evaluation This is an evaluation done by a carefully chosen outsider or outsider team.

27. cg'udgd"NofÍg sfo{qmd cjlwe/ lg/Gt/ ul/g] k|lqmof xf], h;nfO cfof]hgfsf] Pp^f cfGtl/s sfo{sf] ?kdf klg lnO{G%. sfo{qmdsf] ;'¿df k"j{ d"NofÍg - Ex- ante _, dWofjlws (Mid-term), clGtd jf ;DkGg d"NofÍg - Terminal _ / sfo{qmd kl%sf] d"NofÍg (Ex-post) ul/G%. cg'udg sfo{ cfof]hgf sfof{Gjog / ;~rfngsf] cj:yfdf dfq ul/G%. d"NofÍg sfo{ cfof]hgfsf] sfof{Gjogsf] cj:yfdf / cfof]hgf sfof{Gjogsf] ;dflKt kl%sf cj:yfx¿df klg ul/G%. sfof{Gjogsf] cj:yfdf b]lvPsf sdL, sdhf]/Lx¿nfO{ ;'wf/ ug]{ ;+:yfut k|lqmof xf]. sfof{Gjogsf] r/)fdf cfjZos ;'wf/ ug]{ tyf sfof{Gjogsf qmddf ePsf sdL, sdhf]/Laf^ kf& l;sL eljZosf To:t} of]hgf, sfo{qmd / lg)f{ox¿df Joj:yfkgn] ;'wf/ ug]{ ;fwg xf].

28. cg'udgd"NofÍg cg'udg sfo{ cfof]hgfsf] k|lqmof, nufgL / k|ltkmn;+u k|ToIf ¿kdf ;DalGwt x'G%. d"NofÍg sfo{ cfof]hgfsf] k"j{ lgwf{/t nIo / pknlAwsf] l:ylt tyf o;n] ;/f]sf/jfnfnfO{ kf/]sf] c;/ / k|efjs f] cWoog;F+u ;DalGwt %. cg'udg Joj:yfkg k|)ffnLsf] Pp^f cª\u xf]. d"NofÍg sfof{Gjog ul/Psf sfo{af^ kf& l;Sg ] sfo{d"vL Joj:yfksLo cf}hf/ xf]. ;fwf/)ftof, cg'udg sfo{ sfof{Gjog ug]{ lgsfox¿af^ g} ul/G%. ;fwf/)ftof, d"NofÍg sfo{ sfof{Gjog ug]{ lgsfoeGbf aflx/sf / :jtGq ;+:yfx¿ af^ u/fOG%.

29. Uses and Importance of M&E Evaluate/ learn / decide Plan Implement Reflect/learn/ decide/adjust Monitor Implement

30. Uses and Importance of M&E Help you identify problems and their causes; Suggest possible solutions to problems; Raise questions about assumptions and strategy; Push you to reflect on where you are going and how you are getting there;

31. Uses and Importance of M&E Provide you with information and insight; Encourage you to act on the information and insight; Increase the likelihood that you will make a positive development difference. But It is important to recognize that monitoring and evaluation are not magic wands that can be waved to make problems disappear, or to cure them, or to miraculously make changes without a lot of hard work being put in by the project or organization.

32. cg'udgsf] dxTj ljsf; sfo{qmd÷cfof]hgfx?df nufgL ul/Psf] ;|f]t;fwgsf] kf/bzL{, lhDd]jf/Lk"0f{ / k|efjsf/L k|of]u ;'lglZrt ug{, lqmofsnfkx¿nfO{ lgwf{l/t nIok|flKttkm{{ lgb]{lzt ug{, / sfof{Gjogdf s'g} ;d:of / afwfJojwfgx¿ b]lvPdf tTsfn ;dfwfg ug{.

33. d"NofÍgsf] dxTj cfof]hgfsf] p2]]Zo tyf nIo xfl;n ug{ k"j{lgwf{l/t lqmofsnfk, ;|f]t ;fwg / If]q (scope) df kl/jt{g cfjZos 5, 5}g eGg] hfgsf/Lsf pknAw u/fpF5. ;DkGg cfof]hgfsf] ;fGble{stf, bIftf, k|efjsfl/tf, k|efj / lbuf]kgfsf af/]df oyfy{ hfgsf/L pknAw u/fO{ rfn" cj:yfdf cfjZos ;'wf/ ug{ / eljiodf gLlt, of]hgf sfo{qmd÷cfof]hgfx¿sf] th"{dfdf ljutsf cg'ejaf6 kf7 l;sL uNtLx¿ bf]xl/g glbg ;xof]u k'¥ofpF5.

34. glthfd"ns cg'udg k|ltj]bg tyf glthfsf] k|of]u -;fef/– >L tLy{/fh 9sfn, ;x;lrj, /fof]cf;_

35. M&E institutionalization efforts PlanFocus of M&E First to Fourth Practices of progress review in NDC, NPC esp. input and processes No systematic M&E system and processes Fifth Weightage system (Physical progress tied up with actual performance than budget spent) Eighth New M&E System (NDAC, MDAC, M&E units, Formats, indicators) Since Tenth Plan Towards Results based M&E (MfDR)- (PMAS, DPMAS, Streamlined Hh surveys); RBME: indicator-based monitoring

36. Monitoring responsibility AgencyResponsible NPCS, M&E DivisionMonitoring of monitoring Designing guidelines, formats Monitoring outcomes; sustainability monitoring Evaluation Secretariat services to NDAC Facilitate build M&E capacities NPCS, Sectoral Divisions Prog./Project monitoring and progress updates OPMCM. M&E section Monitoring services delivery Monitoring projects of national pride MOF, M&E DivisionMonitoring projects’ key milestones and disbursement status Line ministriesImplementation monitoring, completion evalu.... -;fef/– >L tLy{/fh 9sfn, ;x;lrj, /fof]cf;_

37. cg'udg tyf d"NofÍgsf tx tyf ;+:yfut ;+/rgf txs] sf]s;n] <slxn] <s;/L < /fli6 «o gLlt k|wfgdGqL tyf dlGqkl/ifbsf] sfof{no, /fli6«o of]hgf cfof]u, ;DjlGwt dGqfno gLlt sfof{ Gjog r/0f :jtGq lgsfoaf6 d"NofÍg cfjlws of]hgf /fli6«o of]hgf cfof]u of]hg f cjlwe/ lg/Gt/ cg'udg, :jtGq lgsfoaf6 d"NofÍg klxnf] k|fyldstf k|fKt cfof]hgf k|wfgdGqL tyf dlGqkl/ifbsf] sfof{no, /fli6«o of]hgf cfof]u, dGqfno cfjZo stf cg';f/ ;+o'Qm cg'udg If]qL o sfo{qmd, cfof]hgf ljefu, If]qLo sfof{no cfjZo stfcg' ;f/ lg/Gt/ cg'udg, t];|f] kIf cg'udg, sfo{q md, cfof] hgf lhNnf ljsf; ;ldlt, ;Da4 lhNnftxsf lgsfox? cfjZo stfcg' ;f/ lg/Gt/ cg'udg, t];|f] kIf cg'udg,

38. ljleGg txdf ug'{kg]{ cg'udg tyf d"NofÍg -;fef/– >L tLy{/fh 9sfn, ;x;lrj, /fof]cf;_

39. ljleGg txdf cg'udg tyf d"NofÍg Aoj:yfM /fli6«o tx ◦ dxfn]vf k/LIfssf] sfof{no ◦ k|wfgdGqL tyf dlGqkl/ifb\sf] sfof{no ◦ /fli6«o of]hgf cfof]u ◦ cy{ dGqfno ◦ /fli6«o ;ts{tf s]Gb| ◦ dxfn]vf lgoGqssf] sfof{no

40. ;+:yfut Joj:yf /fli6«o ljsf; ;d:of ;dfwfg ;ldlt dGqfno:t/Lo ljsf; ;d:of ;dfwfg ;ldlt cg'udg tyf d"NofÍg dxfzfvf÷zfvf lhNnf:t/Lo ljsf; sfo{qmd÷cfof]hgfx?sf] cg'udg tyf d"NofÍg Joj:yf  ;'kl/j]If0f tyf cg'udg ;ldlt  :yfgLo :jfoQ zf;g P]g, @)% tyf  :yfgLo :jfoQ zf;g lgodfjnL, @)%^ adf]lhdsf] Joj:yf.