1. Evaluation Network of Mongolia Evaluation in Mongolia
Dolgion Aldar
Executive Director, IRIM
Evaluation Policy in Mongolia

2. Evaluation Policy in Mongolia
From Khans (World’s 2nd largest empire) to
Commissars (World’s 2nd communist country) to
Capitalists (Anomality) in less than 100 years
Today:
Nomadic- Half of 3 mln population
Homogenous – Religion, language, ethnicity
Lower middle income country (GNI per capita USD / 2068 USD)
Large mining resources – (e.g. Oyu Tolgoi mines)
Evaluation Policy in Mongolia

3. Evaluation Policy in Mongolia
Democracy Without Prerequisites
The Inner Asian anomaly
Poor governance performance
Bureaucratic and ineffective
Powerful and well connected elites
Democratic (6.35 out of 10, Democracy Index 2011)
Free (CL -2; PR-2 Freedom House 2011)
Evaluation Policy in Mongolia

4. Independent Research Institute of Mongolia (IRIM)
IRIM is one of Mongolia's leading evaluation companies since 2008.
Implemented over 40 evaluation projects in Mongolia
Concentrating young and national evaluators
Independent and
non-partisan
IRIM is an active member of Evaluation Network of Mongolia (MNE).
MNE is now a member of Asia-Pacific Evaluation Association (APEA)
Evaluation Policy in Mongolia

5. SDGs 2030: The Role of the National Evaluation Framework
IRIM has been actively involved in initiatives to promote evaluation policies and usage
Training for government M&E officials
SDG data readiness assessment using MAPS approach
SDG baseline data and targets working group member
Annual receptions
Media engagement
Meeting with donors and government
Participation in international conferences
In 2015, IRIM successfully organized its first Annual Reception in Ulaanbaatar, under the topic of SDGs 2030: The Role of the National Evaluation Framework
Evaluation Policy in Mongolia

6. Evaluation Network of Mongolia
In 2016, held first meeting of the Evaluation Network of Mongolia
Main conclusions:
Agreed to have a network
Contribute to evaluation culture
Provide capacity building assistance to evaluators and others
Work together at international consultancy level
P2P project with Vietnam, Laos and Malaysia
Evaluation Policy in Mongolia

7. Evaluation Policy in Mongolia
1. Current status of National Evaluation Policies and Systems in Mongolia 
Increasing stakeholder engagement
Evaluation Policy in Mongolia

8. Current legal and policy framework
Long-term Sustainable Development Vision ( )
Law on Development Planning and Policy (2015)
Law on public management and financing (monitoring delivery of outputs and finance)
Government Resolution #322, 2013 increased clarity and direction regarding M&E structures, functions, roles and responsibilities
Law on Gender Equality – M&E indicators used in government need to have gender aspect.
Cabinet Secretariat compiles all reports
Line Ministries and local governments have internal M&E Departments and Information and Research Centers
National Registration and Statistics Office compile main data and collect statistical data
Performance Review Department of the National Audit Office
Accountability mechanism partially in place (Law on citizens’ complaints and feedback, anti-corruption law, Glass Account Law)
Some system in place but
no specific law or policy
on evaluation
Evaluation Policy in Mongolia

9. Lack of budget and resources
Cabinet Secretariat Office of the Government compiles all M&E reports (only 5 staff)
MoF – ODA coordination section (only 4 staff)
M&E departments of line ministries – 3 to 5 staff and overload (ODA projects 3 to 25, local government reports)
Departments have had little or no formal training in M&E (WB diagnosis report 2014)
High turn-over in government
Lack of evaluation of government policies, laws and programmes
Project focused and supply-driven evaluations
Inconsistent and incomparable studies
Lack of standardised evaluation
Not triangulated (also due to lack of data availability)
Lack of impact evaluations
Lack of qualitative and participatory methods in studies (as opposite to traditional registration)
Lack of national capacities and resources
Evaluation Policy in Mongolia

10. 2.Current demand and use of evaluation in the country
Evaluation Policy in Mongolia

11. Data and monitoring use in policy
NRSO
Parliament
Government
Global/ Regional
Reporting to Citizens?
Professional Associations?
Thematic monitoring?
CSOs
Private sector
Inconsistent data
Not timely
Not at one
Disputes happening at Parliament
Line ministries / specialists
Government agencies
Local governments
Evaluation Policy in Mongolia

12. Who will do the data analysis and translate into policy relevant information?
Disaggregate data produced
Checked
Analysed and work with databases
Policy briefs and dissemination
Use of data
“sectoral pagers”
Evaluation Policy in Mongolia

13. 3.Challenges in promoting EFGR evaluation and how to overcome them
Evaluation Policy in Mongolia

14. Evaluation Policy in Mongolia
Constraints:
Human resources in government (especially at sub-national)
Budget allocation
Lack of coordination among the government
Lack of interest and will among stakeholders
Lack of understanding of evaluation (especially politicians)
No core funding for evaluators and VOPE
Lack of career path for evaluators
No communication and feedback to beneficiaries
Seen as a burden and jargon
Opportunities:
Smart governance initiatives
Multi and bilaterals led training and advocacy taking place (UN and World Bank)
Freedom of speech and independence (democratic)
Emerging national evaluators – increasing
Exposure to international standards and evaluation community
Evaluation Policy in Mongolia

15. Promoting partnership
Research institutes (state, universities, private, NGOs)
Law on NGOs allows government to sub-contract activities to NGOs
Laws allowing for PPP
Private sector
Government
Produce qualitative data
conduct data analysis
sex and age disaggregate data
University lecturers mechanisms to substituted
Sector specialised institutes – provide training and coaching
Rapid assessments when data needs to be checked
- Auditing and M&E
Communicate findings
Define NGOs with capacities
using social accountability tools in M&E  
- Advocacy capacity using data – sensitive and correct information
Donors
All Oda projects have data - sharing
Eval network - Coordination with international networks and initiatives
Evaluation Policy in Mongolia

16. Next objectives of the MNE
Training and regular engagement with government officials, politicians and project managers
Training for young evaluators (certified)
Funding for MNE and annual action plan
Common platform engaging VOPE activities and knowledge hub
Translation of key documents into Mongolian
Advocacy activities (newspaper articles, TV interviews and workshops) for public (evaluation culture)
Learning from best practice and country exchange programmes
Develop sectoral pagers and communicate to Parliament
Piggy back – of ongoing evaluations (among donors, align with NRSO data)
Internal institutionalisation
Evaluation Policy in Mongolia