1. UNEG 2017 Annual General Meeting Professionalization of Evaluation
Wednesday, 18 May 2017
Judita Jankovic (ICAO) and Susanne Mattsson (UNFPA), Co-Conveners
9:05-9:45
Session 1: Strategic Objective 1: Evaluation functions and products of UN entities meet
the UNEG Norms and Standards for evaluation
Andrea Cook, UNEG Vice Chair
Professionalization sub-group highlights 2016 & next steps: Judita Jankovic
(ICAO) and Susanne Mattsson (UNFPA), Convener and Deputy-Convener
Location: M2
On behalf of Susanne Mattsson and myself as the co-convenors of this group, we’d like to acknowledge and thank our active members of the working group, as well as the UNEG Secretariat for supporting our work

2. Objectives of AGM session
Provide an overview of key activities and results in
Present pilot project lessons
Seek endorsement of work plan for
Propose options for continuation of this group

3. Professionalization sub-group
Active members:
ICAO
UNFPA
WFP
UN Women
ILO
A quick overview on who we are for those who may be new to UNEG and the AGM. Please note that these are the active members however there are other representatives to this group (10 in total). We need to gain more active members although working with a smaller group has been probably more efficient.

4. Key activities and results
Finalization and adoption of ECF
Dissemination
Webinars – UNEG
Workshops – EES, NY-UN, UKES, UNEG-EPE, Geneva
Products – design, production, distribution
Pilot projects
Supported 6 pilots in 5 organizations
Conducted progress monitoring
Disseminated lessons from pilots
ECF document finalized, printed and widely distributes
ECF leaflet and tool designed, printed
The key activities and results of the WG during 2016 and 2017 focused on finalizing the ECF document (and get it adopted), dissemination activities of the ECF and on supporting the development of pilot projects across UN organizations for the purpose of implementing the ECF.
Dissemination activities involved Susanne and I delivering webinars and workshops, as well as overseeing and managing the design, production and distribution of a number of information products. In terms of the webinars we have delivered one for UNEG with external commentators and we intend to repeat it this year and deliver it to other entities such as VOPEs both from the Global South and North.
This year, we have also delivered two workshops in New York in April, and a workshop that focused on evaluation consultants and the UNEG evaluation competency during the UKES conference last week. We plan to deliver a session during the EPE this week. We will also be delivering a similar workshop to the NY based one in Geneva following the UNEG week and another one is scheduled for participants of a UNSSC course on monitoring and evaluation in Bonn later this year. We participated at a Panel and delivered a workshop during the EES conference in Maastricht last year.
We hope that you have already seen and have a copy of the information products related to the ECF: the main publication, the booklet and the ECF wheel.
In terms of the pilot projects, we have managed the pilot project applications, assessed and selected pilots to launch, monitored their progress and elicited lessons learned. Currently, there are 4 ongoing pilots at UNFPA, WFP, UN Women and ILO. We will highlight some preliminary lessons shortly.

5. WFP - designing an Evaluation Learning programme
To strengthen professional competencies for decentralized evaluations
Initial lessons:
Target different groups of staff
Make the programme practical
Develop and support ‘learning cohorts’
Initial lessons…
The importance of the programme targeting different types of staff functions to accommodate the different types of evaluation knowledge required….(introduction, targeted at decision-makers, support functions to evaluations and the managers of evaluations)
The importance of making the programme ‘practical’ (to follow staff as they manage an evaluation) and to combine e-learning with face-to-face learning and knowledge sharing mechanism..
To develop and support the ‘learning cohorts’ after training and to encourage engagement in WFP’s online evaluation community….

6. ILO – internal evaluation training programme
To strengthen capacity to conduct internal programme and project evaluations.
Initial lessons:
It is a challenge to conduct distance learning with staff who are very busy with other tasks
Face-to-face training with coaching remains the best mean even though it costs more
Highly qualified trainees help to create an effective learning atmosphere.
Lessons related to curriculum design –preliminary material, field examples, theory and practical exercise
Initial lessons…
Curriculum development, Recruitment and selection, delivery of training, and inter-departmental cooperation - this is mentioned in the pilot progress report…but what lessons so far not clarified ?? Craig – can you please flesh the lessons out?
The below two lessons shared via last week…..
It is a challenge to conduct distance learning with staff who are very busy with other tasks.
Face-to-face training with coaching remains the best mean even though it costs more.
Preliminary information received before the start-up of the training builds the capacity of all trainees so that there is not a big variation in their knowledge base.
Participants appreciate a balance between theoretical presentations (paradigms and 'Theory of Change') and practical exercises (last day evaluation of campus facilities).
The ILO Regional Evaluation Officers from Africa and from Asia Pacific attended the pilot.  The concrete examples from the field that these colleagues provided complemented the generic presentations made by the facilitators.

7. UN Women - Professionalisation initiative
To strengthen the evaluation function
Initial lessons:
Adapt the ECF to M&E roles and to the specific organizational context
Engage Human Resources department
Use in-house existing resources
Ensure motivation - certificate of completion
Ensure that the process for credentialing has a base-line self assessment and assessment based on practical management of evaluation
To strengthen the evaluation function – process of credentialing to assure the appropriate skills and competencies for managing gender-responsive evaluations..
Initial lessons…
The importance to adapt UNEG evaluation competencies to M&E roles and to the specific context of UN Women
It is key to engage department for Human Resources
Also key to use in-house existing resources (for UN Women it has been the training centre and HR learning focal point)
Certificate after completed training is motivating factor…
Process for credentialing – base-line self assessment and assessment based on practical management of evaluation..

8. UNFPA – Self-assessment exercise
To strengthen self-reflective practice and to identify linkages between performance and professionals development needs
Initial lessons:
Reflect not only on technical but on interpersonal skills also
Identify different categories/functions of staff within an evaluation office
Link self-assessment to practical opportunities for capacity development
UNFPA – self-assessment exercise linked to identifying relevant professional development initiatives
To strengthen self-reflective practice and to identify linkages between performance and professionals development needs. This is a small initiative within a broader work to elaborate an ECD strategy UNFPA
Initial lessons…
There is great value to reflect on your competencies, and not only on technical skills but also on “soft skills” (for example communication skills)
That it is useful to identify different categories/functions of staff within an evaluation office
Important to think through how to link self-assessment to practical opportunities for capacity development for enhanced value of exercise and to be an instrument of encouragement.xercise linked to identifying relevant professional development initiatives

9. Proposal for a Work Plan 2017-2018
Continued implementation of the ECF pilots
HR focus and engagement
Expand the target groups
Continue collecting critical lessons
Continue with dissemination of the ECF
With emphasis on application
Webinars, workshops etc.
Have the ECF translated as a foundational document of UNEG
These activities reflect what may be viewed as continued needs that should or could be addressed under the professionalization umbrella.
The pilot projects are only few and there is a need to expand their application to other target groups, including to have an HR focus (how to use it in the HR context). During the workshops we held in New York, participants expressed that Heads of evaluation need to talk to and commit Heads of HR departments to gain traction in this area.
Both the ongoing pilots and introducing a mentoring programme provide practical initiatives and applications of the ECF.
Parking lot:
Use of rosters for evaluation consultants and staff
Compile best practice and draft guidance
Revision of the ethical guidelines and code of conduct

10. Proposal for a Work Plan 2017-2018
Continue engagement with other stakeholders
VOPEs from the Global North and the South)
Mentoring programme
Compile success factors and lessons on mentoring systems for evaluation
Compile success factors and lessons on mentoring systems for evaluation as input into UNEG guidance and best practice for organizations

11. Strategic options Option A: Status Quo
WG remains and continues as a group on its own
Option B: Redefine as part of ECD*
Professionalization becomes part of evaluation capacity development
Option C: Dismantle the WG
Main goals have been achieved and there is no need for additional tasks / activities
We now present few options to the heads of evaluation functions on the strategic direction of this working group. Since we have a proposed work plan and in consideration of consultation feedback with our members, we are in favour of Option B.
Option 1 means that the WG continues as is, with a new work plan for that we presented today
Option 2 means that professionalization is part and parcel of ECD, with NECD being one aspect of it. This would enable closer synergies with ECD efforts
Option 3 is about dismantling the WG altogether, given that the main goals as originally envisaged since 2014 have now been achieved (conceptualization of professionalization and revision of the ECF)
* Currently no ECD group, but would be good to have one in its own right with close ties to NECD

12. Background slides