Updating the CES Competencies for Evaluators: A Work in Progress Monday, May 28, 2081 10:30 am - 12:00 pm

Presentation Overview CRWG Members & Mandate Review Process Timelines Instructions for this Session Round Table Activity Discussion Wrap-up Next Steps

The Competency Review Working Group Members of the Competency Review Working Group (CRWG) include: 5 Credentialing Board Members Christine Frank, CE Karyn Hicks, CE Marthe Hurteau, CE Linda Lee, CE Michael Obrecht, CE Member at Large Birgitta Larsson CE VP of CES Board (ex officio) Gail Vallance Barrington, CE (Former VP, Chair)

An oil-change, not a new engine! The CRWG Mandate The CRWG will revisit the CES Competencies for Canadian Evaluation Practice to: Ensure relevance Remove overlaps/duplication Fill in gaps Ensure advancing skill sets for evaluators Adapt to changing environments in evaluation An oil-change, not a new engine!

Topics for Particular Consideration Cultural competencies generally & in relation to the CES commitment to the recommendations of the Truth and Reconciliation Commission Clarity on evaluation ethics Redundancies across competency statements PDP Evaluation findings International developments in evaluator competencies (e.g., AEA, Europe, UN, SDGs) Questions from CE applicants and new CEs from the 2016 Town Hall Series Board member suggestions

Topics Not Included CE application process CE requirements CE training requirements & objectives. (Once the scope of practice is agreed upon, the wording can be reviewed for measurability and action.)

CRWG Timelines Began December 2016 (was to take 6 months) 1st Draft completed February 2018 Feedback obtained (CB, International & Diversity Working Groups) Revised April 2018 2nd Draft presented May 2018 All feedback by June 30 Begin implementation September 2018

Number of Competencies Key Changes—Summary Competency Domain Number of Competencies Original Revised Change Reflective Practice 7 9 + 2 Technical Practice 16 10 - 6 Situational Practice - 2 Management Practice 6 - 1 Interpersonal Practice 5 - 5   All Domains 49 37 - 12 24% fewer Competencies 41% fewer words

Key Changes—Reflective Practice New: Specifies knowledge requirements (1.1) Addresses the place and role of transparency (1.7) Clarified: Recognizes evaluator’s reality in diverse contexts  (1.4) Strengthens intentional reflective practice (1.8) Expands professional learning and development (1.9) Moved: Respects all stakeholders (to Situational Practice)

Key Changes—Technical Practice Overall: Reduced 16 competencies to 10 Reduced the number of descriptors by around half per competency Concentrated on Reflecting all methodologies at a more general level Removing unnecessary words, adding clarity New: Focus on systematic, transparent & culturally relevant methods (2.8) Includes broader reporting mechanisms (2.10)

Key Changes—Situational Practice New: Uses evaluation processes & practices to support reconciliation & build stronger relationships among Indigenous and non-Indigenous peoples (CES TRC motions, 2016) (3.7) Acknowledges the importance of reciprocal processes (rather than the evaluator being the only one who shares knowledge and expertise) (3.2) Combined: Examines/responds to multiple human & natural contexts… (3.1)—was 2 competencies. Identifies stakeholders’ needs…recognizing diversity… (3.2)—was 2 competencies.

Key Changes—Management Practice New: Provides leadership to the evaluation project. (4.1) Combined: Identifies and effectively uses required human, financial and technical resources. (4.3) was 2 competencies. Moved: Attends to issues of evaluation feasibility (now in Technical Practice.) (2.2)

Key Changes—Interpersonal Practice A very broad topic. We have retained only the most significant ones that can also be observed and measured & raised the level of some statements New: Uses communication strategies appropriate to cultural context… (5.1) Demonstrates the ability to build partnerships within the evaluation context. (5.5) Combined: Demonstrates the ability to negotiate, reach shared understanding, reconcile different points of view, and limit conflict. (5.4) (Was 3 more specific competencies.) Removed: Competencies more related to management practice and reflective practice domains (e.g. negotiation skills, collaboration skills and professional credibility) & those related to technical practice.

Instructions for This Session Brief review of changes in each domain area Revolving round tables (10 minutes per domain area) Reflective Practice (Birgitta Larsson) Technical Practice (Christine Frank) Situational Practice (Linda Lee) Management Practice (Karyn Hicks) Interpersonal Practice (Gail Vallance Barrington) Move to next table when timer rings Large Group Feedback Wrap-up Next Steps

Final Thoughts Questions? Comments? Fill out feedback form and/or Send comments & feedback by June 30, 2018 gbarrington@barringtonresearchgrp.com