Factors that Influence Evaluation Utilisation

Theoretical Perspectives Michael Quinn Patton’s ‘Utilisation Focused Evaluation’ Addresses issue of use of evaluation findings in decision-making Stakeholders more likely to use evaluation findings if understand and feel ownership of findings

Theoretical Perspectives contd Carole Weiss (1998) defined four categories of evaluation use: Guidance for action: direct instrumental use of findings Reinforcement of prior beliefs: enhancing confidence of those who press for change Mobilisation of support for desired change Enlightenment: increase in understanding

Theoretical Perspectives contd RAPID (at ODI) Divides influence on use into four areas: –Political context –Nature of the evidence –Links –External factors

Key Factors Affecting Utilisation 1The Personal Factor 2Political Considerations 3Organisational culture 4Evidence 5Effective Dissemination / Communication

Key Factors Affecting Utilisation 1The Personal Factor Finding the proper ‘owner/s’ at senior mgmt. Quality, quantity & timing of interactions is important. Right people for the right issues. Relationships need ongoing nurturing. Consider need to identify multiple stakeholder communities.

Key Factors Affecting Utilisation contd 2Political Considerations Getting the right information to the right people. Creating the right links. Understand how policy makers think. Identify ‘windows of (policy) opportunity’.

Key Factors Affecting Utilisation contd 3 Organisational Culture Evaluation is part of a broader learning process that promotes ownership and establishes a standard follow-up procedure Opportunities and constraints

Key Factors Affecting Utilisation contd Essential characteristics of a follow-up process: Evaluation units play role of facilitator Follow-up includes decision-making by senior mgmt Follow-up format is established within departments concerned Ownership of results thus clearly defined.

Key Factors Affecting Utilisation contd 4 Evidence Relevance, timeliness, brevity, quality. Research approach, methodology, and credibility of evidence Reinforcement of prior beliefs / coherence with other messages and conceptual models

Key Factors Affecting Utilisation contd 5Dissemination and Communication Strategy Active and diversified approaches to dissemination and communication Differentiated, targeted audiences; differentiated products; pro-active follow-up, etc