1 Planning an Evaluation Observations from a Practitioner.

Slides:

Advertisements

Similar presentations

Project Cycle Management

Advertisements

1 Survey of Super LEAs Evaluation Systems Performance Evaluation Advisory Council July 16 th, 2010.

Scaling up the global initiative on the implementation of the SNA and supporting statistics Meeting on Scaling up the coordination and resources for the.

Integrating the NASP Practice Model Into Presentations: Resource Slides Referencing the NASP Practice Model in professional development presentations helps.

Training activities administration and logistical support

Licences for Europe Introductory meeting, 4 February WG 3 - Audiovisual sector and cultural heritage institutions.

1 Evaluating Communication Plans Cvetina Yocheva Evaluation Unit DG REGIO 02/12/2009.

THE GLOBAL FRAMEWORK FOR CLIMATE SERVICES: NEXT STEPS Geoff Love Director, Responsible for the Taskforce Secretariat World Meteorological Organization.

1 Establishing Performance Indicators in Support of The Illinois Commitment Presented to the Illinois Board of Higher Education December 11, 2001.

Supporting further and higher education Setting the scene Rhona Sharpe Learner Experience Support Project.

Recall The Team Skills 1. Analyzing the Problem (with 5 steps) 1.Gain agreement on the problem definition. 2.Understand the root causes 3.Identify the.

CARE Tajikistan Knowledge Transfer for Key Roles ACD Program October 2006.

How to commence the IT Modernization Process?

Guidelines for good project management An output of the RE-ACT project under Interact Ronan Gingles for AER, Strasbourg, 14 June 2007.

1 An Investigation into the Development of a Computerised Information System for NHS Physiotherapy Services in England Dr Robert J. Jones East Sussex Hospitals.

Imran Hussain University of Management and Technology (UMT)

1 Workshop EVALUATION PROCESS – PROGRAMMES AND PROJECTS Waterford 10 TH April Dr Jim Fitzpatrick Managing Director Fitzpatrick Associates 10 Lad.

Project Management Process. Project Complexity means that: a team of people are needed to supply expertise the work needs to be broken into manageable.

Benchmarking as a management tool for continuous improvement in public services u Presentation to Ministry of Culture of the Russian Federation u Peter.

Empowering Staff Through Institute Planning (ESTIP) Executive Workshop Institute Name: XXXXXX Presenter: XXXXXX Date: XXXXXX.

1 SOCIAL RESEARCH ASSOCIATION IRELAND/IRISH EVALUATION NETWORK SEMINAR GOOD PRACTICE IN COMMISSIONING RESEARCH AND EVALUATION 10 TH JANUARY 2006.

Business research methods: data sources

The Analyst as a Project Manager

Key Elements, Emerging Trends and Promising Practices in Monitoring and Evaluation of Development Results Lawrence S. Cooley, President Management Systems.

Learning and Development Developing leaders and managers

Generic Employability Skills Centre for Developing and Evaluating Lifelong Learning (CDELL)

HOW TO WRITE A GOOD TERMS OF REFERENCE FOR FOR EVALUATION Programme Management Interest Group 19 October 2010 Pinky Mashigo.

Project Management – The Project Charter

Needs Analysis Session Scottish Community Development Centre November 2007.

SA Capstone Requirements and Design Week 10 SYST Winter 2013 Instructors: Jerry Kotuba & Joe Varrasso.

1 MBA PROJECT Nasir Afghan/Asad Ilyas. 2 Objective To enable MBA students to execute a client focused challenging assignment and to enhance.

Literature Review and Parts of Proposal

DEVELOPING YOUR PROPOSAL

Certificate IV in Project Management Introduction to Project Management Course Number Qualification Code BSB41507.

1 ISA&D7‏/8‏/ ISA&D7‏/8‏/ ISA&D7‏/8‏/2013 IS Projects: Success and Failure Role of the Project Manager Project Management Tasks in SDLC.

© 2012 Cengage Learning. All Rights Reserved. This edition is intended for use outside of the U.S. only, with content that may be different from the U.S.

UNEP Training Resource ManualTopic 1 Slide 1 Aims and objectives of EIA F modify and improve design F ensure efficient resource use F enhance social aspects.

Switch off your Mobiles Phones or Change Profile to Silent Mode.

FOCUS – Framing, Organizing, Collecting, Understanding, and Synthesizing Paul Friga’s McKinsey Engagement.

Overall Quality Assurance, Selecting and managing external consultants and outsourcing Baku Training Module.

Governance and Commissioning Natalie White DCSF Consultant

Copyright  2005 McGraw-Hill Australia Pty Ltd PPTs t/a Australian Human Resources Management by Jeremy Seward and Tim Dein Slides prepared by Michelle.

Lecture 6 24/9/15. Project … is a planned undertaking that has a beginning and an end and that produces a desired result or product Organized activities.

SOLUTION What kind of plan do we need? How will we know if the work is on track to be done? How quickly can we get this done? How long will this work take.

Hungarian Evaluation Study Tour Dublin 8/9 May 2003 External Evaluation: A Consultant’s Perspective 1.

What is project management?

Managing programs that promote personal effectiveness.

The Role of Statistics and Statisticians in Effectiveness Evaluations Wendy Bergerud Research Branch BC Min. of Forests November 2002.

Project Implementation Management for Success. Focus of Project Management  managing for results,  ensuring sustainability,  stakeholder participation,

Copyright 2010, The World Bank Group. All Rights Reserved. QUALITY ASSURANCE AND EVALUATION Part 1: Quality Assurance 1.

Evaluating Engagement Judging the outcome above the noise of squeaky wheels Heather Shaw, Department of Sustainability & Environment Jessica Dart, Clear.

1 Systems Analysis & Design 7 th Edition Chapter 2.

Switch off your Mobiles Phones or Change Profile to Silent Mode.

Presentation to the Ad-hoc Joint Sub-Committee on Parliamentary Oversight and Accountability Wednesday 20 March 2002 PUBLIC SERVICE MONITORING AND EVALUATION.

Licences for Europe Introductory meeting, 4 February WG 4 – Text and data mining.

Systems Analysis Lecture 5 Requirements Investigation and Analysis 1 BTEC HNC Systems Support Castle College 2007/8.

Contracting for Evaluation Products and Services by James B. Bell

Evaluation What is evaluation?

EIAScreening6(Gajaseni, 2007)1 II. Scoping. EIAScreening6(Gajaseni, 2007)2 Scoping Definition: is a process of interaction between the interested public,

Signalling Programme External Stakeholder Meeting on September 17, 2009.

Learning and Development Developing leaders and managers

Systems Analysis and Design in a Changing World, 4th Edition

Evaluation from the External Evaluator’s Perspective

DARM 2013: Assessment and decision making

Ivor Beazley, World Bank

Management development Bob Riddaway

Outcome Harvesting nitty- gritty Promise and Pitfalls of Participatory Design Atlanta, 10:45–11:30 29 October, 2016.

Learning and Development Developing leaders and managers

Helene Skikos DG Education and Culture

Presentation transcript:

1 Planning an Evaluation Observations from a Practitioner

Topics 2 Introductory remarks Common pitfalls A multi-dimensional activity Key planning steps Some practical tips

Some Overall Considerations 3 A wide variety of different contexts (e.g. doing v supervising, policy v service delivery, ex ante v ex post, technical v non-technical) Planning and doing closely related Experience across a wide range of organisations, topics, etc Overlaps with planning other types of assignments An external consultancy perspective

Pitfalls in Evaluation 4 1.Misunderstand context 2.Objectives unclear, not agreed 3.Client unclear, not agreed 4.Lack of balance, being one-dimensional 5.Thinking you know the answer 6.Work thats not used in the end 7.Having no analytical framework 8.Being over-ambitious 9.Not having the right expertise 10.Failing to consult stakeholders 11.Not allowing time for project/process/management 12.No intellectual leadership 13.Report not doing work justice PLANNING IS PREVENTING THESE

A Multi-dimensional Activity 5 Managing the team Stakeholder Involvement Research Analysis Time, resources, budget Client, user relations EVALUATION A Balancing Act

Key Planning Steps 6 1.Establish/Understand Context who is the client? why being done? any specific use intended? what kind of evaluation is needed 2.Obtain/Prepare/Agree Brief (ToR) is there one already? is it clear? write one? is it agreed? 3.Prepare Work Plan (Proposal) overall approach (i.e. how interpreting brief, how going about it) analytical framework (i.e. overall logic) methodology/techniques (e.g. CBA) work programme (i.e. the data collection)

Key Steps Continued 7 4.Evaluation Team/Resources (budget) no. of people/person days types of people necessary expertise (e.g. on technical aspects) 5.The Output/Report/Schedule meet how often, how many, when? nature of report e.g. length? style? nature? presentations?

Some Practical Tips 8 watch for scope-creep keep re-reading the brief estimate time needed and double it! avoid surprising the client dont over-promise structure the report early on set internal deadlines SATISFACTION = PERCEPTIONS MINUS EXPECTATIONS (S=P-E)