1. 3rd European CAF Users Event CAF Inspiring Change Evaluation report
Lisbon, Portugal
March 2008

2. 3rd European CAF Users Event
Evaluation Report
Objectives
Giving input on strengths and weaknesses of 3rd CAF Event
event overview (facts, programme…)
quantitative and qualitative evaluation
Sharing the experience with future events organizers
learning lessons for continuous improvement

3. 3rd European CAF Users Event
When…
11-12 October 2007
Where…
Lisbon, Calouste Gulbenkian Foundation
Organised by…
DGAEP under the Portuguese Presidency, with the support of European Institute of Public Administration (EIPA)

4. 3rd European CAF Users Event
With who…
278 participants,
from 25 countries
Europeans Institutions, EIPA and EFQM

5. 3rd European CAF Users Event
With who…
Participants by country
AT (9)
BE (11)
BG (7)
CY (2)
CZ (4)
DK (10)
DE (6)
EE (10)
ES (8)
FL (4)
FR (4)
GR (13)
HU (9)
IT (13)
IRL (2)
LT (9)
LU (7)
NO (7)
PL (17)
PT (67)
SE (1)
SL (14)
RO (12)
UK (1)
EIPA (4)
EFQM (2)
Turkey (3)
Eur Inst. (4)

6. 3rd European CAF Users Event
With who…

7. 3rd European CAF Users Event
With who…
Registered participants (and guests)
Effective participants
Attendance analysis

8. 3rd European CAF Users Event
With who…
FEE participants – 181
(Participants Fee = 100€)
No FEE participants - 97
(DGAEP, IPSG, CAF NC, EUPAN, speakers and case presenters)

9. 3rd European CAF Users Event
With who… Fee / No Fee participants by country

10. 3rd European CAF Users Event
How was it…
Event Programme
The programme was organised under 3 different perspectives of the main theme
CAF inspiring Change
People
Innovate and change processes
The commitment of leaders

11. 3rd European CAF Users Event
How was it…
Event Programme (cont.)
6 Plenary Sessions
Welcome and opening; The CAF as an instrument for a bottom-up European quality approach in the public sector
People: the heart of the organisation
Processes: the heart of the matter?
Towards the vision – Committed leadership
National and regional strategies to disseminate the CAF & recent breakthroughs of the CAF in Europe
Presentation of the CAF movie

12. 3rd European CAF Users Event
How was it…
Event Programme (cont.)
15 Parallel Sessions
9 sessions with 18 National Cases (AT, BE, BG, CY, CZ, DE, EE, ES, DK, FR, GR, HU, IT, NO, PL, PT, RO, SL)
3 general parallel sessions (2 rounds)
CAF clinic
CAF eTool and user’s database
Communication strategy for the CAF

13. 3rd European CAF Users Event
How was it…
General attendance in parallel sessions
The most attended sessions:
Communication Strategy for CAF
National cases from Denmark and France
National cases from Hungary and Portugal

14. 3rd European CAF Users Event
What was told about…
Evaluation form
(carried out online 1 week after the event)
93 replies (last Event: 76 replies)
…from 21 different countries
…from 4 types of representations

15. 3rd European CAF Users Event
What was told about…
Evaluation form - questions about:
Content of the presentations – plenary sessions, parallel sessions and general sessions on CAF
CAF movie – its purpose
The new insights for the participant’s organisation
The organisation of the event
General suggestions/remarks

16. 3rd European CAF Users Event
What was told about…
Replies by representative organisations

17. 3rd European CAF Users Event
What was told about…
Replies by country (nº)

18. 3rd European CAF Users Event
What was told about…
Replies by country (%)

19. 3rd European CAF Users Event
What was told about…
Content of presentations
Plenary sessions
People
Processes
Leadership

20. 3rd European CAF Users Event
What was told about…
Content of presentations
Plenary sessions (cont)

21. 3rd European CAF Users Event
What was told about…
Content of presentations
National cases

22. 3rd European CAF Users Event
What was told about…
Content of presentations
General sessions on CAF

23. 3rd European CAF Users Event
What was told about…
Content of presentations
Qualitative remarks
Strengths
High levels of attendance and active participation
Innovative approach in the CAF Clinic presentation

24. 3rd European CAF Users Event
What was told about…
Content of presentations
Qualitative remarks
To improve…
More time for questions and discussion in national cases sessions
Less but better presentations – more practical and informative approaches, and less theoretical
The case presentations should focus more on the results of CAF implementation and less on the process

25. 3rd European CAF Users Event
What was told about…
CAF Movie
Does the movie shows the European dimension of CAF and it’s an attractive tool to promote CAF trough goods practices?

26. 3rd European CAF Users Event
What was told about…
CAF Movie (cont.)
Qualitative evaluation
Excellent example of cross-european collaboration on public administration
Should focus more on “how to use CAF” (technical info versus awareness on CAF)
Why not a shorter version? It's a bit too long

27. 3rd European CAF Users Event
What was told about…
New insights
Have you gained news insights for your own organisation?

28. 3rd European CAF Users Event
What was told about…
New insights (cont.)
YES…on the following issues:
Processes and Committed Leadership
Benchmarking and bench learning opportunities

29. 3rd European CAF Users Event
What was told about….
Event organisation and logistic
Well appreciated, especially the location and the CD with presentations
Some remarks on the schedule (some sessions started late) and the payment system (little bit complicated)
Suggestion: give the presentations not only on CD support

30. 3rd European CAF Users Event
What was told about…
General suggestions/remarks
“CAF for beginners” and CAF for “second generation”…
Previously check the presentations for the event to assure high quality

31. 3rd European CAF Users Event
What was told about…
General suggestions/remarks
More time for discussion in parallel sessions
Case presentations - more focus on results of CAF implementation and less on the process

32. 3rd European CAF Users Event
What was told about…
General suggestions/remarks
More opportunities for informal networking and exchange of experiences
Case presenters – Improve the language skills…

33. 3rd European CAF Users Event
At the end, what we can suggest about it…
Programme
Plenary sessions – speakers must be carefully chosen; must bring new perspectives on the subjects (avoid “more of the same”)
Parallel sessions – very useful to share experiences, practices and knowledge. Time for debate is very important in these sessions
CAF clinic – a success to repeat! Practical approaches are well appreciated

34. 3rd European CAF Users Event
At the end, what we can suggest about it…
Organisation
More responsibility for CAF NC on the matter of evaluating and choosing the national cases presentations in terms of:
quality of cases to present and presentations itself
english fluent speakers
An event location that allow the informal meeting of all participants during breaks

35. 3rd European CAF Users Event
At the end, what we can suggest about it…
Evaluation
Evaluation form – distribution at the event’s last day as well as carried it out online one week after, to improve the number of replies
Improve the evaluation form - see new proposal for discussion

36. 3rd European CAF Users Event
At the end, what we can suggest about it…
Improving the evaluation form – proposal for discussion
New or reformulated topics
Programme & Documentation
Content of presentations
Time allocation for the different activities
Documentation (useful, accurate, innovative)
Event organisation – more discriminated topics

37. 3rd European CAF Users Event
At the end, what we can suggest about it…
Improving the evaluation form – proposal for discussion (cont)
New scale for measurement
More clear
Even number scale, to avoid answers in the middle categories
Allows better treatment and report
Example
Not informative (--)
Little informative (-)
 Informative (+)
 Very informative (++)
N/O No opinion

38. 3rd European CAF Users Event
Find out about it…
CD ROM with the presentations, distributed to all participants
Divulgation on DGAEP and EIPA web pages