1. Measures and Evaluation January 2015

2. Folie mit Grafik Do - implementation objectives agreement Implementation of processes Check - evaluation and assessment evaluation date / results Act – review, feedback and procedures for change Plan - planning purpose and plan goals measures Methodology To repeat: PDCA-Circle

3. GOALS – „W-Rule“ To define: ResponsibilityWho? Target dateWhen? Indicator for evaluationWhat? o Goal dataHow much? (Ressources)With what? PurposeWhy? ContinuationWhat afterwards?

4. MEASURES

5. The measure is the conrete definition, what must be done to reach the goal! Who is responsible? Who is executing? What?  concrete steps Which method? When?  target data for every step With what?  ressources Actionplan = Measureplan

6. Actionplan Subtarget (what?) Responsibility (who?) Ressources (with what?) Measure(s) (how to do?) Target data (when?) Evaluation (Instruments) Project: _________________________________________________________________________ Goal: ___________________________________________________________________________ Projectleader: _____________________________________________________________________

7. To communicate goals and measures cooperation - 100 % communication! Help Said doesn´t meanheardInformation Heard doesn´t meanrealizedStimulation Realized doesn´t meanagreedcommunication Agreed doesn´t meanrememberedTo participate stakeholders Remembered doesn´t meanappliedLeadership Applied doesn´t meanmaintainedRepeating and showing the success

8. EVALUATION

9. Evaluation … ______________________________________________________________________________________________________________________________ … is the possibility, to verify an adoption by data

10. Evaluation helps … ______________________________________________________________________________________________________________________________ … estimating processes … developing … improving … controlling of measures … comparing results

11. EVALUATION - DEFINITION „analysis and valuation of processes and organisations“ e.g. in education- and health-scopes „systematic, databased description and valuation of programms, projects and institutions“

12. Evaluation … … makes useful and sure information available for stakeholders … orients on concrete questions of decision makers … is honest … will improve = evaluation for shaping … will value = evaluation for balancing

13. Types of Evaluation (1) Selfevaluation e. g. Individual feedback External evaluation e. g. TQM-external-Assessment Peer Review

14. Types of evaluation (2) Estimating Persons / Institutions Mostly linked with (negativ) sanctions To enforce unpopular measures Estimating measures To check the effetiveness of the measures criteria und measuring devices are necassary Persons concerned become to participants Not for efficiency comparisons!

15. 15 Quality Circle Plan DoAct Check Evaluation School programme Evaluation report

16. Essential characteristics Utility focusing on intent and purpose – involved persons – concerned persons Practicability realistic, well thought, effectiveness Fairness respectful interaction with concerned persons Accuracy valid information relating to the question

17. Utility Identification of involved and concerned persons Clarification of the evaluation purpose Credibility and competence of the evaluator Selection and extent of the information Transparency of values Completness and clarity of reports Timeliness of the evaluation

18. Practicability Appropriate procedure Diplomatic action Efficiency

19. Fairness Compliance of formal arrangements Protection of individual rights Complete and fair assessment Impartial procedure and report Publication of results

20. Accuracy Description of the object being evaluated Context analysis Description of purpose and procedure Disclosure of sources of information Systematic fault control Analysis of qualitativ and quantitativ information Well-founded conclusion

21. Indicators of evaluation Clear definition of evaluation goals What shows, that a goal, a value, …. in relation to the object of evaluation is reached?

22. Scopes of evaluation Intern – one school Selfevaluation e.g. teaching actions projekts and special measures in a class Projects and measures in the school Extern – more schools e.g. inspectorates Standards, central final exams, … International evaluations - PISA, PIRLS …

23. Basic framework of succesful evaluation Unstandable reasons for the choice of the objective of evaluation Positive approach Relevant questions Effective and practical methods View of the whole picture Secured framework conditions Clear responsibilities Visible using of results

24. Methods und Instruments ______________________________________________________________________________________________________________________________ Questionnaire Interview Observation Card surveying, point monitoring, … or …

25. Question and answer Question Focused on the subject Precise (choice of words specific to target group) Free from value judgements Answer options open Question for decision (yes/no/I don´t know) Gradation „how accurate the information is“ (completly agree -... - strongly disagree) Scale of marks (1 bis 5/6)

26. Procedure of evaluation – step by step Preparing and planing timeframe, responsibilities, involved persons, information channels, indicators, goal, type of presentation of the results Choice of methods in order to goals and target groups Conducting the evaluation involved persons, responsibilities, timeframe, choice of the suitable time Coding and analysis protect the anonymity, timeframe; who can see the results? Summary of the results Interpretation und consequences prepare the context, possible consequences Presentation of the results and outlook

27. … and for a successfull process I wish you … ______________________________________________________________________________________________________________________________ Energy A motivated team Joy in experimenting Courage Success Serenity Endurance Farsightedness Engagement