Measures and Evaluation January 2015

Folie mit Grafik Do - implementation objectives agreement Implementation of processes Check - evaluation and assessment evaluation date / results Act – review, feedback and procedures for change Plan - planning purpose and plan goals measures Methodology To repeat: PDCA-Circle

GOALS – „W-Rule“ To define: ResponsibilityWho? Target dateWhen? Indicator for evaluationWhat? o Goal dataHow much? (Ressources)With what? PurposeWhy? ContinuationWhat afterwards?

MEASURES

The measure is the conrete definition, what must be done to reach the goal! Who is responsible? Who is executing? What?  concrete steps Which method? When?  target data for every step With what?  ressources Actionplan = Measureplan

Actionplan Subtarget (what?) Responsibility (who?) Ressources (with what?) Measure(s) (how to do?) Target data (when?) Evaluation (Instruments) Project: _________________________________________________________________________ Goal: ___________________________________________________________________________ Projectleader: _____________________________________________________________________

To communicate goals and measures cooperation % communication! Help Said doesn´t meanheardInformation Heard doesn´t meanrealizedStimulation Realized doesn´t meanagreedcommunication Agreed doesn´t meanrememberedTo participate stakeholders Remembered doesn´t meanappliedLeadership Applied doesn´t meanmaintainedRepeating and showing the success

EVALUATION

Evaluation … ______________________________________________________________________________________________________________________________ … is the possibility, to verify an adoption by data

Evaluation helps … ______________________________________________________________________________________________________________________________ … estimating processes … developing … improving … controlling of measures … comparing results

EVALUATION - DEFINITION „analysis and valuation of processes and organisations“ e.g. in education- and health-scopes „systematic, databased description and valuation of programms, projects and institutions“

Evaluation … … makes useful and sure information available for stakeholders … orients on concrete questions of decision makers … is honest … will improve = evaluation for shaping … will value = evaluation for balancing

Types of Evaluation (1) Selfevaluation e. g. Individual feedback External evaluation e. g. TQM-external-Assessment Peer Review

Types of evaluation (2) Estimating Persons / Institutions Mostly linked with (negativ) sanctions To enforce unpopular measures Estimating measures To check the effetiveness of the measures criteria und measuring devices are necassary Persons concerned become to participants Not for efficiency comparisons!

15 Quality Circle Plan DoAct Check Evaluation School programme Evaluation report

Essential characteristics Utility focusing on intent and purpose – involved persons – concerned persons Practicability realistic, well thought, effectiveness Fairness respectful interaction with concerned persons Accuracy valid information relating to the question

Utility Identification of involved and concerned persons Clarification of the evaluation purpose Credibility and competence of the evaluator Selection and extent of the information Transparency of values Completness and clarity of reports Timeliness of the evaluation

Practicability Appropriate procedure Diplomatic action Efficiency

Fairness Compliance of formal arrangements Protection of individual rights Complete and fair assessment Impartial procedure and report Publication of results

Accuracy Description of the object being evaluated Context analysis Description of purpose and procedure Disclosure of sources of information Systematic fault control Analysis of qualitativ and quantitativ information Well-founded conclusion

Indicators of evaluation Clear definition of evaluation goals What shows, that a goal, a value, …. in relation to the object of evaluation is reached?

Scopes of evaluation Intern – one school Selfevaluation e.g. teaching actions projekts and special measures in a class Projects and measures in the school Extern – more schools e.g. inspectorates Standards, central final exams, … International evaluations - PISA, PIRLS …

Basic framework of succesful evaluation Unstandable reasons for the choice of the objective of evaluation Positive approach Relevant questions Effective and practical methods View of the whole picture Secured framework conditions Clear responsibilities Visible using of results

Methods und Instruments ______________________________________________________________________________________________________________________________ Questionnaire Interview Observation Card surveying, point monitoring, … or …

Question and answer Question Focused on the subject Precise (choice of words specific to target group) Free from value judgements Answer options open Question for decision (yes/no/I don´t know) Gradation „how accurate the information is“ (completly agree strongly disagree) Scale of marks (1 bis 5/6)

Procedure of evaluation – step by step Preparing and planing timeframe, responsibilities, involved persons, information channels, indicators, goal, type of presentation of the results Choice of methods in order to goals and target groups Conducting the evaluation involved persons, responsibilities, timeframe, choice of the suitable time Coding and analysis protect the anonymity, timeframe; who can see the results? Summary of the results Interpretation und consequences prepare the context, possible consequences Presentation of the results and outlook

… and for a successfull process I wish you … ______________________________________________________________________________________________________________________________ Energy A motivated team Joy in experimenting Courage Success Serenity Endurance Farsightedness Engagement