 Now we are ready to write our evaluation report.  Basically we are going to fill our content to the checklist boxes we learned in lec2. S519.

Slides:



Advertisements
Similar presentations
Critical Reading Strategies: Overview of Research Process
Advertisements

Analyzing Student Work
S519: Evaluation of Information Systems Analyzing data: value and importance Ch6+7.
 How to infer causation: 8 strategies?  How to put them together? S519.
 Systematic determination of the quality or value of something (Scriven, 1991)  What can we evaluate?  Projects, programs, or organizations  Personnel.
Evaluation.
Getting on the same page… Creating a common language to use today.
Writing Reports: Identify these stages I) Obtaining a clear specification II) Research & preparation III) Report writing.
S519: Evaluation of Information Systems Evaluation Criteria Ch3+4.
S519: Evaluation of Information Systems Understanding Evaluation Ch1+2.
Evaluation. Practical Evaluation Michael Quinn Patton.
Technical Writing Function. The purpose of having guidelines is to make the document more readable. Standard guidelines govern – Format – page layout,
Evaluation of Training and Education Activities. Objectives By the end of this presentation, participants will be able to List reasons why evaluation.
Learning Outcomes from Report-Writing Unit
Report Writing Format.
Product Evaluation the outcome phase. Do the magic bullets work? How do you know when an innovative educational program has “worked”? How do you know.
Reporting and Using Evaluation Results Presented on 6/18/15.
Reporting & Ethical Standards EPSY 5245 Michael C. Rodriguez.
1 Framework Programme 7 Guide for Applicants
Applying the Principles of Prior Learning Assessment Debra A. Dagavarian Diane Holtzman Dennis Fotia.
Types of evaluation examine different aspects of performance Resources (Inputs) ActivitiesOutputs Short-Term Outcomes Intermediate Outcomes (through customers)
Professional Certificate – Managing Public Accounts Committees Ian “Ren” Rennie.
Too expensive Too complicated Too time consuming.
Quality assurance activities at EUROSTAT CCSA Conference Helsinki, 6-7 May 2010 Martina Hahn, Eurostat.
1 Introduction to Evaluating the Minnesota Demonstration Program Paint Product Stewardship Initiative September 19, 2007 Seattle, WA Matt Keene, Evaluation.
S519: Evaluation of Information Systems
Note to evaluator… The overall purpose of this presentation is to guide evaluators through the completion of step 7 of the UFE checklist and to “level.
Academic Essays & Report Writing
Evaluation Research and Engineering Education Lesley Jolly For AaeE ERM wiki at
1 L643: Evaluation of Information Systems Week 5: February 4, 2008.
Proposal Development Sample Proposal Format Mahmoud K. El -Jafari College of Business and Economics Al-Quds University – Jerusalem April 11,2007.
Chapter 13– Strategies for Effective Oral Presentations The goal of the presentation is to communicate, clearly and concisely, the results and implications.
10/10/2015 IENG 471 Facilities Planning 1 IENG Lecture END Project Report Requirements & Project Presentation Information.
Understanding Meaning and Importance of Competency Based Assessment
EVALUATION APPROACHES Heather Aquilina 24 March 2015.
The Conclusion and The Defense CSCI 6620 Spring 2014 Thesis Projects: Chapters 11 and 12 CSCI 6620 Spring 2014 Thesis Projects: Chapters 11 and 12.
Elkin High School Beth Felts.  Introduce students to the principles, concepts, and software applications used in the management of projects  Through.
Small Business Consulting Project Guidelines. 2 Milestones Conduct Phase I (Initial Client Interview) by Monday April 6th Complete Phase I (Description)
S519: Evaluation of Information Systems Analyzing data: value and importance Ch6+7.
 Read through problems  Identify problems you think your team has the capacity and interest to solve  Prioritize the problems and indicate the.
Project Report. Suggested TOC Executive Summary Project Background and Assumptions Vision and Mission Statements Objectives SWOT Analysis Recommended.
HOW TO WRITE A SCIENTIFIC PUBLICATION Karl-Heinz Schwalbe You just sit down and start writing?
S519: Evaluation of Information Systems Result D-Ch10.
DESIGN PROPOSAL REPORT. Why write a proposal? Basic means of convincing someone to support a project. Important tool for organizing time and resources.
S519.  What is evaluation?  What are the steps involved?  What are step1 and step2?  What are absolute or relative merit? S519.
Professional Certificate in Electoral Processes Understanding and Demonstrating Assessment Criteria Facilitator: Tony Cash.
Chapter Fourteen Communicating the Research Results and Managing Marketing Research Chapter Fourteen.
S519: Evaluation of Information Systems Meta-evaluation D-Ch11.
12/23/2015 IENG 471 Facilities Planning 1 IENG Lecture 11 Project Requirements & Project Data.
Customer Focus Module Preview This PowerPoint provides a sample of the Strategic Planning Module PowerPoint. The actual Strategic Planning PowerPoint is.
Communicating Marketing Research Findings
Fundamentals of Governance: Parliament and Government Understanding and Demonstrating Assessment Criteria Facilitator: Tony Cash.
S519: Evaluation of Information Systems Understanding Evaluation Ch1+2.
Unit 9: Evaluating a Public Health Surveillance System #1-9-1.
Helpful hints for planning your Wednesday investigation.
Web Analytics & Social Media Monitoring Assignment Briefing June and September 2013 Clive Whysall CAM Examiner.
Implementing Digital Campaigns Clive Whysall CAM Examiner Assignment brief December 2013 / March 2014.
Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 11. Reporting.
Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 10. Evaluation.
PG-26765: Culture and People
Writing Scientific Research Paper
Program Evaluation ED 740 Study Team Project Program Evaluation
MaryCatherine Jones, MPH, Public Health Consultant, CVH Team
Research Methods Project
Forging the Innovation Generation
Meta-evaluation.
S519: Evaluation of Information Systems
Style You need to demonstrate knowledge and understanding beyond undergraduate level and should also reach a level of scope and depth beyond that taught.
Creating a Consulting Report
STEPS Site Report.
Presentation transcript:

 Now we are ready to write our evaluation report.  Basically we are going to fill our content to the checklist boxes we learned in lec2. S519

I. Executive Summary II. Preface III. Methodology 1. Background & Context 2. Descriptions & Definitions 3. Consumers 4. Resources 5. Values 6. Process Evaluation 7. Outcome Evaluation 8 & 9. Comparative Cost-Effectiveness 10. Exportability 11. Overall Significance 12. Recommendations & Explanations 13. Responsibilities 14. Reporting & Follow-up 15. Meta-evaluation S519

 To orient readers to the basics of :  what the evaluation is and  why the evaluation was done  What the main approach was S519

 Shows a short overview (1-2 pages) of what was evaluated and what the main findings were.  You can consider to include the followings:  Very short description of the program  The overall conclusion about the quality or value of the evaluation  The graphical profile of the evaluand‘s performance (see Exhibit7.6)  Several (<7) bullet points about the most important strengths and weaknesses. S519

 Address the following questions:  Who asked for the evaluation and why?  What are the main evaluation questions?  Is this a formative or summative evaluation?  Who are the main audiences for this evaluation report?  Mainly based on your work in Ch2  Please always provide justifications for your conclusions S519

 The main methodologies used in the evaluation  How you set up your experiments  How you collect data  How you analyze your data?  How you draw conclusion  And each with why. S519

 To represent all the initial ingredients  Background  Context  What it is  Whom it serves  The nature and limitation of any resources  Where the values come from S519

 Incude just enough information for readers to be able to understand the basic retionale for the program  Contents are:  Why did this program or product come into existence in the first place (needs assessment)  How is the evaluation supposed to address the needs and problems?  What are the main context of evaluands (e.g. Physical, economic, political) to facilitate or constrain the evaluation? S519

 Describe your evaluand in enough details  Definition of important terms S519

 Identify the actual and potential recipients or users of the evaluand  Describe consumers in geographic locatoin, demographics  Downstream impactees S519

 Describe the available and important resources (which helps to understand the conclusion of the evaluation)  Funds/budget  Physical space  Experience  networks S519

 To convey to the audience how the evaluation team determinded what should be considered as „valuable“ or „high quality“ for the evaluand.  Justify the validity S519

 Getting evaluation explicitly S519

 The issues of evaluation, content and implementation (see Ch4)  Ethics, the priniciple of equity and fairness  Consistency with professional and scientific standards  Efficiency (i.e, minimal wasted effort or resource)  Needs of consumers (e.g., timeliness, learning style, current knowledge)  Needs of staff (e.g., performance on tasks and activities) S519

 The outcomes are what happened to the consumers as a result of coming into contact with the evaluand  Intended and unintended  Short-term and long-term effects  A good way to do  List the main outcome dimensions with a brief explanation of how the list was generated.  Rate each dimension on importance  Explain the used methods (ch7)  Rate the each outcome dimension (ch8)  Provide the justification (evidence, logic, methods) for your rate S519

 It is important to know whether the evaluand is cost-effective  See D-p62-63 S519

 Whether your evaluation could also have value outside its current context.  It is always worth considering the possibility S519

 Combining Checkpoints6-10 to draw an overall conclusion S519

 Using synthesis methodology to draw a summary covering Checkpoints 6-10  Graphical representation (e.g., Exhibit7.6)  Summary of strengths and weaknesses S519

 Recommendations for furture improvement S519

 Who is repsonsible for good or bad results  You have to be highly skilled S519

 Who get the copies of the evaluation reports and in what forms  What are follow-ups to ensure that the findings are used S519

 Self review of the evaluation itself  The validity of their conclusions  Utility to relevant stakesholders  The methodology used for evaluations  Credibility  Cost  Lessoned learned during this evaluation. S519

 Go back to your evaluation group  Discuss all these checkpoints and how are you going to put all your result together S519