INVITATIONAL PRACTICUM IN METAEVALUATION Session 6, 10/13/11 (Dan) 1.India’s Education Capacity Building Program & its evaluation 2.DLS metaevaluation.

Slides:



Advertisements
Similar presentations
HELPING THE NATION SPEND WISELY Performance audit and evaluation: common ground with Internal Audit ? The UK National Audit Office experience Jeremy Lonsdale.
Advertisements

METAEVALUATION An Overview (dls 8/30/11). Key Questions  1. What is the essence of metaevaluation?  2. Why is metaevaluation important?  3, What are.
Placement Workshop Y2, Sem 2 Professional Practice Module (PPM)
MYP Personal Project January 2015 How’s it going? At this stage in your project, you should be: Close to the completion of your final product (if not.
A sample Service Oriented Architecture for Integrating Government Lines of Business.
National Commission for Academic Accreditation & Assessment Preparation for Developmental Reviews.
CHAPTER 27: METAEVALUATION For inclusion in Stufflebeam, & Coryn (2011) Evaluation Theory, Models, & Applications 1.
INVITATIONAL PRACTICUM IN METAEVALUATION Session 2 9/15/11 GAO & Joint Committee Standards DLS 9/13/11 1.
INVITATIONAL PRACTICUM IN METAEVALUATION Session 5, 10/6/11: 1.Update prospectus 2.Reschedule midterm exam for 10/20 3.Review the test plan 4.Review &
Front Matter Transmittal Letter Front Cover Title Page Forward or Preface Abstract Table of Contents List of Illustrations List of Abbreviations and Symbols.
WRITING PORTFOLIOS Comm Arts II Mr. Wreford. Writing Portfolios A portfolio is a collection of work assembled to demonstrate the range, variety, and skill.
SOCI 380 INSTRUCTIONS RE. RESEARCH PAPER DUE DATE: The research paper is due on the last day of class You are required to write and submit a detailed research.
Julianna Bálint Szent István University Ybl Miklós School Dept. of Building Materials and Quality Management Experiment with the model for quality improvement.
Formative and Summative Evaluations
Chapter 3: The Project Management Process Groups
Portfolios Show them what you’ve got © 2008 Marrietta Reber 8/5/2015.
Internal Audit. Session objectives Define Internal Audit To understand functions of Internal Audit To assess effectiveness of Internal Audit and reliance.
Coaching for School Improvement: A Guide for Coaches and Their Supervisors An Overview and Brief Tour Karen Laba Indistar® Summit September 2, 2010.
Pondamania: Exploring Pond Viability Project Overview Teacher Planning Work Samples & Reflections Teaching Resources Assessment & Standards Classroom Teacher.
EVAL 6000: Foundations of Evaluation Dr. Chris L. S. Coryn Nick Saxton Fall 2014.
MARKETING PLAN Contents 1. Executive Summary (1 page) 2. Environmental Analysis (3) 3. SWOT Analysis (2) 4. Marketing Objectives (2) 5. Marketing Strategies.
1 Planning a Healthy Cuisine for Kids Seminar Strategies for Implementation.
Assessment Tools. Contents Overview Objectives What makes for good assessment? Assessment methods/Tools Conclusions.
Project Management Phases Class 6. Initiation & Planning – Agenda Overview of the project management phases Midterm paper details.
The Project Planning Process
Judith Lane, Programme Leader MSc (pre-registration) Physiotherapy,
Evaluation plans for programming period in Poland Experience and new arrangements Ministry of Infrastructure and Development, Poland Athens,
Evaluation Basics Principles of Evaluation Keeping in mind the basic principles for program and evaluation success, leaders of youth programs can begin.
Welcome to FACT #2 About Teacher Inquiry Article Quick SCAN Read
Appendix E – Checklist for Review of Performance Audits Presented by: Ashton Coleman Department of Defense Office of the Inspector General August 16, 2012.
District Meeting # East Bay BTSA Induction Consortium.
EVAL 6000: Foundations of Evaluation Dr. Chris L. S. Coryn Nick Saxton Fall 2014.
National Commission for Academic Accreditation & Assessment Developmental Reviews at King Saud University and King Faisal University.
STANDARDS, QUALITY AND IMPROVEMENT PLANNING in a Pre 5 Centre April 2014 Marie Keen Quality Improvement Officer – Early Years.
Small Business Consulting Project Guidelines. 2 Milestones Conduct Phase I (Initial Client Interview) by Monday April 6th Complete Phase I (Description)
 A review of role and responsibility assignments for those involved in research administration and compliance functions has progressed through a final.
Project Guidelines for MBA Fourth Semester Students.
Assessment Tools.
Effective Grading Strategies Alison Morrison-Shetlar Faculty Center for Teaching and Learning Adapted from the book Effective Grading by Barbara Walvoord.
Assessment and Testing
CES 20th Annual Conference Keun-bok Kang (CNU) & Chan-goo Yi (ETRI) ; Taejon, Korea A DESIGN OF THE METAEVALUATION MODEL A DESIGN OF THE METAEVALUATION.
CONFERENCE EVALUATION REPORTING.  The written report is often the “main” output of your evaluation so it needs time and attention  Consider other alternatives.
Assessing Learners The Teaching Center Department of Pediatrics UNC School of Medicine The Teaching Center.
Quality Assessment of MFA’s evaluations Rita Tesselaar Policy and operations Evaluation Department Netherlands Ministry of Foreign Affairs.
UNIVERSITAT DE BARCELONA Facultat de Biblioteconomia i Documentació Grau d’Informació i Documentació Research Methods Research reports Professor: Ángel.
College of Education Graduate Programs Portfolio Workshop.
1 Allowance For Loan & Lease Losses (ALLL) Overview.
2012 Examiner Training Webinar Series SharePoint User Training Tim Case Courtney Krier.
S6: Internal Audit. Defining Internal Audit Internal Auditing is an independent, objective assurance and consulting activity designed to add value and.
 Teaching: Chapter 14. Assessments provide feedback about students’ learning as it is occurring and evaluates students’ learning after instruction has.
KRISTIN MESSURI THE GRADUATE WRITING CENTER 111H KERN BUILDING Creating CVs and Resumes.
Types of Reports Introductory Report Progress Reports Incident Report Feasibility Report Marketing Report Field Report Laboratory Report.
PGCE Evaluation of Assessment Methods. Why do we assess? Diagnosis: establish entry behaviour, diagnose learning needs/difficulties. Diagnosis: establish.
Welcome. Contents: 1.Organization’s Policies & Procedure 2.Internal Controls 3.Manager’s Financial Role 4.Procurement Process 5.Monthly Financial Report.
Supported Experiments: How to make them successful February 22nd 2013 with Joanne Miles (J Miles Consulting)
BUDGET 4Distribution of budget per phases of the project; 4Itemization of budget; 4Division of budget per source of contribution; 4Division of budget between:
MODULE 6: PLANNING FOR GOVERNANCE AUDIT GOVERNANCE AUDITOR ACCREDITATION COURSE.
Dutchess Community College Middle States Self-Study 2015
Executive Committee Meeting April 2010
Marketing co-op and non-coop
Overview of the Teacher Work Sample (TWS)
Evaluation plans for programming period in Poland
Chapter 21 Formal Reports
Periodic Review Departmental Review.
Jeanie Behrend, FAST Coordinator Janine Quisenberry, FAST Assistant
IATI – Planned evaluation of IATI
Agenda • Introductions • Project Objectives • Project Steps
Manage Sourcing - Supplier
Integrating Gender into Rural Development M&E in Projects and Programs
Doug Glasshoff Greg Gaden Darin Kelberlau
Presentation transcript:

INVITATIONAL PRACTICUM IN METAEVALUATION Session 6, 10/13/11 (Dan) 1.India’s Education Capacity Building Program & its evaluation 2.DLS metaevaluation 3.Chris Coryn’s comments re. the 2 metaevaluation reports, employment of JC Standards, uses of the metaevaluations, and next steps 4.DLS employed checklist and contents of his metaevaluation report 5.Chris Coryn’s reflections on checklist-based metaevaluation and the more general approach by Owens 6.DLS comment on applying checklists 7.Student updates on finding a metaevaluation report 8.Sample questions for next week’s test 1

India’s Education Capacity-building Program (Chris) Overview of the program Roles of Coryn and Cousins Financing of the reform and their evaluations Evaluation arrangements Origin of the metaevaluation Rationale for using the Joint Committee Standards? Selection of 3 metaevaluators Involvement of Cambridge Education Ltd. Charge to the metaevaluators 2

DLS Orientation to the Metaevaluation Assignment (Dan) Each metaevaluator should proceed independently Tailoring of a checklist to the assignment Issue re. draft status of new JC Standards Obtaining and reviewing materials Prohibition against interviewing the evaluators Production of 4 reports Meeting with some of the Indian evaluators Next steps: summative metaevaluations 3

External Consultant’s Perspective on the Process (Chris) Review of the Owens report Resignation of the India-based metaevaluator Contrast of the Owens and Stufflebeam reports Fit of the JC Standards to the Indian context Progress of the evaluation work in India Impact of the India-based evaluations Impact of the Owens and Stufflebeam reports Next steps in the evaluations and metaevaluations 4

Checklists (DLS) Manual Checklist – Filled in using Microsoft Word Automated Checklist – Microsoft Access – Excel 5

Q & A re: AADHAR METAEVALUATION REPORT (Dan) Cover sheet Acroyms page Table of Contents Executive Summary Acknowledgements Intro (particulars, documents) Description of subject evaluation plan Checklist findings (Utility, Feasibility, Propriety, Accuracy, Evaluation Accountability) Tables of results (bottom-line, for each criterion/standard, summary of +s & -s) Conclusions (nature of plan, the evaluators, Utility, Feasibility, Propriety, Accuracy, Evaluation Accountability, strengths & weaknesses, suggestions, bottom-line conclusions) Appendixes (documents reviewed, metaevaluation procedures followed, metaevaluation plan, metaevaluator’s attestation re. meeting metaevaluation criteria, metaevaluator’s credentials) 6

REFLECTIONS (Chris) Checklist-based metaevaluations General, perceptual approach applied by Owens Use of automated checklists 7

STUDENT UPDATES (Dan) Locating metaevaluation reports Locating evaluation reports 8

MID-TERM EXAMINATION (Chris) Sample test questions – Modified true-false – Multiple choice – Work sample followed by multiple choice – Matching – About 60 items Reference to distributed test plan 9