Expertise-Oriented Approach & Consumer-Oriented Approach

Slides:

Advertisements

Similar presentations

[Imagine School at North Port] Oral Exit Report Quality Assurance Review Team School Accreditation.

Advertisements

Performance Assessment

Magnet Status Looking for Quality Patient Outcomes: The American Nurses Credentialing Center's Magnet Program Recognizes Excellence in Patient Care.

Composition of panels Training of experts Consistency External Communication IQA seminar ENQA – The Hague 15 and 16 June 2009.

AfriMAP’s The Justice Sector and the Rule of Law in Namibia

The Teacher Preparation World Cafe September 26, 2008 Statewide Meeting Results and Recommendations New York Higher Education Support Center Task Force.

Becoming a Connoisseur of Technology Integration Michael Simkins, Ed.D. Co-Director, TICAL Santa Cruz County Office of Education.

Literacy in the middle years of schooling focusing on Aboriginal Students.

Evaluating health informatics projects Reasons for and problems of evaluation Objective model Subjective model.

Johns Hopkins University School of Education Johns Hopkins University Evaluation Overview.

Accreditation Process Overview Presented By: The Saint John Vianney Accreditation Team Chris Gordon Pam Pyzyk Courtney Albright Dan Demeter Gloria Goss.

Alternative Strategies for Evaluating Teaching How many have used end-of-semester student evaluations? How many have used an alternative approach? My comments.

MERC Ten Steps to Designing an Evaluation for Your Educational Program Linda Perkowski, Ph.D. University of Minnesota Medical School.

PEER REVIEW OF TEACHING WORKSHOP SUSAN S. WILLIAMS VICE DEAN ALAN KALISH DIRECTOR, UNIVERSITY CENTER FOR ADVANCEMENT OF TEACHING ASC CHAIRS — JAN. 30,

Dr. Suzan Ayers Western Michigan University

The Role of the National Authority for Quality Assurance and Accreditation (NAQAAE) in Egyptian Education The National Authority for Quality Assurance.

How to Interpret and Apply the Characteristics of Excellence: A Framework for Determining Compliance Karen Stout, President Montgomery County Community.

Evaluation Team Chair Training Presented By Dr. Tim Eaton TRACS Regional Representative.

Project Monitoring Evaluation and Assessment

Summative Evaluation The Evaluation after implementation.

Program Evaluation.

Enter System Name AdvancED TM External Review Exit Report Catalyst High School May 11,12,13, 2014.

Management and leadership in nursing Introduction unit “1”

PPA 502 – Program Evaluation Lecture 10 – Maximizing the Use of Evaluation Results.

EDU555 CURRICULUM & INSTRUCTION ENCIK MUHAMAD FURKAN MAT SALLEH WEEK 4 CURRICULUM EVALUATION.

Standards and Guidelines for Quality Assurance in the European

NTEP – Network for Transforming Teacher Preparation A presentation to the State Board TAC on Tiered Licensure and Career Ladders April 6, 2014.

ASSESSMENT& EVALUATION Assessment is an integral part of teaching. Observation is your key assessment tool in the primary and junior grades.

Product Evaluation the outcome phase. Do the magic bullets work? How do you know when an innovative educational program has “worked”? How do you know.

Orienting Extension Faculty that are Volunteer Administrators.

WHAT IS RESEARCH? Catey Bunce Principal Statistician NIHR Biomedical Research Centre (BRC) at Moorfields Eye Hospital NHS Foundation Trust and UCL Institute.

A Connoisseur, a Critic, and a Skeptic walk into a student union… CAS provides a structured method of evaluation: Is the “X” functioning effectively to.

LeMoyne-Owen College December 16, 2009 Mimi Czarnik, Professor of English and Dean of Humanities Becky Burton, Associate Professor of Biology Alverno College,

Too expensive Too complicated Too time consuming.

The Intersection of Assessment, Accreditation, and Accountability: Faculty Unite! Teeanna Rizkallah, Ph.D Chair, Assessment and Educational Effectiveness.

PRESENTED BY THERESA RICHARDS OREGON DEPARTMENT OF EDUCATION AUGUST 2012 Overview of the Oregon Framework for Teacher and Administrator Evaluation and.

Program Outcomes Assessment Techniques: Overview and Examples Steve Steele, Consultant Faculty Online Technology Training Consortium (FOTTC) Applied Sociologist.

Writing Learning Outcomes David Steer & Stephane Booth Co-Chairs Learning Outcomes Committee.

Evaluation and Assessment What are they? Why do we need them? When do we use them?

March 26-28, 2013 SINGAPORE CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders Programme Evaluation (CDIO.

Evidence of Student Learning Fall Faculty Seminar Office of Institutional Research and Assessment August 15, 2012.

EVAL 6000: Foundations of Evaluation Dr. Chris L. S. Coryn Nick Saxton Fall 2014.

EVALUATION. Rules 1.The class will be divided into three teams. Each team will have a colored flag to use as a buzzer to ring in their readiness to answer.

Professional Learning Communities A school-wide approach to ensure that all students learn.

Evidence and Standard Two. The Big Picture The Big Picture Standard Two is about: Curriculum Curriculum Planned, overseen curriculum – with clear outcomes.

Workshops to support the implementation of the new languages syllabuses in Years 7-10.

Performance-Based Assessment HPHE 3150 Dr. Ayers.

We worry about what a child will be tomorrow, yet we forget that he is someone today. --Stacia Tauscher.

Considerations for Curricular Development & Change Donna Mannello, DC Logan University.

Summative Jeopardy Summing Up Summative Decision- Making.

Jeffrey Freund. Jeff Freund: Education and Work History Class of 2000 Class of 2004 Elementary Education Middle Level Mathematics.

School Name Visiting Team Exit Report Month, days, year Insert School’s logo or photo of school building.

Educator Evaluation and Support System Basics. Oregon Framework for Teacher and Administrator Evaluation and Support Systems Alignment of State and Federal.

Introduction to Academic Assessment John Duffield Office of Academic Assessment Georgia State University September 2013.

The Challenges of Health Professional Self- Governance Presentation to CAPPE/ACPEP Thursday, April 10, 2008.

Program Evaluation Principles and Applications PAS 2010.

EDUCATIONAL ADMINISTRATION AS AN EMERGING PROFESSION CHAPTER FOUR OVERVIEW PRESENTED BY: JACKIE LEEDY-CHAMBERLAIN COURSE: ORGANIZATION AND GOVERNANCE OF.

Assessment of the IMIA Educational Accreditation Process J. Mantas, University of Athens A. Hasman, University of Amsterdam E.H. Shortliffe, Columbia and.

Center for Faculty Excellence Workshops First impressions and the reference encounter (handout.

INTRODUCTION TO ASSESSMENT METHODS USED IN MEDICAL EDUCATION AND THEIR RATIONALE.

School practice Dragica Trivic. FINDINGS AND RECOMMENDATIONS FROM TEMPUS MASTS CONFERENCE in Novi Sad Practice should be seen as an integral part of the.

Documentation in Practice Dept. of Clinical Pharmacy.

0 The Norwegian Artistic Research Programme 0 Artistic Research, Funding and Accountability Prague Conference

Some business of External QA: Transparency (reports), measuring impacts, follow up implementation, expected benefits, strategies for the future Josep Grifoll.

School – Based Assessment – Framework

Directions for Expert Review Panel

Program Evaluation Alternative Approaches and Practical Guidelines

Administrator Evaluation Orientation

CLAS/RSF Meeting Dr. Barbara Foorman, Mr. Kevin Smith and Ms. Laurie Lee Regional Educational Laboratory (REL) Southeast at Florida State University.

Evaluation Research Defined as the process of making judgments about the merits, value, or worth of any component of education. (e.g. best text books to.

Presentation transcript:

Expertise-Oriented Approach & Consumer-Oriented Approach Chapter 5 Expertise-Oriented Approach & Consumer-Oriented Approach

Expertise-Oriented Approach Definition: Direct reliance on professional expertise as the primary evaluation strategy Contributors: Flexner & Eisner Historical Foundations: Began in the late 1800s (schools, universities and hospitals) “Accreditation”

What do we know about -Flexner Not a member of the profession he presumed to judge Argued common sense was the most relevant form of expertise He was a layman in terms of education, but he was an educator, and his judgments were directed at medical education rather than the practice of medicine. (what implications does this have for you as an aspiring administrator?)

Eisner Connoisseurship and Criticism What did Eisner use as an analogy for connoisseurship? The art of appreciation – not necessarily a liking or a preference for that which is observed.

Eisner (continued) “to recognize differences that are subtle but significant in a particular qualitative display” (p. 140) Criticism – is the public side of connoisseurship. Educational connoisseurship: “… process and effect of education. In an age of high-stakes testing, it is a perspective we badly need” (p. 141)

Higher Education Examples of Accreditation “Middle States” http://www.msche.org/ Why do institutions of higher education seek accreditation? How is the process for accreditation organized? How has it impacted the Ed Admin program at Wilkes University?

Why seek accreditation To improve programs (formative or summative) 2. Provides consumers and stakeholders with an indication of quality (formative or summative?) 3. Ensures the government and those providing financial assistance that the programs are worthwhile (formative or summative?)

Process Self-study (confidential, why?) Report Review by experts Visits with interviews (all stakeholders) and records review. Recommendations for improvement or approval

Impact on Programs Curriculum Assignments/Assessments Rubrics Consistency Curriculum Assignments/Assessments Rubrics Continual Review Collection of Assessments (see syllabus) Item Analysis

Controversies 1. Conflict of interest 2. Regional seen as formative and too light handed 3. US Dept. summative and outcomes based 4. Confidentiality in Self-Report 5. Transparency in Final Report 6. Competition from other sources (popular ratings - U.S. News and World Report)

Other Accreditation Organizations Specific to Education NCATE http://www.ncate.org/ TEAC http://teac.org/

Ad Hoc Review Panels (Include Panels to Develop Standards p. 138) What current issue in PA is related to this type of Ad Hoc Panel Review? How will it impact you as a future educational leader? http://www.corestandards.org/ http://www.corestandards.org/articles/9-nga-and- ccsso-comment-on-ccssi-governance-suggestions

Orienting Questions (Page 126) What are the arguments for and against using professional judgment as the means for evaluating programs? What are the different types of expertise- oriented approaches? How are they alike and how do they differ? Why is accreditation of institutions of higher education controversial today? How do these controversies reflect the controversies that frequently arise in many evaluations?

Consumer-Oriented Definition: Establish the value, merit or worth, of a product, program or policy. Application of the system: The evaluator is a person with expertise in judging things, but not with the particular content expertise- oriented or connoisseur evaluations.

Developer Scriven Developed checklists (p. 146 – 147) Need Market “Performance” (multiple types) Cost-Effectiveness Extended Support

Resources for Educators WWC http://ies.ed.gov/ncee/wwc/ Buros http://buros.unl.edu/buros/jsp/search.jsp

Orienting Questions (p. 126) 4. How is the consumer-oriented evaluation approach like the expertise-oriented approach? How is it different? 5. How do these approaches influence the practice of evaluation today?