Australasian Higher Education Evaluation Forum (AHEEF) 2008 "Evidence based Decision Making: Scholarship and Practice" 2-3 October, 2008 Australasian Higher.

Slides:

Advertisements

Similar presentations

SCIENCE, TECHNOLOGY AND INNOVATION INDICATORS. 1-Industrial sector: generally the results of scientific researches are still little, and non-existent.

Advertisements

Ms Liz Anderson & Dr Hayley Richards Changing our approach to assessing professional behaviour.

Bologna Process at the University of Helsinki University of Helsinki June 2005

Assessment Adapted from text Effective Teaching Methods Research-Based Practices by Gary D. Borich and How to Differentiate Instruction in Mixed Ability.

University-Wide Course Evaluation Committee Peter Biehl, Chair, Department of Anthropology Krissy Costanzo, Committee Staff Support; Academic Affairs March.

Developing an Effective Tracking and Improvement System for Learning and Teaching Achievements and Future Challenges in Maintaining Academic Standards.

Gwinnett Teacher Effectiveness System Training

Alternative Strategies for Evaluating Teaching How many have used end-of-semester student evaluations? How many have used an alternative approach? My comments.

In medieval times, a preceptor shared his knowledge with his students

Australasian Higher Education Evaluation Forum (AHEEF) 2008 "Evidence based Decision Making: Scholarship and Practice" 2-3 October, 2008 Australasian Higher.

PEER REVIEW OF TEACHING WORKSHOP SUSAN S. WILLIAMS VICE DEAN ALAN KALISH DIRECTOR, UNIVERSITY CENTER FOR ADVANCEMENT OF TEACHING ASC CHAIRS — JAN. 30,

IDEA Student Ratings of Instruction: Adjunct Workshop Dr. Kristi Roberson-Scott Fall 2009 Semester.

IDEA Student Ratings of Instruction Update Carrie Ahern and Lynette Molstad Selected slides reproduced with permission of Dr. Amy Gross from The IDEA Center.

Writing an Effective Proposal for Innovations in Teaching Grant

Facilitators: Janet Lange and Bob Munn

Realities. Registration Provisional Registration (PRT) Valid for 5 years Subject to Confirmation (STC) Valid for 3 years Full Registration Valid for 5.

1 Peer Review of Teaching K.P. Kwan & J. Jones, EDU etkpkwan etjjones x 6287 x6320 EDU Seminar 7 May 1999 (Friday)

CRICOS Provider No 00025B Strategies for enhancing teaching and learning: Reflections from Australia Merrilyn Goos Director Teaching and Educational Development.

From Diagnostic Feedback To University Policy Carmel McNaught.

Student (and other) Course Evaluations Response Rates, Relevance and Results Kathleen Norris Plymouth State University, NH.

Analyzing and Improving College Teaching: Here’s an IDEA Alan C. Lacy, Associate Dean College of Applied Science and Technology Illinois State University.

Benchmarks and Benchmarking in the UK - Lessons Learned Catherine Connor Quality Enhancement Unit London Metropolitan University.

L&C Catalog Content on Certificates of Completion within Management.

Reporting to Parents’ Presentation for Primary Schools

Tips on Preparing a Successful Educational Research Proposal Fiona Fui-Hoon Nah, professor, BIT Nancy J. Stone, professor and chair, Psychological Science.

Assessment Surveys July 22, 2004 Chancellor’s Meeting.

+ Measuring Teaching Quality in the Online Classroom Ann H. Taylor Director, Dutton e-Education Institute College of Earth and Mineral Sciences.

The Ofsted ITE Inspection Framework 2014 A summary.

External Examiners’ Briefing Day Assessment Policy Tuesday 6 th January 2015.

Northampton – Development Opportunities a framework for enabling positive change.

Writing Across the Curriculum (WAC) at Sojourner Douglass College Faculty and Staff Session One Saturday, November 9, 2013.

The Third Year Review A Mini-Accreditation Florida Catholic Conference National Standards and Benchmarks.

Monash University Library Quality Cycle EXCELLENCE AND DIVERSITY and LEADING THE WAY Monash University’s strategic framework and overall directions MONASH.

Teaching Interviews. Training and Development Agency for Schools website Personal Statement guidance.

E-learning as Scholarly Activity Connie Jones, Ed.D. James Calder, Ph.D. Middle Tennessee State University.

Classroom Assessments Checklists, Rating Scales, and Rubrics

Data Development and Pilots Academic Leadership Retreat August 2015.

Key features of the University of Manchester Professor Cathy Cassell Deputy Director (Academic) Sarah Featherstone Head of Undergraduate Services Original.

IDEA Student Ratings of Instruction Shelley A. Chapman, PhD Insight Improvement Impact ® University of Alabama Birmingham September 11, 2012.

Postgraduate Taught Experience Survey (PTES) 2010 Interim Results Dr Pam Wells Adviser, Evidence-Informed Practice.

1 International Perspectives on the Scholarship of Teaching and Learning: An Australian Perspective Michael Prosser University of Sydney.

Developing a Teaching Portfolio for the Job Search Graduate Student Center University of Pennsylvania April 19, 2007 Kathryn K. McMahon Department of Romance.

The Griffith PRO- Teaching Project A Process for Peer Review and Observation of Teaching.

Educators’ Attitudes about the Accessibility and Integration of Technology into the Secondary Curriculum Dr. Christal C. Pritchett Auburn University

Faculty Evaluation for Online Learning Institutional Standards and Emerging Practices Ellen Hoffman Eastern Michigan University.

Abstract: The definition of effective teaching is fluid and dependent on the teaching environment and its community members (faculty, students and administrators).

Columbia University School of Engineering and Applied Science Review and Planning Process Fall 1998.

© 2008 Brigham Young University–Idaho Course Evaluations at BYU-Idaho 1.

Effective Grading Strategies Alison Morrison-Shetlar Faculty Center for Teaching and Learning Adapted from the book Effective Grading by Barbara Walvoord.

Evaluation of the Noyce Teacher Scholarship Program 2010 NSF Noyce Conference Abt Associates Inc. July 9, 2010.

Presenter: Wan-Ning Chen Professor: Ming-Puu Chen Date: November 11, 2009 Ramaswamy, S., Harris, I., & Tschirner, U. (2001). Student peer teaching: An.

Concerns, Data, Next Steps.  New Administration Software from Scantron  New Academic Senate Policy  New Items/Survey Form (ACE, Iowa Item Pool)  New.

Testing and Evaluation

The E-Quality Service Model: Collaboration between the Reference and Circulation departments as a means to improve the library experience for distance.

COUNTING NEW FORMS OF SCHOLARSHIP TOWARD TENURE AND PROMOTION Peter Angelos and Linda Deneen University of Minnesota Duluth October 2010 This work is the.

W R I T I N G M A T T E R S A workshop of the Hoosier Writing Project a site of the National Writing Project at IUPUI Herb Budden, Co-director.

MUS Outcomes Assessment Workshop University-wide Program-level Writing Assessment at The University of Montana Beverly Ann Chin Chair, Writing Committee.

Instructional Leadership Supporting Common Assessments.

Assessing Teaching Through Critical Reflection and Evidence to Encourage Renewal Phyllis Blumberg - University of the Sciences

Making an Excellent School More Excellent: Weston High School’s 21st Century Learning Expectations and Goals

Copyright © Springer Publishing Company, LLC. All Rights Reserved. BECOMING A SCHOLAR IN NURSING EDUCATION – Chapter 16 –

Problem with Multi-purpose Postsecondary Course Evaluations STANLEY VARNHAGEN JASON DANIELS BRAD ARKISON Evaluation & Research Services, Faculty of Extension.

Good teaching for diverse learners

Postgraduate Taught Experience Survey (PTES) 2010 Interim Results

My research questions What are academics’ perceptions of the influences on their curriculum decisions? What are the drivers that support and inhibit.

ASSESSMENT OF STUDENT LEARNING

Course Evaluation Ad-Hoc Committee Recommendations

The Heart of Student Success

IDEA Student Ratings of Instruction

Accountability and Assessment in School Counseling

Presentation transcript:

Australasian Higher Education Evaluation Forum (AHEEF) 2008 "Evidence based Decision Making: Scholarship and Practice" 2-3 October, 2008 Australasian Higher Education Evaluation Forum (AHEEF) 2008 "Evidence based Decision Making: Scholarship and Practice" 2-3 October, 2008 eVALUAte: development and validation of a teaching survey Beatrice Tucker, Beverley Oliver and Julie-Ann Pegden

eVALUate surveys for student feedback eVALUate unit survey (for all current students enrolled in course work units) eVALUate teaching survey (enables students to give feedback to individual teachers on their request)

Literature Review Systems for Measuring Teaching Quality – controversial, validity is questionable (Pounder 2007, Kulik 2001, Kember & Leung 2008, Remedios & Lieverman 2008, Burdsal & Harrison 2008) Used for different purposes –teacher development, promotion, awards –for improving quality of courses, quality audits, benchmarking, funding allocation –student choice of study (Tucker, Jones, Straker, & Cole, 2003, Spencer & Schmelkin, 2002, Ballantyne, 2003; Ory, 2000, Department of Education Science and Training, 2004, Carey & Gregory, 2003) Students and teachers have differing opinions about what they perceive to be good teaching (McLean 2001)

eVALUate surveys at Curtin eVALUate unit survey – for unit review, annual and comprehensive course review, student choice of units, benchmarking, promotions eVALUate teaching survey - for teacher reflection and development, promotions, awards

Development of survey 2003 – committee –students –teaching academics –Deans of teaching and learning –academics with expertise in survey design and evaluation systems (statisticians) Literature was reviewed –excellent teacher characteristics, current instruments used Unit and teaching items included in one survey Oliver, Tucker, Gupta, & Yeo (2008)

Method - focus group Students Managers Teaching academics de Bono's Six Thinking Hats

Method - item development Characteristics of a good teacher Focus GroupLiteratureOther Surveys Item

eVALUate teaching survey 1.Appears knowledgeable in this subject area The teacher seems to have a good understanding of the subject. 2.Is enthusiastic in teaching this unit The teacher makes the subject interesting and conveys his or her enthusiasm for the subject. 3.Is well organised The teacher has material prepared on time, is punctual and structures activities in ways that help learning. 4.Communicates clearly The teacher is easy to understand in face-to-face, online, written and other formats and explains concepts clearly. 5.Is approachable The teacher encourages students to ask questions and seek help. 6.Provides useful feedback The teacher provides timely and helpful feedback so you can learn. 7.Is an effective teacher Overall, this teacher helps you to learn.

eVALUate teaching survey 8. Please comment on [the teacher]'s teaching strengths. 9. Please comment on how you think [the teacher] might improve the teaching and learning in this unit.

Testing and statistical analysis Piloted (x4) to student groups in tested for face validity Pilot 4 - Feedback from teaching staff and students Surveys separated Trialled to all Faculties in 2006 Factor analysis and Rasch analysis – tested the categorical scale and psychometric properties of the items (instrument measures multiple teacher attributes and not just one dominant trait)

How students give feedback

Uptake by teachers

Teaching surveys drive unit survey response rates *significant difference p<0.001

Conclusion All teaching staff are required to conduct a teaching survey annually Teaching surveys help drive unit response rates Teaching eVALUate reports are used to reward staff: for promotion and awards