Presentation is loading. Please wait.

Presentation is loading. Please wait.

Implementing an Online Course Evaluation Solution: Navigating Faculty Governance and Endorsement Jeffrey Cepull, Philadelphia University Brian Hopewell,

Published byOswald Carpenter Modified over 6 years ago

Similar presentations

Presentation on theme: "Implementing an Online Course Evaluation Solution: Navigating Faculty Governance and Endorsement Jeffrey Cepull, Philadelphia University Brian Hopewell,"— Presentation transcript:

1 Implementing an Online Course Evaluation Solution: Navigating Faculty Governance and Endorsement Jeffrey Cepull, Philadelphia University Brian Hopewell, Academic Management Systems Cpyright J. Cepull and B. Hopewell, This work is the intellectual property of the authors. Permission is granted for this material to be shared for non-commercial, educational purposes, provided that this copyright statement appears on the reproduced materials and notice is given that the copying is by permission of the authors. To disseminate otherwise or to republish requires written permission from the authors.

2 Philadelphia University
Undergraduate and graduate programs Six schools 3,400 total student head count 2,850 total undergrads 1,250 resident Numerous online student & faculty services

3 Course Evaluation - History
Paper-based Coordinated by one individual (adjunct faculty) No University-wide office Six schools, six question sets Delayed processing each semester Complicated pre-survey set-up Enormous time spent on post-survey handling

4 Early stages - Fall 2006 Extensive literature search Influence of the UMinn EDUCAUSE presentation Efficacy at <100% response rates Identify a group of early adopters (faculty) Arrange a trial period for testing (AMS) Small-scale pilot at the end of 2006

5 Comprehensive Pilot - Spring 2007
Online evaluation pilot discussed at full faculty meeting Faculty comprised of champions, curious observers, and skeptics Proposed a larger, more comprehensive pilot, focused on undergraduates Partner with Academic Affairs Call for volunteers and target certain faculty Faculty balloting tool

6 Faculty Governance and Endorsement - Fall 2007
Approached the Faculty Affairs and Development Committee Presented data Emphasized rapid access to course feedback Ease of adding summary data to faculty dossiers Sought endorsement for the “option” for faculty to use the online solution

7 Seeking Additional Endorsement - Spring 2008
One-on-one meetings with Deans One-on-one meetings with faculty skeptics One Dean mandates the solution Participation increases Faculty Committee is tasked with revising the six instruments OIR staff provides extensive support Student balloting tool

8 Gaining Committee Support - Fall 2008
Targeting tenure and promotion committees Continue working with the Deans A second Dean mandates the online solution Participation increases

9 Online Evaluations – Total Sections
Semester

10 Response Rates Percentage Semester

11 Placing Emphasis Faculty focus Eliminates the use of class time Immediate access to results Easy to read student comments Summary materials can easily be integrated into a dossier Efficacy of the online approach

12 Additional Benefits Course evaluations are preloaded Evaluation period is three weeks Immediate access for deans Eliminated post survey processing Students received automated reminders to complete surveys Faculty updates on student participation

13 Major Factors for Success
Extensive literature search Aggressive sideline position Look for a success story Small-scale pilot with early adopter faculty Larger pilot focused on faculty volunteers Always refer to the “pilot” process Partner with Academic Affairs Engage the Deans

14 More Factors for Success
Engage the skeptics Discuss at faculty and committee meetings Ballots and surveys Create pathways to adoption (Help Desk) Work toward small victories (option for faculty) Accommodate reasonable faculty requests Be flexible with the online solution Again, always refer to the “pilot” process

15 CoursEval Academic Management Systems “founded by deans & for deans” 15 years in market 150+ customers in USA, Canada, etc. CoursEval customers Looking to save time and money Deeply concerned about “process” (“evaluation is the 3rd rail of academic admin.”) Academic Management Systems

16 reminders Academic Management Systems

17 MyCoursEval Remote Portal Plug-In works with Blackboard, WebCT, Moodle, Sakai and other campus portal systems. Alerts students to pending evaluations. Academic Management Systems

18 Secure, private access Campus logo or program logo here
Log-in info and message for students and/or faculty Several authentication choices are available Administrator feedback via quick Academic Management Systems

19 Use your own survey instruments
Sample student survey customized with campus-specific questions, course and teacher ID, special instructions, multiple faculty, and many other options (including question formats faculty photos and required answers) Flexible answer formats Non-course surveys Long-answer windows Academic Management Systems

20 Participant report: real-time lists of compliant and non-compliant evaluators
By individual compliance within class. Remind delinquents w/ Academic Management Systems

21 Sample faculty report Campus, date,and course ID Faculty report has many format, display, and data options Chart with selected ratings, counts, comparisons, and response rate Question category Easy to read ratings and comparisons (many options) Collected written comments Academic Management Systems

22 Cross-institutional reporting
An ‘At-A-Glance’ view of ratings by department (questions selected by viewer) Academic Management Systems

23 Department level reporting
An ‘At-A-Glance’ view of ratings by course and instructor (questions selected by viewer) Academic Management Systems

24 Tenure and Promotion Summary Report
All evaluations in archive for professor Academic Management Systems

25 Export results to .xls, .csv, .dbf files
Academic Management Systems

26 Faculty evaluation of students
Customize evaluation criteria using your own rubrics. Academic Management Systems

27 References & Resouces Cohen, P.,1980, “Student ratings of instruction and student achievement: a metaanalysis of multisection validity studies,” Review of Education Research, v 51, pp Seldin, P., ed., 2006 Evaluating Faculty Performance, Anker, Theall, M. and Franklin J. (eds.) 1990, Student Ratings of Instruction: Issues for Improving Practice, Jossey-Bass, Brigham Young University: Trav Johnson Academic Management Systems

28 What did you think? Your input is important to us!
Click on “Evaluate This Session” on the Mid-Atlantic Regional program page. Contact AMS for information on no-cost “pilot.”

29 Questions…. Contact information: Jeffrey C. Cepull Vice President for Information Resources and CIO Philadelphia University Brian R. Hopewell Director of Business Development - Higher Education Academic Management Systems

Download ppt "Implementing an Online Course Evaluation Solution: Navigating Faculty Governance and Endorsement Jeffrey Cepull, Philadelphia University Brian Hopewell,"

Similar presentations

The Academic Computing Assessment Data Repository: A New (Free) Tool for Program Assessment Heather Stewart, Director, Institute for Technology Development,

The Academic Computing Assessment Data Repository: A New (Free) Tool for Program Assessment Heather Stewart, Director, Institute for Technology Development,
Web Application Management Moving Beyond CMS Douglas Clark Director, Web Applications Copyright Douglas Clark 2003 This work is the intellectual property.

Web Application Management Moving Beyond CMS Douglas Clark Director, Web Applications Copyright Douglas Clark 2003 This work is the intellectual property.
A Web-based Bibliography Management Initiative: Collaborating for Classroom and Library Technology Integration Brian Nielsen, Academic Technologies Denise.

A Web-based Bibliography Management Initiative: Collaborating for Classroom and Library Technology Integration Brian Nielsen, Academic Technologies Denise.
Worcester Polytechnic Institute 1 Providing Technology Orientation for New Faculty and Staff Copyright © 2005 Worcester Polytechnic Institute This work.

Worcester Polytechnic Institute 1 Providing Technology Orientation for New Faculty and Staff Copyright © 2005 Worcester Polytechnic Institute This work.
Purdue University Calumet Enrollment Services Center Integrated Service Delivery In-person and on the Web Beth Pellicciotti Assistant Vice Chancellor Academic.

Purdue University Calumet Enrollment Services Center Integrated Service Delivery In-person and on the Web Beth Pellicciotti Assistant Vice Chancellor Academic.
Innovation and Outcomes: Voices of Experience Purdue University Calumet Midwest Educause Conference Monday, March 13, 2006 Heather L. Zamojski: Course.

Innovation and Outcomes: Voices of Experience Purdue University Calumet Midwest Educause Conference Monday, March 13, 2006 Heather L. Zamojski: Course.
Flexible Information Literacy Alternatives for Independent Learners Suzanne Hayes March 17, 2003 Copyright Suzanne Hayes 2003. This work is the intellectual.

Flexible Information Literacy Alternatives for Independent Learners Suzanne Hayes March 17, 2003 Copyright Suzanne Hayes This work is the intellectual.
Copyright Jill M. Forrester 2008. This work is the intellectual property of the author. Permission is granted for this material to be shared for non- commercial,

Copyright Jill M. Forrester This work is the intellectual property of the author. Permission is granted for this material to be shared for non- commercial,
Educause Security 2007ISC Information Security Copyright Joshua Beeman, 2007. This work is the intellectual property of the author. Permission is granted.

Educause Security 2007ISC Information Security Copyright Joshua Beeman, This work is the intellectual property of the author. Permission is granted.
Advancing Security Programs through Partnerships Cathy HubbsShirley Payne IT Security Coordinator Director for Security Coordination & Policy George Mason.

Advancing Security Programs through Partnerships Cathy HubbsShirley Payne IT Security Coordinator Director for Security Coordination & Policy George Mason.
New Web-Based Course Evaluation Services Available to Schools and Departments Presentation to Faculty Council November 6, 2009.

New Web-Based Course Evaluation Services Available to Schools and Departments Presentation to Faculty Council November 6, 2009.
Copyright Statement © Jason Rhode and Carol Scheidenhelm. 2006. This work is the intellectual property of the authors. Permission is granted for this material.

Copyright Statement © Jason Rhode and Carol Scheidenhelm This work is the intellectual property of the authors. Permission is granted for this material.
Foundations of Excellence: Support Services for Online Learning Midwest Regional Conference, 2005 Chicago, Illinois Presenters: Diane Dates Casey Jan Engle.

Foundations of Excellence: Support Services for Online Learning Midwest Regional Conference, 2005 Chicago, Illinois Presenters: Diane Dates Casey Jan Engle.
It’s All in How You “Sell” It Pay for Print vs. Print Conservation:

It’s All in How You “Sell” It Pay for Print vs. Print Conservation:
NLII - 2003 Mapping the Learning Space New Orleans, LA Colleen Carmean NLII Fellow Information Technology Director, ASU West Editor, MERLOT Faculty Development.

NLII Mapping the Learning Space New Orleans, LA Colleen Carmean NLII Fellow Information Technology Director, ASU West Editor, MERLOT Faculty Development.
How Collaboration Created an Online Help Desk and Knowledge Base for the Campus Community EDUCAUSE Mid-Atlantic Regional Conference 2008.

How Collaboration Created an Online Help Desk and Knowledge Base for the Campus Community EDUCAUSE Mid-Atlantic Regional Conference 2008.
Copyright Shanna Smith & Tom Bohman (2003). This work is the intellectual property of the authors. Permission is granted for this material to be shared.

Copyright Shanna Smith & Tom Bohman (2003). This work is the intellectual property of the authors. Permission is granted for this material to be shared.
Moving Your Paperwork Online Western Washington University E-Sign Web Forms Copyright Western Washington University, 2004. This work is the intellectual.

Moving Your Paperwork Online Western Washington University E-Sign Web Forms Copyright Western Washington University, This work is the intellectual.
Information Security Governance in Higher Education Policy2004 The EDUCAUSE Policy Conference Gordon Wishon EDUCAUSE/Internet 2 Security Task Force This.

Information Security Governance in Higher Education Policy2004 The EDUCAUSE Policy Conference Gordon Wishon EDUCAUSE/Internet 2 Security Task Force This.
Intellectual Property Protocol and Assessment for Distance Learning Liz Johnson Project Manager Advanced Learning Technologies Board of Regents of the.

Intellectual Property Protocol and Assessment for Distance Learning Liz Johnson Project Manager Advanced Learning Technologies Board of Regents of the.

Similar presentations

Ads by Google