Students’ Ratings of University Teaching: A Data Mining Analysis Chuck Dziuban Research Initiative for Teaching Effectiveness Ida Cook Department of Sociology and Anthropology Faculty Senate Morgan Wang Department of Statistics University of Central Florida

Rationale for the Study Teaching evaluation data for a 3-year period were available to allow a comparison of two different sets of items (UCF/BOR). Responding to faculty interest, the UCF Faculty Senate requested that an evaluation of the Student Evaluation of Instruction measures be performed. (FS )

The Instrument: UCF Items Feedback on your performance in this course The instructor’s interest in your learning Use of class time The instructor’s overall organization of the course Continuity from one class meeting to the next The pace of the course The instructor’s assessment of your progress The text and supplemental learning materials used

The Instrument: Board of Regent Items Description of course objectives and assignments Communication of ideas and information Expression of expectations for performance Availability to assist students In or outside of class Respect and concern for students Stimulation and interest in the course Facilitation of learning Overall assessment of instructor

The Study Layout Approximately 450,000 student responses Five Colleges: Arts and Sciences Business Administration Education Engineering Health and Public Affairs Three Levels: Lower Undergraduate Upper Undergraduate Graduate Three Years:

Overall Rating of the Instructor Binary Decision Tree SAS Enterprise Miner Remaining 15 Items Level Year College Developmental Sample 1 Developmental Sample 2 Developmental Sample 3 Validation Sample Predictors

Decision Tree Example 85.9% n=11, % n=6, % n=2, % n= % n=2, % n=5, % n= % n=1, % n=1, % n= % n= % n=3, % n=2, % n= % n=526 Arts & Sciences, Business Admin., Hospitality Mgmt. Education Engineering Health & Pub. Affairs F2F, E, MW femalesmalesA&SBA & Hosp. mgmt F2FE, M, WE, MF2F Overall

Rules Leading to Overall Rating of Excellent QuestionsExVGGFP Facilitation of Learning● Communication of Ideas and Information ● Probability =.96N=46,805

Rules Leading to Overall Rating of Excellent QuestionsExVGGFP Facilitation of learning● Communication of ideas and information ● Organization of the course● Assessment of student progress ●● Probability =.85N=3,462

Rules Leading to Overall Rating of Excellent QuestionsExVGGFP Facilitation of learning● Communication of ideas and information ● Organization of the course● Instructor interested in your learning ● Probability =.78N=6,215

Overall Ratings Unadjusted and Adjusted for ‘Excellent’ Decision Rules Adjusted for Rule CollegeUnadjusted123 CAS42%95%85%80% CBA36%95%83%77% COE54%97%86%75% CECS32%96%84%78% COHPA48%96%86%74%

For more information… Research Initiative for Teaching Effectiveness Dr. Chuck Dziuban Dr. Patsy Moskal