eSET Timing Close Study Results Stefani Dawn, PhD Assistant Director of Assessment

Background Requests have been made to modify the closing date of eSET. – close before finals – close after finals but before grades are released (with grades access blocked until evaluations are completed) – close at the end of grade week, with access to grades blocked until evaluations are completed

Data Collected Response rates for each of the three scenarios Median scores for each of the three scenarios Survey results Logistical considerations

Response Rates for 3 Different Close Timings TermAnsweredDeclined Total Response Rate Incomplete When Ended (Holds Were Placed on Viewing Grades) Fall % (n=101,042) 22% (n=32,872) 89% 12% (17,732) End of grade release week Winter % (89,363) 24% (32,403) 90% 11% (14,515) End of grade release week Spring % (71,069) 22% (27,253) 80% 19% (23,646) after finals before grades posted Fall % (88,702) 13% (19,449) 73% 27% (40,712) after finals before grades posted Winter % (n=62,930) 8% (n=10,933) 53% 47% (n=64,799) Before finals

Median Scores Term Median – Q1 “The course as a whole was:” Median – Q2 “The instructor’s contribution to a course was:” Fall Winter Spring Fall Winter

Survey Results Timing Preference by % – Faculty/staff (n = 31), Students (n=1669)

Survey Results Comments Summary There were 275 comments submitted: 254 were from students Students: – They are too busy studying and completing papers to complete evaluations before finals – The final is an important part of the course and want to experience the entire course before evaluating it

Survey Results Comments Summary Students: – In many cases, students had either not yet received feedback from faculty on major assignments, or instruction was still occurring before finals – They want to be able to provide thoughtful feedback, which requires time.

Survey Results Comments Summary Students: – They recognize that faculty are concerned about potential retaliation with evaluations after grades are posted, and suggested closing before grades were released or blocking the ability of students to see their grades before evaluations are complete. Likewise, students are very concerned about allowing faculty to see evaluation reports prior to grades being released.

Survey Results Comments Summary Faculty: – Concern about students seeing grades prior to evaluations and retaliatory evaluations as a result, or concerns about scores being lower after students have completed a tough final. – Concern about a low response rate.

Logistical Considerations When closing before finals – Instructor added questions period is reduced. – Reports will not be released until after grades are posted.

Faculty Senate Executive Committee Recommendation – Close after finals but before grades are officially posted on the web with grade access blocked. NOTE: If you post grades on Blackboard and do not want students to view it then the instructor must hide those. There are instructions on the APAA eSET website on how to do this.