IAAC Meeting June 1, 2016

Agenda 1:00 Approval of Minutes from April 6, 2016: 1:05 Educational Program Reporting Update Alex/Kristen Reporting Guidelines 1:15 ARC Rubric Changes Alex/Kyle 1:30 Course Evaluations – Blue Kyle 1:45 Academic Program Review 7-Year Schedule Kristen Next Meeting: August 3rd Minutes from the April 2016 meeting were approved. In attendance: George Bailey, Anthony Britt, Kyle Chapman, Geri Crain, Ellen Dobson, Kristen Dreyfus, Trish Fazzone, Rich Franklin, Leah Katell, Edu Leorri, Susan McGhee, Leslie Pagliari, Rita Reaves, Heather Reis, Alex Senior, John Stiller, Kim Walters, Jeff Ward, Tim Wiseman, Michael Van Scott, Donna Roberson, Tiffany Pires

Educational Programs Reporting Update (as of May 31, 2016) College Total Number of Units 2015-2016 Report Complete Percentage Complete AA 2 1 50% Allied Health 25 0.0% Arts & Sciences 102 61 59.8% Brody 10 20.0% Business 15 Dental Medicine Education 36 33 91.6% Engineering & Technology 20 9 45.0% Fine Arts & Comm. 19 11 57.9% Health & Human Perf. 43 21 48.8% Nursing 4 3 75.0% Reporting Due Dates: Educational Programs: May 15th or June 15th Support Units: August 1st TracDat will be locked on July 1 so that we can run the reports to be reviewed in the fall.

Analysis and Resources Examples of Insufficient Analysis of Results “It appears the curriculum is effective in providing an area-specific knowledge base to students.” “All students in the class got perfect scores on theses questions.” “Graduate faculty have emphasized the need for the examination and reference its importance in individual classes.” Examples of Thorough Analysis of Results Resources: http://www.ecu.edu/cs-acad/ipar/assessment/AssessmentResources.cfm# The Assessment Resources webpage includes the Reporting Guidelines for educational programs and support units. Previously we have observed the Analysis of Results to be an area that needs improvement. Units should consult the Guidelines as they report and use the questions to document a thorough analysis of the data. This should serve as the link to the action plan for the upcoming academic year.

Wednesday August 31st 8:30-10:30 ARC Review Fall 2016 Rubric now in Qualtrics Preview of Rubric (link) IAAC representatives will provide the following by June 30: Programs/Departments that will be reviewed Reviewer assignments The educational program and support unit rubrics will be housed in Qualtrics as a solution to technological difficulties during 2014-15 the review process. In addition, more options have been listed out if the report components do not meet the standard set in the guidelines. For example, Actions Taken: 1a. Does the information describe the curricular or pedagogical actions that faculty took during the 2015-16 academic year (past tense)? Yes, actions taken describe curricular or pedagogical actions that faculty took. No, actions taken are not curricular or pedagogical. (Should these be worth partial credit?) No, actions taken are not taken by faculty. (Should these be worth partial credit?) No, actions taken are missing. (worth 0 points) No, actions taken are unclear. (worth 0 points) No, other: ___________________________________________________________________________ More than one option can be selected. ARC Training Sessions Monday August 29th 2-4pm Wednesday August 31st 8:30-10:30 Wednesday Sept 7th 3-5pm Thursday Sept 8th 3-5pm Monday Sept 12th 8:30-10:30 Wednesday Sept 14th 1-3pm Wednesday Sept 21st 8:30-10:30 Wednesday Sept 21st 13pm

Course Evaluations: Blue - eXplorance New survey Form Approved for pilot by the Faculty Senate in April, 2016 Informed by the PICES Item Catalog (646 survey items) developed by Center for Instructional Excellence, Purdue University Intends to measure 7 dimensions of instructional effectiveness Includes 4 forms: Standard Form: 9 instructor specific questions, 2 course specific questions, 2 student effort questions, and 2 open-ended questions Additional questions for lab, distance education, and field-based courses

Course Evaluations: Blue - eXplorance New Software Advantages: Multiple entry points to the survey: email, Blackboard and QR code Mobile compatible Flexible survey sessions to accommodate early-ending courses Changes to survey administration: Faculty are encouraged to allow time in class for students to complete the survey Data directly pulled from Banner, nightly refresh No manually combining sections or removing courses/instructors from the survey No longer able to use reporting structure in Pirate Port

Course Evaluations: Blue - eXplorance Course inclusion criteria Study abroad, thesis/dissertation, and independent study will be excluded Sections opted out by department will be excluded Enrollment must ≥ 6 UNC Exchange students will be excluded Enrollment for cross-listed courses will be combined Sections delivered by the same instructor at the same location at the same time will be combined

Course Evaluations: Blue - eXplorance Instructor inclusion criteria 94% of course sections have one instructor and 6% have multiple instructors For course sections with multiple instructors, those with 20% or less teaching responsibility will be excluded They do not have sufficient interaction with students If a graduate teaching assistant is the primary instructor, be sure the supervising faculty member is less than 20% For the remaining courses, all instructors will be surveyed

Course Evaluations: Blue - eXplorance Report Access All instructors can access their own reports hosted in Blue, using single sign-on Department Chair access is granted based on instructor’s primary academic home department (no longer using Reporting Structure in Pirate Port) Examples: Deans will have global access to all faculty in the college When a person’s home org is different from one’s primary academic home, the latter is used to assign access GTA’s evaluations can be accessed by department chairs

Course Evaluations: Blue - eXplorance Next Steps Developing reporting templates Individual course evaluation report Aggregated course evaluation reports (department level and college level) Pilot testing new survey form and new software in July (Second Summer Session and 11-week Summer Session) Conducting item analysis, suggesting revisions, and reporting back to the Faculty Senate Communicating the changes to course evaluations to the campus, next fall

Academic Program Review College Department Fall 2016 College of Nursing Graduate (PhD) College of Health & Human Performance School of Social Work Spring 2017 College of Allied Health Sciences Department of Communication Sciences & Disorders Brody School of Medicine Office of Research & Graduate Studies Harriot College of Arts & Sciences Department of English Associate Deans will be more involved with APR sharing of the self-study meeting during the on-site visit external review committee report unit response Link to APR on our website: http://www.ecu.edu/cs-acad/ipar/assessment/ProgramReviews.cfm#

Future IAAC Meetings August 3rd September 7th Support Unit Reports Educational program workbook update ARC members Training schedule Units to be reviewed SACS Update September 7th Survey data available to units IAAC members will be queried for agenda items prior to the August meeting.