Academic Program Viability Report February 2010 Florida Association of Institutional Research 2010 Annual Conference

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research2 Academic Program Viability Report Presenters  Maggie Tymms, Assessment Coordinator for Academic Programs  Dr. James Coraggio, Director of Academic Effectiveness and Assessment

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research3 SPC Background  SPC, established in 1927, is the oldest 2-year college in Florida  First Community College in Florida to offer 4 year degrees (2002)  9 Campuses throughout the county  FTE: 16,967 (LD), 1,677 (UD)  Opening Fall 2009 credited enrollment: 29,560  Annual headcount: 61,414

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research4 Purpose  This presentation describes the Academic Program Viability Report (APVR) which was designed as an abbreviated yearly summative evaluation of a program’s viability and productivity. It provides key College stakeholders such as the President’s Cabinet members a snapshot of relevant program specific information in order to highlight program trends, issues, and program level action plans.

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research5 Institutional Effectiveness “Institutional Effectiveness is the integrated, systematic, explicit, and documented processes of measuring performance against the SPC mission for purposes of continuous improvement of academic programs, administrative services, and educational services offered by the college.” “Closing the Loop”

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research6 Agenda  Comprehensive Academic Program Review (CAPR)  Academic Program Viability Report (APVR)  Measures included  Primary objective  Process  Dissemination of APVR reports  Next steps/Future direction

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research7 Comprehensive Academic Program Review The CAPR is a summative evaluation of the various lower division technical programs at the College  Comprehensive report that summaries all elements of the program’s viability and productivity from a 360- degree perspective  Published on a three-year cycle  Provides comprehensive and relevant program-specific information to key College stakeholders, such as the President’s Cabinet members  Presents program leadership a vehicle to support and document actionable change for the purposes of performance improvement

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research8 Comprehensive Academic Program Review  Program description with recent accreditation information  Performance measures including enrollment, productivity, grade distributions, and fulltime/adjunct faculty ratios  Profitability measures including capital expenditures  Academic outcomes from recent end-of-program assessments  Stakeholder perceptions including student survey of instruction results, advisory committee minutes, and employer and recent alumni survey results  Occupation trends and salary information  State graduate outcomes information  Program director’s perspective of program issues, trends, and recent success

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research9 Comprehensive Academic Program Review Issues with the CAPR  Published on a three-year cycle  Yearly review of a program’s viability is crucial  Producing the CAPR annually is not feasible  Three-year timeline is not adequate for optimum performance improvement

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research10 Performance Improvement From Compliance to Performance Improvement

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research11 Academic Program Viability Report Ultimately, the goal was to  Provide key College stakeholders such as the President’s Cabinet members a snapshot of relevant program specific information  Begin the process of making critical decisions regarding the continued sustainability of a program

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research12 Academic Program Viability Report The APVR was designed in 2006 as an abbreviated summative evaluation of a program’s viability and productivity  Published annually  Developed for each lower division program designated by academic organization levels  Includes five measures  Contains detailed measure descriptions

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research13 Academic Program Viability Report Measures Include  Program Graduates  Actual Course Enrollment  Student Semester Hour (SSH) productivity  Relative Profitability Index (RPI-T)  Employment Trend Data

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research14 Academic Program Viability Report

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research15 Academic Program Viability Report Primary objective of the APVR is to identify positive trends as well as issues in a timely manner  Positive program trends may be used to identify and document best practices  Programmatic issues can be further investigated through the Comprehensive Academic Program Review (CAPR) process

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research16 Academic Program Viability Report The APVR was enhanced in 2009  Now includes program level action plans designed to improve one or more performance measures  Requires formal action plan follow-up reports each year

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research17 Academic Program Viability Report APVR Process  Trend charts and employment data are drafted for each program  Data are reviewed by program Dean/Provost  One-on-one meetings are held with program administrators and their provost  Action plans are created  APVR containing viability reports for each program is provided to the President’s Cabinet  Action plan follow-up is conducted one year later

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research18 Academic Program Viability Report Program Graduates  The total number of graduates under a specific academic organization. This information is separated by Associate in Science (A.S.) program or its affiliated certificates (if applicable).

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research19 Academic Program Viability Report Program Graduates Source: SPC Factbook, Table 31

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research20 Academic Program Viability Report Actual Course Enrollment  Calculated using the sum of actual student enrollment for the courses within the program (Academic Organization Code). This number is a duplicated headcount of students enrolled in the program's core courses, and does not reflect the actual number of students enrolled in the A.S. program or its associated certificates (if applicable).

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research21 Academic Program Viability Report Actual Course Enrollment Source: PeopleSoft Student Administration System: Course Management Summary Report

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research22 Academic Program Viability Report Student Semester Hour (SSH) Productivity  Calculated by dividing the total actual course SSH by the total budgeted course SSH for each program

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research23 Academic Program Viability Report Student Semester Hour (SSH) productivity Source: PeopleSoft Student Administration System: Course Management Summary Report

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research24 Academic Program Viability Report Relative Profitability Index Total (RPI-T) is a measure of program profitability  Calculated by dividing a program’s revenue by the sum of its personnel costs and current expenses.  Program revenues can include student application fees and tuition, out of state fees, and gifts from alumni and charitable organizations.  Personnel expenses can include personnel salary expenses for program management, and instructional staff, personnel salary expenses for temporary personnel and student assistants, and personnel benefits.  Current expenses can include operating expenses for travel, goods and services, and materials and supplies.

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research25 Academic Program Viability Report Relative Profitability Index (RPI-T) Medical Laboratory Technology Source: Summary of Monthly Organization Budget & Actuals Status Report

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research26 Academic Program Viability Report RPI-T comparative measures  To provide a comparison of each program’s RPI-T to other similar programs, three other comparative measures are calculated.  As an example, in the mean RPI-T for SPC was 0.64, the mean RPI-T for programs in the health fields was 0.44, and the mean RPI-T for programs which offered % of their courses online was 0.86.

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research27 Academic Program Viability Report Employment trend information is reported by country and state  The source of the information is the Bureau of Labor Statistics, Office of Occupational Statistics and Employment Projections.  Job openings refer to the average annual job openings due to growth and net replacement.

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research28 Academic Program Viability Report Employment Trend Data

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research29 Program Action Plan

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research30 Program Action Plan

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research31 Academic Program Viability Report

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research32 Disseminating Information  Program specific reports  Published on the Educational Outcomes website  The APVR is one of the educational materials contained in the site  APVRs are uploaded into the site as a complete document (PDF)

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research33 Disseminating Information

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research34 Next Steps Additional measures being considered  Retention  Unduplicated program headcount  Placement (work in field – where, how much; transfer)  Technical attainment (Perkins requirement)

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research35 Future Direction  Ultimate goal is to provide Provosts (Deans) and Program Directors ‘timely’, ‘relevant’ ‘accurate’, and ‘interpretable’ information regarding their programs and their performance outcomes  Multi-measure ‘Dashboard’ style reports (Business Intelligence/Performance Measurement)

FAIR 2010 Conference February 2010 February 25, 2010 Florida Association of Institutional Research36 Questions/Next Steps

Academic Program Viability Report February 2010 Florida Association of Institutional Research 2010 Annual Conference