1. Program Framework Review November 2011 Pamela Miller, Ph.D. AVP for Learning

2. Purpose of Program Review San Juan College recognizes the importance of a systematic program review and evaluation process to guide the continuous improvement of quality academic programs.

3. Purpose (cont’d) The program review process is comprised of four primary data components: Internal analysis ◦ Outcomes assessment ◦ KPI’s Stakeholder surveys Competitive/peer analysis Market analysis

4. Guiding Principles The important guiding principles in program review should be the response to these questions: 1.How do we define our program and expected outcomes? 2.What community need does this address? 3.How well are we meeting our program objectives? 4.What are the characteristics of a quality program? 5.What improvements are recommended for continuous quality improvements? 6.What resources are required to implement those recommendations?

5. Why? Internal Drivers Strategic Planning Information-Driven Decision Making Improved Student Learning Outcomes Improved Instruction Higher Retention and Completion Rates Higher Revenues and/or Lower Costs

6. Why? Internal Drivers (cont’d) Document drivers of curriculum changes Measurable program outcomes Measurable course outcomes linked to program outcomes CSLO’s linked to course outcomes Curriculum mapping

7. External Drivers Accreditation ◦ Higher Learning Commission ◦ School/Program Accreditation National “Mood” ◦ Distrust of higher education system ◦ Increased accountability & transparency  Gainful Employment regulations  Program Integrity regulations  Performance-based funding Why? (cont’d)

8. Who? The Program Review process and Self Study Report is managed by the Program Director/Dept Chair A team approached is recommended: ◦ faculty (full- and part-time) ◦ general education representative(s) ◦ appropriate departmental staff ◦ appropriate faculty/staff outside of School in which program resides ◦ external reviewers (outside of SJC)

9. What? Higher Learning Commission criteria provide the framework for the Program Self Study ◦ Three primary components:  Fit with SJC mission  Planning and Preparing for the Future  Student Learning and Effective Teaching  Key Performance Indicators (Program Effectiveness)  Assessment of Student Learning Outcomes

10. What? (cont’d) Four primary data components: ◦ Internal analysis  Embed assessment activities into the Program Review cycle  KPI’s ◦ Stakeholder surveys  Employers, Students, Graduates, Faculty, Advisory Committee ◦ Competitive/peer analysis ◦ Market analysis

11. When? Key indicators will be reviewed and analyzed annually for all programs, regardless of their position in the Program Review rotation; these indicators may prompt an “out of cycle” program review A Limited number of programs will be reviewed in fall 2011 (one from each school) ◦ These programs will pilot the Program Review process that will be implemented in fall 2012 (5-year cycle begins)

12. How? Self Study Report Template/Outline ◦ The self study report is completed in WEAVE and submitted by the Program Director to the School Dean for review/revision ◦ The Self Study Report is presented to the Department and School for review/revision ◦ The School Dean submits the Self Study Report to the AVP for Learning and the Learning Leadership Team

13. How? (cont’d) Action Plan(s) ◦ One or more Action Plans are drafted by the Program Director and submitted to the School Dean for review/revision ◦ The Action Plan(s) is presented to the Department and School for review/revision ◦ The School Dean submits the Action Plan(s) to the AVP for Learning and the Learning Leadership Team ◦ Action Plan(s) are posted in WEAVE (and on the Portal?)

14. How? (cont’d) Self Study Summary Report ◦ A Self Study Summary Report is prepared in WEAVE by the School Dean and submitted to the AVP for Learning and the Learning Leadership Team ◦ The Self Study Summary Report is posted in WEAVE and on the Portal

15. How? (cont’d) Annual Action Plan Updates ◦ Annual Action Plan Updates are drafted in WEAVE by the Program Director and submitted the School Dean for review/revision ◦ The Annual Action Plan Updates are presented to the Department and School for review/ revision ◦ The School Dean submits the updates to the AVP for Learning and the Learning Leadership Team ◦ Annual Action Plan Updates are posted in WEAVE (and on the Portal?)

16. Resources Required Reference material and professional development ◦ Outcomes-based assessment Web-query database (data available from desktop) – iStrategy Self Study Report/Summary and Action Plan Templates (developing during pilot) Stakeholder Surveys (developed during pilot)

17. Resources Required (cont’d) Centralized storage for Program Review documents (WEAVE and Portal) ◦ Determine what is public and what is not  Self Study Summary Report on Portal (what else?) Stipends for part-time faculty required to participate?

18. LLT Involvement… Leadership Draft/refine Conceptual Framework Define Outcomes Based Assessment Program Review at SJC Develop strategy for faculty inclusion Team membership ◦ Value of external reviewers (outside program/ department) Identify professional development resources needed