Key Performance Indicators: A Primer A presentation to aid Strategic Planning Office of Institutional Research and Planning March 12, 2010

Definitions Key Performance Indicator Key Performance Indicator is a measure used to define and evaluate how successful an organization is. Typically is expressed in terms of making progress towards its long-term organizational goals. is a measure used to define and evaluate how successful an organization is. Typically is expressed in terms of making progress towards its long-term organizational goals. Baseline Baseline Where we are now Where we are now Targets Targets Where we will be Where we will be

Indicators Quantitative measures of performance Quantitative measures of performance Used for reporting purposes (internal and external) Used for reporting purposes (internal and external) Work best within context a (comparison group or longitudinal trends) Work best within context a (comparison group or longitudinal trends) Usually made up of smaller components Usually made up of smaller components

Indicators Tell you “what” but not “why” Tell you “what” but not “why” Not used for decision making without detailed analysis Not used for decision making without detailed analysis Have limitations but valuable for measuring performance Have limitations but valuable for measuring performance Must have validity (a true measure) and reliability (measured the same way over time/across components) Must have validity (a true measure) and reliability (measured the same way over time/across components)

Example: Unemployment Rate Expressed as a % Expressed as a % Accepted as a “report” on status of economy Accepted as a “report” on status of economy Longitudinal (trend over time) Longitudinal (trend over time) Comparisons can be made (states, counties) Comparisons can be made (states, counties) Made up of smaller components (regional, industry) Made up of smaller components (regional, industry) It’s difficult to know WHAT to do about it from this one measure It’s difficult to know WHAT to do about it from this one measure Has understood limitations (underemployed are left out, chronic unemployed are left out, seasonal employment etc) Has understood limitations (underemployed are left out, chronic unemployed are left out, seasonal employment etc) Despite limitations we still know it works (as it rises we see people losing jobs, foreclosures go up, our enrollments go up etc…it has face validity) Despite limitations we still know it works (as it rises we see people losing jobs, foreclosures go up, our enrollments go up etc…it has face validity) Measured the same ever time (Reliability) Measured the same ever time (Reliability) Measured the same by all reporting agencies Measured the same by all reporting agencies

Examples of Indicators Term to Term Persistence Term to Term Persistence Course Success rates Course Success rates Financial spending to date compared to last year Financial spending to date compared to last year Overall Student Satisfaction Overall Student Satisfaction Carbon Footprint Carbon Footprint Institutional Effectiveness Rubric from WASC Institutional Effectiveness Rubric from WASC Measurement of Core Competencies at Institutional Level using eLumen data Measurement of Core Competencies at Institutional Level using eLumen data

Other Aspects of KPI Measure the success of the strategy not just the implementation of the strategy (Success vs. Process) Measure the success of the strategy not just the implementation of the strategy (Success vs. Process) Can be measured Can be measured Measurement is feasible and cost/effort effective Measurement is feasible and cost/effort effective College level College level

Example Goal: Live a vital and healthy lifestyle Goal: Live a vital and healthy lifestyle Strategies: weight management, mental wellness, exercise Strategies: weight management, mental wellness, exercise KPI: Pounds on scale, BMI index, hours meditating, hours recreating, KPI: Pounds on scale, BMI index, hours meditating, hours recreating,

Example #2 Staff Development Goal Staff Development Goal Strategies: Increase time faculty and staff have to engage in staff development activities Strategies: Increase time faculty and staff have to engage in staff development activities KPI: Number of flex days per semester KPI: Number of flex days per semester

Example #3 Diversity and Pluralism Diversity and Pluralism Strategy: Fair and equitable hiring practices Strategy: Fair and equitable hiring practices KPI: Mandatory training for Hiring committees (yes, no, in progress) KPI: Mandatory training for Hiring committees (yes, no, in progress) Diversity of faculty/staff mirrors that of student body Diversity of faculty/staff mirrors that of student body

Program Review and Strategic Plan Teaching and Learning Goal Teaching and Learning Goal Strategy: Increase Student Success in Basic Skills Courses Strategy: Increase Student Success in Basic Skills Courses KPI: ARCC Basic Skills Completion Rates KPI: ARCC Basic Skills Completion Rates

Program Review and Strategic Plan Program Level Goal: Improve student success rates in Basic Skills Course ____. Program Level Goal: Improve student success rates in Basic Skills Course ____. Program Level Strategies: Program Level Strategies: Supplemental Instruction pilot, Supplemental Instruction pilot, Text book Survey Text book Survey Request Institutional Research on Repeaters Request Institutional Research on Repeaters Design intervention for at risk students Design intervention for at risk students KPI: Student Success Rates in course____. KPI: Student Success Rates in course____.