1. Data Dashboards and Key Performance Indicators Presented by: Melissa Wright, M.A. Assistant Director, Baseline September 21, 2012 @CampusLabsCo #labgabLike us on Facebook!www.campuslabs.com/blog

2. What are key performance indicators?

3. performance indicator metrics dashboard balanced scorecard report card success factors

5. Based in business Balanced Scorecard – grounded in strategic initiatives Communicates priorities to constituents (internally & externally) Four perspectives o Financial/resource allocation o Customer/operational & program outcomes o Internal Business Process/key stats o Learning and Growth/learning outcomes

6. Steps to implementation ArticulateOperationalizeCreateShare

7. Steps to implementation Articulate OperationalizeCreateShare

8. Starting points Existing KPIs on your campus Mission and vision Strategic plan Learning outcomes frameworks (e.g., CAS, AAC&U) Numbers you are already using Questions you are already asking

9. Example performance indicators Graduation Rate GPAs Retention Rates Annual Giving Satisfaction Campus Climate Student Awareness Campus Safety Student Participation Class Size Outcome Measures Student Engagement Number of courses Credit Hour Production Contact Hour Housing Occupancy Rates Student Conduct Incidents Student: Faculty Ratio Programs Offered Service Hours

10. Direction of KPI developmentUniversityDivision Department Program

11. Institutional Dashboards Institutional Dashboard Examples: -Mean SAT score -Research Funding -4 or 6 year Graduation Rate -Doctorates Awarded -Undergraduate Enrollment -Graduate Enrollment -Alumni Giving -Financial Aid Awarded -Scholarships Awarded

12. Divisional Dashboards Provide information on the direction of the organization May not be directly actionable for departments Primarily shared “up” or “out” Examples: –Overall student satisfaction –Retention rates –Annual giving –Participation rates

13. Divisional Dashboard example Division of Enrollment Management and Student Development: -% overall student satisfaction rates (by semester) -% student engagement rates (by level of connectedness) -% student involvement rates (by semester) -Learning outcome domain rates (by type of learning environment) -% student development rates (by subject area)

14. Divisional Dashboard example Division of Academic Affairs: -Align with academic strategic plan -Use NSSE measures for student engagement as a structure for goals: –level of academic challenge –active and collaborative learning –student-faculty interaction –enriching educational experiences –supportive campus environment -Example: Buffalo State’s score for the “active and collaborative learning” NSSE benchmark area will rise from 49.7 to at least 55.4, or to a score that earns Buffalo State a place in the upper 50 percent of NSSE institutions.

15. Department Dashboard Focus on the aspects of the department that are critical Measured frequently and more actionable Measures are understood by staff members Have significant and positive impact on daily operations Examples: –Knowledge of policies/procedures –Perceptions –Outcome measures

16. Departmental dashboard example Parent Program: -# contact via email (by year) -# Parent Council Membership (by year and class) -% in-state vs. out-of-state residence -% satisfied with email contact -% satisfied with accessibility of Parent Liaison -% parents who considered themselves “involved”

18. Goals and targets In order to indicate progress or success, a goal or target is needed o External (e.g., determined by board of trustees) o Internal (e.g., director determined goals for department) o Objectively stated (e.g., retention goal of 89%) o Subjectively stated (e.g., learning outcome mean of 4)

19. Considerations Is the development of KPIs internally driven or externally required? Who will be USING the KPIs? With whom will you be SHARING the KPIs? Are others on your campus also developing KPIs? Is there an existing committee that can lead the KPI development process?

20. Keep it simple At core, the performance indicator is simple and informative. KEY is the important word

21. Steps to implementation Articulate Operationalize CreateShare

22. Data collection methods Keep in mind: KPIs are quantitative/numbers and can come from: Campus or student record systems Tracking Surveys Rubrics

23. Data collection: Existing campus systems

24. Data collection: Tracking Student attendance Number of programs Student organization involvement Student use of departmental services Community service hours

25. Data collection: surveys

26. Data collection: Rubrics

27. 80% satisfaction 70% satisfaction 80% satisfaction 90% satisfaction Multiple Sources Single Source

28. Single question on a single survey

29. Single question on multiple surveys

30. Multiple questions on single/multiple surveys

31. Ways to represent data CountPercentageMean

32. Use terms consistently Create data audits and/or data dictionaries Define terms: –“Student” –Class year –Terms/time periods

33. Effect on the assessment process Incorporate KPI into planning or project proposals Develop a standard set of scales and question formats Consider response rate requirements for inclusion in KPIs Create a data dictionary

34. Steps to implementation ArticulateOperationalize Create Share

35. How Campus Labs Can Help Collect event attendance and participation numbers Track exposure to outcome to link to learning/growth based performance indicators Embed performance indicators within your planning and reporting process Show concrete metrics that track improvement towards your larger goals and outcomes Collect survey and rubric data for performance indicators Create a variety of performance indicators Work with your assessment consultant to identify best practices for your institution or division

36. Melissa Wright, M.A. Assistant Director Campus Labs Team mwright@campuslabs.com 716.270.0000 QUESTIONS?