1. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL The Management Academy For Public Health: Developing Entrepreneurial Public Health Managers American Public Health Association 2007 Annual Meeting

2. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL North Carolina Institute for Public Health Evaluation Team Karl Umble, PhD Kimberley Freire, MPH Rebecca Davis, MPH Margot Mahannah, BS Aiko Hattori, MPH Program Staff Stephen Orton, PhD Mekeisha Williams, MPA

3. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Management Academy Program 9 month management development program offered by the UNC-CH School of Public Health and Kenan-Flagler Business School Trains teams comprised of state and local public health department managers and community partners Almost 900 graduates in 9 years

4. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Background 1988 IOM Report “The Future of Public Health” Originally co-sponsored by the CDC, HRSA & RWJ and W.K. Kellogg Foundations. Today, program is funded through tuition fees and CDC grant

5. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL

6. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Program Goals Improve public health professionals’ management and leadership skills Increase public health organizations’ entrepreneurial and collaborative efforts

7. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Management Academy Curriculum Courses in managing people, money and data and social marketing Training on how to develop a business plan Coaching from business experts

8. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Phase I July Civic Entrepreneurship Managing People Managing Money Social Marketing Working in Teams Business Planning 360 Individual Development Plan Phase II October Business Communication Managing Money II Working in Teams II Feasibility Plan Presentations Phase III April Managing People II Business Plan Implementation Business Plan Presentations

9. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Management Academy Evaluation

10. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Evaluation Purpose Provide ongoing feedback for program quality improvement Measure program impacts

11. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Study Outcomes Individual Level Management confidence & performance Work responsibilities & relationships Desire to work in management & public health Commitment to professional development Team Level Business plan implementation Factors that influenced plan implementation

12. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Evaluation Methods Survey All 2003-05 MAPH graduates were sent an on-line survey (N=246, representing 52 teams) 60% response rate (n=146) Interviews One team member from each graduating team were purposively sampled from online survey respondents (N=52 teams) 70% response rate (n=39)

13. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Analysis Survey Conducted quantitative analysis in SAS Coded open-ended comments; generated themes Interviews Audio-taped interviews and recorded written notes Double coded interviews and generated themes

14. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Management & Job Performance

15. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Degree to Which MAPH Has Improved Your Management Confidence and Performance 6%7% 47% 55% 46% 39% 0 20 40 60 80 100 ConfidenceJob Performance Significant Improvement Some Improvement No Change

16. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Increased Job Responsibilities Since Attending Management Academy? (% "Yes") 65 54 52 50 47 39 37 32 28 020406080100 Community Partnerships Staff Supervision Health Program Management Policy Data Analysis Dept Management Financial Management Business Plan Dev Care Coordination

17. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Degree to Which MAPH Influenced Work Relationships 3% 42% 27% 35% 47% 20% 26% 0 20 40 60 80 100 With Supervisor With People You Supervise Significant Improvement Some Improvement No Change Decline

18. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL 16% 37% 46% 0 20 40 60 80 100 Significant Improvement Some Improvement No Change Decline 1% Degree to Which MAPH Has Contributed to Your Commitment to Professional Development

19. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Degree to Which MAPH Has Changed Your Desire to Work in Public Health & Management 38% 29% 59% 69% 0 20 40 60 80 100 Desire to work in public health Desire to work in management Increased No Change Declined2%

20. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Business Plan Implementation

21. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Business Plan Components Definition of the Project Industry Analysis Target Market Definition The Competition & Partners Marketing Strategy Project Operations Implementation & Timeline Risk & Exit Plan Financial Statements (Budget)

22. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Business Plan Implementation Team implemented entire plan Team implemented part of the plan One or more (but not all) team members implemented all or part of the plan

23. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Business Plan Implementation (2003-05) Did Not Implement 59% Don't Know 13% Implemented or in Process 28%

24. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Barriers to Implementing Business Plans Reported by Survey Respondents (%) 52 46 42 32 26 5 11 36 54 49 12 17 18 6 12 01020304050607080 Lack of Financial Resources Limited Staff Availability Competing Org Priorities Maintaining Interest in Plan Lack of Supervisor Support Staff Turnover Problems Within the Team Difficulty Obtaining Advice Did Not Implement PlanImplemented Plan

25. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Survey Participants Who Initiated Public Health Projects* Since Attending MAPH (%) 73% 54% 27% 46% 0 20 40 60 80 100 Implemented Business Plan Did Not Implement Business Plan *Other than original business plan No Yes

26. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Conclusions Management Academy has contributed to managers’ improved confidence and job performance Some participants may experience challenges with supervisors related to entrepreneurial efforts Business plan implementation is one indicator of organizational support for entrepreneurial efforts

27. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Implications Management Academy curriculum is an effective way to improve public health managers’ practices Training programs like MAPH need to find ways to collaborate with organizational leaders to facilitate entrepreneurial efforts

28. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Evaluation Limitations Linking specific components of the program to outcomes is challenging Study only represents activities 1-3 years after program participation

29. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Evaluation Strengths Evaluation measured outcomes Included individual and team level outcomes Multiple methods improved our ability to describe graduates’ activities

30. Management Academy for Public Health SCHOOL OF PUBLIC HEALTH ● ● KENAN-FLAGLER BUSINESS SCHOOL Management Academy Website http://www.maph.unc.edu/