1. ROI Committee Third Meeting November 15, 2013

2. Meeting Agenda Meeting Objectives: Review a draft dashboard concept and continue our discussion of audiences and data reporting Discuss and make initial decisions around the governance structure of the ROI Framework Outline a communications plan, including key messages, audiences, and opportunities for building buy-in 8:00Welcome and Introductions 8:10Dashboard Demo and Discussion 8:50 Governance: Functions and Roles 9:30Communications / PR Planning Discussion 9:50 Wrap-Up and Next Steps 10:00Adjourn

3. ROI in Practice Audiences More FormativeMore Summative Providers “What drives value?” Investors* “What are we getting for our money?” * Broadly defined; can include legislators, taxpayers, and philanthropy DASHBOARD TOPICS Audiences Objects of Evaluation Dashboard Concept Print Reports Services/Program Types

4. ROI in Practice Object of Evaluation More GranularMore Broad Services Funding Streams * Broadly defined; can include legislators, taxpayers, and philanthropy Programs Providers Target Populations DASHBOARD TOPICS Audiences Objects of Evaluation Dashboard Concept Print Reports Services/Program Types

5. ROI in Practice Dashboard Concept DASHBOARD TOPICS Audiences Objects of Evaluation Dashboard Concept Print Reports Services/Program Types

23. ROI in Practice Methodological notes, caveats, and guidelines for appropriate use throughout Primary Report Performance Across Whole System, Including Major Programs, Regions and Funding Streams (?) “What Works?” Performance by Types of Programs and Services “Who is Impacted?” Performance by Types of Programs and Services Program Reports (?) Technical Appendices DASHBOARD TOPICS Audiences Objects of Evaluation Dashboard Concept Print Reports Services/Program Types

24. ROI in Practice Training Credentials? Support Services High-Intensity vs. Low-Intensity How to Define? Cost Duration Services Similar Programs How to define? Population Served Programmatic Goals Intensity of Service DASHBOARD TOPICS Audiences Objects of Evaluation Dashboard Concept Print Reports Services/Program Types

25. Governance and Functions Considerations Credibility / Conflicts of Interest Institutional Incentives Capacity Scope

26. Governance - Examples WSIPP Doesn’t Recommend Policy or Operate/Administer Programs Academics, Researchers, Experts Play Advisory Role; Communities of Practice Research Questions Driven by Lawmakers, Board Strong Connection to Higher Education Board: Legislators, Gov. Appointees, Legislative Staff, Higher Education Takes Pains to Explain Methodologies, Decisions, Revisions; Sensitivity Analysis CBO Doesn’t Recommend Policy or Operate/Administer Programs Academics, Researchers, Experts Play Advisory Role; Communities of Practice Research Questions Driven by Lawmakers Strong Rules on Employee Financial Interests and Political Activities Takes Pains to Explain Methodologies, Decisions, Revisions; Sensitivity Analysis

27. Functions Data Provision/ Management Evaluation Auditing/Review Standard-Setting Communications & Reporting

28. Communications & PR Key Messages Key Audiences Opportunities for Building Buy-In Strategy and Game Plan

29. Finishing Up Next Webinar Tuesday, December 10 10:00 am - Noon