ROI Committee Third Meeting November 15, 2013

Meeting Agenda Meeting Objectives: Review a draft dashboard concept and continue our discussion of audiences and data reporting Discuss and make initial decisions around the governance structure of the ROI Framework Outline a communications plan, including key messages, audiences, and opportunities for building buy-in 8:00Welcome and Introductions 8:10Dashboard Demo and Discussion 8:50 Governance: Functions and Roles 9:30Communications / PR Planning Discussion 9:50 Wrap-Up and Next Steps 10:00Adjourn

ROI in Practice Audiences More FormativeMore Summative Providers “What drives value?” Investors* “What are we getting for our money?” * Broadly defined; can include legislators, taxpayers, and philanthropy DASHBOARD TOPICS Audiences Objects of Evaluation Dashboard Concept Print Reports Services/Program Types

ROI in Practice Object of Evaluation More GranularMore Broad Services Funding Streams * Broadly defined; can include legislators, taxpayers, and philanthropy Programs Providers Target Populations DASHBOARD TOPICS Audiences Objects of Evaluation Dashboard Concept Print Reports Services/Program Types

ROI in Practice Dashboard Concept DASHBOARD TOPICS Audiences Objects of Evaluation Dashboard Concept Print Reports Services/Program Types

ROI in Practice Methodological notes, caveats, and guidelines for appropriate use throughout Primary Report Performance Across Whole System, Including Major Programs, Regions and Funding Streams (?) “What Works?” Performance by Types of Programs and Services “Who is Impacted?” Performance by Types of Programs and Services Program Reports (?) Technical Appendices DASHBOARD TOPICS Audiences Objects of Evaluation Dashboard Concept Print Reports Services/Program Types

ROI in Practice Training Credentials? Support Services High-Intensity vs. Low-Intensity How to Define? Cost Duration Services Similar Programs How to define? Population Served Programmatic Goals Intensity of Service DASHBOARD TOPICS Audiences Objects of Evaluation Dashboard Concept Print Reports Services/Program Types

Governance and Functions Considerations Credibility / Conflicts of Interest Institutional Incentives Capacity Scope

Governance - Examples WSIPP Doesn’t Recommend Policy or Operate/Administer Programs Academics, Researchers, Experts Play Advisory Role; Communities of Practice Research Questions Driven by Lawmakers, Board Strong Connection to Higher Education Board: Legislators, Gov. Appointees, Legislative Staff, Higher Education Takes Pains to Explain Methodologies, Decisions, Revisions; Sensitivity Analysis CBO Doesn’t Recommend Policy or Operate/Administer Programs Academics, Researchers, Experts Play Advisory Role; Communities of Practice Research Questions Driven by Lawmakers Strong Rules on Employee Financial Interests and Political Activities Takes Pains to Explain Methodologies, Decisions, Revisions; Sensitivity Analysis

Functions Data Provision/ Management Evaluation Auditing/Review Standard-Setting Communications & Reporting

Communications & PR Key Messages Key Audiences Opportunities for Building Buy-In Strategy and Game Plan

Finishing Up Next Webinar Tuesday, December 10 10:00 am - Noon