ROMA Next Generation and the CSBG Annual Report - Overview

ROMA Next Generation and the CSBG Annual Report - Overview
June 30, 2017 ROMA Next Generation and the CSBG Annual Report - Overview

Presenters Seth Hassett, Director, Division of Community Assistance, OCS Denise Harlow, Chief Executive Officer, CAP Jarle Crocker, Director, Training and Technical Assistance, CAP Barbara Mooney, ANCRT Katy Kujawski, Research Director, NASCSP Lauren Cook, CSBG Deputy Director, NASCSP ROMA Next Generation and the CSBG Annual Report - Overview

Agenda ROMA Next Generation CSBG Annual Report: Where are we now? Review of Modules: Module 2: Expenditures, Capacity and Resources Module 3: Community Level Module 4: Individual/Family Level Tools and Resources Preparing for Data Collection and Reporting Touch on all of the modules, but will focus on modules 3 and 4 and the NPIs ROMA Next Generation and the CSBG Annual Report - Overview

Introduction Milestones and Accomplishments Successful Submission of Module 1 Annual Report Available “baseline” administrative information ACSI Round 2 entity survey underway Adaptive Challenges Data systems Interpretation of results Continuous improvement focus National measures and reporting ROMA Next Generation and the CSBG Annual Report - Overview

Building on the ROMA Foundation ROMA NEXT GENERATION What does Community Action do? Are Community Action Agencies managed efficiently? What services and/or strategies does Community Action provide? Does Community Action use CSBG to provide services or are funds used mostly for administrative support? Does/can Community Action tackle systemic, complex community issues? Who is Community Action serving? What does Community Action achieve? What is Community Action’s impact on the lives of people with low income and communities? Is Community Action doing what works? Is Community Action responding to current community needs? Is CSBG spread around communities so thin it has little impact? ROMA Next Generation and the CSBG Annual Report - Overview

Improves CSBG Performance Management. Improves CSBG Performance Measurement. Demonstrates Continuous Quality Improvement across a complex system. Demonstrates a commitment to Outcomes. Strengthens local solutions for families and communities. Builds agency capacity for the long term. ROMA Next Generation and the CSBG Annual Report - Overview

The adoption of a National Community Action Theory of Change. Support of creation of Local Theories of Change Renewal of the CSBG network understanding of the necessity of working toward community change as well as individual and family outcomes. Focus on improved collection and analysis of data. New Annual Report with OMB clearance Increased use of data at every point of the full ROMA Cycle. Increased integration of the phases of the ROMA Cycle. ROMA Next Generation and the CSBG Annual Report - Overview

Community Action Theory of Change
The foundation of ROMA NG is the National Community Action Theory of Change. ROMA Next Generation and the CSBG Annual Report - Overview

What is the Community Action Theory of Change?
9/11/2018 What is the Community Action Theory of Change? The National Community Action TOC is the articulation of the underlying beliefs and assumptions that guide a service delivery strategy. It identifies the “why” and the “how” of the activities undertaken and it identifies the “what” of change and improvement produced. This national statement can be adapted for specific local needs and approaches by local CAAs. Describe the elements of a common FRAMEWORK CAAs have to produce change Portray the broad picture of Community Action: long term goals, core principles, system capacity Identify the assumptions that guide the design of services and strategies to reach the long-term goals it hopes to achieve. identify the links that connect the purpose of the network, the understanding of the network’s national system, and the actual strategies implemented by local Community Action Agencies (CAA). ROMA Next Generation and the CSBG Annual Report - Overview

Why We Need It In 2011 Community Action leaders committed to making reforms to CSBG that would improve results for individuals with low-incomes and communities. Articulates core principles for CAA Network. Identifies CAA Network national goals. Demonstrates CAA Networks unique approach. Makes a complicated system easier to understand. Edited ROMA Next Generation and the CSBG Annual Report - Overview

How Was it Developed? By reflecting critical elements of the current CSBG Act. Incorporating the CAA history, vision and values. Considering fresh and innovative thinking about the future of our work. Since 2012 NASCSP has solicited feedback from the Network at meetings and via comment periods to develop the final TOC. Added ROMA Next Generation and the CSBG Annual Report - Overview

NATIONAL THEORY OF CHANGE
9/11/2018 NATIONAL THEORY OF CHANGE Describe the elements of a common FRAMEWORK CAAs have to produce change Portray the broad picture of Community Action: long term goals, core principles, system capacity Identify the assumptions that guide the design of services and strategies to reach the long-term goals it hopes to achieve. Demonstrates commitment to accountability via Performance Management identify the links that connect the purpose of the network, the understanding of the network’s national system, and the actual strategies implemented by local Community Action Agencies (CAA). ROMA Next Generation and the CSBG Annual Report - Overview

A Local Theory of Change
The national TOC is the framework for the network, but each agency will identify its own TOC that will be a reflection of the results of the CAAs needs assessment, strategic planning and Community Action Plan. What does the agency propose to change? Based on local needs Connected to the overarching network goals What is needed to make the change? How will the change be documented? ROMA Next Generation and the CSBG Annual Report - Overview

New Tool Available at www.nascsp.org
9/11/2018 New Tool Available at Added Describe the elements of a common FRAMEWORK CAAs have to produce change Portray the broad picture of Community Action: long term goals, core principles, system capacity Identify the assumptions that guide the design of services and strategies to reach the long-term goals it hopes to achieve. identify the links that connect the purpose of the network, the understanding of the network’s national system, and the actual strategies implemented by local Community Action Agencies (CAA). ROMA Next Generation and the CSBG Annual Report - Overview

CSBG Performance Management Framework
Securing CSBG efficiency and effectiveness at the local, state and federal levels. ROMA Next Generation and the CSBG Annual Report - Overview

Performance Management Framework
Local Organizational Standards State and Federal Accountability Measures Results Oriented Management and Accountability system ROMA Next Generation CSBG Annual Report, which includes an updated and refined set of CSBG outcome measures. These elements are designed to increase accountability across all three levels of the network (federal, state, and local) and to enable program administrators at all levels to make better program decisions based on data. ROMA Next Generation and the CSBG Annual Report - Overview

ROMA NG: The CSBG Annual Report
ROMA Next Generation and the CSBG Annual Report - Overview

Where are we now? CSBG Annual report received a 3-year clearance from the Office of Management and Budget (OMB) on January 12, 2017. This starts the phase-in of the CSBG Annual Report and the phase-out of the CSBG IS Survey. ROMA Next Generation and the CSBG Annual Report - Overview

Finally, Clearance! Now, moving forward…
January 12, 2017 CSBG Annual Report is cleared by OMB February 2017 Module 1 is tested in OLDC by State beta testers T/TA Webinars States prepare to complete Module 1 March 2017 Module 1 is available in OLDC Module 1 Instruction Manual available on NASCSP website Convened the DATA Task Force April 2017 States complete first submission of Module 1 in OLDC States submit CSBG IS Access Database to NASCSP June 2017 Round one of Module 1 and the CSBG IS data review is completed. DATA Task Force holds first in person meeting. Draft instruction manual is in process. ROMA Next Generation and the CSBG Annual Report - Overview

Reporting Timelines: October 1 – September 30
Federal Fiscal Year (FFY) State Reporting Period October 1 – September 30 Data Submission for States: Data Submission for local CSBG Eligible Entities: FFY 2016: October 1, 2015-September 30, 2016 State Reporting Period: October 1, 2015- September 30, 2016 Due March 31, 2017: CSBG IS Survey is submitted to NASCSP. Module 1 is completed based on the 2016 Federal Fiscal Year and submitted through the On-Line Data Collection system (OLDC). CSBG IS Survey FFY 2017: October 1, 2016-September 30, 2017 October 1, 2016- September 30, 2017 Due March 31, 2018: CSBG IS Survey is submitted to NASCSP. Module 1 is completed based on the 2017 Federal Fiscal Year and submitted through OLDC. FFY 2018: October 1, 2017-September 30, 2018 October 1, 2017- September 30, 2018 Due March 31, 2019: CSBG Annual Report (Modules 1-4) is submitted through OLDC. CSBG Annual Report (replaces CSBG IS Survey) FL has an Oct – Sept reporting period. Agencies will begin collecting data for the new report in October of this year, 2017. (In Progress) ROMA Next Generation and the CSBG Annual Report - Overview

How do we get there? Assessment and Planning Communication & Coordination Training and Technical Assistance Do you need new intake forms, data collection processes or training? Research Modules 2-4. Talk with your state, talk with your association, identify new indicators that you plan to utilize Local Agencies: Review of current data systems, timelines, T/TA needs, crosswalk what was reported in the CSBG IS that can be reported in the CSBG Annual Report, identify staff or committee to lead implementation. States: Review of current data systems, timelines, and T/TA. NASCSP: Data procurement templates, survey states for technical assessment and implementation timeline, automation of Modules 2-4 in OLDC. ROMA Next Generation and the CSBG Annual Report - Overview

NATIONAL: Federal Partners NASCSP CAP ANCRT CAPLAW OCS Specialists DATA Task Force States: State CSBG Offices State Associations RPICs Local Agencies: Local Experts Neighbor CAAs COMMUNICATION – WHO, What, How often, work together. Utilize and leverage each other. ROMA Next Generation and the CSBG Annual Report - Overview

The DATA Task Force ROMA Next Generation and the CSBG Annual Report - Overview

CSBG DATA (Data, Analysis, and Technical Assistance) Task Force
9/11/2018 CSBG DATA (Data, Analysis, and Technical Assistance) Task Force Convened by NASCSP to assist OCS and NASCSP in understanding and addressing the CSBG Network’s Data needs, including collection and storage; Use of data for analysis; and Continual improvement of results. DATA Task Force is a consultative body focused on: The transition from the CSBG IS Survey to the CSBG Annual Report; and Ongoing assistance in the implementation of the CSBG Annual Report. Create a data oriented culture. Local, state, associations and national – data needs – yes but also data collection and storage needs. the systems for collection and storage (in silos in most cases) is part of what needs to be considered by this group. “data friendly” org culture. We understand the value of data and want to be sure our data is accurate and complete. The culture of the network has to be changed to embrace these ideas and values. ROMA Next Generation and the CSBG Annual Report - Overview

9/11/2018 DATA Task Force Members by HHS Region 1 10 2 8 5 7 3 9 4 6 Local CAA State Office State Association ROMA Next Generation and the CSBG Annual Report - Overview

DATA Task Force Guidance
Feedback Instructions for Modules 2, 3 & 4 Data Analysis What analysis of IS data currently takes place at the local level? At the state level? How is that data used? What would be the ideal? Communication What are the critical messages about the AR that need to be conveyed to the network? ROMA Next Generation and the CSBG Annual Report - Overview

ROMA NG: The CSBG Annual Report and the CSBG IS Report

Improving Performance Management
Under the IS reporting system we found some things missing: Which have been added to the new Annual Report Reporting of services and strategies Data on state and federal accountability measures Data on Organizational Standards Additional Community Level outcomes (new NPIs) Ability to show progress on community work over time Additional infrastructure for multi level data analysis OMB clearance for 3 years (as of January 2017) ROMA Next Generation and the CSBG Annual Report - Overview

State Administration Module 1 CSBG Eligible Entity Expenditures, Capacity, and Resources Module 2 Community Level Module 3 Individual and Family Level Module 4 ROMA Next Generation and the CSBG Annual Report - Overview

Module 1 State Administration ROMA Next Generation and the CSBG Annual Report - Overview

Module 1: State Administration
Similar to Sections A-D in the CSBG IS Completed by State CSBG Administrators/contractor All information is based on the FFY Includes information on: State administration of CSBG funding Use of State administrative funds and discretionary funds for staff positions, as well as training and technical assistance Compares use of planned funds to actual use Edited ROMA Next Generation and the CSBG Annual Report - Overview

Module 1: State Administration
Includes information on (Continued): Progress of eligible entities in meeting Local Organizational Standards (Section D) Includes information on progress of State in meeting accountability measures (Multiple Sections) Information on State monitoring activities (Section H) Details about CAA Quality Improvement Plans (Section H) ROMA Support for CAAs and State and CAA continuous improvement efforts (Section I) Edited Discuss that there are sections using the ACSI score and on organizational standards. ROMA Next Generation and the CSBG Annual Report - Overview

States report this for the first time, due Friday, new sections on the org standards and the acsi ROMA Next Generation and the CSBG Annual Report - Overview

CSBG Eligible entity Expenditures, Capacity, and resources
Module 2 CSBG Eligible entity Expenditures, Capacity, and resources ROMA Next Generation and the CSBG Annual Report - Overview

Module 2: CSBG Eligible Entity Expenditures, Capacity, and Resources
Similar to Sections E-F in the CSBG IS Completed by eligible entities; reviewed, evaluated, and analyzed by State CSBG Lead Agencies. Section A meets the Congressional requirement for an explanation of the total amount of CSBG funding expended during the reporting period based on categories referenced in the CSBG Act. Section B provides detail on agency capacity building funded by CSBG and other funding sources. Section C provides data on resources allocated to, administered through, and generated by the CSBG Eligible Entity. ROMA Next Generation and the CSBG Annual Report - Overview

Module 2: CSBG Eligible Entity Expenditures, Capacity, and Resources
Where is agency capacity building? There are new data points in module 2 that ask exactly about this ROMA Next Generation and the CSBG Annual Report - Overview

New service categories that align with the other domains ROMA Next Generation and the CSBG Annual Report - Overview

Module 2 ROMA Next Generation and the CSBG Annual Report - Overview

New service categories that align with the other domains ROMA Next Generation and the CSBG Annual Report - Overview

Module 3 Community Level Know there is some anxiety out there about the community level module. we will walk through the module and identify what you can report on. We know that not everyone is able to the same kinds of community level work—working on the homeless rate in your community, but the module is expanded to capture more of this work ROMA Next Generation and the CSBG Annual Report - Overview

CSBG Annual Report | Module 3
Collects information on the agency’s community level initiatives. Showcases the connection between initiatives and outcomes. Demonstrates how initiatives would be reported on over time. Auto-population where information carries over from year to year. Expects that most CAAs have a handful of initiatives that include community strategies and achieve community level change. When we hear agencies talk about needs that were assessed, they are often community level needs: Our community lacks living wage jobs There is a need for more affordable housing We have a high unemployment rate We have a low high school graduation rate in the school district that serves our customers with low income How will we respond to these needs? What will change in communities? Increase in living wage jobs, affordable housing units? Reduced unemployment rate? Increased high school graduation rate? What will agencies do to help make these kinds of changes in their communities? Who will we partner with (as these efforts usually involve multiple organizations.) ROMA Next Generation and the CSBG Annual Report - Overview

Community Level Work Economic Opportunity Act and CSBG Act include the importance of addressing poverty on both the individual/family and community levels. ROMA Next Generation and the CSBG Annual Report - Overview

CSBG Act Included in the purpose and goals: “…to provide assistance to States and local communities, working through a network of community action agencies and other neighborhood based organizations for the reduction of poverty, the revitalization of low-income communities, and the empowerment of low-income families and individuals…” “…the greater use of innovative and effective community-based approaches to attacking the causes and effects of poverty and of community breakdown;” the CSBG Act reflects the importance of addressing poverty on both the individual/family and community levels. Why we do it and why its important ROMA Next Generation and the CSBG Annual Report - Overview

Community Level Work Module 3 is a renewal of the CSBG network’s understanding of the necessity of working toward community change as well as individual and family outcomes. Module 3 creates the reporting space for CAAs to tackle complex community level issues. the CSBG Act reflects the importance of addressing poverty on both the individual/family and community levels. Why we do it and why its important ROMA Next Generation and the CSBG Annual Report - Overview

emphasize here that this would not be b reporting burden for much of the year. Would probably complete at end of the year. Also note one CAA will probably not have more than a handful of reports on this section. ROMA Next Generation and the CSBG Annual Report - Overview

Module 3 Module 3 Community Level – This may look different ROMA Next Generation and the CSBG Annual Report - Overview

Individual and Family Level
Module 4 Individual and Family Level ROMA Next Generation and the CSBG Annual Report - Overview

Outcomes, Services, People
At the individual and family level, ROMA Next Generation connects outcomes, services and participants to facilitate robust analysis. Outcomes (Examples): Obtained jobs, completed education, increased income, improved parenting, secured housing (Proposed Family Level Performance Indicators) Services (Examples): Job Training, Work Experience, Scholarships, Financial Education, Support Groups, Housing Counseling, Food Assistance (Family Level Services). People: Unduplicated count of people served. All participant characteristics (income, job status, education, etc.); and, participants at the time they first engage. A means of connecting people served to services provided to outcomes achieved (or movement toward outcomes) so that we can analyze and improve the services we provide. What are the characteristics of those who achieved outcomes? How do they differ from others served but who did not achieve? What services were provided? What outcomes were achieved? ROMA NG connects outcomes, services, and people to facilitate robust analysis Example: 50 unemployed individuals obtained jobs as a result of job training provided for 80 participants. The NPI information combined with demographic and service information allows agencies and states to analyze what is working and identifies steps to improve service delivery and results to more effectively serve participants. ROMA NG encourages analysis of the data, that will produce questions to be answered for improved management and accountability. 50 out of 80 or 62% have achieved the outcome. Is that a good percent? Is there a difference in demographic profile between those who achieved a job vs. those who didn’t? Is there a difference in intensity or frequency of the service (did some attend more sessions?) ROMA Next Generation and the CSBG Annual Report - Overview

What’s in the new Annual Report?
Module 4 Individual and Family Leve Many data points will be familiar. ROMA Next Generation and the CSBG Annual Report - Overview

Module 4|Services List New list in the Annual Report. The things (services) we deliver to individuals and families. Currently in the IS outputs and outcomes are mixed together. Services and outcomes have been separated so that we can better understand and tell the story of what services are being provided by the Network to achieve results for individuals and families. We know from talking with the field that some individuals and families are receiving services to achieve outcomes in both Goals 1 and 6 (so there is some duplication in reporting) ROMA Next Generation and the CSBG Annual Report - Overview

DATA Analysis What does Community Action do? Are Community Action Agencies managed efficiently? What services and/or strategies does Community Action provide? Does Community Action use CSBG to provide services or are funds used mostly for administrative support? Does/can Community Action tackle systemic, complex community issues? Who is Community Action serving? What does Community Action achieve? What is Community Action’s impact on the lives of people with low income and communities? Is Community Action doing what works? Is Community Action responding to current community needs? Is CSBG spread around communities so thin it has little impact? ROMA Next Generation and the CSBG Annual Report - Overview

9/11/2018 DATA ANALYSIS – DIGGING DEEPER WITH ROMA NG Implementation of the full ROMA cycle includes identifying what will change, based on the locally assessed needs, and how the agency will know if the change has happened. Each part of the ROMA cycle involves data and the opportunity for analysis of that data. Preparation for data collection and analysis has to be included in the agency’s activity model. ROMA Next Generation requires greater use of data and data analysis. ROMA Next Generation and the CSBG Annual Report - Overview

Did the Outcomes achieved address the needs identified in the assessment phase? How well did we track our success? Did we meet our targets? 9/11/2018 What does data tell us about the needs in our specified community? What identified needs can we reasonably address either independently or in partnership with other organizations? Assessment How do the Core Principles in the Theory of Change help guide our agency strategic plan and community action plan? Evaluation Planning What has changed for the people we served? What has changed for our community? What Outcomes were achieved and for whom? What Services and Initiatives contributed to achieving the Outcomes? What can we improve to better respond to local needs? How will we implement our unique combination of Services and Initiatives? And for what Outcomes (NPIs)? ROMA Next Generation How do specific Services and Initiatives (Strategies) help support and produce Outcomes to respond to the needs of our community? How will we strategically respond as an agency to individual, family, and community needs? What impact do we want to have? What are our performance targets? What services and initiatives do we select? Achievement of Results Implementation What Outcomes are observed and measured as Community and Family level NPIs? How do the Outcomes we are tracking move us towards our agency goals in our local TOC? DATA ANALYSIS – DIGGING DEEPER WITH ROMA NG Implementation of the full ROMA cycle includes identifying what will change, based on the locally assessed needs, and how the agency will know if the change has happened. Each part of the ROMA cycle involves data and the opportunity for analysis of that data. Preparation for data collection and analysis has to be included in the agency’s activity model. ROMA Next Generation requires greater use of data and data analysis. Do we have a process for observing progress and using data to make changes as needed? Do we need to make changes to our services and initiatives? ROMA Next Generation and the CSBG Annual Report - Overview

Not Just a Clockwise Movement
The phases of the ROMA cycle must be considered together, with the understanding that the agency might move from Implementation back to Assessment, or from Reporting back to Planning. ROMA Next Generation and the CSBG Annual Report - Overview

How does this all fit together?
CAA Community Needs Assessment CAA Strategic Plan CAA Community Action Plan CSBG State Plan CSBG Annual Report Congressional Report Edited ROMA Next Generation and the CSBG Annual Report - Overview

RESOURCES AND TOOLS ROMA Next Generation and the CSBG Annual Report - Overview

Annotated CSBG Annual Report
This is the and annotated version of Module 1. This is a crosswalk of the CSBG IS and the new Annual Report. ROMA Next Generation and the CSBG Annual Report - Overview

CSBG IS – CSBG Annual Report Crosswalk
This is the and annotated version of Module 1. This is a crosswalk of the CSBG IS and the new Annual Report. ROMA Next Generation and the CSBG Annual Report - Overview

CSBG Annual Report Numbering

Additional Tools and Resources Coming
June/July: CSBG Annual Report Crosswalk with LIHEAP, Head Start, WIOA, and Weatherization. CSBG Annual Report, Webinar Series, focus on Modules 3 & 4. July: Instruction Manuals and Lexicon ROMA Next Generation and the CSBG Annual Report - Overview

NEEDS TO BE UPDATED ONCE I KNOW WHAT OTHERS ARE DOING ROMA Next Generation and the CSBG Annual Report - Overview

Questions? Contact us! Katy Kujawski: Lauren Cook: Jackie Orr: ROMA Next Generation and the CSBG Annual Report - Overview

Upcoming CSBG Annual Report Webinars
Understanding Module 4, Individual and Family Level July 6 - CSBG Annual Report, Module 4 - 1:00PM ET - Click here to register July 7 - CSBG Annual Report, Module :00AM PT - Click here to register July 14 - CSBG Annual Report, Module :00AM CT - Click here to register Understanding Module 3, Community Level July 17 - CSBG Annual Report, Module :00AM ET - Click here to register July 21 - CSBG Annual Report , Module :00AM PT - Click here to register July 25 - CSBG Annual Report, Module :00AM CT - Click here to register CSBG Annual Report, Understanding Module 4, Individual and Family Level Going into further detail, this interactive session will explore Module 4 of the CSBG Annual Report. Items reviewed will include the National Performance Indicators (NPIs), family and individual services, demographics, and targeting. Webinar participants will have an opportunity to ask questions. CSBG Annual Report, Understanding Module 3, Community Level This webinar will explore Module 3 of the CSBG Annual Report, which contains Community Level Indicators and strategies. Items reviewed will include the Community National Performance Indicators (NPIs), community level strategies, and the community initiative status form. Webinar participants will have the opportunity to ask questions. ROMA Next Generation and the CSBG Annual Report - Overview

ROMA Next Generation and the CSBG Annual Report - Overview

Similar presentations

Presentation on theme: "ROMA Next Generation and the CSBG Annual Report - Overview"— Presentation transcript:

Similar presentations

About project

Feedback

Log in

Auth with social network:

ROMA Next Generation and the CSBG Annual Report - Overview

Similar presentations

Presentation on theme: "ROMA Next Generation and the CSBG Annual Report - Overview"— Presentation transcript:

Similar presentations

About project

Feedback