1. Evaluating SPP/APR Improvement Activities
Presented by Jeanna Mullins, Mid-South Regional Resource Center, RRCP Document developed by members of the Systems and Improvement Planning Priority Team (NECTAC and RRCP)

2. Resource Document Highlights
Content
Types of SPP/APR Improvement Activities
Selection and Review of Activities
Steps for Evaluation of Activities
Evaluation Scenarios

3. Poll Question
Have you reviewed the Evaluating SPP/APR Improvement Activities document?

4. Types of Improvement Activities
Improve data collection and reporting
Improve systems administration and monitoring
Build systems and infrastructures of technical assistance and support
Provide technical assistance/ training/professional development

5. Types of Improvement Activities
Clarify/examine/develop policies and procedures
Program Development
Collaboration/coordination
Evaluation
Increase/adjust FTE

6. Selection and Review of Improvement Activities
Root cause analysis?
Links between root cause, data, and proposed outcomes?
Evidence-based practices?
Address more than one indicator?
Identification of collaborative partners?

7. Selection and Review of Improvement Activities
Detailed action plan (tasks, person(s) responsible, resources needed, timelines) for each activity?
Short-term and long-term outcomes?
Data sources, collection, analyses, and reporting?

8. Poll Question
Do you have an evaluation plan for one or more of your SPP/APR improvement activities?

9. Steps for Evaluating Improvement Activities
Goal/Purpose
Questions
Process/Impact
Data Collection Methods

10. Steps for Evaluating Improvement Activities
Timelines
Data Analysis Methods
Use and Reporting of Results
Person(s) Responsible

11. Sample Improvement Activity
Collaborate across State Part C and Section 619 agencies to clarify roles and responsibilities of local programs at the data collection point when the child exits Part C and enters Part B.

12. Collaboration Scenario
Context
Missing data on C3/B7
Local programs are unclear about when data should be collected and reported
Written policies and procedures are unclear, (e.g. roles and responsibilities of Part C v. 619)
All local staff have not been trained

13. Goal/Purpose
Goal
To clarify roles and responsibilities of Part C and Section 619
Question
To what extent did the collaboration result in clear descriptions of roles and responsibilities of Part C and 619 staff?

14. Impact and Methods
Impact: Outcome Evaluation Data Collection Method: Focused discussion with small group

15. Timelines and Data Analysis
Timelines: Prior to the dissemination of revised policies and procedures and provision of training (Identify the specific timelines) Data Analysis: Baseline: Local programs report that roles and responsibilities are not clear.

16. Data Analysis Method
Notes/transcript from the reviewer discussion will be analyzed to determine whether or not roles and responsibilities for Part C and 619 are clear, and, if not, how they could be improved.

17. Data Use and Reporting
Feedback will help ensure written roles and responsibilities are clear. Will be incorporated into overall policies and procedures related to collecting and reporting outcomes data and into training.

18. Persons Responsible
Responsibilities: Part C and 619 staff will identify a set of local providers/program staff to participate in the review and discuss the reviewer feedback and implications for additional clarification needed regarding roles and responsibilities

19. Improvement Planning Resources
RRCP SPP/APR Planning Calendar
Evaluating SPP/APR Improvement Activities
NCRRC SPP/APR Improvement Activity Review Form
State Systems Self-Assessment and Planning Guide
Using the SPP/APR as a Management Tool

20. Questions, Comments, Ideas
What are your thoughts?