1 Salmon ND Community Call March 12, 2015

2 Agenda – Roll Call – Upcoming NDTAC Webinar Series Guest Speaker: Nick Read – Promising Practices: Youth Mental Health First Aid Guest Speaker: Heather Denny, ND Coordinator (Montana) – Salmon Community Updates – CSPR Data Submission – Overview of the Federal Monitoring Process and Indicators – Recent TA Requests – NDTAC Updates

3 Guest Speaker: Nick Read Upcoming Webinar Series

4 Guest Speaker: Heather Denny (MT) Promising Practices: Youth Mental Health First Aid

5 Sharing Good News Salmon Community Updates

6 Iowa: Woodward Academy Makes a Historic Run to the State Basketball Tournament Woodward Academy, a 260-bed, residential treatment facility is the first school for court- involved youth to advance to state Media Coverage – Iowa Public Radio Iowa Public Radio – Des Moines Register Des Moines Register

7 Arizona: First HS Diploma Awarded A facility with 0 high school diplomas when monitored in October 2014 SEA recommended issuing high school course credits First high school diploma awarded this year Media Coverage: – FOX 10 News FOX 10 News

8 Wyoming: Facility featured for use of technology Wyoming Girls’ School featured in a series on the use of educational technology in correctional facilities Support from Center for Educational Excellence in Alternative Settings (CEEAS)Center for Educational Excellence in Alternative Settings (CEEAS) Computer literacy and computer science instruction Media Coverage: – Marketplace LearningCurve (NPR Affiliate) Marketplace LearningCurve (NPR Affiliate)

9 Utah: Featured on a CEEAS-CJCA webinar Utah featured in Five Guiding Principles for Providing High-Quality Education in Juvenile Justice Care SettingsFive Guiding Principles for Providing High-Quality Education in Juvenile Justice Care Settings Principle 1: Creating enduring, positive climates that make learning possible Principle 1: Creating enduring, positive climates that make learning possible

10 Salmon Community Updates Any other updates or news to share? Questions for your colleagues?

11 How’s it going?! CSPR Data Submission

12 CSPR Data Submission Poll Where are you in the CSPR data reporting process? I’m having difficulty getting the last of the data from some subgrantees I’ve collected data from all subgrantees I’m in the process of compiling the data and checking for data quality I’ve already submitted the data via EDFacts and CSPR I’m not entirely sure, the data people at my SEA are taking care of the CSPR data

13 CSPR Data Submission Poll Are there any portions of the CSPR data reporting process that improved this year? TA provided to subgrantees to prepare them for the CSPR collection Subgrantee’s collection of data Collection of data from your subgrantees Checking for data quality Compiling the data from subgrantees Submission of data through EDFacts and CSPR Are there any portions where you would like to improve the CSPR data reporting process? TA provided to subgrantees to prepare them for the CSPR collection Subgrantee’s collection of data Collection of data from your subgrantees Checking for data quality Compiling the data from subgrantees Submission of data through EDFacts and CSPR

14 An Overview Federal Monitoring Process and Indicators

15 Monitoring Plan Office of Safe and Healthy Students (OSHS) Monitoring Plan for Homeless and Neglected or Delinquent Education Programs Revised December 2014 Reflects reorganization that moved the Title I, Part D programs to OSHS

16 Definition and Purpose Monitoring formalizes the integral relationship between ED and the States – Emphasizes accountability for using resources wisely in educating and preparing our nation’s students – Regular and systematic examination of a State’s administration and implementation of a Title I, Part D grant – Necessary to ensure that all children have a fair, equal, and significant opportunity to obtain a high-quality education – Assesses the extent to which States provide leadership and guidance for subgrantees in implementing policies and procedures that comply with the statutes and regulations of Title I, Part D

17 Monitoring Process Preparation for Monitoring – OSHS staff will request that the SEA submit specific documentation about eight weeks prior to scheduled onsite review Onsite or Remote Monitoring – OSHS staff will review additional documentation and will interview SEA and LEA staff with program responsibilities Exit Conference – Monitoring team meets with the SEA to discuss potential findings and recommendations that the team will likely cite in the monitoring report – Responds to questions posed by the SEA

18 NDTAC’s Role Prepare pre-monitoring reports for ED – Coordinator tenure – NDTAC event participation (e.g., webinars, conference, topical calls) Provide TA in response to findings (past 3 years) – TA requests (past 7 years) – CSPR data (FY 13-14) Raise awareness about monitoring indicators Direct States to Federal and NDTAC resources to help Coordinators and subgrantees self-assess preparedness for monitoring visits

19 NDTAC’s Role Observe monitoring visits to inform TA activities and future product development (with coordinator’s approval) NDTAC does NOT monitor States or provide guidance on the likelihood of findings

20 Monitoring Indicators Used by ED to determine the degree of implementation of Federal programs and activities administered by SEAs in three areas: – Standards, Assessment and Accountability – Instructional Support – Fiduciary Criteria ensures a consistent application of these standards across monitoring teams and across States Provide guidance for all States regarding the purpose and intended outcomes of monitoring by describing what is being monitored and providing the criteria for judging the quality of implementation (acceptable evidence)

21 Monitoring Indicators Standards, Assessment and Accountability

22 Monitoring Indicators Standards, Assessment and Accountability To what extent are your subgrantees meeting Subpart 3 program evaluation requirements?

23 Monitoring Indicators Standards, Assessment and Accountability Guiding QuestionNDTAC Resources How does the SEA ensure that students in Title I, Part D programs receive instruction that is aligned with state standards and accountability? What is the SEA process for monitoring Subpart 1 and 2 programs from selection and notification to reporting and corrective action follow-up? Tip Sheet: Subgrantee Monitoring Tip Sheet: Subgrantee Monitoring Title I, Part D, State Coordinator's Orientation Handbook (PDF) Title I, Part D, State Coordinator's Orientation Handbook (PDF) Compliance Isn't Built in a Day: The Importance of Ongoing Communication in Subgrantee Monitoring Compliance Isn't Built in a Day: The Importance of Ongoing Communication in Subgrantee Monitoring Subgrantee Monitoring: How do States Monitor Their SAs and LEAs? Subgrantee Monitoring: How do States Monitor Their SAs and LEAs? Innovative Approaches to Offsite Monitoring and TA Provision Innovative Approaches to Offsite Monitoring and TA Provision

24 Monitoring Indicators Standards, Assessment and Accountability Guiding QuestionNDTAC Resources What is the process for data collection that the SEA uses to obtain demographic, academic and vocational outcome information on all Subpart 1 and 2 programs? How does the SEA evaluate statewide and subgrantee program performance and report the results of such evaluations? Title I, Part D, State Coordinator's Orientation Handbook (PDF) Title I, Part D, State Coordinator's Orientation Handbook (PDF) The Instructional Guide to Reporting Title I, Part D Data in the CSPR for SY 2013–14 The Instructional Guide to Reporting Title I, Part D Data in the CSPR for SY 2013–14 Resources and Tools for Title I, Part D Data Collection for SY 2013–14 Resources and Tools for Title I, Part D Data Collection for SY 2013–14 Measuring Program Success Making the Most of Your Data: Strategies for Evaluating Your Program Making the Most of Your Data: Strategies for Evaluating Your Program

25 Monitoring Indicators Instructional Support

26 Monitoring Indicators Instructional Support

27 Monitoring Indicators Instructional Support Guiding QuestionNDTAC Resources What are the SEA’s goals and objectives for the Title 1, Part D Program? Have they been reviewed and updated recently? Title I, Part D, State Coordinator's Orientation Handbook Title I, Part D, State Coordinator's Orientation Handbook Collaboration and Developing State Plans Collaboration and Developing State Plans How does the SEA inform SAs about their eligibility and application requirements for a Title I, Part D subgrant? Title I, Part D, Program Administration Planning Toolkit Title I, Part D, Program Administration Planning Toolkit What technical assistance does the SEA provide the SAs on developing or revising their Subpart 1 applications? Title I, Part D, Program Administration Planning Toolkit Title I, Part D, Program Administration Planning Toolkit How does the SEA review and evaluate the Subpart 1 applications? Title I, Part D, Program Administration Planning Toolkit Title I, Part D, Program Administration Planning Toolkit

28 Monitoring Indicators Instructional Support Guiding Question (CONT’D)NDTAC Resources Do institutionwide project plans include a comprehensive needs assessment across all education program services? Planning and Implementing Institutionwide Projects Planning and Implementing Institutionwide Projects Tool: Institutionwide Project Planning Toolkit Tool: Institutionwide Project Planning Toolkit How are the needs assessment, curriculum, plans for professional development and program evaluation aligned in institutionwide projects? Tool: Institutionwide Project Planning Toolkit Tool: Institutionwide Project Planning Toolkit

29 Monitoring Indicators Fiduciary

30 Monitoring Indicators Fiduciary

31 Discussion: What internal fiscal controls does your state have in place to account for the use of Title I, Part D funds in a way that meets Federal requirements? Monitoring Indicators Fiduciary

32 Common Monitoring Findings and Recommendations State Plan (former Indicator 1.1) – Whether the content of the State Plan adhered to Federal guidelines (e.g., insufficient or improper identification of State goals; insufficient descriptions of State activities and/or services) – Extent to which States implemented their State Plan, including inappropriate allocation of Part D funds or lack of alignment between the content of the plan and how program activities were being conducted

33 Common Monitoring Findings and Recommendations SA Application (former Indicator 1.2): – Extent to which SA Applications addressed all statutory requirements (i.e., the 19 required elements) – Using an inappropriate application – Insufficient evidence that an application had been approved by the SEA – Not using an application to allocate funds

34 Common Monitoring Findings and Recommendations LEA Application (former Indicator 1.3) – Administering an application that did not meet all statutory requirements (i.e., the 13 required elements) – Insufficient evidence that an application had been approved by the SEA – Not using an application to allocate funds—that is, not sufficiently identifying and inviting LEAs that serve students with the greatest needs to complete an application

35 Common Monitoring Findings and Recommendations IWPs (former Indicator 2.1) – Insufficient monitoring of existing IWPs – SEAs not providing subgrantees an opportunity to submit information related to IWPs on grant applications or for ensuring that each IWP submitted a plan – Insufficient training and technical assistance to SAs

36 Common Monitoring Findings and Recommendations Transition Reservation (former Indicator 3.1): – Insufficient evidence of reserving funds for transition – Not enforcing requirements to reserve funds or reserving insufficient funds for transition – Questionable use of the transition reservation – Inappropriate oversight of transition reservations

37 Common Monitoring Findings and Recommendations Subgrantee Monitoring (former Indicator 3.2): – No evidence of subgrantee monitoring – Insufficient subgrantee monitoring – Use of informal and unsystematic monitoring protocols – Faulty data collection processes – Insufficient use of program evaluation information.

38 Recent TA Request

39 Review of Recent TA Requests: Eligibility of Mental Health Facilities I have a local facility providing mental health services to youth who have been voluntarily placed there that would like to apply for Title I, Part D funds, would it be considered a neglect facility?

40 Review of Recent TA Requests: Eligibility of Mental Health Facilities Facilities are counted as “neglected” or “delinquent” in accordance with the definitions set forth Section 1432 of the Part D statute. Annual Count Toolkit also walks through this. This facility does not seem to fall neatly within the types of facilities defined, potentially because they use different terminology. To confirm facility eligibility consider requesting that subgrantees and facilities submit (to the SEA) relevant facility information: 1.Charter or mission statement 2.Information about the type of children and youth typically served 3.Whether the facility’s regular program of instruction is funded with State, local, or private funding

41 Review of Recent TA Requests: Subgrantee Monitoring Frequency Is it a requirement in the statute for the SEA to monitor their subgrantees once every three years?

42 Review of Recent TA Requests: Subgrantee Monitoring Frequency This request has gone to OGC for clarification, but here are some other considerations: There should be some form of regular desk monitoring or review that can be tied into the application review, as well as review of annual performance and fiscal data. Remote interviews and written reports that may require corrective actions, there are no Federal requirements that specify a minimum. Recommendation that all grantees have this kind of review at least once every 3-5 years depending on how they fare in an annual risk assessment.

43 Review of Recent TA Requests: Data Storage What is the expected policy for storing CSPR/EDFacts data (e.g., how long must it be maintained)? One source at the state indicated they should keep data for 3 years—however this couldn’t be substantiated by any known law. They want to ensure they have sufficient records in case of a lawsuit, which would require them to store records up to 6 years. They would like to make it a state policy to store records up to 7 years, a practice their CSPR coordinator already follows. The CSPR coordinator then archives the data for backup. The state is interested to know if there are existing Federal regulations for data storage and want to align their policies with Federal recommendations.

44 Review of Recent TA Requests: Data Storage This request has gone to OGC for clarification, but here are some other considerations: OESE manually closes out formula grants to States about four years after they are awarded. For example, they close out FY 2011 grants by September Should not have to save documents for more than 3 – 5 years after closeout Hopefully SEAs are maintaining longitudinal databases or summary trend reports of performances Actual physical or electronic copies of individual grantee performance don’t have to be stored, nor multiple copies or earlier draft copies of data

45 What’s New NDTAC Products

46 NDTAC Updates: New Resources Youth with Special Education Needs in Justice Settings NDTAC Fact Sheet: Youth with Special Education Needs in Justice Settings (PDF) NDTAC Fact Sheet: Youth with Special Education Needs in Justice Settings N&D Infocus: Supporting Youth with Special Education Needs in Justice Settings (webinar) N&D Infocus: Supporting Youth with Special Education Needs in Justice Settings Federal guidance Correctional education in juvenile justice facilities: education/index.html education/index.html English learner students’ access to education: education-and-justice-release-joint-guidance-ensure-english- learn education-and-justice-release-joint-guidance-ensure-english- learn

47 NDTAC Updates: Forthcoming Resources NDTAC tip sheets: Beginning With the End in Mind: State Title I, Part D Logic Model Development Guide for Youth Who Are Delinquent and Neglected Determining the Title I, Part D Eligibility of Students Who Have Earned a High School Diploma or GED Transition Services That Support Positive Educational and Vocational Outcomes for Justice-Involved Youth: Overview and Funding Sources

48 NDTAC Updates: Upcoming Calls and Events NDTAC national conference May 2015 Topical calls Improving Data Quality and Use Subgrantee Monitoring Tools NDTAC Resources to Support TA Needs Community calls 16 June 2015