1. GRANT PERFORMANCE REPORT FOR CONTINUATION FUNDING FY 2013 Office of Special Education Programs U.S. Department of Education

2. O S E P Annual Grant Performance Report An annual report of your performance in meeting the approved objectives of the project Required for all active grants, including those in no cost extension (NCE) OSEP reviews the report to determine if substantial progress has been made in order to grant continued funding or an NCE 2

3. O S E P Overview   Recognize strong project objectives that can be associated with high quality performance measures   Develop relevant, measurable, outcome- oriented performance measures that maximize the potential for meaningful data   Complete the ED Grant Performance Report (ED 524B) 3

4. O S E P Why Is This Important? High quality objectives and measures …   Make it easier for you to measure your progress   Allow you to report progress easily and quantitatively   Establish targets (both short-term/annual & long- term)   Allow OSEP staff to gather evidence of program effectiveness 4 Taken from the Center for Evaluation and Education Policy (CEEP) presentation at www.tadnet.org

5. O S E P Goal – Objectives - Measures 5 Program Goal Project Objectives What your project is doing to support the overall program goal (Found in your application) Performance Measures How you measure your progress toward meeting your objectives (Program/GPRA, Project)

6. O S E P Goal – Objectives – Measures (2) 6 Taken from the Center for Evaluation and Education Policy (CEEP) presentation at www.tadnet.org

7. O S E P Project Objectives What are you trying to accomplish? 7

8. O S E P High Quality Project Objectives   Relevance How relevant is the project objective to the overall goal of the program and/or the goal of your project?   Applicability How applicable is the project objective to the specific activities that are being conducted through your particular project? 8 Taken from the Center for Evaluation and Education Policy (CEEP) presentation at www.tadnet.org

9. O S E P High Quality Project Objectives (2)   Focus How focused is the project objective?   Measurability Are there concepts in the project objective that lend themselves to measurement? If so, is measurement feasible? 9 Taken from the Center for Evaluation and Education Policy (CEEP) presentation at www.tadnet.org

10. O S E P Project Objectives -- Examples   Implement early childhood language models in Part C and preschool programs   Increase the capacity of SEAs to scale-up RTI programs   Increase practitioners’ knowledge of social emotional interventions   Disseminate the impact of the project at a national level

11. O S E P Performance Measures How are you measuring your progress in meeting your objectives? 11

12. O S E P Performance Measures (2)   Measurable indicators used to determine how well objectives are being met.   How will progress be assessed?   How much progress will constitute success?   How will it be known if an objective or part of an objective has been achieved? 12 Taken from the Center for Evaluation and Education Policy (CEEP) presentation at www.tadnet.org

13. O S E P Performance Measures (3) 13 Taken from the Center for Evaluation & Educational Policy (CEEP) at Indiana University

14. O S E P Types of Performance Measures   Program Measures established by OSEP for the Technical Assistance and Dissemination program. These include measures established for reporting to Congress under the Government Performance and Results Act of 1993. 14

15. O S E P TA&D Program Performance Measures Program Performance Measure #1: The percentage of products and services deemed to be of high quality by an independent review panel of qualified experts or individuals with appropriate expertise to review the substantive content of the products and services. Program Performance Measure #2: The percentage of products and services deemed to be of high relevance to educational and early intervention policy or practice by an independent review panel of qualified members of the target audiences of the technical assistance and disseminations. Program Performance Measure #3: The percentage of products and services deemed to be of high usefulness by target audiences to improve educational or early intervention policy or practice.

16. O S E P TA&D Program Performance Measures Program Performance Measure #4: The federal cost per unit of technical assistance provided by the Technical Assistance and Dissemination program. Program Performance Measure #5: The percentage of projects that achieve proposed milestones within the approved timeline.

17. O S E P Program Performance Measures   Grantees should propose a project performance measure that addresses each program performance measure. The focus of the project measure must be the same as and clearly aligned with the program measure. 17

18. O S E P Program Performance Measures (2) Program Performance Measure #1: The percentage of products and services deemed to be of high quality by an independent review panel of qualified experts or individuals with appropriate expertise to review the substantive content of the products and services. Example: Each year of the project, an expert advisory group will rate a minimum of 90% of the center’s products as “high quality” (i.e. conceptually sound, based on evidence, and clearly communicated). 18

19. O S E P Program Performance Measures (3) Program Performance Measure #3: The percentage of products and services deemed to be of high usefulness by target audiences to improve educational or early intervention policy or practice. Example: At the end of the second year of the project, 80% of families who participated in a webinar series will rate it as “useful” or “very useful” on written evaluation forms distributed within 3 months of the end of the series. 19

20. O S E P Program Performance Measures (4) Program Performance Measure #4: The federal cost per unit of technical assistance provided by the Technical Assistance and Dissemination program. Choose a specific TA service rendered or a specific TA product that was developed Calculate the cost to render or develop the service or product selected (direct costs + indirect cost) Identify the number of target audience units directly reached by the product or service Divide the cost by the number of target audience units reached 20

21. O S E P Program Performance Measure Program Performance Measure #4: The federal cost per unit of technical assistance provided by the Technical Assistance and Dissemination program. Example: The cost for developing and delivering a workshop on evidence-based math instruction will cost no more than $50.00 per attendee. 21

22. O S E P Program Performance Measures (5) Program Performance Measure #5: The percentage of projects that achieve proposed milestones within the approved timeline. Must use the following (new this year): “X% of proposed milestones for the current reporting period will be completed.” 22

23. O S E P Types of Performance Measures (2)   Project Measures that the grantee establishes to meet their project objectives   Project performance measures can address both the process of working towards an objective and the outcome related to meeting the objective   Ensure a mix of both process and outcome measures 23 Taken from the Center for Evaluation and Education Policy (CEEP) presentation at www.tadnet.org

24. O S E P High Quality Performance Measures High quality performance measures show   What will change   How much change you expect   Who will achieve the change   When the change will take place 24 Taken from the Center for Evaluation and Education Policy (CEEP) presentation at www.tadnet.org

25. O S E P Project Performance Measure Examples Process measure (e.g.) In each of the 2 nd through 5 th years of the grant (when), project staff (who) will provide 15 (how much) training sessions (what) via distance education to paraprofessionals/interveners on providing individualized supports to children who are deaf-blind.

26. O S E P Project Performance Measure Examples (2) Outcome measure (e.g.) At the end of the training sessions and practicum (when), 100% (how many) of paraprofessionals/interveners (who) will be highly qualified to provide individualized supports to children who are deaf-blind (what).

27. O S E P Project Performance Measure Examples (3) Outcome measure (e.g.) At the end of each workshop (when), 85% (how many) of participants (who) will report increased knowledge of literacy practices (what) as measured on a post-training survey.

28. O S E P Project Performance Measure Examples (4) Outcome measure (e.g.) At the end of the 5 th year of the project (when), State Leadership Teams in 3 states (who) will have overseen the full implementation of the intervention model (what) in a minimum of 3 districts (how many).

29. O S E P Project Performance Measure Examples (5) Outcome measure (e.g.) By year 3 of the project (when), 75% (how much) of network members (who) will use the project’s website at least 3 times per year (what) for communication within the network.

30. O S E P Project Performance Measure Example Process measure (e.g.) By the end of the project period (when), project staff (who) will present on activities and outcomes of the project (what) at a minimum of 9 national meetings (how much).

31. O S E P Common Problems   Activities are NOT performance measures   If the best response is “Yes, we did that,” it is likely an activity (not a performance measure)   Examples of activities:   Establish a coaching program   Hold an advisory board meeting   Conduct a workshop 31 Taken from the Center for Evaluation and Education Policy (CEEP) presentation at www.tadnet.org

32. O S E P Common Problems (2)   Performance measures need to be measurable   Examples with measurement problems:   Collaborative partnerships will be maintained   Evaluation will gauge teachers’ knowledge and project effectiveness   To increase the sustainability of the professional development model across the state 32 Taken from the Center for Evaluation and Education Policy (CEEP) presentation at www.tadnet.org

33. O S E P Need additional information on writing performance measures?   All grantees are strongly encouraged to seek training on writing performance measures.   For further information on developing performance measures and logic models, see - http://www.tadnet.org/pages/589 33

34. O S E P Summary   Projects should have a few clear objectives that explain what the project is doing to support their overall goal(s)   Each objective should have a few, specific performance measures to demonstrate how progress toward meeting the objective is being measured 34 Taken from the Center for Evaluation and Education Policy (CEEP) presentation at www.tadnet.org

35. O S E P Completing the ED 524B The ED 524B is a required annual and final reporting form with specific instructions.   The form is used by all ED grants and has been approved by the Office of Management and Budget (OMB). Project Directors must follow the directions listed in the Dear Colleague letter and ED 524B Instructions provided by OSEP http://www2.ed.gov/fund/grant/apply/osep/funding.html http://www2.ed.gov/fund/grant/apply/osep/funding.html   Word or PDF versions of the forms are available at http://www2.ed.gov/fund/grant/apply/appforms/appforms.html http://www2.ed.gov/fund/grant/apply/appforms/appforms.html 35

36. O S E P x Cover Sheet 36 X

37. Reporting Period: For first year grants, the date is the beginning of the project through February 28th. For grants in years 2-5, it is the date from the end of the previous reporting period through February 28th. ANNUAL PERFORMANCE REPORTS 37 022820-- __

38. ANNUAL PERFORMANCE REPORTS Budget Expenditures: Must be data or information from the business or grants office. Report expenditures for the “Reporting Period” (i.e., Budget Period and Reporting Period are the same). Annual Performance Reports 38

39. Signatory must have authority to sign on behalf of the institution since the grant is from the Department to the institution and not to an individual. ( This person is typically not the Project Director). Performance Measure Status: This will be checked “No” for all performance reports. The APR contains data for the reporting period (see #7) ; not the budget period. The date entered here will be the due date for your Final Performance Report, which is 90 days after the end of the grant. ANNUAL PERFORMANCE REPORTS Annual Performance Reports (2) 39

40. Executive Summary Sheet EXECUTIVE SUMMARY SHEET 40 OMB No. 1894-0003 Exp. 02/28/2011 OMB No. 1894-0003 Exp. 02/28/2011 *** Provide highlights of the project's activities and the extent to which the expected outcomes and performance measures were achieved during the reporting period. Do NOT include the project abstract. H326 - - - - - -

41. PROJECT STATUS CHART 41 H326 - - - - - -

42. Enter one of the project’s objectives; on subsequent pages, you will enter additional project objectives as submitted in your grant application. PROJECT STATUS CHART Project Status Chart 42 H326 - - - - - -

43. Enter the PROGRAM performance measure(s) that align with the objective immediately followed by any PROJECT measure(s) developed to address that program measure. Enter any additional PROJECT performance measures that show you are measuring progress toward meeting the objective. PROJECT STATUS CHART Project Status Chart (2) 43

44. Project Status Chart (3) Here you identify if the performance measure is a program measure, “PRGM,” or a project measure, “PROJ.” Note: Program measure refers to one of OSEP’s 5 performance measures for the Technical Assistance and Dissemination Program. Project measures are unique to your grant. PROJECT STATUS CHART 44 PRGM PROJ

45. Depending on your measure, enter either a raw number or a ratio and percentage. Enter the target number identified in the performance measure and then the actual data for this year. If complete data are not available for the measure, enter “999” (if no baseline) or “NA” in the “Raw Number” or “% “column (as appropriate) and provide an explanation at the bottom of the page. PROJECT STATUS CHART QUANTITATIVE DATA 45 86 10 10051050 Measure #1 Measure #2

46. O S E P Information to Include in the Explanation of Progress Section   Describe the data provided (e.g., what data collection methods were used, when were the data collected, how was a sample drawn, are there missing/incomplete data, what was the response rate, was a reliability measure taken). Your Project Officer should be able to understand and interpret the number in the chart from your description in this section.   What changes in the data occurred since last APR (i.e., trend)?   What activities were undertaken to achieve the targets?   If targets were not met, what are possible reasons?   How will activities that failed to meet targets be improved? 46

47. Project Status Chart (4) QUALITATIVE DATA If the measure requires the collection of qualitative data, then leave the “Quantitative Data” section blank. In the Explanation of Progress section of the page, referencing the performance measure by number, report applicable qualitative data along with other information about how these data were collected, targets and activities –refer to previous slide for additional content requirements. PROJECT STATUS CHART 47

48. Final Page of the Report Section B: Refer to the instructions for Section B with the ED 524B Section C: Refer to the instructions for Section C with the ED 524B—put attachments here (e.g., recruitment material, evaluation instruments, journal articles) Final Page of the Report 48 H326 - - - - - -

49. O S E P Section B – Budget Information This section is never blank!   Actual expenditures for reporting period   Provide an explanation if you did not expend funds at the expected rate.   Describe any significant changes to your budget resulting from modifications to project activities.   Describe any changes to your budget that affected your ability to achieve your approved project activities and/or project objectives. 49

50. O S E P Section B – Budget Information (2)   Do you expect to have any unexpended funds at the end of the current budget period? (Explain why, provide an estimate, and indicate how you plan to use the unexpended funds [carryover] in the next budget period.)   Describe any anticipated changes in your budget for the next budget period that require prior approval from the Department. 50

51. O S E P Section C – Additional Information NEW THIS YEAR Projects must include: A list of all new products that were developed in FY 2012 (Between October 1, 2011 and September 30, 2012) A list of all new services that were rendered in FY 2012 51

52. O S E P A product is a piece of work (in text or electronic form) that informs a specific audience on a topic relevant to outcomes for children with disabilities Examples of Products Journal or informational articles Booklets Pamphlets Manuals DVDs or CDs Multimedia kits or modules PowerPoint Presentations Section C – Additional Information (2)

53. O S E P A service is work by a TA&D project that provides information to a specific audience relevant to outcomes for children with disabilities Examples of Services Conducting training Providing captioning, video description, Braille, or other accessible formatting of text or media Leading and convening informational meetings Responding to inquires from a targeted population Section C – Additional Information (3)

54. O S E P Section C – Additional Information (4)   If applicable, please provide a list of current partners on your grant and indicate if any partners changed during the reporting period. Please indicate if you anticipate any change in partners during the next budget period. If any of your partners changed during the reporting period, please describe whether this influenced your ability to achieve your approved project objectives and/or project activities.   Describe any changes that you wish to make in the grant’s activities for the next budget period that are consistent with the scope and objectives of your approved application. 54

55. O S E P Section C – Additional Information (5)   If you are requesting changes to the approved Project Director and/or to other approved key personnel with a proposed effective date during the remainder of the current or the next budget period, please indicate the name, title and percentage of time of the requested key personnel. Attach a resume or curriculum vitae for the proposed key personnel when you submit your performance report. Note: Note: Do not report on any key personnel changes that were already made during the current or previous budget period(s). Departmental approval must be requested and received prior to making key personnel changes.   Provide any other information about your project including unanticipated outcomes or benefits 55

56. O S E P Submitting the ED 524B   Submit the ED 524B at http://www.g5.gov/ (there are instructions for using G5 in the continuation packet)http://www.g5.gov/   A signed ED 524B Cover Sheet must be scanned and emailed in PDF format to your Project Officer.   Special cases require regular email submission of the 524B and the signed cover sheet in PDF format to your Project Officer rather than submission through G5 –   Final reports and APRs for grants in their last performance period or in no-cost extension 56

57. Contact your OSEP Project Officer with any questions! Due Date: April 19, 2013 57