1. 1 Early On ® Child Outcomes: Training to Measure & Report Child Outcomes for Early On Michigan

2. 2 Morning Agenda 1.Why do we need to measure and report early childhood outcomes? 2.What are the early childhood outcomes? 3.How were the early childhood outcomes developed? 4.Which service areas will be measuring child outcomes and when? 5.How will the early childhood outcomes be measured?

3. 3 QUESTIONS & LUNCH!!

4. 4 Afternoon Agenda 6.How will the early childhood outcomes be reported? 7.How will the state use the child outcomes data? 8.Resources 9.Contact Information

5. 5 Section 1 Why do we need to measure and report early childhood outcomes? (page 3)

6. 6 Why do we need to measure and report early childhood outcomes? Federal attention to accountability 1993Government Performance Results Act (GPRA) 1997IDEA reauthorization 1999GPRA comes to Part C (General Supervision, Child Find, Family Support, Natural Environments, Transition) 2003Program Assessment Rating Tool (PART) 2003Early Childhood Outcomes Center (ECO Center) 2004IDEIA reauthorization – SPP/APR

7. 7 Why do we need to measure and report early childhood outcomes? Direct the focus to outcomes, and beyond process; Emphasize the importance of the family’s knowledge of Early On and their role in supporting their children’s development; Direct greater attention to working in partnership with families to achieve child outcomes; Retain federal funding; With demonstration of positive outcomes, possibly increase federal funding; With demonstration of outcomes, make a case for state funding. Benefits to early intervention

8. 8 What do we need to show? When the data is aggregated, we hope to show that: as a State -- for each Local Service area -- --Early On supports children to make developmental progress (measured in comparison to same-aged peers)

9. 9

10. 10 Section 2 What are the early childhood outcomes? (page 4)

11. 11 What are the early childhood outcomes? The overarching goal for all children is to be active and successful participants now and in the future, in a variety of settings: Children have positive social relationships. Children acquire and use knowledge and skills. Children take appropriate action to meet their needs.

12. 12 What are the early childhood outcomes? These child outcomes were adopted by the Results Teams within Redesign, and are consistent with: Great Start Early Childhood Standard of Quality for Infants & Toddlers

13. 13 Section 3 How were the early childhood outcomes developed? (page 6)

14. 14 How were the early childhood outcomes developed? The ECO Center was asked by OSEP to promote the development and implementation of child and family outcome measures for infants, toddlers, and preschoolers with disabilities.

15. 15 How were the early childhood outcomes developed? ECO Center process A year long consensus-building process that involved input from and review by numerous stakeholders including federal, state and local policy-makers and administrators, local providers, family members of children with disabilities and researchers. Use of ECO Center work The work of the ECO Center will contribute to the: –Development of data on outcomes for young children with disabilities that can be aggregated and reported at the national level. –Regular use of outcome data for documenting program effects and improving programs at the local and state levels.

16. 16 Section 4 What is the schedule for child outcomes measurement? (page 7)

17. 17 Which service areas will be measuring child outcomes and when? Allegan Berrien Clare-Gladwin Dickinson-Iron Kent Lapeer Lewis Cass Livingston Manistee Mason-Lake Menominee Muskegon Oakland Oceana Saginaw Shiawassee St. Joseph Van Buren Wexford- Missaukee Cohort 1 began collecting data on children enrolling in Early On starting July 1, 2006.

18. 18 Which service areas will be measuring child outcomes and when? Cohort 2 will begin collecting data on children enrolling in Early On starting July 1, 2007. AMA Calhoun Char-Em COP Clinton Copper Country Delta-Schoolcraft Gratiot-Isabella Genesee Hillsdale Jackson Kalamazoo Lenawee Macomb Midland Montcalm Ottawa Sanilac Tuscola

19. 19 Which service areas will be measuring child outcomes and when? Cohort 3 will begin collecting data on children enrolling in Early On starting July 1, 2008. Barry Bay-Arenac Branch COOR Eastern UP Eaton Gogebic- Ontonagon Huron Ingham Ionia Iosco Marquette-Alger Mecosta-Osceola Monroe Newaygo St. Clair Traverse Bay Washtenaw Wayne

20. 20 Section 5 How will the early childhood outcomes be measured? (page 9)

21. 21 Determine Rating Domain/Skill- based information Comprehensive Developmental Assessment Other Assessment information (if available) Functioning across settings and situations Observation Parent Input Rating for Functional Outcome 1 For each child enrolled in Early On Rating for Functional Outcome 2 Rating for Functional Outcome 3

22. 22 How will the early childhood outcomes be measured? Cohort 2 will collect data for EVERY child enrolled in Early On after July 1, 2007.

23. 23 How will the early childhood outcomes be measured? Data Sources Data from one or more assessment tools –Developmental assessment tool –Crosswalked to child outcomes Observation Family Input

24. 24 How will the early childhood outcomes be measured? Frequency of measurement ENTRY data collected at the time of the Initial IFSP ANNUAL data collected at the time of the Annual review EXIT data collected at Exit for children enrolled for at least 6 continuous months

25. 25 How will the early childhood outcomes be measured? Use of existing assessments Use ongoing assessment whenever possible Use other assessments if they were completed within 90 days of the measurement point (within 90 days of Entry, Annual, or Exit)

26. 26 How will the early childhood outcomes be measured? Rating Scale 1234567 Not YetEmergingSomewhatCompletely

27. 27 How will the early childhood outcomes be measured? (Page11) 1Not YetChild does not yet show functioning expected of a child his or her age in any situation. Child’s skills and behaviors also do not yet include any immediate foundational skills upon which to build age appropriate functioning. Child’s functioning might be described as that of a much younger child. 2Between Not Yet & Emerging Some of the foundational skills are there, though not all the immediate foundational skills. 3EmergingChild does not yet show functioning expected of a child of his or her age in any situation. Child’s behavior and skills include immediate foundational skills upon which to build age appropriate functioning. Functioning might be described as like that of a younger child. 4Between Emerging & Somewhat Immediate foundational skills are in place, and child has demonstrated age appropriate skills once or twice, perhaps not deliberately. 5SomewhatChild shows functioning expected for his or her age some of the time and/or in some situations. Child’s functioning is a mix of age appropriate and not appropriate functioning. Functioning might be described as like that of a slightly younger child. 6Between Somewhat & Completely Child’s functioning generally is considered appropriate for his or her age but there are some concerns about the child’s functioning in this outcome area. 7CompletelyThe child shows functioning expected for his or her age in all or almost all everyday situations that are part of the child’s life. Functioning is considered appropriate for his or her age. No one has any concerns about the child’s functioning in this outcome area.

28. 28 Process for determining child outcomes data (Page 12) Decision Tree Process at Entry, Annual, Exit Collaboration with 619 Special Education Preschool Special Considerations Helpful Tools

29. 29 Section 6 How will the early childhood outcomes be reported? (page 18) Qualitative Compliance Information Project Center for Urban Studies

30. 30 The Child Outcome Summary Form (COSF) The COSF will allow local service areas to use existing data sources to provide required data for use in Michigan’s Annual Performance Report (APR), on Indicator SPP3. The COSF is a method for summarizing information from data sources in a way specific to OSEP reporting requirements for Indicator SPP3.

31. 31 The completion of the COSF will be available through two methods Online (web-based) data entry system –Takes less time to complete than the scannable form. –Requires no postage. –Provides less chance for errors. Scannable paper format –Contact your Early On Coordinator for original forms. Do not use copies of these forms. The scanning equipment is very sensitive to any deviations and will be unable to read any duplicated forms.

32. 32 Online COSF (page 18)

33. 33 Online COSF The online COSF system will be available July 1, 2007. If you want to use the online COSF for training purposes, contact Christina Peltier at: 313-577-8364 or ah9191@wayne.edu. The web address to the online COSF is: https://co.cus.wayne.edu/. https://co.cus.wayne.edu/

34. 34 The Online COSF: Confidentiality Each local Early On Coordinator from the participating 19 service areas (Cohort 1) will submit a list of approved Early On staff to the WSU by June 25, 2007. Use the month and the day of birth for the Access ID. The zeros are necessary. (see example below). ISD: Name Access ID (MM//DD) Phone NumberBusiness Email Jane Doe0508313-313-3131Djane@ISDemail.com

35. 35 Confidentiality cont’d. Only staff members listed as approved users will be allowed access to the online COSF system. –There is no limit to the amount of staff members that can be approved. To access the online COSF system, each approved user must register with their access ID. –The access ID will be the month and day of birth of the staff member, e.g. April 5 would be 0405).

36. 36 Online Registration (page 19) Submit your name, access ID, and select your ISD.

37. 37 Sign up for new account WSU will verify your identity with the access ID. Create a: –User name; –Password; and –Security question with answer. Fill in your contact information (business email). Click on Create User.

38. 38 Create User

39. 39 Access the Online System Enter your User Name and Password. Click on the Login button. If you forget your password, click the link above. A computer generated password will be sent to the email you listed on the create user page. –The computer generated password can be changed to an easier to a different password with the link on the login page.

40. 40 New or Previous COSF? Choose if you are entering in a new COSF or finishing a previous COSF. Click on the “continue” button.

41. 41 Entering in a New COSF (page 21)

42. 42 Sections of the COSF Child Identification Information –Required. Data Sources –Required. Outcome Rating –Required. Filling Out Assessment Scores –This is an optional section.

43. 43 Security: Saving your data Each section of the online COSF system will have a session setting of 15 minutes. If there is no server activity (i.e., clicking the “save and continue” button) for 15 minutes, it will time-out and users will lose all information. Click “save and continue” or “save and logout”. Once you click the “save and continue” button that causes server activity, you will have a fresh 15 minutes. After you have finished the form, select “Submit Form” indicating you completed the COSF. Once this is selected, you will be unable to re-enter the child’s COSF, even with the previously assigned code number.

44. 44 Child Identification Information All information is required. Name EETRK Code (Child ID field in EETRK) Gender Date of Birth (e.g. 1/5/06) Eligibility Race/Ethnicity

45. 45

46. 46 Unique Code Number After you complete the Child ID Information section, the program will issue you an Unique Code Number (UCN) for the specific COSF form. Record this number so you can re-access the child’s file should you need to complete data entry in a follow-up session. This Number is unique to the COSF and not to the child.

47. 47 Data Sources All information is required. Comprehensive Assessment Tool used in determining rating (Choose only one) Date assessment tool was completed : (e.g. 1/5/08) Method for obtaining parent input for COSF ratings (Choose only one) Date parent input was gathered for COSF ratings (e.g. 1/5/08)

48. 48

49. 49 Outcome Rating All information is required. Date COSF ratings were determined (e.g. 1/5/08) Type of rating (Entry, Annual or Exit) Based on the State Team’s guidelines, provide a rating for each indicator, even if there is no delay. If there is no delay, record as 7.Completely. Has the child developed any new skills since the previous COSF (This is for Annual or Exit COSFs only.)

50. 50

51. 51 Filling Out Assessment Scores (page 25) This is an additional request beyond what is required by OSEP. If you used the HELP, E-LAP, or IDA, please provide additional data for MDE. For these instruments, we are collecting summary data that will help identify what scores on assessments are associated with which of the seven ratings.

52. 52 Filling Out Assessment Scores At this section, you will be given the choice to: –complete Filling Out Assessment Scores by selecting the appropriate assessment; –go to another COSF; or –submit the form and logout.

53. 53 Example: Completing the optional section for the IDA

54. 54 Submitting the Form and Logging out. Make sure all fields are completed and the data is accurate. Select “Submit Form” indicating you completed the COSF. Once this is selected, you will be unable to re-enter the child’s COSF, even with the Unique Code Number (UCN). Print a copy for your records.

55. 55 Returning to an Existing COSF (page 26)

56. 56 Returning to an Existing COSF To continue an existing COSF, the approved user must enter in the Unique Code Number (UCN) for that COSF. The user must then verify the child’s first name and first initial of his/her last name connected with that COSF before continuing data entry. –The child’s name will not be visible to the user once it has been verified. This will take the user to the beginning of the COSF. They can click to quickly move to where they previously finished.

57. 57 The Scannable COSF (page 27)

58. 58 The Scannable COSF When completing the forms, please only use original forms provided by WSU. –The scanning equipment is very sensitive to any deviations and will be unable to read any duplicated forms. WSU will send additional forms as requested. Do not leave any answers blank. The entire form must be completed.

59. 59 PAGE 1 of COSF Child Identification Information Can be completed by staff that regularly deals with data entry. Identification Information includes: –Child’s name; –EETRK code (if available); –Date rating for COSF was determined; –Type of rating; –ISD code; –Date of birth; –Type of eligibility; –Race/Ethnicity; and –Gender. The service coordinator/provider will need to fill in when the COSF ratings were determined.

60. 60 PAGE 1 of COSF

61. 61 Page 2 of COSF Data Sources Assessment Information includes : –Comprehensive Tool used; –Date assessment tool was completed. Based on guidelines from the Michigan State Interagency Team, provide a rating for each indicator. The rating must be determined by the service coordinator/provider responsible for assessing the child. Mark if there are any new skills relating to the indicator.

62. 62 PAGE 2 of COSF

63. 63 PAGE 3 of the COSF Filling Out Assessment Scores This is an additional request beyond what is required by OSEP. If you used the HELP, Bayley, E-LAP, IDA, DAY-C, or Brigance, Please provide additional data for MDE. If you need a copy of Page 3, contact your Early On Coordinator and tell him or her what assessment form you use. We are collecting summary data that will help identify what scores on assessments are associated with which of the seven ratings.

64. 64 PAGE 3 of the COSF Example: IDA

65. 65 Mailing COSFs to WSU (Cohort 2) All scannable COSFs should be sent by UPS or FED EX (in order to protect children’s identifying information) to: Center for Urban Studies Attention: Christina Peltier 656 W. Kirby 3040 F/AB Detroit, MI 48202

66. 66 Procedures and Timeline (page 30)

67. 67 Cohort 1 Timeline Reporting for FFY 2006-2007 (7/1/06 – 6/30/07) –All COSFs (scannable and online) from July 1, 2006 to June 30, 2007, (if children entered Early On between July 1, 2006 and June 30, 2007), should be sent to Wayne State by August 1, 2007. Reporting for FFY 2007-2008 (7/1/07 – 6/30/08) –Online COSFs from entry, annual, or exit from July 1, 2007 to June 30, 2008 can be entered after July 1, 2007, (if children entered Early On after July 1st, 2006). –Scannable COSFs from entry, annual, or exit from July 1, 2007 to June 30, 2008 should be collected and sent from service areas in monthly batches beginning August 1, 2007, (if children entered Early On after July 1st, 2006). –All COSFs (scannable and online) from July 1, 2007 to June 30, 2008, (if children entered Early On between July 1, 2006 and June 30, 2008) should be sent to Wayne State by August 1, 2008.

68. 68 Cohort 2 Timeline Reporting for FFY 2007-2008 (7/1/07 – 6/30/08) –Online COSFs from entry, annual, or exit from July 1, 2007 to June 30, 2008 can be entered after July 1, 2007, (if children entered Early On between July 1st, 2007 and June 30, 2008). –Scannable COSFs from entry, annual, or exit from July 1, 2007 to June 30, 2008 should be collected and sent from service areas in monthly batches beginning August 1, 2007, (if children entered Early On between July 1st, 2007 and June 30, 2008). –All COSFs (scannable and online) from July 1, 2007 to June 30, 2008, (if children entered Early On between July 1st, 2007 and June 30, 2008) should be sent to Wayne State by August 1, 2008.

69. 69 Procedures and timeline for sending Entry data to WSU Entry COSFs - Children entering Early On between July 1st and June 30th of the following year. ScannableSend completed COSFs to Wayne State in batches, on the first of the month, starting August 1st. The last batch must be sent by August 1st, the end of the fiscal year. OnlineBeginning July 1st, complete COSFs as children are assessed. Complete all COSFs by August 1st, the end of the fiscal year.

70. 70 Annual COSFs - Children entering Early On after July 1, 2006, receiving an annual COSF between July 1st and June 30th. ScannableSend completed COSFs to Wayne State in batches, on the first of the month, starting August 1st. The last batch must be sent by August 1st, the end of the fiscal year. OnlineBeginning July 1st, complete COSFs as children are assessed. Complete all COSFs by August 1st, the end of the fiscal year. Procedures and timeline for sending Annual data to WSU

71. 71 Procedures and timeline for sending Exit data to WSU Exit COSFs - Children entering Early On July 1, 2006 or later and exiting before June 30th, who were enrolled continuously for 6 months. ScannableSend completed COSFs to Wayne State in batches, by August 1st, end of the fiscal year. OnlineComplete COSFs by August 1st, end of the fiscal year.

72. 72 Storing and Securing the Data A copy of the completed COSF should be kept for each child’s central record, at the service area. A copy should also be offered to the family. Security and Reporting –Data security. All data transmitted and received by the evaluation team will be encrypted using secure sockets layer technology (SSL). –Data reporting. Data will be analyzed and reported to the Michigan Department of Education at the group level; no individual children will be identified.

73. 73 What happens when WSU gets the data ?

74. 74 Section 7 How will the state use the child outcomes data? (page 33)

75. 75 How will the state use the Child Outcomes data? Reporting to OSEP Reporting to the public

76. 76

77. 77 Data that will be reported % of infants and toddlers who maintained functioning at a level comparable to same-aged peers % of infants and toddlers who improved functioning to reach a level comparable to same-aged peers % of infants and toddlers who improved functioning to a level nearer to same-aged peers but did not reach it % of infants and toddlers who improved functioning but not sufficient to move nearer to functioning comparable to same-aged peers % of infants and toddlers who did not improve functioning compared to same age peers For each of the three outcomes, we will report:

78. 78 How will the state use the Child Outcomes data? Making policy decisions Monitoring Informing training Informing research and funding

79. 79 Resources & Contact Information are in the Handbook, in Sections 8 & 9 (pages 35-36); please contact us if you need additional information as you get started!

80. 80 Ongoing Communication FOR COHORT 2 Would you like us to start a Cohort 2 Yahoo email Group, where anyone can sign up and post questions/comments? We will email people who register for these Child Outcome trainings with updates, as they become available.

81. 81 THANK YOU FOR YOUR TIME AND ATTENTION!!