1. The Child Outcomes Summary Competency Check (COS-CC) Amy Nicholas, Naomi Younggren, Siobhan Colgan & Kathi Gillaspy 2013 Improving Data, Improving Outcomes Conference

2. Getting to Know You 2 Early Childhood Outcomes Center

3. What is the COS-CC? A set of materials to assess staff understanding of the essential knowledge and skills needed to contribute to the COS process. Early Childhood Outcomes Center3

4. Purpose of the COS-CC To provide states with a mechanism to verify that staff have basic competencies To identify professional development needs Early Childhood Outcomes Center4

5. The COS Competency Check The COS-CC is not a training tool. –It is expected that staff using the COS-CC would have attended training on the basic competencies prior to using the assessments. Early Childhood Outcomes Center5

6. The Development Process Responding to needs in the field Workgroup process with ECO staff, state and national experts for content validity Release in early 2014 6 Early Childhood Outcomes Center

7. Essential Knowledge and Skills Includes: General COS process information Content of the three child outcomes The 7-point rating scale Age-expected child development 7 Early Childhood Outcomes Center

8. Essential Knowledge and Skills Does not include: Observation of children’s skills and behaviors Collaborative teaming These are essential to the COS process, but are difficult to assess. 8 Early Childhood Outcomes Center

9. Passing the COS-CC Passing the COS-CC doesn’t make you an expert – it only verifies that you have the basic competencies needed to contribute to the COS discussions. Early Childhood Outcomes Center9

10. Organization of the COS-CC Package Two levels of information (Levels 1 & 2) –Banks of questions and answers (both levels) –Case studies and videos (level 2) Level 1 must be passed before moving on to Level 2. Instructions will be included, with options for customizing the materials for your state. 10 Early Childhood Outcomes Center

11. COS-CC Level 1 11 Early Childhood Outcomes Center Over 100 multiple choice and true/false questions about: –The COS process; –The three child outcomes; and –The 7-point rating scale. Answer key

12. Administering Level 1 Questions 20 items for Level 1 should be chosen accordingly: –5 questions about the COS process –5 questions about the three child outcomes –10 questions about the 7-point rating scale When selecting the questions, select questions that represent a range of content (i.e. all three outcomes, all 7 points on the rating scale). 12 Early Childhood Outcomes Center

13. Competency Self-Check! 13 Early Childhood Outcomes Center Source: Google Image Sample Level 1 Questions

14. Proceeding to Level 2 Criteria for “passing” Level 1 are being developed. Considerations include: –Cut score needed to “pass” and proceed to Level 2 –Providing additional opportunities to complete Level 1 items after engaging in professional development –Conducting an error analysis of the questions that were answered incorrectly 14 Early Childhood Outcomes Center

15. COS-CC Level 2 Early Childhood Outcomes Center15 Include  Video clips  Write-ups  Competency questions  Rating Key (AE-IF-F)  Scoring guidance (under development) Case Studies  Practical  Hands-on  Authentic

16. Case Studies Three Early Intervention –4, 19, and 31 months Three Early Childhood Special Education –3, 4, and almost 5 years old 16Early Childhood Outcomes Center

17. Sample Meeting Euriah Video clip Write-up Competency Questions Rating Key 17Early Childhood Outcomes Center

18. Video Clip 18Early Childhood Outcomes Center

19. Write-up Referral information Intake (EI) / Observation (ECSE) Birth/medical history Evaluation (5 domains & test results) Present levels by 3 outcomes 19Early Childhood Outcomes Center

20. 20 Write-up

21. COS-CC Level 2 Competency Questions Outcome content –Which of the following is not a skill associated with Outcome 1 for Euriah? Age anchoring –For each of the following, identify if the skill is age-expected, immediate foundational, or foundational. Rating –What rating should the team assign Euriah for Outcome 1? 21 Early Childhood Outcomes Center

22. Rating Key Skills from –Evaluation, video, & present levels Organized by –Age-expected (AE) –Immediate foundational (IF) –Foundational (F) Rating given by number (1-7) 22 Early Childhood Outcomes Center

23. 23 Early Childhood Outcomes Center Rating Key

24. Terms of Use No changes or adaptations may be made to the case studies or videos Adaptations to questions for state terminology or procedures only Online use encouraged – without posting answers 24 Early Childhood Outcomes Center

25. Terms of Use Materials available from the ECO/ECTA Center upon request Support available to help determine how to use materials within a state Acknowledgement of acceptance of terms prior to use 25 Early Childhood Outcomes Center

26. Implementation Plan to have those who use the materials first participate in a learning community to share challenges and successes for implementation Will develop mechanisms for gathering feedback from state staff and providers completing the COS-CC 26 Early Childhood Outcomes Center

27. Options for States to Disseminate COS-CC Materials Paper/pencil administration –Provide downloadable “forms” of the CC on a secured website or distribute via email Create an online assessment –Examples of free options: ClassMarker (http://www.classmarker.com)http://www.classmarker.com ProProfs (http://www.proprofs.com/quiz-school)http://www.proprofs.com/quiz-school QuizStar (http://quizstar.4teachers.org)http://quizstar.4teachers.org 27 Early Childhood Outcomes Center

28. What do you think? What excites you about this? What are you concerned about? What supports and resources will states need from ECO/ECTA in order to use the COS-CC effectively? How might we best use a learning community to support implementation of this product? Early Childhood Outcomes Center28

29. Need answers? Kathi Gillaspy: kathi.gillaspy@unc.edukathi.gillaspy@unc.edu Siobhan Colgan: siobhan.colgan@unc.edusiobhan.colgan@unc.edu Amy Nicholas: anicholas@jhu.eduanicholas@jhu.edu Naomi Younggren: naomi.younggren@googlemail.comnaomi.younggren@googlemail.com 29 Early Childhood Outcomes Center