1. Strategies for Utilizing Assessment Results to Improve Instruction Rae Lees, NOCTI Consultant NACTEI Conference Philadelphia, Pennsylvania May 2011

2. Session Overview  Overview of NOCTI  Selecting an Assessment  Putting the Data to Work  Q&A

3. Overview of NOCTI  Over 40 years serving the CTE community  Non-profit organization  Owned and operated by the 50 states  Works with both secondary and post-secondary populations  The Whitener Group (a NOCTI subsidiary) provides services to industry

4. Our Customer Breakdown

5. Our Product Breakdown

6.  Over 80 Job Ready tests offered  30 Pathway tests in 10 clusters available  Over 90 private industry employment and/or advancement tests delivered  20 teacher-level assessments  Study guides for all Job Ready and Pathway assessments  Countdown Kits offered for 40 titles  Successful Schools-Successful Programs Guide Supplemental ProductsAssessments NOCTI Products

7. Selecting an Assessment  Determine purpose of assessment  Determine audience  Determine results desired  Research available options

8. Selecting an Assessment

9. Learn how NOCTI assessments can be used to meet Perkins requirements for technical assessments!

10. Job Ready Assessments  Assess technical skills at the occupation level (e.g., Accounting, Carpentry, Pre-Engineering)  Measure aspects of occupational competence such as factual and theoretical knowledge  Target secondary and post-secondary program completers

11. NOCTI Job Ready Assessment Blueprint Number of Questions: 222 Areas Covered:Accounting

12. NOCTI Job Ready Assessment Blueprint Number of Questions: 222 Areas Covered:Accounting

13. NOCTI Job Ready Assessment Blueprint Number of Questions: 222 Areas Covered:Accounting

14. NOCTI Pathway Assessment Blueprint Banking & Related Services Number of Questions: 104 Areas Covered:

15. Other NOCTI Services  Customized Standards Development  Customized Assessment Development  Professional Development Workshops  Certification Delivery Systems  Local and State Program Management

16. Assessment Results  NOCTI’s Standard Score Reporting Package:  Individual Score Reports  Group Score Reports  Comparative Data  Other Reports Available:  Task-Link Reports  Integrated Academic Reports

17. NOCTI Standard Score Reports Individual Score Reports Provided for each test taker Scores by duty and total Pre-/post-test comparisons Comparative data Individual Score Reports Provided for each test taker Scores by duty and total Pre-/post-test comparisons Comparative data

18. NOCTI Standard Score Reports Group Score Report Provided for the testing group Duty and total scores for each participant Group Score Report Provided for the testing group Duty and total scores for each participant

19. NOCTI Standard Score Reports Analysis of Scores Report Provided for the testing group Comparative data Criterion- referenced cut score Other statistical information Analysis of Scores Report Provided for the testing group Comparative data Criterion- referenced cut score Other statistical information

20. NOCTI Additional Reports: Task-Link Report Includes: Number of items presented for each task Average correct by group Number correct for each test taker Task-Link Report Includes: Number of items presented for each task Average correct by group Number correct for each test taker

21. NOCTI Additional Reports: Integrated Academics Report

22. Putting the Data to Work

23. What is CTEDDI?  Training that is highly interactive  A process, not a one-time event  Uses data that teachers and schools own  Builds on the success of an ever- increasing community of practice  Ongoing state-supported mentorship, local coaches and online help

24. CTEDDI Instructional Improvement Cycle

25. Benefits of CTEDDI  Educators:  Data-driven instructional improvement  Improved ability to meet accountability goals  A positive educational impact  CTE Community:  Practical application of Perkins data  Logic-based policy tool  Demonstrate ROI  Everyone  Increased student achievement  Enhanced preparation for college and careers  Gains in workforce competence/productivity

26. Ways to Participate Statewide Implementation State DOE support Use of Sharing Center Ongoing mentorship Access to evolving resources Access to a national network Statewide common workshops on data Use of real data Jump-Start Local support Access to existing resources (for the Jump-Start days only) 2-day workshop on CTEDDI process Use of mock data Introductory PD Access to existing resources (for the day only) 1-day (or less) workshop Use of a portion of exercise data

27. Questions? www.nocti.org 1.800.334.6283