1. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org The Next Horizon Incorporating Student Perception Surveys into the Continuous Improvement Systems of Educator Preparation Providers Jennifer E. Carinci Director Research, Innovation, and Data Strategy AYPF Student Survey Discussion Group - April 2, 2015

2. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org What is CAEP? CAEP’s mission Advance excellent educator preparation through evidence-based accreditation that assures quality and supports continuous improvement to strengthen P-12 student learning CAEP’s vision Increase the value of accreditation to be an attribute demanded by the public while expanding its footprint by bringing more providers into the accreditation fold Purpose of accreditation Assure teacher candidates, parents, employers, policy makers and the public that a CAEP-accredited provider has been rigorously evaluated and has met or exceeded high standards of quality

3. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org CAEP Standards: Levers for Improved Educator Quality Build partnerships and strong clinical experiences Raise and assure candidate quality Data-driven, continuous improvement Include all providers Insistence that preparation be judged by outcomes and impact on P-12 student learning and development  —Results matter; “effort” is not enough.

4. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org CAEP’s Interest in Student Surveys

5. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org Evidence for Meeting Standards Data on Impact of candidates 3.5 Before the provider recommends any completing candidate for licensure or certification, it documents that the candidate has reached a high standard for content knowledge in the fields where certification is sought and can teach effectively with positive impacts on P-12 student learning and development. Data on Impact of completers 4.2 The provider demonstrates, through structured and validated observation instruments and student surveys, that completers effectively apply the professional knowledge, skills, and dispositions that the preparation experiences were designed to achieve. Continuous Improvement tool 5.4. Measures of completer impact, including available outcome data on P-12 student growth, are summarized, externally benchmarked, analyzed, shared widely, and acted upon in decision-making related to programs, resource allocation, and future direction.

6. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org Urgency: Educator Preparation and Quality Metrics “A primary obstacle to investigating…many…important aspects of teacher preparation is the lack of systemic data collection, at both the national and state levels.” National Research Council Report, 2010 Availability & Quality of Data in Educator Preparation Recent Reports Timeliness

7. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org Building an Evidence-Based System for teacher Preparation

8. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org Strategic Goal 3: To advance research and innovation CAEP will develop and implement an agenda for research and innovation to foster continuous improvement in educator preparation.

9. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org

10. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org Previous Pilot/Current Pilot Objectives  Efficacy of using instrument in pre-service  Exploration of implementation challenges  Feedback to candidates on P-12 impact  Feedback to providers on P-12 impact  Tracking from pre-service and in-service  Continuous improvement of candidates  Continuous improvement of EPPs Previous

11. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org Participants to date Fall 2013Spring 2014Fall 2014Spring 2015 Providers39720 Provider States 28612 Candidates38261105~662 K-12 Surveys1,1025,3092,100~16,000 Average # of surveys ordered per class = 25 Average # of surveys completed per class = 20.34 Average student participation rate = 81.36%

12. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org Current Pilot by Semesters Year 1 (2014-2015) Candidates Year 2 (2015-2016) Completers Survey Administration Periods FallSpringFallSpring So What? Pre-service to In-service

13. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org Results/Feedback To Providers Aggregate domain scores Raw data for provider’s candidates To Candidates

14. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org Average Domain Scores for Spring 2014 Sample DomainMeanMinMax Care.81.321 Challenge.83.31 Captivate.72.11 Confer.67.091 Consolidate.76.271 Controls.58.041 Clarifies.81.251 Seven C Combined.74.25.97

15. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org Average Domain Scores for Fall 2014 Sample DomainMeanMinMax Care.82.351 Challenge.83.571 Captivate.75.271 Confer.70.341 Consolidate.76.371 Controls.65.18.97 Clarifies.81.391 Seven C Combined.76.41.99

16. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org Three Key Messages Students are good observers There is variation in pre-service teaching quality Potential for use in continuous improvement of candidates and providers

17. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org Considerations Permissions  provider, district, school, classroom, student Provider personnel buy-in  Dean, clinical educators, candidates Placement duration Placement organization Placement/semester timing Cost

18. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org What’s Next? Norming Correlation Triangulation Tracking Integration/Sustainability Provider continuous improvement Candidate continuous improvement

19. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org Use and Usefulness versus

20. CONNECT WITH CAEP | www.CAEPnet.org | Twitter: @CAEPupdateswww.CAEPnet.org QUESTIONS? Contact information:  Jennifer E. Carinci CAEP, Director of Research, Innovation, and Data Strategy jennifer.carinci@caepnet.org