CONNECT WITH CAEP | | The Next Horizon Incorporating Student Perception Surveys into the Continuous Improvement Systems of Educator Preparation Providers Jennifer E. Carinci Director Research, Innovation, and Data Strategy AYPF Student Survey Discussion Group - April 2, 2015

CONNECT WITH CAEP | | What is CAEP? CAEP’s mission Advance excellent educator preparation through evidence-based accreditation that assures quality and supports continuous improvement to strengthen P-12 student learning CAEP’s vision Increase the value of accreditation to be an attribute demanded by the public while expanding its footprint by bringing more providers into the accreditation fold Purpose of accreditation Assure teacher candidates, parents, employers, policy makers and the public that a CAEP-accredited provider has been rigorously evaluated and has met or exceeded high standards of quality

CONNECT WITH CAEP | | CAEP Standards: Levers for Improved Educator Quality Build partnerships and strong clinical experiences Raise and assure candidate quality Data-driven, continuous improvement Include all providers Insistence that preparation be judged by outcomes and impact on P-12 student learning and development  —Results matter; “effort” is not enough.

CONNECT WITH CAEP | | CAEP’s Interest in Student Surveys

CONNECT WITH CAEP | | Evidence for Meeting Standards Data on Impact of candidates 3.5 Before the provider recommends any completing candidate for licensure or certification, it documents that the candidate has reached a high standard for content knowledge in the fields where certification is sought and can teach effectively with positive impacts on P-12 student learning and development. Data on Impact of completers 4.2 The provider demonstrates, through structured and validated observation instruments and student surveys, that completers effectively apply the professional knowledge, skills, and dispositions that the preparation experiences were designed to achieve. Continuous Improvement tool 5.4. Measures of completer impact, including available outcome data on P-12 student growth, are summarized, externally benchmarked, analyzed, shared widely, and acted upon in decision-making related to programs, resource allocation, and future direction.

CONNECT WITH CAEP | | Urgency: Educator Preparation and Quality Metrics “A primary obstacle to investigating…many…important aspects of teacher preparation is the lack of systemic data collection, at both the national and state levels.” National Research Council Report, 2010 Availability & Quality of Data in Educator Preparation Recent Reports Timeliness

CONNECT WITH CAEP | | Building an Evidence-Based System for teacher Preparation

CONNECT WITH CAEP | | Strategic Goal 3: To advance research and innovation CAEP will develop and implement an agenda for research and innovation to foster continuous improvement in educator preparation.

CONNECT WITH CAEP | |

CONNECT WITH CAEP | | Previous Pilot/Current Pilot Objectives  Efficacy of using instrument in pre-service  Exploration of implementation challenges  Feedback to candidates on P-12 impact  Feedback to providers on P-12 impact  Tracking from pre-service and in-service  Continuous improvement of candidates  Continuous improvement of EPPs Previous

CONNECT WITH CAEP | | Participants to date Fall 2013Spring 2014Fall 2014Spring 2015 Providers39720 Provider States Candidates ~662 K-12 Surveys1,1025,3092,100~16,000 Average # of surveys ordered per class = 25 Average # of surveys completed per class = Average student participation rate = 81.36%

CONNECT WITH CAEP | | Current Pilot by Semesters Year 1 ( ) Candidates Year 2 ( ) Completers Survey Administration Periods FallSpringFallSpring So What? Pre-service to In-service

CONNECT WITH CAEP | | Results/Feedback To Providers Aggregate domain scores Raw data for provider’s candidates To Candidates

CONNECT WITH CAEP | | Average Domain Scores for Spring 2014 Sample DomainMeanMinMax Care Challenge Captivate Confer Consolidate Controls Clarifies Seven C Combined

CONNECT WITH CAEP | | Average Domain Scores for Fall 2014 Sample DomainMeanMinMax Care Challenge Captivate Confer Consolidate Controls Clarifies Seven C Combined

CONNECT WITH CAEP | | Three Key Messages Students are good observers There is variation in pre-service teaching quality Potential for use in continuous improvement of candidates and providers

CONNECT WITH CAEP | | Considerations Permissions  provider, district, school, classroom, student Provider personnel buy-in  Dean, clinical educators, candidates Placement duration Placement organization Placement/semester timing Cost

CONNECT WITH CAEP | | What’s Next? Norming Correlation Triangulation Tracking Integration/Sustainability Provider continuous improvement Candidate continuous improvement

CONNECT WITH CAEP | | Use and Usefulness versus

CONNECT WITH CAEP | | QUESTIONS? Contact information:  Jennifer E. Carinci CAEP, Director of Research, Innovation, and Data Strategy