Preparation Program Accountability EPSB Retreat July 15, 2013 Terry Hibpshman Martin School for Public Policy and Administration University of Kentucky 1 (c) 2013 Education Professional Standards Board

2 Inference Expert Judgment Based on multiple sources of information Derived from noisy and incomplete sources So that decisions are nonmonotonic Applying bright lines only where appropriate (c) 2013 Education Professional Standards Board

Influences Product-oriented accountability trends Post-Sanders perceptions of teacher effects Title II of the Higher Education Act The Elementary and Secondary Education Act – NCLB Race to the top KDE PGES CAEP proposed program quality standards EPSB Goals and Themes 3 And of course, the ubiquitous NCTQ (c) 2013 Education Professional Standards Board

EPSB Goals Goal 1: Every approved educator preparation program meets or exceeds all accreditation standards and prepares knowledgeable, capable teachers and administrators who demonstrate effectiveness in helping all students reach educational achievement. Goal 2: Every professional position in a Kentucky public school is staffed by a properly credentialed educator. Goal 3: Every credentialed educator exemplifies behaviors that maintain the dignity and integrity of the profession by adhering to established law and EPSB Code of Ethics. Goal 4: Every credentialed educator participates in a high quality induction into the profession and approved educational advancement programs that support effectiveness in helping all students achieve. Goal 5: The EPSB shall be managed for both effectiveness and efficiency, fully complying with all statutes, regulations and established federal, state, and agency policies. 4 (c) 2013 Education Professional Standards Board

EPSB Themes  Diversity (with specific attention to exceptional children including the gifted and talented, cultural and ethnic diversity)  Assessment (developing skills to assess student learning)  Literacy/Reading  Closing the Achievement Gap (identify what courses emphasize strategies for closing the gap) I would suggest there are others Awareness of local conditions Productivity 5 (c) 2013 Education Professional Standards Board

How do we know when we’ve succeeded? EPSB Goals are operationalized by strategies Goal 4: Every credentialed educator participates in a high quality induction into the profession and approved educational advancement programs that support effectiveness in helping all students achieve. Strategy 4.1. Develop and utilize reliable measures of teacher effectiveness and student achievement that may be used in evaluation of induction and professional advancement activities. 6 (c) 2013 Education Professional Standards Board

Strategies are operationalized by measurements Proposed Measurement Item 25: Mean performance score on internship performance record Which requires a valid, reliable, and sensitive intern performance measurement methodology And there might be additional measures Teacher effectiveness Student achievement 7 (c) 2013 Education Professional Standards Board

General Accountability Approach Horizontal accountability Coordinated with KDE Incorporates federal requirements Eventually incorporate CAEP stadards Sensitive to conditions of practice Segmented teacher labor market School and district characteristics Weighted by year post-completion Addresses matters within the control of preparation programs Differentiates between poor judgment and lack of capacity Measures are practice-relevant Consequences administered within a “just culture” framework Incentives and technical assistance to help programs develop effective internal accountability systems Subject to ongoing review and revision 8 (c) 2013 Education Professional Standards Board

Consequences Reporting Technical assistance Program review Sanctions Identification as a poorly-performing program Limitations on the program’s privileges Decertification And an escalation component 9 SlideSlide 12

Implementation  Create scales for the reporting of existing methods, such as accreditation processes  Identify additional elements for the dashboard, and develop display formats  Develop methods for creating the disaggregated values using SGP data  Develop generalized statistical procedures for analysis of longitudinal data  Develop procedures for review and revision of the accountability model  Develop a yearly program progress report format  Develop inference guidelines, train staff 10 (c) 2013 Education Professional Standards Board

Examples Production Effectiveness Completions Praxis 11 (c) 2013 Education Professional Standards Board

Questions/Comments 12 (c) 2013 Education Professional Standards Board

13 (c) 2013 Education Professional Standards Board

Reporting YearNumber of Headings HEA Title II State Annual Report Number of Report Headings And the rules keep changing (c) 2013 Education Professional Standards Board

College-Level Coursework: Maximum=87 points Must be documented by official college transcript and specific to the teaching assignment listed above. Must be coursework in core content – i.e., not pedagogy. May be coursework taken prior to or after initial certification. 3 points per credit hour earned Teaching Experience: Maximum=45 points Must be in the teaching assignment and in an accredited school 3 points per year Professional Development: Maximum=45 points Must be consistent with the definition of “high quality professional development” delineated in Section 9101 of NCLB 5 points per documented activity during the past 10 years Achievements/Awards: Maximum=35 points Must be specific to the teaching assignment listed above (e.g., department chair; cooperating teacher for student teacher; KTIP resource teacher; documented student learning as demonstrated via state/ national test scores; teaching awards). 5 points per documented activity during the past 10 years Source: Kentucky Educational Professional Standards Board; Identifying Highly Qualified TeachersIdentifying Highly Qualified Teachers Kentucky HOUSSE Scoring Protocol 15 (c) 2013 Education Professional Standards Board

Designing and implementing rigorous standards and high-quality assessments. Attracting and keeping great teachers and leaders in America’s classrooms Supporting data systems that inform decisions and improve instruction Using innovation and effective approaches to turn-around struggling schools Demonstrating and sustaining education reform Race to the Top Reforms 16 (c) 2013 Education Professional Standards Board

17

Proposed CAEP Accountability Standards Content and pedagogical knowledge Clinical partnerships and practice Candidate quality, recruitment and selectivity Program impact Provider quality, continuous improvement, and capacity In addition, a CAEP data acquisition and reporting mechanism to monitor the quality of teacher education programs nationally 18 (c) 2013 Education Professional Standards Board

Program Completers by Content Area Southern State University Content area Completers 2008 Completers 2009 Completers 2010 Completers 2011 Completers 2012 Completers 2013 Completers 2014 Completers 2015 Elementary Education Middle School Mathematics Middle School Science Middle School Social Studies Middle School Language Arts Music Art Physical Education Chemistry Physics Biology1518* English An example - Production 19 (Simulated) (c) 2013 Education Professional Standards Board

20 (Simulated) (c) 2013 Education Professional Standards Board

TPP/School accountability attribution by practice year Practice YearTPP componentSchool component 1100%0% 280%20% 360%40% 4 60% 520%80% 6 or more0%100% 21 (c) 2013 Education Professional Standards Board

22 (Real historical data)

This is a relatively small, rural, nonpublic institution 23 (Real historical data) (c) 2013 Education Professional Standards Board

This is a relatively large, rural, public institution 24 (c) 2013 Education Professional Standards Board

This is a medium-sized, rural, nonpublic institution 25 (c) 2013 Education Professional Standards Board

This is a small, urban, nonpublic institution 26 (c) 2013 Education Professional Standards Board

27 (c) 2013 Education Professional Standards Board

28 (c) 2013 Education Professional Standards Board

29 (c) 2013 Education Professional Standards Board

30 (c) 2013 Education Professional Standards Board

31 (c) 2013 Education Professional Standards Board

32 (c) 2013 Education Professional Standards Board