1. How Are Teacher Education Institutions Using Data to Improve Programs? Lessons Learned from the SUNY Teacher Education Program Assessment FIPSE Project, 2003-07 A presentation at the Carnegie Roundtable Discussion “Improving New York’s Teacher Education Programs Through Evidence- Based Decision Making” April 18, 2007 Albany, New York Suzanne Weber, Project Director & Associate Dean School of Education, SUNY Oswego

2. How Are Teacher Education Institutions Using Data to Improve Programs? 3 big ideas for my remarks (3 handouts with more information): 1.Describe collaborative SUNY FIPSE Project 2.Illustrate typical data now available and used by the SUNY colleges to improve programs 3.Describe a framework for a new educational quality information system that could provide data to NYSED, colleges and the schools to improve PK-12 student achievement

3. SUNY Teacher Education Program Assessment FIPSE Project Purpose of SUNY FIPSE project is to create campus-level assessment systems that support data-driven program improvements to increase beginning teacher competency Involves all 16 teacher education institutions in the SUNY System Includes a wide variety of institutions and programs SUNY prepares about 30% of college-recommended teachers in New York State Involves high level of collaboration across campuses and with SUNY System

4. About 2/3 of the SUNYs are NCATE, 1/3 TEAC, no RATE Whatever the accreditation agency, all SUNYs are collecting and analyzing data in five major categories: Candidate Content Knowledge Performance Candidate Curriculum Development Performance* Candidate Teaching Performance* Candidate Impact on PK-12 Student Learning* Program & Operational Effectiveness *Usually includes assessment of Candidate Ability to Meet Needs of Diverse Learners, Instructional Technology Skills, and/or Professional Dispositions Provide selected examples in each category (complete set in handout) SUNY Teacher Education Program Assessment FIPSE Project

5. Teacher Candidate Performance Content Knowledge (Of great interest to A&S faculty) Example 1. Social Studies CST Results (SUNY TCED) X Axis: 0=Total, 1=History, 2=Geography, 3=Economics, 4=Civics, Citizenship & Government, 5=Social Studies Skills, 6=Essay on History Y Axis: 220 is passing score; 300 is maximum score.

6. Teacher Candidate Performance Content Knowledge Example 2. All SUNY Social Studies CST Results X Axis: 0=Total, 1=History, 2=Geography, 3=Economics, 4=Civics, Citizenship & Government, 5=Social Studies Skills, 6=Essay on History Y Axis: 220 is passing score; 300 is maximum score.

7. Teacher Candidate Performance Content Knowledge (Of great interest to A&S faculty) Example 4. Content Knowledge in Student Teaching X Axis: Social Studies Content Areas Y Axis: 2=Met But Needs Development, 3=Met (Target), 4=Met with Distinction Ant His Geg Psy Soc Pol Eco STS GLS Civ

8. Teacher Candidate Performance Teaching Performance Example 6. Instructional Skill in Student Teaching X Axis: INTASC Standards Y Axis: 2=Met But Needs Development, 3=Met (Target), 4=Met with Distinction Content Human Adapting Multiple Manage Comm Planning Assess Reflect Partner Prof Instruct Know Dev Instruct Strategy Motivate Skill Disp Tech

9. Teacher Candidate Performance Lesson/Unit Planning Impact on P-12 Student Learning Example 9. Teacher Work Sample X Axis: Class Goals Assess Instruct Anal Student Reflection Context Plan Sequence Learning Y Axis: 2=Met But Needs Development, 3=Met (Target), 4=Met with Distinction Requires analysis of pre/post test data (and assessment of higher order thinking skills) Traditional lesson & unit plan objectives embedded in TWS

10. Teacher Candidate Performance Lesson/Unit Planning Example 11. Teacher Work Sample X Axis: Class Goals Assessment Instructional Context Plan Sequence Y Axis: 2=Met But Needs Development, 3=Met (Target), 4=Met with Distinction

11. Teacher Candidate Performance Program Effectiveness Example 13. Candidate Exit Survey X Axis: Overall Career Student Fellow Support Admin Fac & Assess Educ Equity Student Res & Teach Qual Serv Teach Cand Serv Serv Courses Constit Diversity Dev Prof Dev Strat Instruct Y Axis: 4=Good, 5=Very Good, 6=Excellent

12. 3 TEACH Certification Exam Enhancement (Possible) 1 TEACH Tracking Enhancement (Planned) 2 TEACH Pipeline Enhancement (Planned) Student & Environment Student Ability & Motivation, Peers, Family, Social Setting Teacher Examinations General Knowledge, Content Specialty, Pedagogy School Characteristics Location, High Needs, Diversity, Report Cards, Administration Teacher Employment Location, Assignment, Diversity, Persistence, Demand Teacher Certification Certification Route, Initial & Additional Certification(s) Teacher Candidate Performance Content Knowledge, Curriculum Development, Instructional Performance, Impact on PK-12 Student Learning Teacher Candidate Characteristics Program, GPA/SAT/GRE, Diversity, Admission & Transfer Status Toward a New York State PK-16 Educational Quality Information System 4 Performance Link (Possible) Preservice/Inservice Teacher Teacher Performance Annual Professional Performance Review (APPR) School Conditions Class Size, Learning Environment, Leadership, Facilities, Funding Teacher Characteristics Certifications, Diversity, Experience, Professional Development PK-12 Student Achievement Gr 3-8 Annual Tests, Regents Exams

13. Toward a New York State PK-16 Educational Quality Information System PK-12 Student Achievement Gr 3-8 Annual Tests, Regents Exams 1.Teacher education institutions are already using data to improve programs: Candidate Content Knowledge; Curriculum Development Performance; Teaching Performance; Impact on PK-12 Student Learning; and Program & Operational Effectiveness 2. A PK-16 educational quality information system is needed in New York State to: Understand teachers’ career paths and performance, and Enhance PK-12 student achievement

14. Lessons Learned from the SUNY Teacher Education Program Assessment FIPSE Project, 2003-07 A presentation at the Carnegie Roundtable Discussion “Improving New York’s Teacher Education Programs Through Evidence- Based Decision Making” April 18, 2007 Albany, New York Suzanne Weber, Project Director & Associate Dean School of Education, SUNY Oswego How Are Teacher Education Institutions Using Data to Improve Programs? www.oswego.edu/~educate/fipse

16. Teacher Candidate Performance Content Knowledge Example 3. Benchmarked Content GPA X Axis: Year (2002-03, 2003-04, 2004-05, 2005-06) Y Axis: Content GPA (2.00, 2.50, 3.00, 3.50, 4.00)

17. Teacher Candidate Performance Content Knowledge Example 5. Content Knowledge in Student Teaching Ant His Geg Psy Soc Pol Eco STS GLS Civ Total Pass Rate 100% 97% 100% 99%

18. Teacher Candidate Performance Teaching Knowledge Example 7. Social Studies ATS-W Results X Axis: 0=Total, 1=Student Dev, 2=Instruct & Assess, 3=Prof Env, 4=Essay on Instruct & Assess Y Axis: 220 is passing score; 300 is maximum score.

19. Teacher Candidate Performance Teaching Knowledge Example 8. All SUNY Social Studies ATS-W Results X Axis: 0=Total, 1=Student Dev, 2=Instruct & Assess, 3=Prof Env, 4=Essay on Instruct & Assess Y Axis: 220 is passing score; 300 is maximum score.

20. Teacher Candidate Performance Lesson/Unit Planning Impact on P-12 Student Learning Example 10. Teacher Work Sample X Axis: Class Goals Assess Instruct Student Reflection Context Plan Sequence Learning Total Pass Rate100% 98%100%

21. Teacher Candidate Performance Impact on P-12 Student Learning Example 12. Teacher Work Sample X Axis: Analysis of Evaluation & Student Learning Reflection Y Axis: 2=Met But Needs Development, 3=Met (Target), 4=Met with Distinction