1. Milwaukee Mathematics Partnership A Path Model for Evaluating Teacher and Student Effects MSP Evaluation Summit II Carl E. Hanssen MMP External Evaluator

2. 10/04/20062 Evaluation Goals  Help the MMP better serve its constituents and improve its effectiveness  Serve the broader mathematics education community through documentation and dissemination of MMP activities

3. 10/04/20063 Evaluation Logic Model Student Achievement Teacher Content & Pedagogical Knowledge Math Faculty Involvement Learning Team Effort School Buy-in Teacher Involvement New Courses District Buy-in MPA Ownership MATC Buy-In UWM Buy-In Classroom Practice MMP Activities Proximal Outcomes Distal Outcomes

4. 10/04/20064 HLM Approach Student Achievement Teachers/ Classrooms Schools Nested In

5. 10/04/20065 SEM Approach Education Experience Professional Development Classroom Practice Teacher MKT Student Achievement

6. 10/04/20066 Sample  114 grade 3-8 teachers from 11 different schools  Typical teacher Bachelors Degree 4-6 years of experience 24 hours of mathematics PD in 05-06 Slightly below norm MKT Believed in MMP practices Just under half of students were proficient  Missing data for MKT, MMP Practices, and SA were imputed

7. 10/04/20067 Results Education Experience Professional Development Classroom Practice Teacher MKT Student Achievement.02 (.09) -1.69 (1.28).01 (.06).49 (.88).00 (.00) -.02 (.03).04* (.02).00 (.00) * p <.05 Note. Standard errors reported in parentheses X 2 (4,n=114)=9.03, p=.06 RMSEA=.10; GFI=.97; AGFI=.87

8. 10/04/20068 Room for improvement?  Model Specification Add path from MKT to Classroom Practice Eliminate path from MKT to SA No paths from Education and Experience to MKT Add SES Add Prior Year SA  Measurement Better teacher demographic data New measure for education? Improve measures of classroom practice Timing of student achievement

9. 10/04/20069 Alternative Model Education (or time since degree?) Experience (change to continuous) Professional Development Classroom Practice (need something better) Teacher MKT Student Achievement (which year?) Prior Year Student Achievement Student SES

10. 10/04/200610 Implications for Evaluation  Establish better measures of classroom practice  Establish better data links between teachers and student achievement  “Peel the onion” and use information to guide project activities