1. CaMSP Database and APR Webinar Public Works, Inc. CaMSP Database and October 15, 2011 APR Update April 4, 2011 CaMSP Network Meeting Patty O’Driscoll Albert Chen Public Works, Inc.

2. Public Works, Inc. serves as the statewide evaluator for California Mathematics and Science Partnership (CaMSP) program and supports the completion of the APR by local partnerships and the California Department of Education (CDE).

3. Federal APR--VIIIB GPRA Public Works,Inc. is responsible for assisting partnerships to complete Section VIIIB of the APR-- the student outcome GPRA. PLEASE NOTE: Without your student rosters to Public Works, Inc., you will not be able to complete your APR! REMINDER: The teacher outcome GPRA (VIIIA) is the responsibility of the local evaluator and partnership.

4. CaMSP Database www.publicworksinc.org A little history… –Designed in 2003-04 to meet anticipated reporting guidelines for the federal APR. –Refined over the years to meet reporting guidelines and to accurately report attendance for funding purposes. –Burden for data collection from local partnerships has eased over the years--PW receives STAR and PAIF from CDE. –Partnerships provide student rosters so PW can link teacher and student information for outcome study

5. CaMSP Database Data security –Individual teachers data is confidential. No individual student data is identified or shared. –Student data is not available on the PW database. –2 authorized users per partnership helps to maintain confidentiality of information. –PW offers data MOUs if required at local level.

6. CaMSP Database Development Activity Fields –Activity Focus –Description –Project Design –Project Need –Go to demo… –Sample activities included in handout documents Intensive Activity (Makeup) Classroom Follow-up

7. 2011 APR Update Data Request letter sent by Public Works, Inc. to partnerships August 15, 2011: Data request includes Treatment teachers and Control teachers selected by Public Works, Inc. Treatment teachers are participating teachers with at least 60 hours of intensive and 24 hours of follow- up CaMSP professional development in mathematics or science through June 30, 2011 for every year completed. Teacher participation hours reflects the attendance reported through June 30, 2011 on the PW database.

8. Data Request Letter (cont’d) PW provides to the partnerships an emailed list of participating teachers (treatment) and a list of control group teachers (for comparison with treatment) Each teacher listed has been given a PW- assigned teacher identification number that is unique to PW’s evaluation Partnerships need to pull together lists of students taught by treatment and control teachers in 2010-11.

9. Student Outcome Uses The data collected for the APR is also used for the student outcome study. –Designed to meet federal and state requirements –Used to examine improved student academic achievement on state mathematics and science assessment. The data PW collects can also be used by partnerships in its local evaluations if requested--A handout describing how is included in the handouts.

10. Helpful Tips for Grade/ Student Rosters Use a query based on those students who actually received a letter grade from listed teachers for mathematics or science Student names are not needed, but student identification numbers must match those from the STAR data files May provide separate Excel worksheets for each grade/student roster by semester

11. Helpful Tips for Grade/ Student Rosters Example:

12. Federal APR From the roster lists that are provided, PW will provide the data to complete Section VIII B to meet the CDE deadline of October 15, 2011. Based on 2010 APR, this includes 1.Number of students taught mathematics/science by MSP teachers 2.Number of students with state assessment data in mathematics/science 3.Number of students who score at basic or below in mathematics/science 4.Number of students who scored at proficient or above in mathematics/science

13. Local Evaluation Report A local evaluation report MUST be attached to the APR There is no prescribed format but PW has provided some guiding questions for local evaluators to use when writing their reports Guiding Questions for the Local evaluation report is included in the handouts PW reviews the evaluator reports and provides feedback to CDE after APRs are complete

14. PAIF Update PW used the 2008-09 PAIF file for the Cohort 7 database and to create the control lists for the 2010 APR. PW has received the 2009-10 PAIF from CDE. Teacher assignment information was not collected for the 2009-10 PAIF--for now, we will work with what we have. PW will work with partnerships in Fall 2011 if additional data is needed.

15. Reporting Deadlines Narrative, Project Profile & Local Evaluation Report for Cohorts 5, 6 7 and Research due to CDE on October 15, 2011 in order for CDE to meet ED submission deadline.

16. Public Works, Inc. Team Questions about the APR and the data collection process can be addressed to: -Albert Chen, achen@publicworksinc.orgachen@publicworksinc.org -Velette Bozeman, velette@publicworksinc.orgvelette@publicworksinc.org -Phone number: 626-564-9890 -Patty O’Driscoll, patty@publicworksinc.orgpatty@publicworksinc.org -Phone number: 707-933-8219