1. LEUSD Mobility Tracking Best Practice Shannon Wells, Ph.D.

2. General Data Issues that Impact Accountability Student Information System errors – Some Examples affecting accountability: English Learners marked as speaking English only R-FEP students Prof/Adv in Language Arts after only one year Students receiving special ed. services without a disability code Missing dates for students exiting special ed. services Wrong or missing race/ethnic codes Parent ed. Levels Full student schedules GATE Incorrect student mobility information

4. Inaccurate Data Not Just in LEUSD Student Information System American Indian in a Riverside County SIS (not LEUSD) Parents reported “white” for race/ethnicity on Registration Packet

5. General Pitfalls with Student Data Pre-ID extracted months before STAR – LEUSD Practice Extracted in January Demographic corrections tracked and made through end of testing Reliance on student information systems (canned pre-id extracts) – LEUSD Practice Customized extracts developed by technical personnel, following direction of accountability office Frequent/common data errors – LEUSD Practice Data with common errors affecting accountability measures are collected separately from the student information system Used for Pre-ID, rather than using data in SIS **STAR testing in late April/early May**

6. LEUSD Student Data Work with Key Data Systems to merge external data, identify errors, correct data, submit pre-ID – Expertise in student data, testing, and accountability rules Continue collecting/verifying student data after pre-ID submitted Review each individual student’s demographic record being submitted to state Utilize extended data corrections window to update/correct data through the last allowed date – Last day of testing in May

7. WHAT IS MOBILITY AND HOW CAN WE KNOW WHETHER IT IS ACCURATE? 7

8. What is Mobility? CBEDS Date: First Wednesday in October School, CBEDS % of students who were counted as part of the school enrollment on the October CBEDS data collection, and who have been continuously enrolled since that date to the date of STAR Program testing – Used for inclusion/exclusion mobility rules AND for similar schools ranks LEA, CBEDS % of students who were counted as part of the LEA enrollment on the October CBEDS data collection, and who have been continuously enrolled since that date to the date of STAR Program testing – used for inclusion/exclusion mobility rules 8

9. Why Do Scores From Mobile Students Not Count for API and AYP? If a student is enrolled from CBEDS until the first day of testing, California considers him/her to have been enrolled in a school for a “full academic year.” The same criterion is used for LEAs. Federal and state accountability only use results from students in which a school/district had the opportunity to provide a continuous education for the school year. 9

10. 10 Schools or districts cannot take credit for students they did not provide a continuous education to Schools or districts are not held accountable for students they did not provide a continuous education to

11. Inaccurate CBEDS/Mobility Reporting 11 Students’ Initials Date Exited LEUSD Date Entered Receiving District CST ELA (Receiving District) CST Math (Receiving District) CST Science (Receiving District) District CBEDS* (Receiving District) School CBEDS* (Receiving District) AH4/14/104/19/10BasicProficientN/AYes BH4/14/104/19/10Proficient Yes *CBEDS Yes = Continuously enrolled from first Wednesday in October 2009 until the first day of testing (May 2010)

12. 12

13. Reported CBEDS Yes (Continuously Enrolled) 200920102011% NSLP Alvord Unified91928872 Banning Unified90919282 Beaumont Unified92939560 Coachella Valley Unified9293 90 Corona-Norco Unified9596 43 Desert Sands Unified95 9662 Hemet Unified93 9273 Jurupa Unified88919376 Lake Elsinore Unified86807954 Menifee Union Elementary92939443 Moreno Valley Unified9091 80 Murrieta Valley Unified94 9526 Nuview Union93949671 Palm Springs Unified95 82 Palo Verde Unified95 67 Perris Elementary87899187 Perris Union High91 9267 Riverside County Office of Education35 3246 Riverside Unified95 9660 Romoland Elementary90 8972 San Jacinto Unified89888974 Temecula Valley Unified94959618 Val Verde Unified89 80 Three Year Reported Mobility Rates and 2011 Percent of Low Income Students 13

14. 14

15. 15 Census Geography Through its many surveys, the Census Bureau reports data for a wide variety of geographic types, ranging from the entire United States down to a Census Block. The geographic types that a survey reports on will depend upon the survey's purpose, and how the data were collected.

16. 16 American Community Survey (ACS) “The American Community Survey (ACS) is an annual national survey collected monthly which provides communities with reliable and timely demographic, housing, social, and economic data every year. Annual data on Migration is used to determine the extent of residential mobility of the population for the U.S., states, metropolitan areas, and more specific geographical areas for the given survey year. Data are available from 2000 to the present.” Survey results show the percent of people that live in the same house as they did the prior year. This is similar to school districts’ measures of mobility. http://factfinder.census.gov/servlet/ADPGeoSearchByListServlet?ds_name=ACS_2009_5YR_G00_&_lang=en&_ts=335276417580

17. 17 Sources: Census Residential Mobility (Same House One Year) (http://factfinder.census.gov/servlet/ADPGeoSearchByListServlet?ds_name=ACS_2009_5YR_G00_&_lang=en&_ts=335276417580)http://factfinder.census.gov/servlet/ADPGeoSearchByListServlet?ds_name=ACS_2009_5YR_G00_&_lang=en&_ts=335276417580 2011 District Mobility (http://data1.cde.ca.gov/dataquest/)http://data1.cde.ca.gov/dataquest/

18. 18 District Mobility Tracking CBEDS Yes (Non-Mobile) Census Mobility from American Community Survey (Non-Mobile) 20102011 Residential Mobility Margin of Error +/- Difference Between 2011 District Reported and Census Mobility Does the District Mobility Match Census Mobility? Alvord Unified928879.32.208.70NO Banning Unified919280.22.8011.80NO Beaumont Unified939580.52.5014.50NO Coachella Valley Unified93 84.62.108.40NO Corona-Norco Unified96 83.11.1012.90NO Desert Sands Unified959681.71.3014.30NO Hemet Unified939277.61.6014.40NO Jurupa Unified919384.82.108.20NO Lake Elsinore Unified807980.81.901.80YES Menifee Union Elementary939480.22.2013.80NO Moreno Valley Unified91 87.01.104.00NO Murrieta Valley Unified949581.91.6013.10NO Nuview Union949688.84.407.20NO Palm Springs Unified95 82.21.5012.80NO Palo Verde Unified95 74.73.3020.30NO Perris Elementary899181.23.109.80NO Perris Union High919281.11.5010.90NO Riverside Unified959681.01.2015.00NO Romoland Elementary908980.94.308.10NO San Jacinto Unified888978.13.5010.90NO Temecula Valley Unified959682.41.4013.60NO Val Verde Unified89 83.52.105.50NO LEUSD Mobility Range = 77.1 to 80.9 79 – 1.9 = 77.1; 79 + 1.9 = 80.9

19. Mobility Summary Mobile students do not count for API or AYP Mobile students count in all other reports that teachers and admin. look at Little change in district reported mobility rates from 2010 to 2011 – 2010: 80-96% – 2011: 79-96% Looking at multiple sources of data, most districts appear to be underreporting mobility – Districts reported, on average 93% non-mobile, versus census results of 82% – LEUSD was within the margin of error of percent of district residents not moving in one year (2010 and 2011) – Looking at what is reported at the student level, we know districts are not report accurately in all cases – Working with other districts, we have clearly seen students being mismarked 19

20. 2006 TO 2008 IMPACT OF DISTRICT MOBILITY API and AYP 20

21. 21

22. 22

23. 23

24. LEUSD MOBILITY TRACKING AND DATA REPORTING 24

25. Mobility Tracking Student movement in and out of schools and district monitored daily – Site personnel collect and submit the students who enter and exit the school Registrar, Attendance Clerk, Office Staff – Information is submitted by each site to ISS each Tuesday – Principal signs off as to the accuracy of the mobility report Students who enter a school between CBEDS date and the first day of STAR testing are “School CBEDS No” – Scores do not count for school, may count for district Students who enter the district between CBEDS date and the first day of STAR testing are “District CBEDS No” – Scores do not count for district or any school All students test, regardless of mobility

29. LEUSD Instructional Model Know targets and understand accountability systems Know details of all students (Ongoing String Data) – Subgroup inclusion – Previous achievement – Strengths and Weaknesses – Evaluate student progress on a continual basis Teach standards – not textbooks – from first day of instruction – Teach all assessed standards – all standards are “key, essential” standards Freedom to teach -- Not tied to any specific materials – Teachers have flexibility/expectation to create creative, relevant lessons that allow their specific students to understand the content standards – Focus on results, not process

30. Questions? Shannon@KeyDataSys.com Doug.Wells@LEUSD.k12.ca.us