1 QRIS Environment Rating Scale Policy Development EEC Board Policy and Research Committee December 2, 2013

2 Discussion Objectives Overview of current ERS policy Overview of proposed ERS policy Review of ERS policies across 4 states Picture of a Level 3 Center Based program under the proposed ERS policy ERS Policy Timeline

3 Subscale Item

4 Current Environment Rating Scale Policy

5 Challenges Presented by Current ERS Policy At all levels the environment rating scales contain between items. If any one of these items falls below the QRIS Level requirements, EEC is unable to grant the program’s/provider’s level. The current scoring requirement of a 3, 5 or 6 on all individual ERS items, is not necessarily indicative of low program quality. For example, some programs/providers may score low on an item because, as a result of bussing, they have limited greetings and departures with family members. Facility and program structure limitations are a barrier for some programs. For example, if a facility does not have an adult only dedicated restroom, they cannot meet the QRIS Level 2 requirements. Certain subscales are more directly linked to child outcomes. The current ERS policy does not address this in any way.

6 Proposed Environment Rating Scale Policy * See sample “Environment Rating Scale Reliable Rater Visit Report” to review a list of subscales and proposed score requirements.

7

8

9 Review of ERS Scoring Policies MAMDPAAR Level 1 No ERS Self-Assessment Level 2 Overall: 3 Subscale: 2 or 3, IP required Self-Assessment Subscale: no requirements Self-Assessment Subscale: below 3 requires IP Overall: 3 Subscale: no requirements Level 3 Overall: 4.5 (PQS) Subscale: 3 or 4, IP required Overall: 4 (IA) Subscale: no requirements Overall: 4.25 (IA) Subscale: below 3.5 requires IP Overall: 4 Subscale: no requirements Level 4 Overall: 5.5 (IA) Subscale: 4 or 5, IP required Overall: 5 (IA) Subscale: no requirements Overall: 5.25 (IA) Subscale: below 4.25 requires IP Key: Independent Assessor (IA), Improvement plan (IP), Program Quality Specialist (PQS)

10 Picture of a Level 3 QRIS Program View brief video to demonstrate what quality would look like in a program granted Level 3 in QRIS, with the proposed ERS policy Review sample ERS indicators that would be met to achieve score requirements under proposed policy Research linking ERS subscales to improved child outcomes

11 Subscale: Language-Reasoning Supportive research: “Preschool teacher’s use of sophisticated vocabulary during free play has also been found to predict fourth grade reading comprehension and word recognition” (Dickinson &Porsche, 2011). Informal use of language: Indicator 5.3 – Staff add information to expand on ideas presented by children

12 Subscale: Activities Supportive research: “…emergent numeracy skills in preschool, including counting, number knowledge, estimation and number pattern facility have been found to predict mathematical competence in the elementary grades” (Duncan et al., 2007; Geary, 2003; Jordan, Kaplan, Olah & Locuniak, 2006; Welsh, Nix, Blair, Bierman, & Nelson, 2010). Math/number: Indicator 5.4 – Daily activities used to promote math/number learning (Ex. Setting table, counting while climbing steps, using timers to take turns)

13 Subscale: Interaction Supportive research: “Studies using a combined dataset from the National Center of Early Development Multi-State Study of Prekindergarten (NCEDL) and the Statewide Early Education Programs Study (SWEEP) have indicated that instructional interactions and the social emotional climate of the classroom are significant predictors of children’s academic gains in language and literacy” (Burchinal et. al., 2010; Howes, et. al., 2008; Mashburn et. al., 2008). Staff-child interactions: Indicator 5.2 – Staff show respect for children (Ex. Listen attentively, make eye contact, treat children fairly, do not discriminate)

14 Subscale: Interaction Supportive Research: “In a national survey of more than 3500 kindergarten teachers, 46% of teachers indicated that at least half of the children in their classrooms lacked competencies in pre-academic skills, following directions and peer relations, which teachers viewed as significant barriers to school success” (Rimm-Kaufman, Pianta & Cox, 2000). Interactions among children: Indicator 5.2 – Staff help children develop appropriate social behavior with peers (Ex. help children talk through conflicts instead of fighting; encourage socially isolated children to find friends; help children understand feelings of others)

15 Thoughts from the Early Education and Care Community “Maintains integrity of tool and gives more flexibility without disregarding individual items.” “Adds in wiggle room without sacrificing quality.” “Looks at the big picture of program quality.” “Addresses that while the ERS is a big measure of quality, it is not the only method of demonstrating accomplishment of QRIS standards.”

16 Timeline for ERS Policy Implementation PQS unit presents proposal to EEC Board Policy Committee and EEC Board (including feedback from the field) December 2013 PQS unit incorporates feedback given from EEC Policy Committee and EEC Board in preparation for board vote January 2013 PQS unit presents proposed policy to EEC Board for decision/vote to adopt new ERS policy Policies and potential challenges are shared with the QRIS working group for thoughts and feedback February 2013 PQS unit in collaboration with input from the QRIS working group, develops a plan for sharing scores and granting level 3 ratings PQS unit begins sharing scores with field and granting level 3 ratings March 2013

17 Questions and Comments

18 References Burchinal, M., Vandergrift, N., Pianta, R., & Mashburn, A. (2010). Threshold analysis of association between child care quality and child outcomes for low-income children in pre-kindergarten programs. Early Childhood Research Quarterly, 25, Dickinson, D. K., & Porche, M.V. (2011). Relation between language experiences in preschool classrooms and children’s kindergarten and fourth-grade language and reading abilities. Child Development, 82, Duncan, G.J., Dowsett, C.J., Claessens, A., Magnuson, K., Huston, A.C., Klebanov, P., Pagani, L.S., Feinstein, L., Engel, M., Brooks- Gunn, J., Sexton, H., Duckworth, K., Japel, C. (2007). School readiness and later achievement. Developmental Psychology, 43, Geary, D.C. (2003). Learning disabilities in arithmetic: Problem solving differences and cognitive deficits. In H.L. Swanson, K.R. Harris, & S. Graham (Eds.), Handbook of learning disabilities (pp ). New York: Guilford. Howes, C., Burchinal, M., Pianta, R., Bryant, D., Early, D., Clifford, R. M., Barbarin, O. (2008). Ready to learn? Children’s pre- academic achievement in pre-kindergarten programs. Early Childhood Research Quarterly, 23, Jordan, N.C., Kaplan, D., Olah, L.N., Locuniak, M.N. (2006). Number sense growth in kindergarten: A longitudinal investigation of children at risk for mathematics difficulties. Child Development, 77, Mashburn, A. J., Pianta, R.C., Hamre, B.K., Downer, J.T., Barbarin, O.A., Bryant, D., Burchinal, M., Early, D.M., & Howes, C. (2008). Measures of classroom quality in prekindergarten and children’s development of academic, language and social skills. Child Development, 79, Rimm-Kaufman, S. E., Pianta, R. C., & Cox, M. J. (2000). Teachers’ judgments of problems in the transition to kindergarten. Early Childhood Research Quarterly, 15, Welsh, J.A., Nix, R.L., Blair, C., Bierman, K.L., & Nelson, K.E. (2010). The development of cognitive skills and gains in academic school readiness for children from low-income families. Journal of Educational Psychology, 102(1),