Classroom Factors PISA/PIRLS Task Force International Reading Association January 2005

Classroom Factors Curriculum and instruction Resources and their use Assessment

PIRLS findings National/regional curriculum and assessments have greatest influence on schools reading curriculum. 38% of students are always or almost always taught reading as a whole-class activity. 53% of students instructed using textbook or reading series. Classrooms where all students use the same materials and work at their own speed are most common. Curriculum and Instruction 1

On average, students receive 7 hours of language instruction weekly. 84% of students read fiction weekly. 56% of students read nonfiction weekly. Silent reading is a frequent daily activity for 66% of students. An additional 27% report reading silently at least weekly. Majority of teachers (56%) report asking students to read aloud to whole class. Students report reading aloud less frequently23% daily, 36% weekly. Curriculum and Instruction 2

PISA findings Teachers with better qualifications were associated with higher achievement. Teacher autonomy is positively associated with higher achievement. Excessive prescription of teaching practices does not appear to raise standards and may have the converse effect. Student strategic self-management of learning was associated with higher achievement. Curriculum and Instruction 3

Establishing Context Are individual students literacy needs in balance with national, regional, and community mandates? If not, how can balance be restored? How much class time is allocated to reading? How does that compare to international averages? Is whole-class reading instruction commonly used? Curriculum and Instruction 4

Establishing Context Are most students using the same books? What are the advantages and disadvantages of this? For which students? Do students read a good balance and variety of reading materials? What is the typical balance between direct teacher instruction, independent silent reading, reading aloud to the class, and reading in groups or pairs? Curriculum and Instruction 5

Establishing Context How are students encouraged to choose and manage their own reading? Is teacher direction of student reading overly emphasized? What systems are in place to check on the effectiveness of student self-management efforts? Curriculum and Instruction 6

Planning Action What should reading professionals do to ensure that curriculum and instruction support reading achievement? Curriculum and Instruction 7

Greater instructional resources correlate with higher achievement. (PISA) Frequent use of available resources is key. (PIRLS) Classroom libraries are under-used. (PIRLS) High interest in using computers for learning activities correlates with higher reading performance. (PISA) Resources and Their Use 8

Establishing Context What reading resources are available in the classroom? Are we giving students regular access to the books we have? How do we know? In how many different places are these books? How do we know? If we don't know, how can we find out? Resources and Their Use 9

Establishing Context Do we use the computers we have effectively and efficiently for reading-related activities? Do students have regular and frequent access to computers for reading-related activities? To what extent should we target available computers on groups who might benefit most? Resources and Their Use 10

Planning Action What should reading professionals do to ensure appropriate resources and their use? Resources and Their Use 11

PISA and PIRLS raised issues about both formative and summative assessment. Formative assessment – frequent, occurs during learning, enables adaptations of instruction on a small scale. Summative assessment – infrequent, occurs post- instruction, typically involves large numbers of learners, identifies broad issues in instructional effectiveness. Assessment 12

PIRLS findings on assessment methods 70% - teachers professional opinion 55% - classroom tests 39% - diagnostic tests, 23% - national/regional examinations 16% - standardized tests Assessment 13

PISA findings related to achievement press Achievement press correlates negatively with reading in 68% OECD countries and 50% non-OECD countries. Correlation between such press and reading engagement was also largely negative. Grading systems may not align with international benchmarks: students meeting teacher/school expectations may perform poorly on PISA/PIRL measures. Assessment 14

Assessment Establishing Context Are formative and summative assessments in use? Is demographic, organizational, and resource information collected and accessible? Are whole school/regional development plans informed by the management information system? 15

Establishing Context Is assessment balanced among oral and written questioning, diagnostic tests, classroom tests, standardized tests, and national/regional exams? Are there additional assessments? Which tests are formative? Summative? Do some serve both purposes? What are the relative advantages, disadvantages, and unintended consequences of various assessments? Assessment 16

Establishing Context Are there regional differences concerning test sophistication or practice? Urban/rural differences? How do these compare to international averages? What do literacy assessments suggest about instructional focus on reflection and evaluation as well as information retrieval and interpretative comprehension? Assessment 17

Establishing Context Are students pressured by excessive emphasis on the results of externally-imposed summative tests? Are teachers pressed by excessive emphasis on the results of externally-imposed summative tests? What might be an unintended consequence of too little accountability or too little consistency? Assessment 18

Establishing Context What is the source of benchmarks for grading students? Are there national benchmarks? How does the grading system correlate with other assessments? Does the grading system take into account all pertinent assessment issues? What evidence is there that outcomes of assessments are used in ways that enhance literacy learning? At the national/regional level? At school/class levels? Assessment 19

Planning Action What should reading professionals do to ensure that assessments support reading achievement? Assessment 20