Barbara Foorman, Yaacov Petscher, & Chris Schatschneider, Florida Center for Reading Research, Florida State University

FCRR’s Subaward to ETS’ RFU- Assessment grant : Developed computer-adaptive K-12 component skills battery [(item tryouts, IRT analyses, & linking studies. Called the FCRR Reading Assessment (FRA)]. The FRA added academic language tasks to previous reading assessments of the TPRI (& Tejas LEE) and FAIR : Conducted cross-sectional and longitudinal studies of reading & language development & predictive validity studies of FRA.

The Florida Center for Reading Research Reading Assessment (FRA) is a set of computer-administered (prekindergarten) or computer-adaptive (K–2 and 3– 12) literacy assessment systems that consist of screening, comprehension, and diagnostic reading and language tasks. The preK system has 3 forms. The K–2 and 3–12 systems are computer-adaptive and, therefore, do not have forms. All systems completed within 45 minutes. Licensed to FLDOE as the FAIR-FS and to Lexia Learning as the RAPID. What is the FRA?

FRA Technical Manuals (Foorman, Petscher, & Schatschneider, 2015) at: researchers/fra.asphttp:// researchers/fra.asp Validity addressed through analysis of: factor structure; discriminant, convergent, predictive, and diagnostic validity. Marginal reliabilities addressed with Item Response Theory. Psychometrics

Word Recognition Task Vocabulary Knowledge Task Syntactic Knowledge Task Reading Comprehension Task Number of items Passages administered% students mean passage9.7% median passages22.7% administered 30 items31%2%15%3 passages67.6% Reliability marginal reliability coefficient Cronbach's alpha ≥.9 82%98%87%54% Cronbach's alpha ≥.8 98%99% 93% Time (minutes : seconds) mean3:042:063:54NA* median2:361:403:30NA* directions time0:420:240:350: FRA Task Efficiency *The mean and median values for amount of time spent on the Reading Comprehension Task are not available due to the nature of the task.

Note : GMAT = Gates-MacGinitie Reading Test; SAT-10 = Stanford Achievement Test, 10 th edition; FSA = FL Standards Assessment Predictive Validity of the 3-10 FRA to End-of-Year Outcomes

Structure of reading K - 3 Foorman et al. (2015) Reading & Writing Decoding fluency Syntax Phonological awareness Vocabulary Listening Comp Oral language Reading Comprehension

Structure of reading Foorman, et al. (2015) Journal of Educational Psychology Decoding fluency Syntax Vocabulary Oral language Reading Comprehension 72% - 99% variance

 FRA: Grades K - 2 “ Before you put the book at the end of the row, click on the cat.” “ The girl is eating dinner by herself.”

 FRA: Grades 3 through 12

Results translate to instruction --FCRR Student Center Activities FAIR-FS professional development --Implications of connectives for text understanding ions _for_connectives.docx Uses of the FRA

Example of FRA score report for English learner student in upper elementary who is learning to read English Technical assistance project of the Regional Educational Laboratory Southeast at FSU/FCRR

 Vocabulary Pairs (K,1,2) Audio provides each word and box lights up as each word is said. Student clicks on 2 words that go together.

Combining information on ability scores and levels: Do students who stay within level meet or exceed the 50 th percentile? Technical assistance project of the Regional Educational Laboratory Southeast at FSU/FCRR

Examples from data chats Teachers saw students’ FRA scores as consistent with oral language proficiency scores. Teachers saw low Following Directions scores as consistent with observations of inattentiveness and poor memory Teachers strategized about instruction to improve vocabulary (using recommendations from WWC practice guide) Teachers shared growth charts with parents and with receiving teachers Technical assistance project of the Regional Educational Laboratory Southeast at FSU/FCRR

Lessons learned Eliminate overlapping assessments & delineate their purpose. Select online computer-adaptive literacy assessments with strong evidence of validity and reliability and that measure growth. Select K-2 measures that can be administered individually so that teachers can observe & respond to students’ misconceptions & learning differences. Support PD on how to administer computer-adaptive assessments & interpret/use data at the classroom, school, and district level. Train teachers/staff for min before school starts. Strategize how to implement 1:1 administration for students needing foundational skills, such as using support staff or combining students across classrooms within a grade. Conduct data chats during team meetings after each assessment period to discuss translation of data to instructional planning. Technical assistance project of the Regional Educational Laboratory Southeast at FSU/FCRR