Using EVAAS to Improve Student Performance Heather Stewart Jody Cleven Region 4 PD Leads NCDPI

North Carolina uses two different models in EVAAS 1.The Univariate Response Model (URM) is used for EOGs in grades 5 and 8 science, EOCs in high school, and CTE Post-Assessments; URM will be used for the Common Exams (predicts) 2.The Multivariate Response Model (MRM) is used for EOGs in grades 3 – 8 mathematics and English Language Arts (projects)

Predict/Project The URM uses a student’s prior test scores to predict where a student will be positioned in the statewide distribution of students who take a certain assessment The MRM uses a student’s prior test scores to project where students will be positioned in the statewide distribution of students who take a certain assessment In both cases, the basic methodology is the same: using a student’s prior test scores to consider their performance on an assessment he or she will take at the end of the school year

Predictive VA Model – Univariate Response Model (Predicts) For reports where testing is not sequential (gr. 5 and 8 science, EOCs in high school, CTE post-assessments) Common Exams Students must have three previous test scores for a predictive model Effect is difference between predicted and observed scores

Value-Added Reporting Predictions Projections

Value-Added Reports – Multivariate Model (Projections)

Value-Added Reporting

The NCE Base is by definition set at 50.0, and it represents the average attainment level of students in the grade and subject, statewide. If the school mean is greater, the average student in the school is performing at a higher achievement level than the average student in the state.

District Diagnostic Reports Use to identify patterns or trends of progress among students expected to score at different achievement levels

Value-Added Reports

Diagnostic Report

Diagnostic Reports – the whiskers

District Performance Diagnostic Reports Use to identify patterns or trends or progress among students predicted to score at different performance levels as determined by their scores on NC tests Students assigned to Projected Performance Levels based on their predicted scores Shows the number (Nr) and percentage of students in the district that fall into each Projected Performance Level

District Performance Diagnostic Reports

Student Lists

Clicking on a Student

Student Projection Report

Interpreting the Pie Chart Light Red Green Yellow

Diagnostic Reports Looking for Patterns

School Diagnostic Shed Pattern

School Diagnostic Reverse Shed Pattern

School Diagnostic Tent Pattern

School Diagnostic V Pattern

School Diagnostic Opportunity Gap Pattern

What would an ideal pattern on a Diagnostic Report look like for closing the achievement gap?

Diagnostic Report Desirable Pattern

Feeder Pattern Report

Summary of School Value-Added

Summary of School Diagnostic

New Reports – Decision Dashboard

Decision Dashboard Continued

School Accountability Growth

Scatterplots