1. Validating Growth Models
CCSSO
National Conference on Student Assessment
June 30, 2017

2. Validity and Validation
In olden days, validity and validation were not quite so complicated…

3. So let it be written.
So let it be done.

4. Why is your use of those test scores valid?

5. Validating the Growth Model
… a process to ensure the growth model is valid for its intended purpose
What is the intended purpose?
Of the accountability system?
Of the growth model within the accountability system?

6. Why Growth?
Someone needs to be able to explain the role of growth within the accountability system?
Not only to help determine whether the appropriate growth model has been selected?
But also to help with the evaluation of whether it is serving its intended purpose as we validate the accountability system
Validating the Accountability System
Braun (2008) Vicissitudes of the Validators

7. Validity of Accountability Systems
Braun’s (2008) argument regarding the validity of accountability systems:
An accountability system is imposed or implemented with the intent that it will accomplish its desired goals (e.g., increased student achievement).
The mechanism by which this will happen is called the “theory-of-action”.
In validating an accountability system, the theory-of-action plays the same role as does the construct in test validation.
Thus, consequential validity is the ultimate criterion by which we should judge an accountability system.

8. “Theory of Action” The accountability system
Results in classifications
Identifies schools for support and assistance
Leads to actions
Actions lead to improvement
How does growth fit into the model?
What are the intended uses and interpretations of growth as part of the model?
Is there a clear path for that information to lead to the desired actions?

9. Back to Braun
consequential validity is the ultimate criterion by which we should judge an accountability system.
Ultimate consequential validity question– Did the implementation of the accountability system lead to the desired improvements in performance?
There are lots of dots to connect between the design of the accountability system and improved student performance.
As with everything else, trained professionals and fidelity of implementation are critical.
Isolating and evaluating the role and impact of the growth model could be difficult?
Is it necessary or useful to do so?
How does validating the growth model fit into the overall plan for validating the accountability system?