1. Measuring Instructional Alignment
Andrew C. Porter Vanderbilt University

2. Methods for Measuring Alignment of Assessments to Content Standards
Norman Webb
Wixson
Buros Center
CREST
Porter and colleagues
Achieve Incorporated
American Association for the Advancement of Sciences Project 2061
Council for Basic Education

3. Content Matrix

4. Vertical and Horizontal Alignment
Achievement
Instruction
District
Assessment
Standards
State
Assessment
Standards

5. Example Matrices to Measure Alignment
Cognitive Demand
Assessment
Standards .3 .1 .2 .2 .1
Topics
∑ |X-Y| 2
X=Assessment Cell Proportions
Y=Standards Cell Proportions
Alignment Index =1 -

6. Alignment of Assessments with Standards 7th-Grade Math:Goals Study
Average Within-State Alignment = .40
Average Between-State Alignment = .39
Average State-Test-to-NCTM Alignment = .39

7. Alignment of Instruction with Assessment 8th-Grade Math:SCASS Study
Average Within-State Alignment = .22
Average Between-State Alignment = .23
Average State-to-NAPE Alignment = .39

8. Alignment of Instruction with Instruction 8th-Grade Math: SCASS Study
Average Alignment = .69

9. 7th Grade Standards
State E
State F
NCTM

10. Dimensions of Measuring Alignment
Measuring alignment of assessments to a standard vs measuring alignment more generally among instruction, curriculum materials, assessments and standards
Alignment as a function of content only vs alignment as a function of additional factors: pedagogy, item quality, consistency of philosophy, content accuracy, coherence of content
Independent individual experts vs experts operating as a group
Standards for how much is enough alignment

11. Dimensions of Quality
The dimensions, labels, and grain size of the language
The recruiting and training of experts
For measuring the enacted curriculum
Sampling of days
Sampling of students
Frequency of data collection
Observer or respondent bias
Completeness of data
Predict gains in student achievement

12. Websites for more Information on Curriculum Assessment

14. 7th-Grade Standards--Close View
Number Sense and Numeration
State E
State F
NCTM

15. 7th-Grade Standards--Close View
Data Analysis and Probability
State E
State F
NCTM

16. Response Rates for Survey
Eisenhower Longitudinal
Wave %
Wave %
Wave %
Eisenhower Cross-Sectional %
Reform Up Close %

17. Alignment to Predict Achievement Gains

18. Index Intercorrelations