Rod Johnson & Sandra Johnson Assessment Europe Generalise not specialise: design implications for a national assessment bank

Some history

Original AAP database

Re-conceptualisation

Assessment materials Variety of subjects and formats – suitable for pupils aged 7 to 14 Pencil & paper and practical Several years’ of materials resource to be recovered Existing AAP materials used to initially populate the 5-14 National Assessment bank

Example 1

Example 2

Example 2 continued

Example 3

A generalised ontology for storing assessment materials

Example 4: single-item task

Example 2 Section C: multi-item subtask

Example 3 revisited: multi- subitem single-item task

Example 5: a 2-item task

Key question What should properly be stored in the assessment bank?

Our answer Task images Resource materials Descriptive metadata but not Marking details Test construction algorithms Statistical metadata

Distributed information system architecture