1. Test developers’ competencies and quality assurance on test development

2. Steps for development and evaluation of an instrument - Revision
Clarify the purposes of the assessment
Identify population
Identify variables being measured (content of the test)
Identify test conditions
Establish Test blue print
Develop test and write scoring guideline
Panel and revise (First revision)
Produce tests for piloting
Pilot and evaluate item quality
Revise the items (second revision)
Assembly of test version for trial
Conduct trial and evaluate item quality
Assembly of the final test version
These are the steps for development of a set of items measuring a scale. The topic that I present today fall into the step “Psychometric evaluation of the item set for measuring a scale. This step should follow test administration, data entry and data cleaning. The reason for doing this is to inform the test developers if there is any times that do not do a good job and make sure the test items measuring a scale have good quality and that we can confidently produce our final test. In many cases, even after we administer the final test, before reproting it is sometimes necessary to have anther check of item properties.

3. Test developers’ tasks, competencies and quality assurance
What are the knowledge and skills test developers should have in order to do this task well?
How to conduct quality assurance of this task?
Clarify the purposes of the assessment
Identify population
Identify variables being measured (content of the test)
Identify test conditions
Establish Test blue print
Develop test and write scoring guideline
Panel and revise (First revision)
Produce tests for piloting
Pilot and evaluate item quality
Revise the items (second revision)
Assembly of test version for trial
Conduct trial and evaluate item quality
Revise and assembly of the final test version

4. Identifying needs for capacity building
Evaluation
Self evaluation

5. Self-Assessment questionnaire for test developers
To what extent can you perform this task?
Please put a tick on the appropriate cell.
I have not done this before
I have some experience but still not confident
I have good knowledge and skills to perform this task. I just need to update my knowledge and skills
I am on top of this task and can train others
Identify the purposes of the assessment
Identify population
Identify variables being measured (content of the test)
Identify test conditions
Establish Test blue print
Develop test items and write scoring guideline
Panel and revise (First revision)
Produce tests for piloting
Pilot and evaluate item quality
Revise the items (second revision)
Assembly of test version for trial
Conduct trial and evaluate item quality
Assembly of the final test version