FSM National Standardized Test for Teachers Science Test Evaluation

NSTT Evaluation Criteria 1. Tests assess relevant knowledge - the content tested reflects the subject area knowledge that is needed for effective teaching.

NSTT Evaluation Criteria 2. Tests assess relevant skills - the skills tested reflect the actual skills that are needed for effective teaching.

NSTT Evaluation Criteria 3. Tests Assess Higher Order Cognitive Skills - higher order cognitive skills that can be transferred to effective teaching are tested.

NSTT Evaluation Criteria 4. Tests use real world contexts - Skills, abilities and personal qualities are tested in the real world through performance.

NSTT Evaluation Criteria 5. Tests model good practice - Test items offer good models of a range of innovative and effective teaching and assessment methods.

NSTT Evaluation Criteria 6. Tests provide useful information - Test item analysis offers useful information on teachers’ strengths and weaknesses for management purposes such as promotion and Professional Development.

NSTT Evaluation Criteria 1. Tests assess relevant knowledge 2. Tests assess relevant skills 3. Tests Assess Higher Order Cognitive Skills 4. Tests use real world contexts 5. Tests model good practice 6. Tests provide useful information

Depth of Knowledge evaluation tool

What is the source of energy for the water cycle? a.volcanic eruptions b.the sun c.gravity d.electricity What level would this question from the NSTT fall under?

Depth of Knowledge evaluation tool What is the source of energy for the water cycle? a.volcanic eruptions b.the sun c.gravity d.electricity What level would this question from the NSTT fall under?

NSTT Science Evaluation Form Use the NSTT Science Evaluation Form to conduct an evaluation of at least ten test items chosen at random from the NSTT Science test. There are 68 items.

NSTT – Evaluation Form Based on your evaluation of the ten items, assign a rating from 1 (low) to 4 (high).

NSTT – Evaluation Form Evaluate the items for Depth of Knowledge. Assign a level 1 to 4 for most of the items.

NSTT – Evaluation Form Transfer your scores to the Web Profile. Blue lines are assessments, red lines are scores.

NSTT – Evaluation Form Join the dots to form a profile. The profile gives a visual representation of the strengths and weaknesses of the assessment.

NSTT – Evaluation Form We can display all the profiles and compare them. We can also combine the scores, calculate an average and produce a single profile.

NSTT Evaluation Additional considerations - establishing a pass mark - test integrity and security - re-taking the test - are all three tests of the same level of difficulty?