Assessment Item Types: SA/C, TF, Matching

Assessment Item Types Objective Assessments Objective Assessments Performance Assessments Performance Assessments

Objective Assessments Highly structured Highly structured Require examinee to supply a word or two, or to select the correct answer from a list of alternatives Require examinee to supply a word or two, or to select the correct answer from a list of alternatives Generally, there is only one correct answer Generally, there is only one correct answer Scoring is typically dichotomous Scoring is typically dichotomous

Performance Assessments Examinee required to select, organize, and present the answer (i.e. essay) Examinee required to select, organize, and present the answer (i.e. essay) Examinee required to use equipment, make observations, develop hypothesis, build something, or perform for an audience. Examinee required to use equipment, make observations, develop hypothesis, build something, or perform for an audience. Usually no single answer or “best” response. Usually no single answer or “best” response. Scoring is typically polytomous and requires expert judgment. Scoring is typically polytomous and requires expert judgment.

Which do I use? There is no conflict between the two types. There is no conflict between the two types. Type used depends on the learning objectives. Type used depends on the learning objectives. “The law of the instrument” “The law of the instrument”

Objective Assessments Two Categories Supply type Supply type –Short answer –Completion Selection type Selection type –True-false or alternative response –Matching –Multiple choice

Short Answer/Completion

Best suited to knowledge level objectives Best suited to knowledge level objectives Presented in the form of a question or an incomplete statement: Presented in the form of a question or an incomplete statement: What is the name of the man who invented the steamboat? The name of the man who invented the steamboat is __________ The name of the man who invented the steamboat is __________

Short Answer/Completion Advantages: Advantages: –Easy to construct –Students must supply the answer (i.e. recall memory), thus reducing measurement error due to guessing.

Short Answer/Completion Disadvantages Disadvantages –Unsuitable for measuring complex learning –Difficulty in scoring: Level of specificity Level of specificity “Where was George Washington born?” Spelling Spelling

Short Answer/Completion Suggestions for Development Suggestions for Development –Word the item so the required answer is both brief and specific. –An animal that eats the flesh of other animals is _______ –An animal that eats the flesh of other animals is classified as _______

Short Answer/Completion Suggestions for Development Suggestions for Development –Do not take statements directly from the textbooks to use as a basis for short- answer items. –Chlorine is a _________ –Chlorine belongs to a group of elements that combine with metals to form salts. It is therefore classified as a _______

Short Answer/Completion Suggestions for Development Suggestions for Development –A direct question is generally more desirable than an incomplete statement. –John Glenn made his first orbital flight around the earth in _______ –When did John Glenn make his first orbital flight around the earth? _______ –In what year did John Glenn make his first orbital flight around the earth? _______

Short Answer/Completion Suggestions for Development Suggestions for Development –If the answer is to be expressed in numerical units, indicate the type of answer required. –If oranges weigh 5 2/3 oz. each, how much will a dozen oranges weigh? _______ –If oranges weigh 5 2/3 oz. each, how much will a dozen oranges weigh? ____ lb. ____ oz.

Short Answer/Completion Suggestions for Development Suggestions for Development –On completion items, do not use too many blanks or let the blanks provide clues. –____ animals that are born ___ and ___ their young are called _______ –Warm-blooded animals that are born alive and suckle their young are called _______ –The legislative branches of the U.S. government are the ______ and the ____ __ _______

TRUE/FALSE AND MATCHING ITEMS

T/F Best suited to knowledge level objectives. Best suited to knowledge level objectives. Presented in the form of a statement. Presented in the form of a statement. T FThe earth is a planet.

T/F Advantages: Advantages: –Efficient –Can assess a lot of material in a short time –Ease of construction (yea, right).

T/F Disadvantages Disadvantages –Unsuitable for measuring beyond knowledge level learning. –Measurement error due to guessing. –Response sets (i.e. a consistent tendency to follow a pattern in responding to items). –Specific Determiners (e.g. never, always)

T/F Suggestions for Development Suggestions for Development –Avoid broad general statements if they are to be judged true or false. “The president of the United States is elected to that office.”

T/F Suggestions for Development Suggestions for Development –Avoid trivial statements “Harry S. Truman was the 33 rd president of the United States”

T/F Suggestions for Development Suggestions for Development –Avoid the use of negative statements, especially double negatives. “None of the steps in the experiment was unnecessary” “All of the steps in the experiment were necessary”

T/F Suggestions for Development Suggestions for Development –Avoid long, complex sentences. “Despite the theoretical and experimental difficulties of determining exact pH value of a solution, it is possible to determine whether a solution is an acid by the red color formed on litmus paper when it is inserted into the solution.” “Litmus paper turns red in an acid solution.”

T/F Suggestions for Development Suggestions for Development –Avoid including two ideas in one statement. (AKA double barreled questions). “A worm cannot see because it has simple eyes.” “Whales are mammals because they are large.”

T/F Suggestions for Development Suggestions for Development –Avoid using opinion that is not attributed to some source, unless the ability to measure opinion is being specifically measured. “Adequate medical care can be best provided through socialized medicine.” “The AMA favors socialized medicine as the best means of providing adequate medical care.”

T/F Suggestions for Development Suggestions for Development –Try to keep all items similar in length, i.e. don’t let a long statement be true and short ones false. –Try to have approximately the same number of true and false items.

Matching Composed of a premise (i.e. event, function, definition) and a response (i.e. date, part, term). Composed of a premise (i.e. event, function, definition) and a response (i.e. date, part, term). Examinee is to match the response to the appropriate premise. Examinee is to match the response to the appropriate premise.

Matching Advantages: Advantages: –Compact –Can assess a lot of material in a short time –Ease of construction (yea, right).

Matching Disadvantages Disadvantages –Unsuitable for measuring beyond knowledge level learning. –Measurement error due to guessing and irrelevant clues. –Difficulty in finding homogenous material.

Matching Suggestions for Development Suggestions for Development –Use only homogenous material in a single matching exercise 1. Invented telephoneA. Washington 2. Discovered AmericaB. John Glenn 3. First to orbit earthC. Columbus 4. First president of U.S.D. Alexander Bell

Matching Suggestions for Development Suggestions for Development –Include an unequal number of responses and premises, and instruct the examinee that the responses may be used once, more than once, or not at all. –Keep the list of items to be matched brief, and place the shorter responses on the right. –Indicate in the directions the basis for matching the responses and premises.

Matching Suggestions for Development Suggestions for Development –Arrange the list of responses in logical order. Place words in alphabetical order and numbers in sequence. –Place all of the items for one matching exercise on the same page.

Your Assignment Three short-answer/completion Three short-answer/completion Three T/F Three T/F Five matching. Five matching.