Assessment CLEAR & UNAMBIGUOUS
What is the purpose of your assessment? *************************************** To evaluate of overall proficiency? For placement of Ss? To measure achievement within a course?
2. What are the Objectives? forms, functions, language abilities?
3. How will the test specification reflect the purpose & objectives? How will each objective be weighted? Points 1, 2, & 3 = ‘VALIDITY’
4. How will test tasks be selected & arranged? Practical Mirror tasks practiced previously (Content VALIDITY) Should be able to be evaluated reliably(by T or scorer) Tasks authentic Task arrangement biased for best performance
5. What kind of scoring, feedback is expected? Letter grade Holistic score T provided Substantive washback
TYPES OF TESTS Aptitude Proficiency-measure performance against a norm(TOEFL) gate-keeping Diagnostic-aware of errors & encourage adoption of compensatory strategies Placement Achievement
ACHIEVEMENT TESTS Specifications Determined by Objectives of Lesson, Unit, Course Importance assigned to each objective Tasks employed in lessons of unit/course Extent to which assessment lends itself to formative washback Practicality
Midterm Exam Outline for High-Int Section A VOCAB Match word to definition(5 items) Use words in a sentence(5 items) Section B GRAMMAR Error detection-underline/circle error(10 items) Section C READING COMPREHENSION 2 one-paragraph passages(4 short answer items each) Section D WRITING Respond to 2 paragraph article about Native Americans Weddings
PURPOSE OF ASSESSMENT What do you want you Ss: to be able to do? to know?
CLASS CONTEXT: Intermediate Integrated Skills Class Emphasis on Social Conversation OBJECTIVES: 1.Performance Elicited (Ss will distinguish btw /nk/ & /ng/) 2.Targeted Linguistic Domain (listening)
Form Focused Objectives(Listening and Speaking) Ss will 1.Recognize and produce tag questions, with correct grammatical form and final intonation pattern, in simple social conversations. 2.Recognize and produce wh-information questions with correct final intonation pattern.
Communication Skills (Speaking) Ss will 3. State completed actions and events in a social conversation 4. Ask for confirmation in a social conversation 5. Give opinions in an event in a social conversation 6. Produce language with contextually appropriate intonation, stress, and rhythm
Reading Skills (simple essay or short story) Ss will 7. Recognize irregular past tense of selected verbs in an essay or short story Writing Skills (simple essay or short story) Ss will 8. Write a one-paragraph story about a simple event in the past 9. Use conjunctions so and because in a statement of opinion
TEST SPECIFICATIONS a. outline of test b. what skills will be tested c. what items will look like You have: -30 minutes -12 students to assess -an integrated curriculum(all 4 skills)
Elicitation Method ORAL(Ss listens)WRITTEN(Ss reads) Word, pair of words Sentence(s), question Direction Monologue, speech Pre-recorded conversation Interactive(live) dialogue Word, pair of words Sentence(s), question Direction Paragraph Essay, excerpt Short story, book Response Mode ORAL WRITTEN Repeat Read aloud Yes/no Short response Describe Role-play Monologue (speech) Interactive dialogue mark fill in the blank option Fill-in-the-blank Spell a word Define a term(with a phrase) Short answer (2-3 sentences) Essay
Objectives--Ss will: 1.Recognize and produce tag questions, with correct grammatical form and final intonation pattern, in simple social conversations. 2.Recognize and produce wh-information questions with correct final intonation pattern. 3.State completed actions and events in a social conversation 4.Ask for confirmation in a social conversation 5.Give opinions in an event in a social conversation 6.Produce language with contextually appropriate intonation, stress, and rhythm 7.Recognize irregular past tense of selected verbs in an essay or short story 8.Write a one-paragraph story about a simple event in the past 9.Use conjunctions so and because in a statement of opinion
TEST SPECIFICATIONS Speaking(5 minutes per S on previous day) Format: Oral interview, T and S Task: T asks questions of S (Objectives 3, 5 emphasis 6) Listening (10 minutes) Format: T makes audio recording in advance w/1 other voice on it Task: 5 minimal pair items, multiple choice (Objective 1) 5 interpretation items, multiple choice (Objective 2) Reading (10 minutes) Format: cloze test items (10 total) in a story line Task: fill-in-the-blank (Objective 7) Writing (10 minutes) Format: prompt for a topic: why I liked/didn’t like a recent TV series Task: writing a short opinion paragraph (Objective 9)
Oral Interview Format A. Warm up: questions & Comments B. Level Check Question(OBJECTIVES: 3,5,6) 1.Tell me what you did last weekend. 2.Tell me about an interesting trip you took last year. 3. How did you like the TV show we saw last week? C. Probe (OBJECTIVES: 5,6) 1.What is your opinion about______?(news event) 2.How do you feel about______?(other news event) D. Wind down: comments & reassurance
Listening Part A--Listen to the recording and choose the sentence on your test that is closest in meaning to the sentence you heard. VOICE: They sure made a mess at that party, didn’t they? S reads: a. They didn’t make a mess, did they? b. They did make a mess, didn’t they? Listening Part B--Listen to the recording and choose the sentence on your test that is closest in meaning to the sentence you heard. Voice: Where did Suleyman go after the party? S reads: a. Yes, he did. b. Because he was tired. c. To Pelcim’s house for another party. d. He went home around eleven o’clock.
To capture only the OBJECTIVES you’ve focused on: Interview & Writing—Need a RUBRIC to score (holistic & a simple analytic scale) Listening section B—Creating/Using Audio isv logistically difficult. Read ‘VOICE’ instead. d. Around eleven o’clock. Interview-follow-up questions for one word or very short answers. Writing prompt--Name one of the characters at the party in the sitcom we saw. Use the word so at least once and the word because at least once to tell why you did/didn’t like that person.