Measuring Complex Achievement: Essay Questions

Slides:



Advertisements
Similar presentations
Understanding by Design Day 2 Roosevelt Complex Secondary Science Training.
Advertisements

Assessment Adapted from text Effective Teaching Methods Research-Based Practices by Gary D. Borich and How to Differentiate Instruction in Mixed Ability.
Performance Tasks for English Language Arts
On-Demand Writing Assessment
IPM Exam PreparationIPM Exam Preparation November 12 th pm – 5.15pm 2 hours & 15 minutes reading time.
Designing Scoring Rubrics. What is a Rubric? Guidelines by which a product is judged Guidelines by which a product is judged Explain the standards for.
MODULE 3 1st 2nd 3rd. The Backward Design Learning Objectives What is the purpose of doing an assessment? How to determine what kind of evidences to.
Developing Rubrics Presented by Frank H. Osborne, Ph. D. © 2015 EMSE 3123 Math and Science in Education 1.
Lamar State College-Port Arthur February 16 & 17, 2011.
The Personal Statement: Strategies for Supporting Students
HOW TO EXCEL ON ESSAY EXAMS San José State University Writing Center Dr. Jim Lobdell.
Agung Is Hardiyana F Novian Zaini. Primarily caused by dissatisfaction to the traditional tests, which are lack of:  Validity  Authenticity.
Dr. Robert Mayes University of Wyoming Science and Mathematics Teaching Center
Assessing and Evaluating Learning
KPIs: Definition and Real Examples
Classroom Assessment A Practical Guide for Educators by Craig A. Mertler Chapter 9 Subjective Test Items.
Classroom Test and Assessment
Testing Writing. We have to : have representative sample of the tasks that we expect the students to perform. those task should elicit valid samples of.
ASSESSMENT OF ESSAY TYPE QUESTIONS. CONSTRUCTING QUESTIONS Construct questions that test HIGHER LEVEL PROCESSES SUCH AS Construct questions that test.
Assessment Basics and Active Student Involvement.
Essay Assessment Tasks
Formulating objectives, general and specific
Descriptive and Causal Research Designs
TEXAS TECH UNIVERSITY HEALTH SCIENCES CENTER SCHOOL OF PHARMACY KRYSTAL K. HAASE, PHARM.D., FCCP, BCPS ASSOCIATE PROFESSOR BEYOND MULTIPLE CHOICE QUESTIONS.
The Comprehensive School Health Education Curriculum:
Preparing our students for the EAP English Prompt.
Becoming a Teacher Ninth Edition
Portfolios.
Classroom Assessments Checklists, Rating Scales, and Rubrics
Classroom Assessment A Practical Guide for Educators by Craig A
What Makes an Essay an Essay. Essay is defined as a short piece of composition written from a writer’s point of view that is most commonly linked to an.
EDU 385 Education Assessment in the Classroom
CONSTRUCTING OBJECTIVE TEST ITEMS: MULTIPLE-CHOICE FORMS CONSTRUCTING OBJECTIVE TEST ITEMS: MULTIPLE-CHOICE FORMS CHAPTER 8 AMY L. BLACKWELL JUNE 19, 2007.
Understanding PARCC and Disciplinary Literacy November
Technology in the classroom. UM weather Great way to begin a day or class –Links to 300 weather sites –Links to 700 web cams to view weather –Radar and.
Measuring Complex Achievement
EDU 385 Education Assessment in the Classroom
Session 2 Traditional Assessments Session 2 Traditional Assessments.
Writing Supply Items Gronlund, Chapter 8. Supply Type Items Require students to supply the answer Length of response varies –Short-answer items –Restricted-response.
Preparing Effective Essay Questions Bryan Bradley Center for Teaching and Learning January 21, 2010
Performance Assessment OSI Workshop June 25 – 27, 2003 Yerevan, Armenia Ara Tekian, PhD, MHPE University of Illinois at Chicago.
ASSESSING STUDENT ACHIEVEMENT Using Multiple Measures Prepared by Dean Gilbert, Science Consultant Los Angeles County Office of Education.
Performance Appraisal
SHOW US YOUR RUBRICS A FACULTY DEVELOPMENT WORKSHOP SERIES Material for this workshop comes from the Schreyer Institute for Innovation in Learning.
Assessment Specifications Gronlund, Chapter 4 Gronlund, Chapter 5.
Assessment and Testing
Facilitate Group Learning
Major Science Project Process A blueprint for experiment success.
Criterion-Referenced Testing and Curriculum-Based Assessment EDPI 344.
What is a Rubric? A rubric is a set of scoring criteria for a performance task. A rubric also serves as a blueprint for the student to use in constructing.
Assessment Basics and Active Student Involvement Block II.
Classroom Assessment A Practical Guide for Educators by Craig A. Mertler Chapter 4 Overview of Assessment Techniques.
Educational Methods The bag of tricks Direct Instruction/Lecture ä Advantages ä Teacher controlled ä Many objectives can be mastered in a short amount.
Essay Questions. Two Main Purposes for essay questions 1. to assess students' understanding of and ability to think with subject matter content. 2. to.
Using Multiple Measures ASSESSING STUDENT ACHIEVEMENT.
Students Assessment: Essay Type Questions. Dr. G. U. Kavathia Associate Professor in Microbiology, P. D. U. Govt. Medical college, Rajkot.
Chapter 6 Assessing Science Learning Updated Spring 2012 – D. Fulton.
25 minutes long Must write in pencil Off topic or illegible score will receive a 0 Essay must reflect your original and individual work.
 Good for:  Knowledge level content  Evaluating student understanding of popular misconceptions  Concepts with two logical responses.
Assessment in Education ~ What teachers need to know.
Copyright © Springer Publishing Company, LLC. All Rights Reserved. DEVELOPING AND USING TESTS – Chapter 11 –
Presentation by: Muhammad Riaz Anjum Nasir Mahmood PRESENTATION WRITING ESSAY TYPE QUESTIONS.
Classroom Assessments Checklists, Rating Scales, and Rubrics
Classroom Assessment A Practical Guide for Educators by Craig A
Performance Assessment Development
EDU 385 Session 8 Writing Selection items
Classroom Assessments Checklists, Rating Scales, and Rubrics
Classroom test and Assessment
What Are Rubrics? Rubrics are components of:
Testing Schedule.
Presentation transcript:

Measuring Complex Achievement: Essay Questions Chapter 10 Jessica Rigsby

Objectives for Chapter 10 Discuss the use of essay questions Compare two types of essay questions Hypothesize the advantages and disadvantages of using essay questions Compare two types of scoring rubrics Evaluate sample essays using a scoring rubric Create examples of two types of essay questions

What’s So Great About Essay Questions? They allow assessment of students’ abilities to: Formulate problems Organize, integrate, and evaluate ideas and information Apply knowledge and skills

Forms and Uses of Essay Questions May be used to measure knowledge of factual information Full potential realized with more higher-order thinking problems

Useful in meeting learning outcomes concerned with the abilities to conceptualize, construct, organize, integrate, relate, and evaluate ideas in content areas such as: history, civics, literature, science, math, etc. Most widely used when the main focus is on student writing in any subject Examples: distinguishing between narrative essays, expository essays, and persuasive essays or focusing on writing process

Confucius Say… The freedom of response provided by essay questions is not an all-or-nothing affair but, rather, a matter of degrees. Restricted Response Extended- Response

Restricted Response Essay Questions Usually limits both the content and the response by restricting the scope of the topic to be discussed, generally indicated in the question Useful for measuring learning outcomes requiring interpretation and application of data in a specific area Any outcomes measured by an objective interpretive exercise can be measured by a restricted response essay question

Examples of Restricted Response Essay Questions Describe two situations that demonstrate the application of the law of supply and demand. Do not use those examples discussed in class. State the main differences between the Vietnam War and previous wars in which the United States has participated. Why is the barometer one of the most useful instruments for forecasting weather? Answer in a brief paragraph.

Is there a better method for evaluating complex achievement… The Restricted Response essay question provides for more ease of assessment, but it restricts the scope of the topic to be discussed and indicates the nature of the desired response to the student which limits his or her opportunity to demonstrate these behaviors on their own. Is there a better method for evaluating complex achievement…

Extended-Response Essay Questions Freedom of response allows student to select information that they think is pertinent, to organize the answer in accordance with their best judgment, and to integrate and evaluate ideas as they deem appropriate Places value on higher-order thinking skills

Examples of Extended-Response Essay Questions Imagine that you and a friend found a magic wand. Write a story about an adventure that you and your friend had with the magic wand. Compare developments in international relations in the administrations of President William Clinton and President George W. Bush. Cite examples when possible.

To Keep Things Simple… Objective Interpretive- select Restricted Response Essay- supply Extended-Response Essay- write

Pros & Cons of Essay Questions Apply your knowledge They give student the options to chose what they want to write about reasoning The teacher can tell if the student studies or not Can often prepare in advance what to write Time consuming Grading: grammar usage vs. content Legibility Hard to formulate ideas in time Takes longer to grade

How Can We Change Those Cons to Pros? Unreliability- clearly defining learning outcomes to be measured, properly framing questions, carefully following scoring rules, and obtaining practice in scoring Amount of time- reserve use of extended-response questions for learning outcomes that cannot be measured well objectively

Limited Sampling- try to obtain as representative a sample of learning outcomes as possible (accumulate a series of essays throughout the school year to be included in a writing portfolio)

Suggestions for Constructing Essay Questions Restrict use of essays to learning outcomes that cannot be measured well objectively Construct questions that call forth skills specified in learning standards Example box on page 235

Phrase the question so that the students’ task is clearly indicated Example: Poor: Compare the Democratic and Republican parties.

Better: Compare the current policies of the Democratic and Republican parties with regard to the role of government in private business. Support your statements with examples when possible. (Your answer should be confined to two pages. It will be evaluated in terms of the appropriateness of the facts and examples presented and the skill with which it is organized.)

Now that we have essay questions how do we score them? Indicate an approximate time limit for each question Avoid the use of optional questions Example Box page 239 Now that we have essay questions how do we score them?

Scoring Essay Questions Tips to remember… Use clear specifications of scoring criteria Inform students of scoring criteria Use an initial review to find “anchor” responses for comparison Use descriptive rather than judgmental scores or levels (“writing is clear and thoughts are complete” vs. “excellent”)

Scoring for Restricted Response Essay Questions In most instances, the teacher should write an example of an expected response For example, if the student is asked to describe three factors that contributed to the start of the Civil War, the teacher would construct a list of acceptable reasons and give the student 1 point for each of up to three reasons given from the list

Scoring for Extended-Response Essay Questions Analytic Scoring Rubrics Consist of a rubric broken down into key dimensions that will be evaluated Enables teacher to focus on one characteristic of a response at a time Provides maximum feedback for students

Holistic Scoring Rubrics Yield a single overall score taking into account the entire response Can be used to grade essays more quickly Does not provide as much specific feedback as analytic rubric Should not consist of scores alone, but rather contain scores accompanied by statements of the characteristics of the response Example Table 10.3 and 10.4

Suggestions for Scoring Essay Questions Prepare an outline of the expected answer in advance and use a clear scoring rubric Use the scoring rubric that is most appropriate Decide how to handle factors that are irrelevant to the learning outcomes being measured

Evaluate all responses to one question before going on to the next one When possible, evaluate answers without looking at the student’s name If especially important decisions are to be based on the results, obtain two or more independent ratings Look out for bluffing! Page 247