Dr. Marciano B. Melchor University of Ha’il, KINGDOM OF SAUDI ARABIA May 2013.

Slides:



Advertisements
Similar presentations
Assessing Student Performance
Advertisements

Performance Assessment
Using Text Effectively in the Biology Classroom
A didactic plan for a communicative translation class Dr. Constanza Gerding Salas Leipzig Universität - Universidad de Concepción May 2012.
Michigan Assessment Consortium Common Assessment Development Series Putting Together The Test Blueprint.
Designing Instruction Objectives, Indirect Instruction, and Differentiation Adapted from required text: Effective Teaching Methods: Research-Based Practice.
Using Multiple Choice Tests for Assessment Purposes: Designing Multiple Choice Tests to Reflect and Foster Learning Outcomes Terri Flateby, Ph.D.
(IN)FORMATIVE ASSESSMENT August Are You… ASSESSMENT SAVVY? Skilled in gathering accurate information about students learning? Using it effectively.
TWS Aid for Scorers Information on the Background of TWS.
Educational Outcomes: The Role of Competencies and The Importance of Assessment.
Seminar /workshop on cognitive attainment ppt Dr Charles C. Chan 28 Sept 2001 Dr Charles C. Chan 28 Sept 2001 Assessing APSS Students Learning.
Challenge Question: Why is being organized on the first day of school important? Self-Test Questions: 1.How do I get my classroom ready? 2.How do I prepare.
Principles of High Quality Assessment
Understanding Validity for Teachers
Science Inquiry Minds-on Hands-on.
Classroom Assessment A Practical Guide for Educators by Craig A
Developing Evaluation Instruments
Principles of Assessment
Joanna O. Masingila Dana Olanoff Dennis Kwaka.  Grew out of 2010 AMTE symposium session about preparing instructors to teach mathematics content courses.
Subject Matter Expert/Author: Assoc. Prof. Dr Rashid Johar (OUM) Faculty of Science and Foundation Studies Copyright © ODL Jan 2005 Open University Malaysia.
Building Effective Assessments. Agenda  Brief overview of Assess2Know content development  Assessment building pre-planning  Cognitive factors  Building.
Chapter 8 Measuring Cognitive Knowledge. Cognitive Domain Intellectual abilities ranging from rote memory tasks to the synthesis and evaluation of complex.
ASSESSMENT OF STUDENT LEARNING Manal bait Gharim.
1 Issues in Assessment in Higher Education: Science Higher Education Forum on Scientific Competencies Medellin-Colombia Nov 2-4, 2005 Dr Hans Wagemaker.
Teaching Today: An Introduction to Education 8th edition
Week 5 Lecture 4. Lecture’s objectives  Understand the principles of language assessment.  Use language assessment principles to evaluate existing tests.
Evelyn Wassel, Ed.D. Summer  Skilled in gathering accurate information about students learning?  Using it effectively to promote further learning?
Assessment Specifications Gronlund, Chapter 4 Gronlund, Chapter 5.
Assessing in the Cognitive Domain KNR 341 Chapter 8 Dr. Henninger.
Lecture by: Chris Ross Chapter 7: Teacher-Designed Strategies.
What the*!?# is an SLO? Workshop on Student Learning Outcomes For De Anza College Faculty.
Assessment and Testing
Planning for Assessment Taxonomies It is the classification of levels of intellectual behavior which is important to learning Formative Assessment Summative.
An Integral Part of Professional Learning Communities.
Changes in Professional licensure Teacher evaluation system Training at Coastal Carolina University.
Standards-Based Science Assessment. Ohio’s Science Cognitive Demands Science is more than a body of knowledge. It must not be misperceived as lists of.
Instructional Leadership: Planning Rigorous Curriculum (What is Rigorous Curriculum?)
Revised Bloom’s Taxonomy Designing Aligned Instruction.
Defining & Aligning Local Curriculum. What is Curriculum? Individually consider your personal definition of the term curriculum What words do you think.
The definition of table of specification. Table of specification is a chart that provides graphic representations of a related to the content of a course.
Writing Learning Outcomes Best Practices. Do Now What is your process for writing learning objectives? How do you come up with the information?
Testing & Measurement  Criterion-Referenced Tests.  Pre-tests  Post-tests  Norm-Referenced Tests.
Teacher Work Sample. Lectures Objectives: 1.Define the teacher work sample. 2.Integrate lesson plans with a practice Teacher Work Sample in terms of the.
Understanding Standards: Advanced Higher Event
D2L Refresher Upload content into the Content section in a D2L course
Educational Assessments – Sound Design
SECTION 3 Grading Criteria
Assessment and Evaluation
Formative and Summative Assessment
Concept of Test Validity
Classroom Assessment A Practical Guide for Educators by Craig A
ASSESSMENT OF STUDENT LEARNING
Welcome.
What is Deep Learning? Motivational Context Active Learning
Classroom Assessment Validity And Bias in Assessment.
Eileen Herteis The Gwenna Moss Teaching & Learning Centre
Prepared by: Toni Joy Thurs Atayoc, RMT
Instructional Learning Cycle:
Assessment 101 Zubair Amin MD MHPE.
Topic Principles and Theories in Curriculum Development
Classroom Assessment A Practical Guide for Educators by Craig A. Mertler Chapter 8 Objective Test Items.
Critically Evaluating an Assessment Task
Exploring Assessment Options NC Teaching Standard 4
Writing Learning Outcomes
Parent-Teacher Partnerships for Student Success
Learning Assessment Learning Teaching Dr. Md. Mozahar Ali
Validity and Reliability II: The Basics
In The Name Of the Most High
HS Physical Science Spring 2017
EDUC 2130 Quiz #10 W. Huitt.
Presentation transcript:

Dr. Marciano B. Melchor University of Ha’il, KINGDOM OF SAUDI ARABIA May 2013

A Table of Specifications is a two-way chart which describes the topics to be covered by a test and the number of items or points which will be associated with each topic.

 Kubiszyn & Borich, (2003) emphasized the following significance and components of TOS: 1. A Table of Specifications consists of a two- way chart or grid relating instructional objectives to the instructional content. The column of the chart lists the objectives or "levels of skills" (Gredlcr, 1999) to be addressed; The rows list the key concepts or content the test is to measure.

According to Bloom, et al. (1971), "We have found it useful to represent the relation of content and behaviors in the form of a two dimensional table with the objectives on one axis, the content on the other”.

2. A Table of Specifications identifies not only the content areas covered in class, it identifies the performance objectives at each level of the cognitive domain of Bloom's Taxonomy. Teachers can be assured that they are measuring students' learning across a wide range of content and readings as well as cognitive processes requiring higher order thinking.

3. A Table of Specifications is developed before the test is written. In fact it should be constructed before the actual teaching begins.

4. The purpose of a Table of Specifications is to identify the achievement domains being measured and to ensure that a fair and representative sample of questions appear on the test.

Carey (1988) pointed out that the time available for testing depended not only on the length of the class period but also on students' attention spans.

1. A true-false test item takes 15 seconds to answer unless the student is asked to provide the correct answer for false questions. Then the time increases to seconds. 2. A seven item matching exercise takes seconds.

3. A four response multiple choice test item that asks for an answer regarding a term, fact, definition, rule or principle (knowledge level item) takes 30 seconds. The same type of test item that is at the application level may take 60 seconds.

4. Any test item format that requires solving a problem, analyzing, synthesizing information or evaluating examples adds seconds to a question.

5. Short-answer test items take seconds. 6. An essay test takes 60 seconds for each point to be compared and contrasted.

If an individual can perform the most difficult aspects of the objective, the instructor can "assume" the lower levels can be done. However, if testing the lower levels, the instructor cannot "assume" the individual can perform the higher levels.

The cornerstone of classroom assessment practices is the validity of the judgments about students’ learning and knowledge. A TOS is one tool that teachers can use to support their professional judgment when creating or selecting test for use with their students.

In order to understand how to best modify a TOS to meet your needs, it is important to understand the goal of this strategy: improving validity of a teacher’s evaluations based on a given assessment. Validity is the degree to which the evaluations or judgments we make as teachers about our students can be trusted based on the quality of evidence we gathered (Wolming & Wilkstrom, 2010).

From the literatures we have known that standardized tests are valid. The question needs to he asked if GPAs are a valid measures of student achievement? GPAs are based in large measure on teacher made tests. If teacher made tests are not valid, how can a students GPA be valid? The use of a Table of Specifications can provide teacher made tests validity (Notar, Charles, 2004).

Lei, Bassiri and Schultz,(2001) found that a college GPA was an unreliable predictor of student achievement. Since we assume that norm referenced tests are valid measures, the tendency is to put more weight on those results concerning student achievement.

According to Ooster (2003) the faculty made tests will likely have poor content validity, "cause for concern because each assessment instrument depends on its validity more than on any other factor."

A Table of Specifications benefits students in two ways. First, it improves the validity of teacher-made tests. Second, it can improve student learning as well.

A Table of Specifications helps to ensure that there is a match between what is taught and what is tested. Classroom assessment should be driven by classroom teaching which itself is driven by course goals and objectives. Tables of Specifications provide the link between teaching and testing. (University of Kansas, 2013)

Teachers can collaborate with students, teachers or colleagues on the construction of the Table of Specifications:  what are the main ideas and topics,  what emphasis should be placed on each topic,  what should be on the test? Open discussion and negotiation of these issues can encourage higher levels of understanding while also modeling good learning and study skills.

THANK YOU …..