Group 2: 1. Miss. Duong Sochivy 2. Miss. Im Samphy 3. Miss. Lay Sreyleap 4. Miss. Seng Puthy 1 ROYAL UNIVERSITY OF PHNOM PENH INSTITUTE OF FOREIGN LANGUAGES.

Slides:



Advertisements
Similar presentations
Item Analysis.
Advertisements

Item Analysis: A Crash Course Lou Ann Cooper, PhD Master Educator Fellowship Program January 10, 2008.
Learning Objectives Copyright © 2002 South-Western/Thomson Learning Data Processing and Fundamental Data Analysis CHAPTER fourteen.
Learning Objectives 1 Copyright © 2002 South-Western/Thomson Learning Data Processing and Fundamental Data Analysis CHAPTER fourteen.
Learning Objectives Copyright © 2004 John Wiley & Sons, Inc. Data Processing, Fundamental Data Analysis, and Statistical Testing of Differences CHAPTER.
Central Tendency Mean – the average value of a data set. Add all the items in a data set then divide by the number of items in the data set.
Test Construction Processes 1- Determining the function and the form 2- Planning( Content: table of specification) 3- Preparing( Knowledge and experience)
Item Analysis What makes a question good??? Answer options?
Business Statistics: A Decision-Making Approach, 7e © 2008 Prentice-Hall, Inc. Chap 3-1 Business Statistics: A Decision-Making Approach 7 th Edition Chapter.
PPA 415 – Research Methods in Public Administration Lecture 4 – Measures of Dispersion.
ANALYZING AND USING TEST ITEM DATA
Measures of Central Tendency
Chapter 4 Measures of Central Tendency
The Data Analysis Plan. The Overall Data Analysis Plan Purpose: To tell a story. To construct a coherent narrative that explains findings, argues against.
Copyright © 2008 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved. John W. Creswell Educational Research: Planning,
Office of Institutional Research, Planning and Assessment January 24, 2011 UNDERSTANDING THE DIAGNOSTIC GUIDE.
BIOSTAT - 2 The final averages for the last 200 students who took this course are Are you worried?
0-12 Mean, Median, Mode, Range and Quartiles Objective: Calculate the measures of central tendency of a set of data.
1.3 Psychology Statistics AP Psychology Mr. Loomis.
Foundations of Educational Measurement
McMillan Educational Research: Fundamentals for the Consumer, 6e © 2012 Pearson Education, Inc. All rights reserved. Educational Research: Fundamentals.
Test item analysis: When are statistics a good thing? Andrew Martin Purdue Pesticide Programs.
10a. Univariate Analysis Part 1 CSCI N207 Data Analysis Using Spreadsheet Lingma Acheson Department of Computer and Information Science,
Tuesday August 27, 2013 Distributions: Measures of Central Tendency & Variability.
Instrumentation (cont.) February 28 Note: Measurement Plan Due Next Week.
Techniques to improve test items and instruction
DATA ANALYSIS n Measures of Central Tendency F MEAN F MODE F MEDIAN.
INVESTIGATION 1.
Thinking Mathematically
Experimental Research Methods in Language Learning Chapter 9 Descriptive Statistics.
Basic Measurement and Statistics in Testing. Outline Central Tendency and Dispersion Standardized Scores Error and Standard Error of Measurement (Sm)
Grading and Analysis Report For Clinical Portfolio 1.
Basic Statistical Terms: Statistics: refers to the sample A means by which a set of data may be described and interpreted in a meaningful way. A method.
Measures of Central Tendency. These measures indicate a value, which all the observations tend to have, or a value where all the observations can be assumed.
CHAPTER 3  Descriptive Statistics Measures of Central Tendency 1.
LECTURE CENTRAL TENDENCIES & DISPERSION POSTGRADUATE METHODOLOGY COURSE.
Sociology 5811: Lecture 3: Measures of Central Tendency and Dispersion Copyright © 2005 by Evan Schofer Do not copy or distribute without permission.
Chapter 6: Analyzing and Interpreting Quantitative Data
Summary Statistics: Measures of Location and Dispersion.
MEASURES OF DISPERSION 1 Lecture 4. 2 Objectives Explain the importance of measures of dispersion. Compute and interpret the range, the mean deviation,
Chapter 6: Interpreting the Measures of Variability.
Measures Of Central Tendency
Medical Statistics (full English class) Ji-Qian Fang School of Public Health Sun Yat-Sen University.
On stats Descriptive statistics reduce data sets to allow for easier interpretation. Statistics allow use to look at average scores. For instance,
1 STAT 500 – Statistics for Managers STAT 500 Statistics for Managers.
Central Tendency Mean – the average value of a data set. Add all the items in a data set then divide by the number of items in the data set.
Descriptive Statistics(Summary and Variability measures)
Psychometrics: Exam Analysis David Hope
Copyright © 2016 Brooks/Cole Cengage Learning Intro to Statistics Part II Descriptive Statistics Intro to Statistics Part II Descriptive Statistics Ernesto.
Introduction Dispersion 1 Central Tendency alone does not explain the observations fully as it does reveal the degree of spread or variability of individual.
Slide 1 Copyright © 2004 Pearson Education, Inc.  Descriptive Statistics summarize or describe the important characteristics of a known set of population.
Central Tendency Quartiles and Percentiles (الربيعيات والمئينات)
CHAPTER 12 Statistics.
Measures of Central Tendency
ARDHIAN SUSENO CHOIRUL RISA PRADANA P.
Intro to Statistics Part II Descriptive Statistics
Descriptive Statistics (Part 2)
Intro to Statistics Part II Descriptive Statistics
Introduction to Summary Statistics
DS5 CEC Interpreting Sets of Data
Chapter 3 Describing Data Using Numerical Measures
MEASURES OF CENTRAL TENDENCY
Test Development Test conceptualization Test construction Test tryout
Percentiles and Box-and- Whisker Plots
Using statistics to evaluate your test Gerard Seinhorst
Measures in Variability
Analyzing test data using Excel Gerard Seinhorst
CHAPTER 12 Statistics.
Lecture 4 Psyc 300A.
Tests are given for 4 primary reasons.
Presentation transcript:

Group 2: 1. Miss. Duong Sochivy 2. Miss. Im Samphy 3. Miss. Lay Sreyleap 4. Miss. Seng Puthy 1 ROYAL UNIVERSITY OF PHNOM PENH INSTITUTE OF FOREIGN LANGUAGES DEPARTMENT OF ENGLISH Mrs. San Sotheary Lecturer: Mrs. San Sotheary Subject: TM402 ACADEMIC YEAR: Topic: Interpreting Test Score

C ONTENTS I. Frequency Distribution(Puthy) II. Measures of central tendency 1. Mode 2. Median 3. Mean III. Measures of dispersion (Chivy) 1. Range 2. Standard Deviation IV. Item and Test analysis (Samphy) 1. Item difficulty 2. Item Discrimination V. Guessing (Leap) VI. Example of Test Score Interpretation 2

I.F REQUENCY DISTRIBUTION

II. M EASURES OF CENTRAL TENDENCY 1. Mode Mode refers to the score which most candidates obtained. 19,20,22,23,23,24,25,25,25, 26, 26, 26, 26, 26,27,27,27,29, 29,30,30,32,33,33,34,35 Mode =26

2. M EDIAN Odd number Median refers to the score gained by the middle candidate. Even number Median = the lowest score in the top half____ the highest score in the bottom half

2. M EDIAN (C ONT.) the bottom half 19,20,22,23,23,24,25,25,25,26,26,26, 26, 26,27,27,27,29,29,30,30,32,33,33,34,35 the top half = 26 6

3. M EAN m= mean f = frequency x = score N =number of testees = the sum of

E XAMPLE 1 m = m =56.2

E XAMPLE 2 m = m =67.4

D ISTRIBUTION OF SCORES

III. M EASURES OF DISPERSION 1. Range  measure the difference between highest and lowest score 12 Range = Highest Score – Lowest Score

2. Standard Deviation Standard Deviation (s.d) measures the degree to which the group of score deviates from the mean. s.d: standard deviation N: number of the scores d: deviation of each score from mean 13 s.d. =  d ²/N

S TEPS TO CALCULATE S.D S TEPS TO CALCULATE S.D 14

15 IV. Item and test analysis Item is the smallest unit that produces distinctive and meaningful information on a test or rating scale. Test analysis examine how the test items perform as a set. There are three tools for test analysis: item difficulty, item discrimination and item distractors.

1. Item Difficulty Item difficulty (p) is simply the percentage of students taking the test who answered the item correctly P value directly restrict the variability of the test scores P value of o. (p=0) and p value of 1.0 (p=1.0), there is no individual difference P = the number of people answering the item correctly / total number of the people answering the item

No Individual Difference Table 1 (Minimum Item Difficulty) Note. * denotes correct response GroupItem Response * ABCD Upper group 4506 Lower group 2607 P: (0+0)/30 =.00p D: (0-0)/15 =.00

No Individual Difference Table 2 (Maximum Item Difficulty) Note. * denotes correct response GroupItem Response * ABCD Upper group Lower group P : (15+15)/30 = 1.00p D : (15-15)/15 =.00

Individual Difference Table 3 (Maximum Item Difficulty) Note. * denotes correct response GroupItem Response * ABCD Upper group Lower group 2556 P: (13+5)/30 =.60p D : (13-5)/15 =.53

2.Item Discrimination One would expect people who do well on the test to answer that item correctly, and those who do poorly to answer the item incorrectly Two way can be determined the item discrimination are the item discrimination index, D and discrimination coefficients

A.Item discrimination Index, D The discrimination index, D, is the number of people in the upper group who answered the item correctly minus the number of people in the lower group who answered the item correctly, divide by the number of people in the largest of two group A good job of discrimination, when more people in the top- scoring group will have answered the item correctly. (see in table 3) A negative discrimination index, when number of lower group answered the correct item are more than upper group, thus that such a test doesn’t valid. (see in table 7)

A rule of thumb, in the terms of discrimination index -.40 and greater are very good items -.30 t0.39 are reasonably good but possibly subject to improvement -.20 t0.29 are marginal item and need some revision - below.19 are considered poor items

Table 7 (Negative Item Discrimination Index D) Note. *denotes correct response GroupItem Response * ABCD Upper group 0000 Lower group P : (0+15)/30 =.50p D : (0-15)/15 = -1.0

B.Distractors Distractors are the incorrect alternative choices in each item Items should be modified if students consistently fail to select certain multiple choice alternatives Distractors should be implausible

V. G UESSING Individual candidates approach guessing in different ways  the reliability of the subsequent scores may seriously affected. N: the correct score R: the number of correct answers w: the number of incorrect answers A: the number of options in each items 25 N= R-w/(A-1)

Simpler formula of Correct Score (N) Option per items Corrected Scores 5 R-1/4w 4 R-1/3w 3 R-1/2w 2 R-w 26

Eg: A student who has scored 61% in a test comprising multiple choice items with 4 options will have 61 correct answers and 39 incorrect. => N = 61 – 39/4-1 = 61 – 39/3 = 61 – 13 = 48 This means that the actual ability of that Ss should be 48 without guessing. 27

Compare class A and B taught by the same teacher and explain their implications for further teaching and learning. It was a progress test conducted to check Ss’ monthly progress in three month of a five month intermediate general English course. 28

I NTERPRETATION N A = N B = 25 Mean B > Mean A => Class B outperform Class A S.d B > S.d A => Class B is Heterogeneous Bottom 4 A < Bottom 4 B => Use cooperative learning in Class B Mean is respectively low in both class A and B => Find out what the main causes of the low performances are and take solution especially Class A. 30

31