1. Comparing TOEIC® and vocabulary test scores
Masaya Kanzaki
Kanda University of International Studies
METHOD
3. Correlations
3-1. TOEIC listening, reading and speaking tests
3-2. VLT VST
3-4. VLT vs. VST
3-5. TOEIC vs. VLT & VST
4. Scatterplots
4-1. TOEIC L vs. VLT TOEIC L vs. VST
4-3. TOEIC R vs. VLT TOEIC R vs. VST
4-5. TOEIC S vs. VLT TOEIC S vs. VST
To compare the results of three types of TOEIC® tests and two types of vocabulary tests and see how well they correlate with each other L R
L+R S 1
.69*
.90*
.50*
.93*
.47*
.52*
*p < .001
Participants
82 students attending a private university in the Kanto area (10 male, 72 female)
Year: 64 2nd year, 14 3rd year, 4 4th year
Major: 20 English, 2 Chinese, 48 International Communication, 12 International Business Career
First language: 79 Japanese, 3 Chinese
Materials
1. TOEIC listening test (L)
100 multiple-choice questions, 45 minutes, score range: 5-495
2. TOEIC reading test (R)
100 multiple-choice questions, 75 minutes, score range: 5-495
3. TOEIC speaking test (S)
Computer-based, 20 minutes, score range: 0-200
4. Vocabulary Levels Test (VLT)
Schmitt (2000) Version 1, 2000 level, 3000 level, 5000 level, Academic word level, 30 questions per level, 120 questions in total
5. Vocabulary Size Test (VST)
20,000 version, which was developed from the original 14,000 version (Nation and Beglar, 2007), Version A 1-40 and Version B 1-40, 80 questions in total
VLT2000
VLT300
VTL5000
VLT AW 1
.59*
.56*
.62*
VLT3000
.72*
.65*
*p < .001
VST A
VST B
.47*
*p < .001
Part 1
Part 2
Part 3
Part 4
Photographs 10 questions
Question-response 30 questions
Conversations 30 questions
Short talks 30 questions
VLT2000
VLT300
VTL5000
VLT AW
VLT All
VST A
.41*
.42*
.33*
.34*
.43*
VST B
.52*
.58*
.61*
.54*
.65*
VST A+B
.51*
.63*
*p < .001
Part 5
Part 6
Part 7
Incomplete sentences 40 questions
Text completion 12 questions
Reading comprehension 48 questions
VLT2000
VLT300
VTL5000
VLT AW
VLT All
VST A
VST B
VST A+B
VLT+VST L
.42*
.46*
.38*
.44*
.49*
.33*
.34*
.39*
.50* R
.63*
.58*
.62*
.69*
.51*
.54*
.61*
.72*
L+R
.60*
.53*
.59*
.65*
.47*
.56*
.68* S
.40*
.52*
.55*
.28*
*p < .001
Question 1-2
Question 3
Question 4-6
Question 7-9
Question 10
Read a text aloud
Describe a picture
Respond to questions
Respond to questions using information provided
Propose a solution
RESULTS
1. Descriptive statistics
2. Reliability of VLT and VST (Cronbach’s α)
Mean SD
Minimum
Maximum
Skewness
Kurtosis L
370.98
57.79
205
495
-.25
.45 R
267.87
66.05
115
400
-.06
-.61
L+R
638.84
111.07
320
890
-.15
.05 S
114.27
25.23 40
160
-.66
.43
VLT2000
26.18
2.74 17 30
-.70
.48
VLT3000
20.65
5.01 5 28
-.62
.13
VLT5000
18.30
4.2 6
-.77
.64
VLT AW
21.11
5.29 3 29
-1.12
1.54
VLT All
86.24
14.9 45
114
-.80
.27
VST A
22.35
3.7 14
-.08
-.49
VST B
21.50
3.49
-.69
VST A+B
43.85
6.16 31 56
-.04
VLT2000
VLT3000
VLT5000
VLT AW
VLT All
VST A
VST B
VST A+B
# of items 30
120 40 80 α
.62
.80
.71
.85
.92
.52
.44
.65
ACKNOWLEDGEMENT
This study was supported by JPS KAKENHI Grant Number