1. Types of School Value-Added Reports
Differential Effectiveness
Report
Estimates All Years
Multi-Subject
Estimate
Table
Graph
All Schools, Similar Intake, Same District Report

2. All Schools, Similar Intake & Same District Comparisons Report

3. Distribution of schools’ value-added estimate shown by a box-and-whisker plot
School with the highest value-added
75 percentile
The box encloses the estimates of middle 50% of schools
median
25 percentile
School with the lowest value-added

4. This school has value-added slightly above
75% of all schools

5. This school has value-added well above 75% of similar intake schools

6. This school has value-added above average among schools from the same district

7. Differential Effectiveness Report
This School
All Schools
e.g. HKCEE
e.g. AAI

8. Simple Regression Method: The concept of Residuals
200
above average value-added
HK schools 7
HKCEE 78
100
average value-added
100
below average value-added 70 80 90
100
110
120
130
AAI

9. Multilevel Modelling Method: The concept of Residuals
200
value-added at student level
above average value-added
HK schools 7
School A
value-added at school level
HKCEE 78
100
average value-added
100
below average value-added 70 80 90
100
110
120
130
AAI

10. The absolute performance of school A in Chinese Language HKCEE
180 A
160 B
140 C
120 D
100 E 80 F 60 U 40 20
Grade A B C D E % 20
14.7 26
21.3 18

11. The value-added performance of school A in Chinese Language HKCEE
180 A
160
The School B
140 C
120
Below
average value-added D
100 E 80 F 60 U 40
HK Schools 20
AAI 70 85
100
115
130
Grade A B C D E % 20
14.7 26
21.3 18

12. The absolute performance of school B in Chinese Language HKCEE
180 A
160 B
140 C
120 D
100 E 80 F 60 U 40 20
Grade A B C D E % 20
14.7 26
21.3 18

13. The value-added performance of school B in Chinese Language HKCEE
180 A
HK Schools
160
The School B
140 C
120
Above
average value-added D
100 E 80 F 60 U 40 20
AAI 70
130 85
100
115
Grade A B C D E % 20
14.7 26
21.3 18

14. The absolute performance of school C in Chinese Language HKCEE
180 A
160 B
140 C
120 D
100 E 80 F 60 U 40 20
Grade A B C D E % 20
14.7 26
21.3 18

15. The value-added performance of school C in Chinese Language HKCEE
180 A
HK Schools
160
The School B
140 C
Average value-added
120 D
100 E 80 F 60 U 40 20
AAI 70
130 85
100
115
Grade A B C D E % 20
14.7 26
21.3 18

16. The value-added performance in Mathematics HKCEE 2000
180 A
HK Schools
160
The School B
140 C
120
Above
average value-added D
100 E 80 F 60 U 40 20
AAI 70
130 85
100
115
Grade A B C D E %
18.4
14.2
25.5
24.8
17.1

17. The value-added performance in Mathematics HKCEE 2001
180 A
HK Schools
160
The School B
140 C
120
Average value-added D
100 E 80 F 60 U 40 20
AAI 70
130 85
100
115
Grade A B C D E % 21
17.4
24.6
20.3
16.7

18. The value-added performance in Mathematics HKCEE 2002
180 A
160
The School B
140 C
Below
average value-added
120 D
100 E 80 F 60 U 40
HK Schools 20
AAI 70 85
100
115
130
Grade A B C D E % 20
14.7 26
21.3 18

19. Types of Differential Effectiveness
Pre-Test
Post-Test
Figure 1
Figure 2
Figure 3
Schools are different in their value-added performance, but have no significant difference in promoting the academic performance of students of different abilities.

20. Types of Differential Effectiveness
Pre-Test
Post-Test
Figure 4
Figure 5
Figure 6
Schools are different in their value-added performance but all are more effective in promoting the academic attainment of more able students

21. Types of Differential Effectiveness
Pre-Test
Post-Test
Figure 7
Figure 8
Figure 9
Schools are different in their value-added performance but all are more effective in promoting the academic attainment of less able students

22. Estimates
high
estimate
95% confidence interval
low

23. Estimates All Years Report
Group of schools with similar value-added
Data in tabular form
Name/Group
Value-Added
Stanine
Low
Estimate
High
2000
-9.56
-7.08
-4.59 1
2001
-4.02
-1.87
0.28 4
2002
-1.49
1.24
3.97 6
Enable comparison of value-added performance of a subject across the years

24. Stanine
A stanine is a standardized score with a mean of 5 and a standard deviation of 2. They range from 1 to 9. There are two kinds of stanines,
(a) School intake: To categorize schools into groups with a similar intake, the average AAI was calculated of all students in all schools at the S5 level and the average core 3 was calculated of all students in all schools at the S7 level.
(b) School value-added estimates: To categorize schools into groups with similar value-added

25. × : stanine of a school stanine = 7 Normal distribution
stanine = 7
Similar intake Group
× : stanine of a school
Normal distribution
(Converted from average AAI )

26. Multi-Subject Report Multi-Subject Estimate Table
Multi-Subject Estimate Graph

27. Multi-Subject Estimate Table
Low
Value-added Estimate
High
Additional Mathematics
-3.88
-0.69
2.51
Biology
-5.22
-3.42
-1.61
Chemistry
-7.1
-4.86
-2.62
Chinese History
-8.78
-6.46
-4.13
Chinese Language
-7.84
-5.59
-3.35
Computer Studies
-4.02
-1.87
0.28
Economics
-9.01
-6.59
-4.18
English Language (Syl B)
-3.77
-1.97
-0.17
Mathematics
-6.57
-4.26
-1.95
Physics
-5.04
-2.58
-0.13

28. Multi-Subject Estimate Table
Subject Group
N Subjects Offered
N Subjects in Top 10% VA
N Subjects in Top 50% VA
Chinese Language Education 1
English Language Education
Mathematics Education 2
Personal, Social and Humanities Education
Science Education 3
Technology Education

29. Multi-Subject Estimate Graph
Value Added Score
Additional Mathemathics
Best 6
Biology
Chemistry
Chinese History
Chinese Language
Chinese Literature
Computer Studies
Core 3
English Language (Syl B)
Geography
History
Mathematics
Physics
Religious Studies (B, C)

30. Both high and low estimates are positive
Above average value-added

31. Both low and high estimates are negative
Below average value-added

32. Cannot conclude that value-added is above average

33. Cannot conclude that value-added is below average

34. Check value-added estimates listed in Multi-Subject Table

35. Both low and high estimates are positive
Subject
Low
Estimate
High
Additional Mathematics
-0.84
1.67
4.18
Best 6
-1.88
0.02
1.93
Biology
-3.82
-1.93
-0.04
Chemistry
-4.33
-2.23
-0.13
Chinese History
3.83 6
Chinese Language
-2.35
-0.47
1.41
Chinese Literature
-0.81
1.43
3.67
Computer Studies
0.05
2.12
4.19
Core 3
-0.64
1.4
3.45
Economics
-1.44
0.84
3.11
English Language
1.66
3.96
6.25
Geography
-4.5
-2.55
-0.59
History
-2.87
-0.56
1.75
Mathematics
-0.74
1.39
3.52
Physics
-3.06
1.78
Above average value-added

36. Check value-added estimates listed in Multi-Subject Table

37. Both low and high estimates are negative
Subject
Low
Estimate
High
Additional Mathematics
-0.84
1.67
4.18
Best 6
-1.88
0.02
1.93
Biology
-3.82
-1.93
-0.04
Chemistry
-4.33
-2.23
-0.13
Chinese History
3.83 6
Chinese Language
-2.35
-0.47
1.41
Chinese Literature
-0.81
1.43
3.67
Computer Studies
0.05
2.12
4.19
Core 3
-0.64
1.4
3.45
Economics
-1.44
0.84
3.11
English Language
1.66
3.96
6.25
Geography
-4.5
-2.55
-0.59
History
-2.87
-0.56
1.75
Mathematics
-0.74
1.39
3.52
Physics
-3.06
1.78
Below average value-added