2. Results of TSA 2005 A Report on the Basic Competencies of Students at the End of Key Stages 1 and 2 in Chinese, English and Mathematics

3. 2 Background to the TSA The 2000 report of the Education Commission sets out detailed proposals for two kinds of basic competency assessment: –Student Assessment –System Assessment (now renamed ‘Territory-wide System Assessment’ (TSA)) HKEAA commissioned to develop and administer both projects for EMB

4. 3 Purposes of the TSA Provide the Government and schools with information on standards Monitor the effectiveness of policies School improvement

5. 4 Scope of TSA Chinese Language, English Language and Mathematics P3 in 2004 P3 and P6 in 2005 P3, P6 and S3 in 2006

6. 5 Administration of the Assessment Written Assessments –68,000 P3 students and 78,000 P6 students from some 700 schools –Conducted over 2 days in July –Students randomly assigned Oral Assessment –12 or 24 students randomly selected from each school –Conducted over two days in May –Two oral assessors

7. 6 Changes in 2005 All written papers centrally marked by an external panel of experienced teachers One internal and one external assessors to assess oral language

8. 7 Setting the Standards P3 standards –Set in 2004 using expert panels and international benchmarking P6 standards –Set using expert panels to fine tune standards established empirically with reference to P3 standards

9. 8 Territory-wide P3 Results Subject Percent Achieving Basic Competency 2004 2005 Chinese Language (Listening, Reading & Writing) 82.784.7 English Language (Listening, Reading & Writing) 75.978.8 Mathematics84.986.8

10. 9 Territory-wide P3 Results

11. 10 Territory-wide P6 Results Subject Percent Achieving Basic Competency Chinese Language (Listening, Reading & Writing) 75.8 English Language (Listening, Reading & Writing) 70.5 Mathematics83.0

12. 11 P3 versus P6

13. 12 Absenteeism Rate A survey was conducted in August 2005 on absenteeism rates in primary schools by the HKEAA. The figures showed that the average daily absenteeism rate in the month of June was 1.5% but that the average absenteeism rate on the two days was 1.8%. A total of 58 schools were found to have absenteeism rates of 5% or more for P.3 written assessments, while 50 schools were found to have absenteeism rates of 5% or more for P.6 written assessments.

14. 13 Absenteeism Rate Based on a worst-case scenario in which all absences over 1.5% were of students who would have failed to achieve basic competency The maximum distortion in the territory-wide estimates of the percent meeting the standard – around 0.3% for P.6 and around 0.6% for P.3.

15. 14 Absenteeism Rate Schools with absenteeism rates of 5% or more may not truly reflect the percentages had they been in full attendance. Hence, these results are not recommended as the sole indicators for the development of learning and teaching programme.

16. 15 Confidentiality EMB and HKEAA will maintain confidentiality of individual schools’ results at all times. School results are for school improvement purposes. Schools will be able to access their own results electronically via the internet, using confidentiality protocols.

17. Territory-wide System Assessment 2005 Release of Results 8 December 2005

18. TSA 2005 Results Results are released in the form of three reports: 1.School Report – Summary of school data with percentages of students achieving Basic Competency, and the average percentages for each of the subject papers.School Report 2.Item Analysis Report (sorted by Sub-paper) – detailed analysis of school percentages for each of the items, following the question paper sequence.Item Analysis Report (sorted by Sub-paper) 3.Item Analysis Report (sorted by Basic Competency) – detailed analysis of school percentages for each of the items, in sequence of Basic Competencies.Item Analysis Report (sorted by Basic Competency) Note: Reports excluding SEN to be released in mid-January

19. TSA 2005 Results – New Initiative in 2005 Results are released on the TSA website through online access to “www.systemassessment.edu.hk”. Schools can download the reports from the TSA website from 12 December 2005 to 31 January 2006.

20. TSA 2005 Results – Reports Security Schools will receive a sealed envelope through registered mail with the new passwords to access the website and the reports. 1.Logon User Name 2.Logon Password 3.PDF Password for downloading reports

21. TSA 2005 Results – Reports Security The PDF password, additional password on file level, provides greater security for the files. Reminder to Schools – Please keep all the passwords in a safe and secure place..

22. TSA 2005 Results – Reports Download Select ‘Login’

23. TSA 2005 Results – Reports Download Input the Login Name and User Password

24. TSA 2005 Results – Reports Download Procedure Select Download Assessment Reports

25. TSA 2005 Results – Reports Download Procedure Select the Report to be downloaded

26. TSA 2005 Results – Reports Download Procedure Read through the Protocol from EMB …

27. TSA 2005 Results – Reports Download Procedure And then click the ‘I Accept’ before downloading the report

28. TSA 2005 Results – Reports Download Procedure Then the system prompts for the file level password Input the PDF Password and then click ‘OK’ The report will then be displayed

29. TSA 2005 Results – Enquiries Three ways for enquiries: 1.Schools not yet receiving a sealed envelope through registered mail on 13 December or later – call Administrative Team at 2325 0161. 2.Technical problems during download – Call our hotline at 2591 3099. 3.Questions on school data – Fill in the Recheck Request Form (on the website) and fax to 2591 0728.

30. TSA 2005 Report Details of the background to TSA, the development process, administration, marking and standards-setting Extensive competency-by-competency analyses of student performance in each subject, with exemplars Discussion of the way forward and proposed improvements for the future

31. Thank You

32. 31 School Report 科目 Subject 完成紙筆評估的 學生人數 Number of students completing written assessment (A) 已達基本水平的 學生人數 Number of students achieving Basic Competency (B) 學校已達基本水平 的學生百分率 School percentage of students achieving Basic Competency (B/A  X  全港已達基本水平 的學生百分率 Territory-wide percentage of students achieving Basic Competency 中國語文 Chinese Language 31268485 英國語文 English Language 31227179 數學 Mathematics 32299187 學校 School: School A (hkp00998) 級別 Level: 小三

33. 32 School Report 科目 Subject 完成紙筆評估的 學生人數 Number of students completing written assessment (A) 已達基本水平的 學生人數 Number of students achieving Basic Competency (B) 學校已達基本水平 的學生百分率 School percentage of students achieving Basic Competency (B/A  X  全港已達基本水平 的學生百分率 Territory-wide percentage of students achieving Basic Competency 中國語文 Chinese Language 98838576 英國語文 English Language 96656871 數學 Mathematics 94838883 學校 School: School B (hkp00999) 級別 Level: 小六

34. 33 School Report 學校 School: School B (hkp00999) 中國語文 Chinese Language 卷別 : 能力或範疇 Paper: Skill or Dimension 學生人數 Number of students 滿分 Maximum score (A) 學校平均分 School Average Score (B) 學校答對率 School average as a % of maximum score (B/A X  全港答對率 Territory-wide average as a % of maximum score 3CL1: 聆聽 Listening 771410.17275 3CL2: 聆聽 Listening 721511.37574 3CR1: 閱讀 Reading 522516.06470 3CR2: 閱讀 Reading 492417.07172 3CR3: 閱讀 Reading 482416.66976

35. 34 School Report 卷別 : 能力或範疇 Paper: Skill or Dimension 學生人數 Number of students 滿分 Maximum score (A) 學校平均分 School Average Score (B) 學校答對率 School average as a % of maximum score (B/A X  全港答對率 Territory-wide average as a % of maximum score 3CW1: 寫作 Writing 342211.15162 3CW2: 寫作 Writing 342210.14662 3CW3: 寫作 Writing 30229.74463 學校 School: School B (hkp00999) 中國語文 Chinese Language

36. 35 School Report 學校 School: School B (hkp00999) 中國語文 Chinese Language 卷別 : 能力或範疇 Paper: Skill or Dimension 學生人數 Number of students 滿分 Maximum score (A) 學校平均分 School Average Score (B) 學校答對率 School average as a % of maximum score (B/A X  全港答對率 Territory- wide average as a % of maximum score 說話 ( 個人 ) Speaking (Individual) 122117.08168 說話 ( 小組 ) Speaking (Group) 12107.87868 3CAV: 視聽資訊 Audio-visual Information 302115.17269

37. 36 Item Analysis by Sub-paper 題號 Item no. 選項 Option 得分 / 等級 Score/Grade 學校百分率 School percentage 全港百分率 Territory-wide percentage Q01A B C D * U# 13.5% 16.2% 0.0% 70.3% 0.0% 5.1% 9.1% 2.6% 83.1% 0.1% Q110 1 U# 40.5% 59.5% 0.0% 27.9% 72.0% 0.1% 題目分析報告 ( 以卷別為序 ) Item Analysis Report (Sorted by Sub-paper) 中國語文 Chinese Language ( 分卷 : 3CL1 聆聽評估 ) * 正確答案 Correct answer # 沒有答題或答案無效 No or invalid answer @ 不屬於第一學習階段的「基本能力」範圍 Not included in BC descriptors at KS1 由兩名評審員評估 ( 寫作及說話 ) Rated by two assessors (Writing & Speaking) 學校 School: School B (hkp00999) 級別 Level: 小三

38. 37 Item Analysis by Basic Competency 範疇 Skill 基本能力 Basic Competency 卷別 Sub- paper 題號 Item no. 選項 Option 得分 / 等級 Score/ Grade 學校百分 率 School percentage 全港百分率 Territory-wide percentage ReadingL2-R-5-P3BC Using a small range of reading strategies to understanding the meaning of short and simple texts with the help of cues 3ERW1 3ERW3 P2A Q01 P4A Q01 A B C * D U# 12.0% 16.0% 60.0% 4.0% 8.0% 7.4% 3.5% 85.1% 1.3% 2.8% 3ERW1P4 Q040 1 U# 93.3% 7.7% 0.0% 79.2% 19.2% 1.7% 學校 School: School B (hkp00999) 級別 Level: 小三 * 正確答案 Correct answer # 沒有答題或答案無效 No or invalid answer 由兩名評審員評估 ( 寫作及說話 ) Rated by two assessors (Writing & Speaking) 題目分析報告 ( 以基本能力為序 ) Item Analysis Report (Sorted by Basic Competency) 英國語文 English Language