Portfolio Committee on Basic Education 03 February 2010 Dr Mafu S Rakometsi.

Slides:



Advertisements
Similar presentations
Presenting: Units A1 and A2
Advertisements

Qualifications Update: National 5 Music Qualifications Update: National 5 Music.
Australian Curriculum
WHAT CAN WE LEARN FROM THE NSC RESULTS? SETTING AND MAINTAINING STANDARDS in the NSC Portfolio Committee APRIL 2012.
Evaluating tests and examinations What questions to ask to make sure your assessment is the best that can be produced within your context. Dianne Wall.
© Grant Thornton UK LLP. All rights reserved. Review of Sickness Absence Vale of Glamorgan Council Final Report- November 2009.
Standards and Guidelines for Quality Assurance in the European
“Outside looking in” The evaluation of the NSC in South Africa by UK NARIC Anne Oberholzer.
1 INTRODUCING THE REVISED NATIONAL CURRICULUM STATEMENT INTO THE SENIOR PHASE A WCED ORIENTATION WORKSHOP FOR THE SENIOR PHASE 2005 DIRECTORATE:CURRICULUM.
Presentation on the draft framework for Personal, employability, learning and thinking skills for all 11- to 19-year-olds October 2005.
OUR CURRENT REALITIES ARE...
The effective use of tests and tasks to support teacher assessment in Y2 4 th February 2014 Karen Samples.
NCCSAD Advisory Board1 Research Objective Two Alignment Methodologies Diane M. Browder, PhD Claudia Flowers, PhD University of North Carolina at Charlotte.
ECTS definition : Student centred system, Student centred system, Based on student workload required to : Based on student workload required to : Achieve.
New qualifications, assessment & quality assurance to support the Senior Phase of Curriculum for Excellence.
ACCOUNTABILITY IN SOUTH AFRICAN SCHOOLING. General propositions South African schooling is driven largely by supply-side measures South African schooling.
BY Karen Liu, Ph. D. Indiana State University August 18,
ASSESSMENT IN EDUCATION ASSESSMENT IN EDUCATION. Copyright Keith Morrison, 2004 PERFORMANCE ASSESSMENT... Concerns direct reality rather than disconnected.
Prof. György BAZSA, former president Hungarian Accreditation Committee (HAC) CUBRIK Workshop IV Beograd, 13 March, 2012 European Standards and Guidelines.
Update on Progress in Preparations for ANA 2013 Meeting of the National Consultative Forum 20 August 2013.
Verification: Quality Assurance in Assessment Verification is the main quality assurance process associated with assessment systems and practice - whether.
Qualifications Update: Environmental Science Qualifications Update: Environmental Science.
NCS Implementation Review: Task Team Report- CEM Decisions Towards Implementation Presentation to the Select Committee 11 August
1 PRESENTATION TO THE PORTFOLIO COMMITTEE ON PUBLIC SERVICE AND ADMINISTRATION 1 June 2005 REPORT ON THE ABILITIES OF DEPARTMENTS TO DEAL WITH DEVOLVED.
University of Glamorgan Faculty of Business & Society FGM Development Day Wednesday 18 th July 2012 The UK Quality Code for Higher Education A Brief Guide.
FET National Curriculum Statements Dramatic Arts Beyond 2006 WESTERN CAPE EDUCATION DEPARTMENT.
Portfolio Committee on Basic Education Report on the Quality Assurance of the NSC 19 January 2010 Dr Mafu S Rakometsi.
Programme Objectives Analyze the main components of a competency-based qualification system (e.g., Singapore Workforce Skills) Analyze the process and.
COMPLIANCE WITH THE SIGNING AND FILING OF PERFORMANCE AGREEMENTS BY HEADS OF DEPARTMENT BRIEFING TO THE PORTFOLIO COMMITTEE ON PUBLIC SERVICE AND ADMINISTRATION.
REPORT National Senior Certificate Examination Results 2009 Presentation by Nkosinathi Sishi –Chief Director: National Examinations and Assessment to the.
PRESENTATION ON ASSESSMENT Compiled & Presented by: Mrs T.P. Sithole.
1 DEPARTMENT OF EDUCATION AND ASGI-SA Presentation to PORTFOLIO COMMITTEE.
DRAMA MODERATION PROTOCOL FET Drama. Introduction n Circular 128/2002 n Protocol to take effect 2003 n UMALUSI tasked with quality assuring provision.
Release of the 2010 Standardisation Decisions Presentation to Portfolio Committee on Basic Education 15 March 2011.
RESEARCH UNIT INPUT ON OVERSIGHT AND ACCOUNTABILITY MODEL: PETITIONS.
REPORT ON LEAKAGES OF QUESTION PAPERS AT TVET COLLEGES AND TURNAROUND PLAN TO PREVENT QUESTION PAPER LEAKAGES 1 Presentation to the Portfolio Committee.
Dr. Salwa El-Magoli Chairperson of the National Quality Assurance and Accreditation Committee. Former Dean of the Faculty of Agricultural, Cairo university.
AN UPDATE ON THE EVALUATION OF THE PERFORMANCE OF HEADS OF DEPARTMENT IN THE PUBLIC SERVICE Presentation to the Portfolio Committee on Public Service and.
Technical Report National Senior Certificate RESULTS 2008 Presented by nkosi sishi –chief director: national examinations, assessment and measurement 12.
DINALEDI SCHOOL PROJECT 1 PRESENTATION TO PORTFOLIO COMMITTEE 14 SEPTEMBER 2011.
Portfolio Committee on Higher Education Report on the Quality Assurance of NC (V) L2-4; NATED N2-3 and GETC: ABET L4 3 February 2016 Dr Mafu S Rakometsi.
Page 1 Portfolio Committee on Water and Environmental Affairs 14 July 2009.
PISA – an option to learn from other countries‘ educational systems On PISA and German educational reforms within the past decade Seminar in Tallinn, 19.
1 A Framework for Junior Cycle BRIEFING October 2012.
Proposed End-of-Course (EOC) Cut Scores for the Spring 2015 Test Administration Presentation to the Nevada State Board of Education March 17, 2016.
1 st KWAZULU - NATAL ABET IN THE WORKPLACE INDABA 22 June 2009 John April 1 Quality Assurance in ABET and its implications.
GENERAL EDUCATION CERTIFICATE(GEC) ABET Examination Cycle & Related Processes ABET IN THE WORKPLACE INDABA Presented by Mr. D. Govender.
Progress against indicators October 2013 Martin Gustafsson.
QCTO’s Occupational Certificates. Who is the QCTO? The Quality Council for Trades and Occupations (QCTO) is a Quality Council established in 2010 in terms.
QCTO Scoping Presentation Electrical Inspector 26 August QCTO Presentation Electrical Inspector
Support for English, maths and ESOL Module 1 Managing the transition to functional skills.
NSLA AND BASIC EDUCATION SECTOR LEKGOTLA
Department of Higher Education and Training
7 February 2012 Dr Mafu S Rakometsi
National Certificate (Vocational)
PRESENTATION TO PORTFOLIO COMMITTEE MEETING 23 August 2016
Living up to expectations
National Senior Certificate
Progress Report on the Certification Backlog
2006 Examinations Results Lessons for the improvement strategy
Select Committee on Education and Recreation
SETTING AND MAINTAINING STANDARDS in the NSC
EXAMINATIONS AND ASSESSMENT
SAAEA 2018 Umalusi Ms Nomaswazi Shabalala/Christiaan Geel
PRESENTATION TO PORTFOLIO COMMITTEE ON BASIC EDUCATION
May 2019 Dr SP Mchunu & Ms ML Madalane
Umalusi Presentation to the
  Using the RUMM2030 outputs as feedback on learner performance in Communication in English for Adult learners Nthabeleng Lepota 13th SAAEA Conference.
SAAEA 2019 Conference Agnes Mohale
Presentation transcript:

Portfolio Committee on Basic Education 03 February 2010 Dr Mafu S Rakometsi

WHAT CAN WE LEARN FROM THE NSC RESULTS? Prof. John Volmink - Chairperson of Umalusi

The Class of 2009  Second cohort of candidates to write the new National Senior Certificate (NSC)  Completely new qualification based on the National Curriculum Statement  The NSC replaces the Senior Certificate which was written at the end of 2007 and which will finally be phased out in 2011  Some sat for the NSC ( enrolled including repeater candidates)  Approximately 60,25% of all those who have written have met the requirements of a pass

 The NSC differs from the previous Senior Certificate both in structure as well as in grading  A critical feature of the Senior Certificate was that what determined a pass or fail was based on the aggregate score  The NSC determines a pass or fail by 40% in at least three subjects and 30% in three others  Not completely appropriate to compare overall results between the two qualifications Comparing the NSC with that of previous years

 The number of candidates passing  The quality of the results  The standardisation of the exam  The predicative quality of the exam for performance at HE level Some criteria for comparison

 Massification is a natural outcome of an education system that is non-racist, non-sexist and democratic  It is the clear that there has been a steady increase over the last decade in the number of learners who enrolled for and wrote the Senior Certificate  It is also significant that almost of the Class of 2009 did not pass because they narrowly missed the pass mark in one or two subjects  They qualify to write supplementary examinations and if half of these candidates pass, the final pass mark may go beyond the 67% mark  The underlying philosophy of the NCS had been designed to ensure that most people achieve the minimum requirement for a pass The number of candidates passing

Senior Certificate examination results, all schools, Year No. of Candidates Passes NumberChange in number (%) NumberChange in passes (%) Sources: DoE, 2004, 2005a, 2005b, 2005c, 2007, 2008, 2009 The number of candidates passing : Trends in senior certificate enrolment and passes

Senior Certificate examination results, all schools, Year No. of Candidates Passes NumberChange in number (%) NumberChange in passes (%) Sources: DoE, 2004, 2005a, 2005b, 2005c, 2007, 2008, 2009 The number of candidates passing : Trends in senior certificate enrolment and passes

 Concerns about quality has become a thorny issue and the subject of much debate albeit uninformed at most times.  SA public uses the matric results as the main indicators of quality of the education system and so there is an understandable concern about what these new results of a new qualification is saying about the current state of education  It is important however that we interrogate some of our assumptions that inform our beliefs about standards and quality The quality of the results

 The first assumption is that “more means less” or “more means worse” Stellenbosch University Website: “In the light of phasing out of matriculation exemption and of the distinction between subjects on the higher and standard grade, a significant number of learners will probably qualify for basic admission to university on the basis of their subject combination…..The implication is that many more learners may be able to apply for admission to Stellenbosch University. ……. With this background, it becomes clear why it is necessary for the University to have its own measure to interpret the meaning and value of the new NSC and also to generate additional information in order to make finer distinctions.” Assumptions that affect our perceptions Assumption 1

 Another assumption is that we now use vastly different methods of standardising the results  Responsibility for matriculation results has changed hands:  JMB ( )  SAFCERT (1992 – 2001)  Umalusi (2002 – to date)  The one constant has been the standardisation process used for the examinations.  This is crucial to:  Obtain equivalence of the standard of the SCE  Across years, subjects and examination authorities  It is also necessary in order to deliver a relatively constant product to the HE sector and to the workplace Assumption 2: Trustworthiness The standardisation of the exam

There is an assumption that we are at a much worse place today than in 1995

Senior Certificate examination results, all schools, Sources: DoE, 2004, 2005a, 2005b, 2005c, 2007, 2008, 2009 Senior Certificate examination results

 Another assumption is that the NCS is of a lower standard than the previous curriculum.  Research completed by Umalusi into the standard of the NCS curriculum confirms that in most cases the NCS presents a greater cognitive challenge  The NCS also represents modern, updated and more demanding versions of previous subjects Umalusi’s research on comparisons of NSC with NATED 550

 It needs to be said however that the National Curriculum Statement represents different sets of standards for all  Not only does it reflect the new values embedded in the Constitution but also aims to develop learners who can respond to the growth and development of knowledge and technology and the demands of the 21st century The NCS philosophy

 Nationally set curriculum  Internationally benchmarked  Modern and relevant: 21st Century skills  Reflect the progressive values of the constitution  Focus on Africa and South Africa What is the NCS?

The design of the NCS CONSTITUTION = soil in which the Fundamental Values are grounded 10 FUNDAMENTAL VALUES = roots of the tree COs and DOs = trunk of the tree LOs = branches of the tree ASs = leaves of the tree

 Social transformation  Outcomes-based education  High knowledge and skills  Integration and applied competence  Progression  Articulation and portability  Human rights, inclusivity, environmental and social justice  Valuing indigenous knowledge systems  Credibility, quality and efficiency Nine principles of the NCS PRINCIPLES = nutrients that feed the tree

 Solve problems  Work with others  Manage self  Communicate early  Use science and technology  Understand world as a set of related systems  Strategies to learn  Citizenship  Cultural and aesthetic sensitivity  Education and career opportunities  Entrepreneurial opportunities Five critical and seven developmental outcomes

Can HE Trust the NSC Results?

Senior Certificate examination results, all schools, YearNo. of Candidates PassesUniversity Exemption NumberRate (%)NumberRate (%) Sources: DoE, 2004, 2005a, 2005b, 2005c, 2007, 2008, 2009 Senior Certificate examination results and HE

Senior Certificate examination results, all schools, YearNo. of Candidates PassesUniversity Exemption NumberRate (%)NumberRate (%) Sources: DoE, 2004, 2005a, 2005b, 2005c, 2007, 2008, 2009 Senior Certificate examination results and HE

Senior Certificate examination results, all schools, Year No. of Candidates University Exemption NumberChange in number (%) NumberChange in exemptions (%) Sources: DoE, 2004, 2005a, 2005b, 2005c, 2007, 2008, 2009 Senior Certificate examination results and HE

Senior Certificate examination results, all schools, Year No. of Candidates University Exemption NumberChange in number (%) NumberChange in exemptions (%) Sources: DoE, 2004, 2005a, 2005b, 2005c, 2007, 2008, 2009 Senior Certificate examination results and HE

Senior Certificate examination results, all schools, Sources: DoE, 2004, 2005a, 2005b, 2005c, 2007, 2008, 2009 Senior Certificate examination results

Maintaining Standards Research Project  Purpose of the Research To provide Umalusi’s Assessment and Statistics Committee with information on the comparability of the old NATED 550 and new National Curriculum Statement curricula, and on the comparative difficulty of the exams associated with each.

Comparing curricula  In-depth policy analysis of content, skills and assessment  Design features i.e. outcomes, assessment standards, sequencing, progression, etc. Benchmarking NCS exams  Comparison: NATED 550 HG & SG (2005-7) and 2008 & 2009 NSC exam papers  Analysis of NSC 2009 examination in correlation with SAG Methodology

Subjects Considered in 2008 SubjectsCurriculum Evaluation Exam Analysis English FAL √√ Geography √√ Life Sciences √√ Mathematics √√ Mathematics Literacy √√ Physical Sciences √√ Reports are available

Subjects Considered in 2009 SubjectsCurriculum EvaluationExam Analysis English FAL √ Geography √ Life Sciences √ Mathematics √ Mathematics Literacy √ Physical Sciences √ Accounting √√ Business Studies √√ Economics √√ History √√

 This special role of mathematics has seen it continuously singled out in discussions on:  Curriculum reforms  Examination results  Historically 30% to 40% of secondary schools in the country simply did not offer any mathematics beyond grade nine  In 2009 all 620,000 learners took some form of mathematics The case of Mathematics

 The Class of 2009 had learners who passed mathematics at the 50% level or higher  The Class of 2008 had learners who passed mathematics at the 50% level or higher  This stands in contrast to the 25,000 who passed Higher Grade mathematics in 2007  A further learners passed mathematical literacy, most of whom would not have done any mathematics in the previous system.  A total of passed ML at the level of 80% or higher Mathematics and the Class of 2009

Number passing Math at different thresholds Sources: DoE, Abdridged Report on the 2008 NSC Examniation Results, December 2008; Doe, Technical Report – NSC, December 2008 Math pass rate Wrote Passed at 30% Passed at 40% Passed at 50% Passed at 60% Total did not pass

Number passing HG Math Sources: Vithal, 2008, Table constructed from data in CDE Research Report No 13; Kahn 2007, DoE Senior Certificate Technical Report 2006; DoE Senior Certificate Report Figures rounded off Trends in HG Math pass rate Year No. Wrote Math No. Wrote Math HG No. Passed Math HG ,000 60,000 29, ,000 65,000 22, ,000 68,000 20, ,000 60,000 20, ,000 50,000 20, ,000 39,000 19, ,000 35,000 20, ,000 35,000 21, ,000 36,000 23, ,000 40,000 24,000 * Pass at 50% or higher

Number passing HG Math Sources: Vithal, 2008, Table constructed from data in CDE Research Report No 13; Kahn 2007, DoE Senior Certificate Technical Report 2006; DoE Senior Certificate Report Report on the National senior Certificate Examination results 2009 Figures rounded off Trends in HG Math pass rate Year No. Wrote Math No. Wrote Math HG No. Passed Math HG ,000 40,000 24, ,000 44,000 26, ,000 47,000 25, ,000 46,000 25, ,821n.a. 63,038* ,630n.a.52,866* * Pass at 50% or higher

 The cognitive challenge for mathematics for the class of 2008 was closer to the old SG level as judged by the Umalusi research panel  Furthermore there was a mismatch between the suggested cognitive demand as provided by the SAGs and the cognitive challenge in the exemplars and the final mathematics examination  Only about 46% of learners met the minimum requirements for a pass in mathematics Some remarks about Mathematics and the Class of 2008

2009 exam was more challenging than the 2008 exam  2009 aligned to the exam guideline  Provided a challenge at the top end  Only about 44% of learners met the minimum requirements for a pass in mathematics Some remarks about mathematics and the Class of 2009

% of marks at each level of cognitive demand on HG and SG Math papers SG HG2008 NSC2009 NSCSAGS Knowledg e (%) Routine procedur es (%) Complex procedur e (%) Problem solving (%) Sources: Draft Composite Exam Analysis Report: Maths, Umalusi Research, 2008 Cognitive demand for HG and SG Mathematics

 Curriculum needs urgent attention  Content overload  Selection of examinable content (especially Chemistry)  2009 exam was of a similar standard to 2008  Difficult for both top and lower achieving learners The case of Physical Science

 The Class of 2009 had learners who passed Physical Science at the 40% level or higher  The Class of 2008 had learners who passed Physical Science at the 40% level or higher  This stands in contrast to the who passed Higher Grade Physical Science in 2007 Physical Science and the Class of 2009

Number passing Physical Science at different thresholds Sources: DoE, Abdridged Report on the 2008 NSC Examniation Results, December 2008; Doe, Technical Report – NSC, December 2008 Physical Science pass rate Wrote Passed at 30% Passed at 40% Passed at 50% Passed at 60% Total did not pass

Number passing HG Physical Science Sources: Vithal, 2008, Table constructed from data in CDE Research Report No 13; Kahn 2007, DoE Senior Certificate Technical Report 2006; DoE Senior Certificate Report Report on the National senior Certificate Examination results 2009 Figures rounded off Trends in HG Physical Science pass rate Year No. Wrote Phys. Sc No. Passed Phys.Sc HG ,302 29, ,172 28, ,300n.a.61,480 * ,957n.a.45,531* * Pass at 40% or higher

% of marks at each level of cognitive demand on HG and SG Physical Science papers SG HG2008 NSC2009 NSCSAG’s Factual (%) Recall - 15 Comprehension- 35 Conceptu al (%) Analysis &Application-40 Problem Solving (%) Evaluation & Synthesis- 10 Sources: Draft Composite Exam Analysis Report: Maths, Umalusi Research, 2008 Cognitive demand for HG and SG Physical Science

Results of other Critical Subjects  Life Sciences  2009 exam was more difficult for below-average candidates, but not so challenging for above-average candidates  Accounting  curriculum  NCS content more than Nated 550 content  Examination guidelines cover % of new disciplines  2009 exam was of a similar standard to 2008  difficult for both top and lower achieving learners

Quality Assurance of the 2009 National Senior Certificate Examination Dr Mafu S Rakometsi – CEO of Umalusi

2009 Quality assurance processes Moderation of the question papers; Moderation of Site-Based Assessment (SBA); Monitoring of the conduct of the NSC examination; Verification of marking; and Standardization of marks.

Scope of the quality assurance processes Number of NSC 2009 question papers moderated Number of subjects Number of papers Approved/ Conditionally approved at 1 st moderation Approved/ Conditionally approved at 2 nd moderation Approved/ Conditionally approved at 3 rd moderation

Scope of the quality assurance processes… Moderation of SBA SubjectsProvinces ECFSGPKZNLimpMPNWNCWC Accounting√√√√ Business Studies√√√ Economics√√√ English First Additional Lang√√√ Geography√√√ History√√√√ Life Sciences√√√√ Life Orientation√√√√√√√√√ Mathematics√√√ Mathematical Literacy√√√ Physical Science√√√

Scope of the quality assurance processes… Monitoring of the NSC examination: writing phase ProvinceNo of exam centres No of candidates enrolled No of exam centers monitored by Umalusi No of Umalusi monitors per province No of exam centers monitored by Umalusi staff EC FS GP KZN Limp MP NC NW WC Total

Scope of the quality assurance processes… Monitoring of the NSC examination: marking ProvinceNo of marking centres No of marking centers visited by Umalusi monitors No of marking centers visited by Umalusi staff EC FS GP KZN Limp MP NC03 01 NW1403- WC02 - Total

Scope of the quality assurance processes… Moderation of marking Memoranda discussion meetings  Approved and signed off finalized memoranda/ marking guidelines for all the NSC subjects Centralised moderation (see next slide)

Scope of the quality assurance processes… Centralized moderation of marking Non language subjectsLanguage subjects AccountingAfrikaans First Additional Language P1, P2, P3 Agricultural Science P1, P2, P3English First Additional Language P1, P2, P3 Business StudiesIsiXhosa Home Language P1, P2, P3 EconomicsSesotho Home Language P1, P2, P3 Geography P1, P2Setswana Home Language P1, P2, P3 History P1, P2 Life Sciences P1, P2 Mathematics P1, P2, P3 Mathematical Literacy P1, P2 Physical Science P1, P2

Areas of good practice Generally papers catered for both the weaker & high performing candidates, In many cases the Nov 2009 & March 2010 were presented at the same time for moderation, this ensured comparability of standard, External moderators signed the final papers off before dispatch to provinces for printing, Great improvement observed in the monitoring of exams by provinces, Security measures were intensified in the majority of centers across provinces,

Areas of concern Moderation of SBA Majority of provinces do not conduct actual moderation of SBA tasks & learner portfolios – moderation exercise is limited to a compliance audit. Majority of the SBA tasks reflect over reliance on past examination papers, educators lack creativity in developing suitable tasks, SBA tasks developed by educators focus mainly on assessing the lower cognitive skills, Educators battle with the development & use of rubrics used for scoring learners,

Areas of concern… Implementation & Assessment of Life Orientation (LO) requires serious attention. LO is 100% internally assessed and standards vary from one province to the other, and even within provinces. Monitoring of exams: Incidents of improper registration of candidates resulted in duplications and some candidates not registered or registered for the incorrect subjects, The appointment of suitable trained Invigilators and Chief Invigilators is essential. This will address problems relating to the flouting of even basic examination regulations. The security systems in Mpumalanga during the printing, distribution, and storage of question papers require urgent attention.

Areas of concern… Criteria for the appointment of markers should be strictly adhered to so as not to disadvantage candidates. Moderation of marking: Memoranda discussion meetings for small subjects did not receive the same attention as that given to the gateway subjects. These memorandum discussions were poorly attended. Added to this was the absence of input from the provinces. The problems with the improper translation of question papers into Afrikaans is still of great concern.

Areas of concern… Additions were made to the final memoranda without the consent of the DoBE and Umalusi. A few incidents of non- adherence to the final memoranda were observed, (pg 37, 38 of the NSC report). Some markers do not have the ability and experience to handle higher-order cognitive level questions that required insight and logical reasoning. There were instances of inaccurate totaling of marks and incorrect transferring of marks to the cover page during marking.

Areas of concern… Standardization of marks: Data on the raw mark distribution for 2008 did not correspond with data contained in the 2009 standardization booklets. The number of candidates reflected in the pairs analysis was also not accurate. The data sets submitted for verification of the resulting process was incomplete and sometimes not in accordance with the Umalusi specifications. This resulted in a delay of the verification process. Poor learner performance especially in Mathematics, Physical Science & Accounting point to problems with the curriculum as well as teaching and learning.

Recommendations Moderation of SBA: Moderation of the standard of SBA must be implemented at the school and cluster levels. Checks for compliance can still be part of the moderation process to ensure adherence to policy. All the assessment bodies should ensure that all educators are familiar with the policy requirements to ensure the meeting of national standards. Monitoring of exams: The appointment of suitably trained Chief Invigilators is essential. This will address problems relating to the flouting of even basic examination regulations.

Recommendations … Verification of marking: Criteria for the appointment of markers should be strictly adhered to so as not to disadvantage candidates. Standardization of marks: Data submitted for standardisation purposes must be accurate and in the specified format.

Recommendations … There is a need to establish a basis for the standardization of Life Orientation (LO). Umalusi recommends that an externally- written component be introduced for LO with a view to set standards for the assessment of this subject. There is an urgent need for very intensive teacher training focusing on the content of the new Accounting curriculum. This must then translate into the effective teaching, learning, and assessment of the subject. The Physical Science curriculum appears to be challenging in terms of breadth and needs to be reviewed. Teaching and Learning of Mathematics needs to be strengthened

Examination Irregularities The majority of irregularities were of a technical nature and these were reported to Umalusi in terms of established processes. Some irregularities were as a result of registration-related problems, eg candidates not appearing on mark sheets, some registered for incorrect subjects. Major irregularities: Leakage of the 5 papers in Mpumalanga: Mathematics P1 & 2, Physical Science P1 & 2 and Accounting. These were reported to Umalusi in October Back-up papers were moderated under tremendous time pressure.

Examination Irregularities… On 20 December 2009, Umalusi was informed that the DoE investigations revealed that other papers may have been compromised in Mpumalanga. An official report from the DoE was sent to Umalusi on 29 Dec. Umalusi EXCO constituted on 30 Dec and agreed that the matter be investigated further. Based on the information in the DoE report, Umalusi decided not to approve the release of Mpumalanga results at its approval meeting of 04 Jan 2010.

Examination irregularities… The Assessment Standards Committee of Umalusi was tasked to do a thorough verification of the Mpumalanga results between 04 and 06 Jan Method used:  comparison of the average performance of schools in 2009 with their average performance in 2008 per subject and based on their raw marks scored in both years.  the Standard deviations of these raw marks were also compared as well as the difference between the raw examination mean & the raw SBA mean between 2008 & Small positive differences in these means from 2008 to 2009 would mean that there were positive interventions. Significant (high) differences would indicate that there were possible irregularities.

Examination irregularities… The investigation showed that most of the differences were negative, indicating that there was a downward trend in the performance of candidates in Mpumalanga. Based on the investigation, the Assessment Standards Committee concluded that their was no indication of any patterns to suggest systemic inflation of results. Umalusi EXCO presented the Umalusi findings to the Minister on the 6 th January Based on this Umalusi Council took a decision to approve release of Mpumalanga results.

Conclusion The findings of the quality assurance processes are a clear indication of a maturing system that has, on the one hand, made positive strides towards improvement in certain areas of assessment and examination, but, on the other hand, still has a few challenges that need to be addressed. The quality assurance of each of these processes presented above was conducted based on Umalusi criteria. Umalusi uses criteria that are subjected to constant review and refinement, to ensure that they are in line with current trends in assessment and examinations.

Conclusion… As a final quality assurance measure, Umalusi moderated the final marks awarded to the candidates. This is done through a rigorous standardization process carried out in line with established principles and procedures. Through this process, Umalusi ensures the consistency of the NSC examination over time and across the provinces. Apart from the statistical inputs presented, Umalusi considered qualitative inputs, as well as very sound educational reasoning to arrive at the 2009 standardization decisions. Umalusi is proud to indicate that in the main, the candidates’ raw marks were accepted. There were very few instances where it was necessary to perform minor adjustments to the candidates’ raw marks.

Conclusion… In general Umalusi is pleased with the manner in which the 2009 NSC examination was administered. Umalusi acknowledges that a number of technical irregularities were reported, but these were addressed in a fitting manner. The few serious irregularities reported were also afforded proper investigation and resolution to ensure that the credibility of the 2009 NSC examination is maintained. Umalusi takes this opportunity to express appreciation to the national & provincial departments of education for their concerted effort in ensuring a credible examination. Umalusi expresses appreciation also to all the relevant stakeholders for the necessary support given in line with Umalusi quality assurance initiatives.

Thank you!