1. 1 st KWAZULU - NATAL ABET IN THE WORKPLACE INDABA 22 June 2009 John April 1 Quality Assurance in ABET and its implications

2. KZN – learner performance overview Total ABET Level 4 enrolment for KZN = 57 as given earlier by Mrs S. Mthembu 54 learners passed = 94,7% pass rate Certificates issued: 2001 – 2007 +/- 15 000 learning area certificates (11% of national total) +/- 900 full GETCs HALALA KZN! HALALA! WELL DONE KZN!!

3. Historical Background Umalusi has been engaged with quality assurance of assessment of ABET Level 4 internal and external assessments since 2001 Initially they looked at policy compliance and system related issues Focus have gradually shifted from this to a more quality driven monitoring & evaluation approach – through verification 3

4. Legislative change – Implications for Umalusi NQF Act replaces SAQA Act of 1995 Umalusi becomes 1of 3 Quality Councils CHE and Umalusi redefined & new QCTO Umalusi Sector (not Band) ETQA – responsible for general and further education and training as provided for in institutions 4

5. Mandate Ensuring continuous enhancement of quality in delivery and outcomes of the General and FET sectors of the national education and training system (in institutions) Developing a sub-framework of qualifications and a quality assurance framework for GET and FET 5

6. This means… Development of a Quality Assurance Framework iro the sub-framework for GET and FET Advice to the Minister of Education (change) Focus is on a combination of three aspects that determine standards for certification in GFET: Quality assurance of provision (accreditation) Quality assurance of qualifications and curricula Quality assurance of assessment 6

7. For AET, this means, Umalusi… Accredits private providers of ABET/AET and assessment bodies who offer and/or assess approved qualifications and curricula Evaluates and approves - and develops - the relevant qualifications and curricula in GET and FET bands (managing the sub-framework) Quality assures assessment, both internal and external (exams), at exit points for both public and private examinations Certificates learner attainment 7

8. Setting and assuring standards for the sub-framework: The “Potjie” Approach Developing and evaluating qualifications and curriculum The stew = combination of approaches: Assessment: Combination of external and internal assessment = Exams and CASS Quality of provision: Self-evaluation / improvement and inspection Few qualifications types with central curriculum Supported by: Research, data analysis and reports Result: Credible certification = Standards Quality assuring Institutions & assessment bodies Quality assuring assessment standard Credible Certification Data analysis and reporting “fire” Research “fire” 8

9. Quality Assurance Regime Quality assurance of provision – accreditation of providers and assessment bodies Quality assurance of assessment –Moderation of question papers –Moderation of internal assessment (CASS /SBA) –Monitoring of the writing of the ABET level 4 examination –Moderation of marking and –Stadardisation of examinations and internal assessment results Qualifications, curriculum and certifications – approving and developing the new sub-framework 9

10. Moderation of question paper focus on: Adequate representation of the curriculum in the question papers Adequate representation of relevant conceptual domains and relevant levels of cognitive challenge Fairness & reliability of question papers Maintain public confidence in the examination system 10

11. Umalusi criteria for moderation of question papers: Content coverage Cognitive skills Internal moderation Language and bias Predictability Adherence to policy Marking memoranda Technical criteria Overall impression of the paper 11

12. Moderation of internal assessment focus on: RELIABILITYFAIRNESS VALIDITY Maintain public confidence in the moderation of internal assessment 12

13. Moderation of internal assessment: Site Based Assessment (SBA) Tasks Internal Moderation of SBA tasks @ DoE per LA External Moderation Level Report on Findings of External Moderation Setting of SBA tasks Internal Moderation of SBA tasks Centre Level District / Regional Level Provincial Level Implementation SBA tasks SBA moderation process 13

14. Umalusi criteria for moderation of SBA tasks: Pre-moderation –Sampling of portfolios –Compliance to policy –Educator training –Quality of site-based assessment –Internal moderation and –Monitoring and evaluation 14

15. Umalusi criteria for moderation of SBA tasks: Moderation of educator and learner portfolios –Provincial policies –Quality of internal moderation at all levels –Quality and standard of assessment tasks –Recording and reporting 15

16. Umalusi criteria for moderation of SBA tasks: Post-moderation –Informal feedback session followed by formal report –Reporting on the key findings –Identifying areas of concern and –Recommending areas for improvement 16

17. Why the focus on exams? Examinations are more reliable – the CASS marks show poor correlation between exam marks. Therefore we statistically moderate (standardize against exam mark). It provides a common standard across the country We are currently exploring additional alternatives for workplaces and providers eg. Provider forum and more assessment opportunities – pilot project 17

18. Challenges for SBA in the workplace Implementation – mainly outsourced to providers, quality of provision sometimes questionable. Skills crisis (lack of skilled or adequately / appropriately qualified workforce) Financial crisis - funding Lack of buy-in from employers and employees Time associated with training / learning (completion / full qualification) Benefits for both parties (ROI / qualification / promotion opportunities) 18

19. Role of workplace in internal assessment Take responsibility of staff development – ABET in particular Mandated obligation – legislation / NSDS 2 / parliament / policy Social responsibility – economic empowerment / poverty reduction Geared towards satisfying long term HRD needs – skills shortage Provide opportunities for learning (access, redress, etc.) Adult Learners’ Week Theme for 2009: –L–Living to learn & learning to live: The power of youth and adult learning 19

20. Implications for the workplace Integrated approach Strategic partnerships with other departments Political will Dedicated funding for programmes Improved ME&R Long term HRD strategy - MDGs 20

21. Umalusi Research: AET The f-word (Curriculum and assessment of compulsory fundamentals in provider programmes), 2007 Improving public schooling seminar series: How can quality assurance improve quality, 2008 Umalusi’s site visits to private adult education & training (AET) providers 2007, 2008 Report on the quality assurance of the ABET Level 4 Examinations, 2008 The state of national curricula in ABET, 2008 (not released yet) 21

22. Thank you – contact details: John April Assistant Manager: Quality Assurance of Assessment for Adult Education and Training Tel: (012) 349 1510 ext 254 Fax: (012) 349 1511 or (012) 349 2742 (QAA:AET) Cell: 074 344 2302 Email: john@umalusi.org.za john@umalusi.org.za 22