External Examining at Northumbria Dr. Ann Macfadyen Acting Faculty Associate Pro-Vice Chancellor (Learning and Teaching), Faculty of Engineering and Environment Northumbria University

AIMS for today To provide: A brief introduction to Northumbria University Role of the external examiner at Northumbria University Assessment processes and guidance A brief overview of the University Assessment Regulations

About Northumbria

External Examining: The Role External examiners are appointed to provide each institution with impartial and independent advice, as well as informative comment on the institution's standards and on student achievement in relation to those standards QAA, UK Quality Code, Chapter B7: External Examining

The Role ……to provide informative comment and recommendations upon whether or not: an institution is maintaining the threshold academic standards set for its awards in accordance with the frameworks for higher education qualifications and applicable subject benchmark statements the assessment process measures student achievement rigorously and fairly against the intended outcomes…. and is conducted in line with the institution’s policies and regulations the academic standards and the achievements of students are comparable with those in other UK higher education institutions of which external examiners have experience. QAA Quality Code for Higher Education Chapter B7: External Examining

Aspects of the role External examiners are: expected to comment on assessment process and academic standards not required to comment on learning resources, although such comments will be welcomed and considered regarded as ‘critical friends’

Levels of involvement Levels contributing to the award level 5/6 of honours programmes level 5 of Foundation Degrees exceptionally at level 3/4 if contributing to award or required by professional body all modules on PGT programmes Comment on provision delivered in Partnerships Programme Assessment Board (PAB) external overview of operation, handling of personal or technical extenuating circumstances (PECs and TECs)

External examiner involvement Design of assessments Moderation of assessment marking and feedback Exam board processes

Assessment design stage New development being rolled out, not all examiners involved as yet New online portal to: facilitate the internal and external moderation/approval of assessment tasks – assignment briefs, exam papers etc. – prior to them being issued to students Collect relevant assessment submission data Removes the need to complete Word forms or email large files and provides a level of consistency in the presentation of certain information Bespoke user interface based on personal allocations of modules Provides a clear audit trail of activity in line with the moderation policy and QAA standards Accessed via e:Vision

Assessment moderation Feedback from external examiners about location of work for moderation – lack of consistency between modules Working group set up to develop more standard practice eg. Specific area within Blackboard module pages

Moderation Standards Samples of assessed work Internally Moderated Square root of student cohort, minimum 6 Dissertations UG following mark-concealed second marking of all dissertations, standard sample plus confirmation of process sent to external examiner PGT possibly larger sample by agreement All work (including exam scripts) is returned to students

Module reporting Assessment brief / copy of examination paper Marking scheme / solutions / grade descriptors / assessment criteria A sample of scripts A list of students and marks for the whole cohort which should be added as an appendix to this template, including markers’ names and appropriate breakdown of marks between questions / sections / components answered

Module reporting form

Programme Assessment Board PAB Chair - FPVC Secretary Prog. Leaders External Examiners Module Leaders can attend Head of Dept FAPVC (L and T)

Pre-PAB scrutiny of marks Satisfactory internal and external moderation Trends, anomalies, missing information and benchmark norms PEC Sub-committee recommendations noted on the PAB report Anonymous marking Release of marks by each department, noting any issues arising including TEC decisions, Academic Misconduct cases and ratification of mark changes from Heads of Department (HODs)

PAB processes Summary lists of majority of students Results which would normally be acknowledged without detailed or individual discussion Detailed reporting for students Those who are borderline or have PECs that have been accepted Statistical summaries Module and programme results Discussion Instances of significant deviation from modular benchmark norms Reports from departments Concerns flagged by an External Examiner as part of their sampling process.

Exam Board Structure Programme Assessment Boards To confirm the progression/award status for individual students To confirm that pre-PAB scrutiny of module marks has taken place To receive confirmation from the External Examiner(s) that the PAB has been conducted in accordance with points 1 and 2 as mentioned above.

Key Resources Web Pages: Roles and responsibilities of external examiners https://www.northumbria.ac.uk/sd/central/ar/qualitysupport/asspolicies/eeguidance/?view=Standard Assessment Regulations and Policies https://www.northumbria.ac.uk/sd/central/ar/qualitysupport/asspolicies/?view=Standard External Examiners Annual Report Guidance https://www.northumbria.ac.uk/static/worddocuments/ardocs/ee/eereportwriting Report Templates

Adjusting Marks? The external examiner may wish to recommend, either formally at the PAB or informally in advance of it, that module marks are changed e.g. by scaling a set of marks, for the whole cohort, either up or down recommend the correction of marks that have been determined incorrectly, where both internal and external markers are in agreement but may not recommend adjustments to individual marks

Your Report Standard template in an electronic format Single report which should cover all deliveries, where programmes/modules run at overseas partners Students and staff should not be named Normally required by 31st July Written response by Northumbria must be provided Shared with student representatives Reports, and responses to them, form part of the University’s formal review process https://www.northumbria.ac.uk/sd/central/ar/qualitysupport/asspolicies/eeguidance/?view=Standard

New Reporting Portal Project underway to create an online portal External examiners will complete the report online Programme/Academic leads will complete the response/action plan online Aiming for new portal to be in place by May 2018 for completion of 2017/18 annual reports It would be useful to have 3 or 4 volunteers who could help us with testing and give us feedback

Faculty Contacts   Contact Information Description of duties Academic Contact Name, Position, Telephone Email name@northumbria.ac.uk Liaison over assessment strategy, professional requirements, programme structure and module content Academic Contact for Franchise provision Liaison in relation to assessment strategy, moderation and module content for delivery at our partner institution. Faculty Registrar Advice on regulatory issues Administrative Contact Exam Board dates, marking schedule, approval of assessments, moderation of samples Administrative Contact for Franchise provision Exam Board dates, marking schedule, moderation of samples in relation to delivery at our partner institution

Academic Registry Structure

Overview of Programme Framework for Northumbria Awards

Northumbria Graduate Characteristics A Northumbria graduate will be able to: Be able to think independently, understand and justify their own opinions, and will recognise the need to challenge their thinking, and the thinking of others Be able to apply their disciplinary knowledge to complex problems in their discipline and its professional or industrial practice in order to identify appropriate solutions which are sustainable and justifiable. Value curiosity, collaboration and analysis as keystones in the creation of new knowledge and practice Be able to communicate effectively to diverse audiences utilising a range of formats and media Display the attitudes and skills to engage and work constructively and sensitively in multi-cultural environments and teams and have an awareness of ethical considerations Combine all of the above to support their future employability and long term career prospects

Northumbria Graduate Characteristics In addition, a Northumbria Masters graduate will be able to: PG Cert / Diploma will be able to: Critically reflect on their own work and that of others Present and justify their work, in the context of wider theories and practice, to their peers Display and critically apply expert knowledge within areas of their discipline and /or its practice Masters degree will further be able to: Conceptualise, theorise and undertake research which addresses complex issues and which advances understanding within the discipline or practice Contribute to the creation of new knowledge and /or applications to practice within their discipline through a critical understanding of the processes through which knowledge is created. Formulate balanced judgements when considering incomplete or ambiguous data and can communicate these judgements clearly to both specialist and non-specialist audiences

Design Pillars

The framework – Key features Option modules must contribute directly and positively to the Programme learning outcomes, and there should be no more than: No options at level 4 40 credits of option at level 5 80 credits of option at level 6 20 / 30 credit modules or multiples there of as the building blocks for taught post graduate awards. Provision of opportunity all programmes at level 5 of all undergraduate degrees to enable study abroad / placements (Semester or Full Year) Year Long modules can continue but clear semesterised step on step off point & process has to be approved with module design

External Examining at Northumbria Assessment Regulations: An overview

Assessment Regulations Available at: https://www.northumbria.ac.uk/ARTA

AWARDS Awards are made up of a particular number of credits at specified level/s: Honours degrees normally comprise 360 credits: 120 at levels 4, 5 and 6 Masters degrees normally comprise 180 credits at level 7 All modules must be passed to progress to next level or stage Where modules are failed, referral or compensation may be possible Any approved variations will be made clear by Faculty

Degree Classification Based on best 100 credits from level (i.e. disregarding 20 credits with lowest mark) 3 Year Degree (Hons) Programmes: Either the average of the best 100 credits in levels 6:5 weighted 60%:40%; or the average of the best 100 credits in level 6 (whichever benefits the student) https://www.northumbria.ac.uk/static/5007/arpdf/ARTA

Modules Modules contribute an approved number of credits Provided students have passed the module overall then not all assessment components need to be attempted Module pass mark normally 40% for UG (level 6 and below) 50% for PGT (level 7) modules/components can be pass/fail

Referral Automatic referral opportunity on PT programmes FT programmes: If level average requirement is met, no limit to number of referrals level 3/4 - 30% levels 5/6 - 40% level 7 - 45% One opportunity to resit PGT dissertation, irrespective of level average After referral, module capped at pass mark. This mark will be used for the calculation of level averages and final classification

Compensation Not available at intermediate stages of PT programmes On FT programmes, level average requirement must be met Module mark must be at least 30%; a failed pass/fail module cannot be compensated or a module containing academic misconduct Maximum 20 credits per 120 credit level Credit awarded (and module pass mark)

Review of assessment regulations Proposals that have been out to consultation: the removal of separate part time and full time regulations the removal of a level average requirement at first sit to determine eligibility for re-sit and compensation for full time students bring the compensation threshold for PGT in line with UG.  ie, 10% below the pass mark allowing students to interrupt studies at any point in the year allowing failing students to repeat the final (awarding) year of their course removal of a progression point for PGT students after 120 credits

Thank You We hope you enjoy your time as an External Examiner at Northumbria Dr Ann Macfadyen Acting Faculty Associate Pro-Vice Chancellor (Learning and Teaching), Faculty of Engineering and Environment Northumbria University ann.macfadyen@northumbria.ac.uk +44(0)191 227 4754

Any Questions?