Outcome of TFCS round robin testing TFCS-ahm-02 Outcome of TFCS round robin testing

Overview of TFCS round robin testing Introduction This report provides a summary of the round robin testing on Cyber Security and Software Update regs The aim was to assess whether different Technical Services/Approval Authorities could reach the same conclusions for both regulations Testing involved two Technical Services (and their respective Approval Authorities) and one manufacturer The information provided comes from the manufacturer The report comes from the DfT in order to anonymise who the participants were (the DfT did not participate)

Approach adopted How the testing was undertaken: Two preparatory workshops were held to align an understanding of the regulations and agree an assessment plan. All parties were invited Assessments of the SUMS and CSMS were made separately, with the manufacturer supplying information requested Vehicle type assessments were conducted jointly at the manufacturers premises, with the same information provided to all parties Reports and feedbacks were provided to the manufacturer by TS/AA

Outcomes Appraisal of the SUMS/CSMS One AA/TS concentrated on the effectiveness/robustness of the regulation whilst the other focused on the evaluation of the processes inside the manufacturer Therefore a direct comparison is not possible Information requested by both was similar The draft ISO 21434 was used as base to conduct the assessment and proved useful in providing a harmonised approach

Outcomes Appraisal of the vehicle type Both TS/AA focused on an evaluation of the information provided Both requested similar information and identified similar gaps in the information provided A full appraisal of all the type approval requirements was not possible (it was not possible to gather all the information required in the time available)

Conclusions The manufacturer concluded that: The different Technical Services and Approval Authorities demonstrated the same understanding of the regulations The different Technical Services and Approval Authorities demonstrated the same understanding of the documentation they required ISO 21434 provided a useful aid to the assessment and harmonising approaches The round robin testing provides an indicative result that a similar conclusion might be reached if a full information package is available