1. VMAD-03-11
Describe in a few sentences what should be the outcome of the ‘audit/virtual testing/in-use data reporting
Audit
Confirmation that the manufacturers have appropriate processes in place to develop AV’s for the road through the development phase and lifecycle of the vehicle. This shall include the process of updating vehicles on the road.
In addition develop methods to confirm that the vehicle design has mitigated risk and meets the minimum performance requirements.
What are the questions to be answered?
What are the minimum documentation requirements to achieve this?
How early should this process start?
How prescriptive do the requirements need to be and what level should aim for?
Who should conduct the audit?
What is an acceptable level of risk?
Solutions:
Use R79 Annex 6 as a basis (Annex CEL). However, more is required.
FMEA’s, Fault Tree Analysis will be included – how to manage the negative outcomes.
ISO26262 (mainly regarding failures) and SOTIF (some focus on driver assistance systems) taking the basic principles and applying them to an audit approach.

2. Virtual Testing
Develop a method to validate safe driving in millions of driving km without having to drive the vehicle in various traffic scenarios. When a vehicle is registered on the road other road users must have confidence that a minimum standard has been applied to achieve this.
What are the questions to be answered?
Do we need one standardised tool or can multiple solutions be permitted?
How can we interchange simulation models or results?
Where should such a virtual testing tool be hosted?
What is the OEM’s current knowledge level?
How do we define the ODD?
What is an acceptable ‘risk level’? We need to define this.
What are the edge cases for a given technology?
How do we ensure that all infrastructure requirements are covered?
How do we determine that the vehicle has made a ‘right’ decision?
Need to certify the OEM’s methodology used for simulation – how do we determine what is appropriate?
How do we validate the simulation; determine some parameters – ttc in the ODD declared by the manufacturer?
How do we include the audit of the sensor model?
Who is the holder of the database of scenario’s?
Should a scenario description language be standardised?

3. In use reporting
To develop a method/process whereby vehicle safety can be continuously improved when in the market place.
What questions need to be answered?
How to ensure the vehicles on the road continue to learn?
What is the lifecycle of the vehicle?
What kind of data needs to be collected for in use reporting?
At what interval should the data be collected?
Who has access to the data?
What is the reporting structure for reporting this information and decision making?
How do we ensure suitable oversight of the reporting?
How do we ensure transparency of OEM’s decision making to update vehicles?
How to ensure that the newly foreseen scenarios are added to the vehicle capability over the lifetime of the vehicle.
Inspection of validation plan and result must be considered. R140 is a good example for validation.

4. c) Indicate which persons/organisations need to be involved in this group?
CP’s, TAA’s, Tech services, OEM’s, Suppliers, Software companies should be involved
Companies that are deep into validating simulation tool chains
Keep as one group Audit/virtual testing/in-service
Need a high level picture regarding how VMAD will operate
What is a practical first step for audit/virtual testing/in service testing?
Immediate term: Simulation of the manufacturer’s current tools