1. LDV Real Driving Emissions: - Assessment of data evaluation methods for RDE -
RDE Task Force Meeting, 7th January 2014
Theodoros Vlachos, Martin Weiss, Pierre Bonnel - European Commission DG - Joint Research Centre (JRC) - IET - Institute for Energy and Transport

2. Objectives Proposal of a comparison among data evaluation methods
Valid trips only.
Solid black line is referred to the mean value of emission measured during the trip as it is listed at TEST REPORT worksheet of EMROAD.
Dashed black line is like the solid one, but no data exclusions for warm up and DPF RGN were applied on the trips.
Blue line is referred to averages obtained by EMROAD independently the severity category (all: Soft, Severe and Normal MAW are used for calculations).
Red Line is EMROAD results referred to normal MAW only (average MAW values).
Green curve is representing emissions computed by CLEAR.
All the results are considering all vehicle speed bins: Urban, Rural, Motorway.
V001 NOx Emissions:
U/R/M Emissions
CLEAR 1.5
EMROAD v5.7

3. Outline Assessment Criteria
Summary of analysis to be conducted per criterion
Results

4. Outline Assessment Criteria
Summary of analysis to be conducted per criterion
Results

5. Assessment criteria (1/1)
ROBUSTNESS:
Ability to evaluate testing conditions (trip)
Data coverage
Ability to assess RDE performance
Ability to assess RDE performance under specific testing conditions
Robustness against uncertainties of data acquisition and data evaluation
Technological neutrality
PRACTICABILITY:
PEMS testing effort
Availability and accuracy/reliability of input parameters
Simplicity of calculation steps
Possibility for independent RDE testing
Flexibility to be adapted to future emissions legislation

6. Outline Assessment Criteria Proposed analysis per assessment criterion
Results

7. Robustness Analysis (1/2)
Analysis and results required from the different tools:
Assessment Criterion
Analysis
ROBUSTNESS
A. Ability to evaluate testing conditions (trip)
Results from indicators (method specific or not)
B. Data coverage
Efficiency in making use of the test data
C. Ability to assess RDE performance
Total emissions [g/km] with and without data exclusion for all tests:
I. Taking into account all driving conditions (normal, severe, soft)
II. For normal driving only
D. Ability to assess RDE performance under specific testing conditions
For normal driving only (for all tests):
I. Average emissions [g/km] for U/R/M, separately, with and without data exclusion
II. Distance weighted emissions [g/km] with and without data exclusion

8. Robustness Analysis (2/2)
Analysis and results required from the different tools:
Assessment Criterion
Analysis
ROBUSTNESS
E. Robustness against uncertainties of data acquisition and data evaluation
Case studies
Data uncertainties: Sensitivity studies
Robustness of data evaluation 1:
Performance of the RDE method for specific testing situations
Roundtrip clockwise and counterclockwise driving
Aggressive versus soft or normal driving style
Aggressive driving during part of a test
Robustness of data evaluation 2:
Sensitivity of the RDE method to their design parameters
F. Technology neutrality
Description of the principles envisaged to adapt the methods to hybrid powertrains and alternative fuels
(Discussion) Implications in terms of testing (Parameters and quality required)
(Possibly) case studies with results (as for criteria A, B, C, D)

9. Outline Assessment Criteria
Summary of analysis to be conducted per criterion
Results

10. Presentation Results
Analysis and results required from the different tools:
Assessment Criterion
Analysis
ROBUSTNESS
A. Ability to evaluate testing conditions (trip)
Results from indicators (method specific or not)
B. Data coverage
Efficiency in making use of the test data
C. Ability to assess RDE performance
Total emissions [g/km] with and without data exclusion for all tests:
I. Taking into account all driving conditions (normal, severe, soft)
II. For normal driving only
D. Ability to assess RDE performance under specific testing conditions
For normal driving only (for all tests):
I. Average emissions [g/km] for U/R/M, separately, with and without data exclusion
II. Distance weighted emissions [g/km] with and without data exclusion

11. Outline Assessment Criteria
Summary of analysis to be conducted per criterion
Results
A. Ability to evaluate testing conditions (trip)
C. Ability to assess RDE performance
D. Ability to assess RDE performance under specific testing conditions

12. A.Testing Cond. (EMROAD) (1/1)
MAW Share vs. Vehicle Speed (EMROAD):
Share of Normal MAW
(V001)
SCM#1, SCM#2, ROUTE#1-AGG route do not show a sufficient number of MAW (10%) for all speed bins (Urban, Rural and Motorway) => NOT VALID trips => to be COMPLEMENTED
EMROAD v5.7

13. A.Testing Cond. (CLEAR) (1/5)
Time Share vs. Power (CLEAR):
ROM#2, ROM#3, SCM#1 and SCM#2 routes show a time share vs. power distribution outside of WLTP region for at least one vehicle speed bin (Urban, Rural, Motorway) => NOT VALID trips => to be COMPLEMENTED
WLTP region is defined on the basis of WLTP target time share and the Deviation Factor.
Power bin related to idling/motored engine operating conditions is not taken into account for validating trips.
Plots depicting time share vs. power distributions of NOT VALID trips are shown in the following slides.

14. A.Testing Cond. (CLEAR) (2/5)
Time Share vs. Power (CLEAR) – ROM#2:
CLEAR v1.5
Time Share vs. Power:
U/R/M (V001)
Time Share vs. Power:
Urban (V001)
Time Share vs. Power:
Rural (V001)
Time Share vs. Power:
Motorway (V001)
Time share [%] of power bin P= kW is outside the region (0.000%, minimum WLTP region=0.011%), for Rural driving.

15. A.Testing Cond. (CLEAR) (3/5)
Time Share vs. Power (CLEAR) – ROM#3:
CLEAR v1.5
Time Share vs. Power:
U/R/M (V001)
Time Share vs. Power:
Urban (V001)
Time Share vs. Power:
Rural (V001)
Time Share vs. Power:
Motorway (V001)
Time share [%] of power bins P= kW and P= kW are outside the region for Urban and Rural driving respectively.

16. A.Testing Cond. (CLEAR) (4/5)
Time Share vs. Power (CLEAR) – SCM#1:
CLEAR v1.5
Time Share vs. Power:
U/R/M (V001)
Time Share vs. Power:
Urban (V001)
Time Share vs. Power:
Rural (V001)
Time Share vs. Power:
Motorway (V001)
Time share [%] of power bins P= kW and P= kW are outside the region for Urban and Rural driving respectively. During Motorway driving all power bins are outside the region.

17. A.Testing Cond. (CLEAR) (5/5)
Time Share vs. Power (CLEAR) – SCM#2:
CLEAR v1.5
Time Share vs. Power:
U/R/M (V001)
Time Share vs. Power:
Urban (V001)
Time Share vs. Power:
Rural (V001)
Time Share vs. Power:
Motorway (V001)
Time share [%] of power bins P=35-84 kW are outside the region for Urban and Rural driving respectively. During Motorway driving all power bins are outside the region.

18. Outline Assessment Criteria
Summary of analysis to be conducted per criterion
Results
A. Ability to evaluate testing conditions (trip)
C. Ability to assess RDE performance
Routes Comparison and driving style comparison
D. Ability to assess RDE performance under specific testing conditions

19. Outline Assessment Criteria
Summary of analysis to be conducted per criterion
Results
A. Ability to evaluate testing conditions (trip)
C. Ability to assess RDE performance
Routes Comparison and driving style comparison
D. Ability to assess RDE performance under specific testing conditions

20. C.RDE Performance (1/2)
NOx Emissions results U/R/M (CLEAR and EMROAD):
CLEAR 1.5
EMROAD v5.7
V001 NOx Emissions:
U/R/M Emissions
Valid trips only.
Solid black line is referred to the mean value of emission measured during the trip as it is listed at TEST REPORT worksheet of EMROAD.
Dashed black line is like the solid one, but no data exclusions for warm up and DPF RGN were applied on the trips.
Blue line is referred to averages obtained by EMROAD independently the severity category (all: Soft, Severe and Normal MAW are used for calculations).
Red Line is EMROAD results referred to normal MAW only (average MAW values).
Green curve is representing emissions computed by CLEAR.
All the results are considering all vehicle speed bins: Urban, Rural, Motorway.
Valid Trips only.

21. C.RDE Performance (2/2)
CO2 Emissions results U/R/M (CLEAR and EMROAD):
CLEAR 1.5
EMROAD v5.7
V001 CO2 Emissions:
U/R/M Emissions
Valid trips only.
Solid black line is referred to the mean value of emission measured during the trip as it is listed at TEST REPORT worksheet of EMROAD.
Dashed black line is like the solid one, but no data exclusions for warm up and DPF RGN were applied on the trips.
Blue line is referred to averages obtained by EMROAD independently the severity category (all: Soft, Severe and Normal MAW are used for calculations).
Red Line is EMROAD results referred to normal MAW only (average MAW values).
Green curve is representing emissions computed by CLEAR.
All the results are considering all vehicle speed bins: Urban, Rural, Motorway.
Valid Trips only.

22. Outline Assessment Criteria
Summary of analysis to be conducted per criterion
Results
A. Ability to evaluate testing conditions (trip)
C. Ability to assess RDE performance
D. Ability to assess RDE performance under specific testing conditions
Routes Comparison and driving style comparison

23. Outline Assessment Criteria
Summary of analysis to be conducted per criterion
Results
A. Ability to evaluate testing conditions (trip)
C. Ability to assess RDE performance
D. Ability to assess RDE performance under specific testing conditions
Routes Comparison and driving style comparison

24. D.RDE Performance: Urban (1/2)
NOx Emissions results Urban Driving (CLEAR and EMROAD):
CLEAR 1.5
EMROAD v5.7
V001 NOx Emissions:
Urban Emissions
Valid trips only.
Solid black line is referred to the mean value of emission measured during the trip as it is listed at TEST REPORT worksheet of EMROAD.
Dashed black line is like the solid one, but no data exclusions for warm up and DPF RGN were applied on the trips.
Blue line is referred to averages obtained by EMROAD independently the severity category (all: Soft, Severe and Normal MAW are used for calculations).
Red Line is EMROAD results referred to normal MAW only (average MAW values).
Green curve is representing emissions computed by CLEAR.
All the results are considering Urban driving.
Valid Trips only.

25. D.RDE Performance: Urban (2/2)
CO2 Emissions results Urban Driving (CLEAR and EMROAD):
CLEAR 1.5
EMROAD v5.7
V001 CO2 Emissions:
Urban Emissions
Valid trips only.
Solid black line is referred to the mean value of emission measured during the trip as it is listed at TEST REPORT worksheet of EMROAD.
Dashed black line is like the solid one, but no data exclusions for warm up and DPF RGN were applied on the trips.
Blue line is referred to averages obtained by EMROAD independently the severity category (all: Soft, Severe and Normal MAW are used for calculations).
Red Line is EMROAD results referred to normal MAW only (average MAW values).
Green curve is representing emissions computed by CLEAR.
All the results are considering Urban driving.
Valid Trips only.

26. D.RDE Performance: Rural (1/2)
NOx Emissions results Rural Driving (CLEAR and EMROAD):
CLEAR 1.5
EMROAD v5.7
V001 NOx Emissions:
Rural Emissions
Valid trips only.
Solid black line is referred to the mean value of emission measured during the trip as it is listed at TEST REPORT worksheet of EMROAD.
Dashed black line is like the solid one, but no data exclusions for warm up and DPF RGN were applied on the trips.
Blue line is referred to averages obtained by EMROAD independently the severity category (all: Soft, Severe and Normal MAW are used for calculations).
Red Line is EMROAD results referred to normal MAW only (average MAW values).
Green curve is representing emissions computed by CLEAR.
All the results are considering Rural driving.
Valid Trips only.

27. D.RDE Performance: Rural (2/2)
CO2 Emissions results Rural Driving (CLEAR and EMROAD):
CLEAR 1.5
EMROAD v5.7
V001 CO2 Emissions:
Rural Emissions
Valid trips only.
Solid black line is referred to the mean value of emission measured during the trip as it is listed at TEST REPORT worksheet of EMROAD.
Dashed black line is like the solid one, but no data exclusions for warm up and DPF RGN were applied on the trips.
Blue line is referred to averages obtained by EMROAD independently the severity category (all: Soft, Severe and Normal MAW are used for calculations).
Red Line is EMROAD results referred to normal MAW only (average MAW values).
Green curve is representing emissions computed by CLEAR.
All the results are considering Rural driving.
Valid Trips only.

28. D.RDE Performance: M.way (1/2)
NOx Emissions results Motorway Driving (CLEAR and EMROAD):
CLEAR 1.5
EMROAD v5.7
Valid trips only.
Solid black line is referred to the mean value of emission measured during the trip as it is listed at TEST REPORT worksheet of EMROAD.
Dashed black line is like the solid one, but no data exclusions for warm up and DPF RGN were applied on the trips.
Blue line is referred to averages obtained by EMROAD independently the severity category (all: Soft, Severe and Normal MAW are used for calculations).
Red Line is EMROAD results referred to normal MAW only (average MAW values).
Green curve is representing emissions computed by CLEAR.
All the results are considering Motorway driving.
V001 NOx Emissions:
Motorway Emissions
Valid Trips only.

29. D.RDE Performance: M.way (2/2)
CO2 Emissions results Motorway Driving (CLEAR and EMROAD):
CLEAR 1.5
EMROAD v5.7
V001 CO2 Emissions:
Motorway Emissions
Valid trips only.
Solid black line is referred to the mean value of emission measured during the trip as it is listed at TEST REPORT worksheet of EMROAD.
Dashed black line is like the solid one, but no data exclusions for warm up and DPF RGN were applied on the trips.
Blue line is referred to averages obtained by EMROAD independently the severity category (all: Soft, Severe and Normal MAW are used for calculations).
Red Line is EMROAD results referred to normal MAW only (average MAW values).
Green curve is representing emissions computed by CLEAR.
All the results are considering Motorway driving.
Valid Trips only.

30. D.RDE Performance:1/3Mix (1/2)
NOx Emissions results (U+R+M)/3 (CLEAR and EMROAD):
CLEAR 1.5
EMROAD v5.7
V001 NOx Emissions:
(U+R+M)/3 Emissions
Valid trips only.
Solid black line is referred to the mean value of emission measured during the trip as it is listed at TEST REPORT worksheet of EMROAD.
Dashed black line is like the solid one, but no data exclusions for warm up and DPF RGN were applied on the trips.
Blue line is referred to averages obtained by EMROAD independently the severity category (all: Soft, Severe and Normal MAW are used for calculations).
Red Line is EMROAD results referred to normal MAW only (average MAW values).
Green curve is representing emissions computed by CLEAR.
results are considering all vehicle speed bins: (Urban+Rural+Motorway)/3.
Valid Trips only.

31. D.RDE Performance:1/3Mix(2/2)
CO2 Emissions results (U+R+M)/3 (CLEAR and EMROAD):
CLEAR 1.5
EMROAD v5.7
V001 CO2 Emissions:
(U+R+M)/3 Emissions
Valid trips only.
Solid black line is referred to the mean value of emission measured during the trip as it is listed at TEST REPORT worksheet of EMROAD.
Dashed black line is like the solid one, but no data exclusions for warm up and DPF RGN were applied on the trips.
Blue line is referred to averages obtained by EMROAD independently the severity category (all: Soft, Severe and Normal MAW are used for calculations).
Red Line is EMROAD results referred to normal MAW only (average MAW values).
Green curve is representing emissions computed by CLEAR.
results are considering all vehicle speed bins: (Urban+Rural+Motorway)/3.
Valid Trips only.

32. For further information, please contact:
Theodoros Vlachos – EC JRC –
Martin Weiss – EC JRC –
Pierre Bonnel – EC JRC –

33. LDV Real Driving Emissions: - Assessment of data evaluation methods for RDE -
RDE Task Force Meeting, 7th January 2014
Theodoros Vlachos, Martin Weiss, Pierre Bonnel - European Commission DG - Joint Research Centre (JRC) - IET - Institute for Energy and Transport