1. DNV GL © 2016 SAFER, SMARTER, GREENER DNV GL © 2016 HVAC 3 Quality Maintenance 1 2013-14 Program Year Impact Evaluation

2. DNV GL © 2016 2013-14 Research Plan  Public review in 2015 (www.energydataweb.com)www.energydataweb.com  Non-residential focus (95% of savings)  Approach by Measure Group because program tracks savings by measure – Difficult to evaluate whole unit and disaggregate to measures – New laboratory data to support measure savings  Choosing measures to focus on… 2

3. DNV GL © 2016 2013-14 Tracking Data 3 Commercial QM and HVAC tune up Program Savings by Measure kWh

4. DNV GL © 2016 Overview of the research plan 4

5. DNV GL © 2016 Deviations from Research Plan 5 Objective from Research Plan In Report Status Detail / Why? Ex post gross kWh, kW and therm, RR Yes Ex post net kWh, kW and therm NoNTG surveys and analysis behind schedule. Will be reported in a follow-up addendum. Reasons for RRYesReasons for high/low Realization Rate Timely feedbackNoProgress drafts of field data provided to ED advisors, but no memos to CPUC, IOUs, or stakeholders. Installation rateYesNot applicable to coil cleaning measure Unit Energy Savings (UES) PartialUnit energy savings not recalculated per research plan for thermostat adjustment and fan control measures. Sample CompletionPartialSamples were partially completed. See sample table below. Precision targetsPartialPrecision target exceeded for coil cleaning and economizers, below for other measures. See table below.

6. DNV GL © 2016 Deviations from Research Plan 6 Measure Sample PlannedAchievedDifference Ride Along Ex Post Ride Along Ex Post Ride Along Ex Post Coil Cleaning2928 RCA22 24 (9 usable) -13 Economizer21243 Supply Fan Control514 -50 Thermostat51511-5-4 Measure Precision Planned Precision Achieved PrecisionDifference Coil Cleaning ± 31% ± 17% 14% RCA ± 35% ± 56% -21% Economizer ± 36% ± 24% 12% Supply Fan Control ± 47% ± 70% -23% Thermostat ± 42% ± 72% -30%

7. DNV GL © 2016 Deviations from Research Plan 7 IOUProgram Number of Fielded Sites Un-usable SitesReason PGEAirCare Plus98test only PGECQM31test only SCECQM21missing charge adjust data in implementer SDGEDirect Install43sites missing from implementer data SDGEDeemed62 one site missing from implementer, other sites found but missing charge data for some units Total 2415 62% of fielded RCA sites were not used in the analysis

8. DNV GL © 2016 Realization Rate Results Coil Cleaning Refrigerant Charge Adjustment Economizer Repair Thermostat Adjustment Supply Fan Control Adjustment PG&E Commercial QM 29%43%30%20% Air Care Plus619%3%44%30%pass-through SDG&E Deemed Incentives– Commercial HVAC 64% 56% Commercial Direct Install 58%26%56%30% SCE – Quality Maintenance Measure Commercial QM91% 8

9. DNV GL © 2016 Key Findings Coil Cleaning  Coil cleaning realization rate of 64% in the SDGE programs. – Lab data different from previous data used in WP.  AirCare Plus program high RR (619%), due to claim reduction directed by disposition.  Workpapers have same savings for Evaporator and Condenser coil cleaning – Lab data shows evaporator (cooling coil) cleaning savings within measurement error 9

10. DNV GL © 2016 Key Findings Coil Cleaning 10

11. DNV GL © 2016 Key Findings Refrigerant Charge  RCA 25%-65% realization rate primarily due to difference between new laboratory data and the previous data – Lab data show lower capacity and efficiency impacts than previously assumed  Diagnostic protocols varied by program and don’t result in factory charge – More work needed on diagnostic protocols 11

12. DNV GL © 2016 Key Findings Economizer  Average economizer realization rate of 56% is higher than the previous evaluation findings of 23%.  Evaluation findings were based primarily on economizer functionality found in the ex post field effort.  Most economizers had non-digital controllers – Design flaws with older controllers 12

13. DNV GL © 2016 Key Findings Thermostat  Thermostat 30% IR because many did not meet program setback requirements. 13 Utility Installed thermostat measure workpaper specifications for unoccupied building periods Cooling set point temperature Heating set point temperature SCE85F60F SDG&E85F55F PG&E85F60F

14. DNV GL © 2016 Key Findings Supply Fan Control  Only evaluated for PG&E’s Commercial QM program. 20% IR based on their implementer- supplied data, which was inconsistent with the tracking claims. 14 Initial Supply fan condition in PGE CQM implementer data

15. DNV GL © 2016 Key Findings SCE QM  The implementer data installation factor was much higher than disposition assumptions. 15 Individual Treatment Disposition Incidence Implementer Data Incidence Refrigerant Charge Adjustment40%38% Condenser Coil Cleaning40%86% Evaporator Coil Cleaning20%97% Air Flow Adjustment20%32% Thermostat Replacement20%18% Thermostat Reprogramming10%29% Economizer Repair10%26% Economizer Reprogramming10%17%

16. DNV GL © 2016 Recommendations  Re-think evaporator coil cleaning, only very dirty coils show impacts.  Re-think charge adjustments, indirect diagnostics should continue to be evaluated.  Issue of claiming refrigerant charge adjustments that were test only, double check that claims are supported 16

17. DNV GL © 2016 Recommendations  Economizers – exclude some types that are problematic, provide training on ADEC  T-stat and Supply fan – data needs to support claims  Link between implementer data and tracking 17

18. DNV GL © 2016 Recommendations Recommend Implementer Collect More Data – Coil cleaning: discharge pressure and outdoor temperature – RCA: amount of charge added or removed from the units by the program – Economizer repair: changeover setpoint and photograph of the economizer open and closed for each claimed economizer – Thermostat adjustment: set point temperatures before and after adjustment – Supply fan control: baseline fan state 18

19. DNV GL © 2016 Next Steps – Collect more true-baseline data and more lab data under mixed faults for coil cleaning measures – Collect more RCA field data –Larger than anticipated variability (cv=2.5 instead of cv=1) means we need a larger sample. – Collect additional data on why economizers are not functioning. Collect data to further quantify outside airflow rates. – Collect more thermostat and supply fan control data. (cv=1.5 instead of cv=1). 19

20. DNV GL © 2016 SAFER, SMARTER, GREENER www.dnvgl.com Posting Comments: http://www.energydataweb.com/cpuc/ search.aspx; select “2013-2014” program cycle and search “HVAC”. Public comment may be posted to the Public Document Area through Tuesday March 15, 2016. http://www.energydataweb.com/cpuc/ search.aspx 20 Jennifer McWilliams Jennifer.mcwilliams@dnvgl.com 510.390.5756 (mobile) Lola Odunlami Lola.odunlami@cpuc.ca.gov 415.703.1893