New-Construction Manufactured Homes: Update on the Path to Proven Savings Regional Technical Forum November 10 th, 2015 Josh Rushton & Mohit Singh-Chhabra.

Slides:



Advertisements
Similar presentations
SEEM Calibration: Revisited Revising the regression to use continuous heat loss variable Regional Technical Forum December 17, 2013.
Advertisements

New Construction Calibration Research Results and Request for Decision Regional Technical Forum March 18, 2014.
Residential Refrigerators and Freezers UES Measure Update Regional Technical Forum October 14, 2014.
The Saga Continues: Measure Interactions for Residential HVAC and Wx measures Regional Technical Forum April 23, 2014.
Oregon Energy Star Homes Measure Update New Measure Proposal April 22nd,
SEEM Calibration for Multi-Family Buildings Regional Technical Forum September 18, 2012 Analysis Performed By Ben Larson, Jon Heller, Henry Odum, and Carmen.
High Performance Manufactured Homes Active UES Proposal Presentation to the Regional Technical Forum April 17, 2012 Project Sponsor: Bonneville Power Administration.
UES Measure Sunsets Regional Technical Forum December 17, 2013.
Residential Clothes Washers and Dryers Technical Subcommittee Ryan Firestone & Christian Douglass Regional Technical Forum March 10, PM.
NEEM Manufactured Homes Field Test Results David Baylon, Ecotope.
Manufactured Homes Calibration: Existing and New Homes Mohit Singh-Chhabra & Josh Rushton RTF Update March 17, 2015.
Manufactured Homes Calibration: Existing and New Homes Mohit Singh-Chhabra & Josh Rushton RTF Update May 12, 2015.
Heat Pump Water Heater (HPWH) Subcommittee Christian Douglass Regional Technical Forum June 18, 2015.
Residential New Construction Montana House: UES Measure Update Adam Hadley Regional Technical Forum April 14, 2015.
Manufactured Homes Calibration: Existing and New Homes Mohit Singh-Chhabra & Josh Rushton RTF MH Calibration Subcommittee February 27, 2015.
Direction on Guidelines Savings Definition Path: CONTINUED Remaining Useful Life (RUL) and Measure Interaction Regional Technical Forum February 19, 2014.
Manufactured Homes Calibration: Existing and New Homes Josh Rushton & Mohit Singh-Chhabra RTF Update June 16, 2015.
SEEM 94 Calibration to RBSA Data Progress Report on Phase 2 (Digging a Little Deeper) Subcommittee Regional Technical Forum March 20, 2013.
DHP for Houses with Electric FAF Research Plan: Revisions Adam Hadley, Ben Hannas, Bob Davis, My Ton R&E Subcommittee February 25, 2015.
Applying SEEM Updates, Calibration, and Measure Interaction Decisions to: Manufactured Homes Weatherization UES Measures Regional Technical Forum June.
Delivery Verification Jennifer Anziano Regional Technical Forum March 17, 2015.
Residential Single Family and Manufactured Home Heat Pump Water Heaters Christian Douglass Regional Technical Forum 4/14/2015.
QC Follow-up for Single Family SEEM Calibration, HVAC UES Measures, and Weatherization Measures Adam Hadley Regional Technical Forum May 12, 2015.
SEEM Calibration: Phase-2 Adjustments for Failed VBDD Fits Regional Technical Forum August 12, 2014.
Analysis of Weatherization Measures Options for Savings Methodology and Presentation of Costs from 6 th Plan Regional Technical Forum May 4 th, 2010.
Path for Multi-Family (MF) Weatherization and NC Measures Christian Douglass 8/18/2015.
Applying SEEM Updates, Calibration, and Measure Interaction Decisions to: Single Family Weatherization and HVAC UES Measures Follow-up from August RTF.
SEEM Calibration: Phase II Single Family Heating Energy Regional Technical Forum September 17, 2013 Presented By: Josh Rushton and Adam Hadley Subcommittee.
SEEM Calibration: Phase II Single Family Heating Energy Regional Technical Forum August 20, 2013 Presented By: Josh Rushton and Adam Hadley Subcommittee.
Ductless Heat Pumps (DHP) in Single Family Homes with Zonal Electric Heat Proven UES Measure Proposal Regional Technical Forum November 19, 2013.
SEEM Calibration for Manufactured Homes Regional Technical Forum July 15, 2014.
SEEM Calibration: Phase-2 Adjustments for Failed VBDD Fits RTF Calibration Subcommittee July 31, 2014.
Manufactured Homes Calibration: New Construction Regional Technical Forum September 22 nd, 2015 Mohit Singh-Chhabra.
Research Strategy Review: Advanced Power Strips MH HVAC Related Measures Jennifer Anziano RTF R&E Subcommittee August 6, 2015.
Implementer’s Group July 2015 RTF Meeting Debrief and Upcoming Meeting Prep July 29, 2015.
Implementer’s Group June 2015 RTF Meeting Debrief and Upcoming Meeting Prep June 23, 2015.
Guidelines Revisions Defining What RTF Means by “Savings” December 17,
Proposed Deemed Savings Rates for Energy Star 3.0 Plus 30% Televisions By Christina Steinhoff June 1,
REM as a Compliance Tool Infiltration Trade-off REMRate vs. SEEM February 19th,
SEEM Calibration for Manufactured Housing Regional Technical Forum December 13, 2011 Analysis Performed ByAdam Hadley Cursory Reviews ByTom Eckman, Ben.
SEEM Calibration for Multi-Family Buildings Regional Technical Forum September 18, 2012 Analysis Performed By Ben Larson, Jon Heller, Henry Odum, and Carmen.
Residential New SF Energy Star Homes Idaho and Montana UES Measure Updates: Energy Star Homes, DHP TCO Homes, and BOP2 Homes March 18 th, 2014.
Residential New SF Energy Star Homes UES Measure Update December 17th, 2013.
Implementer’s Group May 2015 Meeting Debrief and Upcoming Meeting Prep May 19, 2015.
PTCS Commissioning, Controls & Sizing Update of UES Measure Category and/or Status Regional Technical Forum July 15, 2014.
Ductless Heat Pumps (DHP) in Single Family Homes with Zonal Electric Heat UES Measure Update Regional Technical Forum March 18, 2014.
Ductless Heat Pumps (DHP) in Single Family Homes with Zonal Electric Heat Proven UES Measure Proposal Regional Technical Forum October 16, 2013.
ENERGY STAR and EcoRated Homes: Planning Estimates and Research Strategy Regional Technical Forum December 8 th, 2015 Josh Rushton & Mohit Singh-Chhabra.
Working Towards Better Savings Estimates for HVAC and Weatherization Measures Regional Technical Forum September 16, 2014.
ENERGY STAR and Eco-Rated Homes: Planning Estimates and Research Strategy Regional Technical Forum December 8 th, 2015 Josh Rushton & Mohit Singh-Chhabra.
Multifamily Homes: Calibration Update Regional Technical Forum December 8 th, 2015.
New Construction Calibration Preliminary Research and a Request for Guidance on Issues Raised in December Regional Technical Forum January 22, 2013.
Applying SEEM Updates, Calibration, and Measure Interaction Decisions to: Manufactured Homes Weatherization UES Measures Regional Technical Forum December.
Residential Showerheads UES Update Ryan Firestone Regional Technical Forum October 20, 2015.
Where did it go? Lost savings found in real-world data SEEM Calibration for the Northwest Power and Conservation Council’s Regional Technical Forum (RTF)
Research Strategy: New-Construction Manufactured Home Measures Research and Evaluation Subcommittee Josh Rushton November 19, 2015.
Idaho and Montana Residential Single Family New Construction Measures Mohit Singh-Chhabra Regional Technical Forum October 20 th, 2015.
ENERGY STAR Commercial Refrigerators and Freezers Regional Technical Forum January 21 st, 2016 Mohit Singh-Chhabra.
RTF New Homes Subcommittee February 11, 2016 Next Step Homes Update.
Planning UES Measures: SF New Construction Heat Pump Upgrades (9.0 HSPF and VCHP) Heat Pump Commissioning Controls and Sizing Adam Hadley Regional Technical.
Planning UES Measures: Prescriptive Duct Sealing SF Performance-based Duct Sealing SF Performance-based Duct Sealing MH Adam Hadley & Josh Rushton Regional.
RTF Management Update Jennifer Anziano Regional Technical Forum July 21, 2015.
Non-Proven Residential Duct Sealing Measures: Research Strategy Josh Rushton and Adam Hadley Research and Evaluation Subcommittee October 7, 2015.
Implementer’s Group October 2015 RTF Meeting Debrief and Upcoming Meeting Prep October 29, 2015.
RTF Management Updates Jennifer Light Regional Technical Forum February 17, 2016.
Mohit Singh-Chhabra, Josh Rushton RTF Presentation March 15, 2016 New Homes Standard Protocol Update.
Ductless Heat Pumps (DHP) in Single Family Homes with Zonal Electric Heat UES Measure Update Regional Technical Forum June 17, 2014.
Research Strategy: Residential Ductless Heat Pumps Research and Evaluation Subcommittee Christian Douglass and Josh Rushton January 8, 2016.
Manufactured Homes: Heat Pump Related Measures Regional Technical Forum Presentation August 18 th, 2015.
Working Towards Better Savings Estimates for HVAC and Weatherization Measures Regional Technical Forum September 16, 2014.
Presentation transcript:

New-Construction Manufactured Homes: Update on the Path to Proven Savings Regional Technical Forum November 10 th, 2015 Josh Rushton & Mohit Singh-Chhabra

Today’s Objective Review recent discussions related MH calibration and new construction measures Get RTF advice and consent on general direction for MH new construction measures – Staff/CAT recommends moving NEEM (ENERGYSTAR) and EcoRated Homes measures to Planning category – Research needed to directly compare average energy consumption in efficient-case homes and in standard (HUD+) new-construction homes – No change to measures for existing MHs 2

Measure Background Two measures for new-construction Manufactured Homes (MH) – MH ENERGY STAR (NEEM 1.1): Only shell specs – MH Eco-Rated: Shell specs + lighting + appliances – Confused about specs? See Additional Slides! Both measures currently – Category “Proven” – Status “Under Review” – Sunset November 30,

Calibration History (Existing MH) August 2014: RTF approved MH Calibration for existing homes (Phases I & II) – Calibration captures adjustment factors that align modeled heating energy consumption (SEEM.69) with observed heating energy consumption (VBDD) – Adjustments correct an unknown mix of misalignments related to heating load, system performance, behavioral, and other factors December 2014: CAT presented Wx savings for existing MH based on calibration – Savings values much lower than expected – RTF directed CAT to review calibration, compare with pre/post program data June 2015: CAT showed how calibration results compare to pre/post data from Idaho Power program – Reasonable agreement for Wx savings in Electric Resistance (ER) homes; RTF approved calibration curve and Wx savings for existing MHs with ER heat – Poor agreement for Heat Pump (HP) conversions and Wx in HP homes; HP-related MH measures moved to planning; Research Strategy approved at August meeting 4

Calibration History (New MH) September RTF Meeting – CAT proposed extending calibration curve for new construction homes by adding 89 NEEM homes to the RBSA dataset – Baylon observed that VBDD naturally over-estimates space heating Algorithm picks up HDD-correlated energy consumption from other end-uses (e.g., winter-time increases in lighting and water heating) Worrisome because calibration objective was to align SEEM’s space heating estimates with VBDD May be especially important for NC homes with low heat loads Since September – NEEA contracted Ecotope and Energy RM to look into the VBDD question and assess whether calibration can reliably estimate savings for new construction measures – CAT worked with NEEA, Ecotope, and Energy RM to resolve easy issues and identify difficult issues 5

Recent Discussions 6

NEEA Working Group Concern 1 CAT Response in RED Back-of-envelope calculations suggest VBDD picks up about 1000 kWh of HDD-correlated consumption from end-uses other than space heating Makes sense. Easy to modify calculations – Subtract 1000 kWh from VBDD heating energy variable at the outset – Notation: Adjusted VBDD = VBDD.ht.kWh – Leads to ≈1000 kWh reduction in baseline and efficient-case heating energy estimates No significant effect on savings estimates 7

NEEA Working Group Concern 2 CAT Response in RED The relationship between SEEM and VBDD is distorted when the calibration curve is defined in terms of percent differences (SEEM – VBDD)/SEEM – A linear relationship or simple off-set between SEEM and VBDD will appear curved when expressed in percent terms – This leads to more extreme adjustments for efficient homes than standard homes, and this will bias savings estimates CAT disagrees. Single relationship can be expressed in more than one way – Trend may look different under different transformations, but this doesn’t change the basic relationship (more on this next) – Can change how different points influence regression fit This can affect final fitted trend, especially when data is sliced thin Effect is not systematic – not a bias threat – No systematic effect on savings (see additional slides) 8

How do predictions based on percent-scale regression look when we convert them to predicted kWh and add them to the absolute-scale plot (left)? Concern 2: Percent differences vs absolute kWh Data filters: No heat pumps, R2 > 0.45, SEEM & VBDD < 20,000 kWh

Predictions from percent- difference regression roughly agree with trend in absolute kWh plot

Concern 2: Percent differences vs absolute kWh …a closer look at that lower plot Linear fit Predictions from percent- differences plot Loess smoother fit

NEEA Working Group Concern 3 CAT Response in RED Calibration may be capturing behavioral or other issues. Doesn’t seem consistent with pure-physics account of heat loss. Right – main concern is how much slower the meter spins 12

Concern 4.1: Comparing RBSA to NEEM CAT Response in RED 13 RBSA not a sufficient comparison group Only includes 6 non-NEEM homes built since 2004 Other RBSA U-values may not be consistent with NEEM U-values ∆kWh / ∆SEEM.69 (slope) differs between RBSA and NEEM samples CAT agrees data sets may not be similar enough for “fair” comparison Today’s recommendation based on this concern Probably shouldn’t read much into apparent difference in slopes NEEM homes all have the same U- values in SEEM input Data sets look more similar when x- axis scaled as kWh/sq.ft. (see additional slides)

Concern 4.2: Comparing NEEM to NEEM? CAT Response in RED 14 ∆kWh / ∆SEEM.69 (the slope) near 1 for NEEM homes Makes physical sense – maybe we should use this trend for calibration adjustments CAT disagrees. In NEEM sample, SEEM.69 only varies because of climate and sq. ft. Slope ≈ 1 only says SEEM.69 treats sq. ft. & climate about right in NEEM homes Not enough to generalize ∆kWh / ∆SEEM.69 to address changes in Uo

Proposed Path Forward 15

Motivation Need data that provides direct insight into difference between energy consumption in efficient new MHs and standard new MHs Ideally, data will include billing kWh and building specs for samples of efficient and standard new homes 16

Staff Recommendation New-Construction MH (ENERGYSTAR and EcoRated Homes): Move both measures to Planning. Research strategy to emphasize that savings estimate(s) should be closely tied to observed differences in kWh between efficient and baseline groups. – Final UES values likely to include adjustments based on SEEM models (plus observed ∆kWh / ∆SEEM.69) Examples: Savings by heating zone; cross-walk between NEEM and EcoRated savings estimates – Area of special emphasis: For basic savings estimates to be accepted, need fairly “clean” comparison across groups. Confounding variables (heat pumps, wood heat, etc.) tracked where possible to avoid major imbalances between the groups “Fair” comparison probably more important than wide regional representation or highly detailed audit data Existing MH measures: No change. We’ve already compared savings against IDP pre/post program data – More data always welcome; no need to move back to planning in the mean time 17

Discussion and RTF Direction Is this the right path? Can feasible research really get us to more solid ground? Should Staff/CAT develop a Research Strategy in order to move the ENERGYSTAR and EcoRated manufactured homes measures to the Planning category? 18

Decision needed “I, _______, move that the RTF extends the sunset date for both manufactured homes measures, ENERGYSTAR and EcoRated homes, to March 31, 2016” 19

Additional Slides 20

Alphabet Soup HUD. Minimum federal standard, some homes still being built to this spec – HUD update working its way through the system, likely to take effect within a few years – New HUD requirements expected to come close to the current NEEM specs (NEEM 1.1). HUD+. Estimated average spec for non-NEEM/EcoRated home since about NEEM 1.0 was SuperGoodSense after that program ended. NEEM 1.0 lasted until NEEM 1.1 refers to the NEEM program as updated in 2004 (current spec at time of this presentation) – Relative to NEEM 1.0, big change is that NEEM 1.1 locks down window efficiency at U-0.35 (prior to this, efficient windows could be traded off against other shell components). – NEEM 1.1 specs cover shell components, duct sealing and ventilation (exhaust fan, max 32 Watts, running continuously, no heat exchanger), plus a tiny DHW thing (0.93). – NEEM 1.1 meets current ENERGY STAR requirements, but the reverse does not always hold. It might not make sense for RTF to use the ENERGY STAR label in its measure workbooks because NEEM 1.1 is really the requirement, and the national ENERGY STAR spec would not always meet NEEM. (Marketers would still be able to use ENERGY STAR label for all NEEM homes) EcoRated is NEEM 1.1, plus window U-0.32, 80% efficient lighting, ENERGYSTAR fridge and dishwasher, and low-flow showerheads and faucets. HPMH is a very efficient spec that has been studied in small demonstration projects but currently has very little traction in the region. NEEM 2.0 doesn’t yet exist. It is currently a placeholder for the program that will replace NEEM 1.1 after the coming HUD update takes effect 21

Savings estimates according to three different calibration regressions (1) Estimated savings for existing construction measures. For demonstration only (figures have not undergone thorough QC) Represented calibrations: Percent-difference regression with original VBDD estimates – Essentially the calibration from September Percent difference regression with VBDD – Upper-left graph in four-plot slide above Absolute-scale regression – Upper-right graph in four-plot slide 22

Savings estimates according to three different calibration regressions (2) Estimated savings for existing construction measures. For demonstration only (figures have not undergone thorough QC) Represented calibrations: Percent-difference regression with original VBDD estimates – Essentially the calibration from September Percent difference regression with VBDD – Upper-left graph in four-plot slide above Absolute-scale regression – Upper-right graph in four-plot slide 23

24 Both graphs use y = percent difference Only difference is x-variable: SEEM kWh/ft 2 (left) vs SEEM kWh (right) Left: As SEEM kWh/ft 2 varies, trend in percent differences similar between NEEM and RBSA Right: As SEEM kWh varies, trend in percent differences looks different between NEEM and RBSA This highlights the risk of drawing conclusions from a comparison of different data sets Note: x-variable choice (kWh versus kWh/ft 2 ) has little net effect on estimated savings in RBSA-only calibration Note on X-axis scale Data filters: No heat pumps, R2 > 0.45, SEEM & VBDD < 20,000 kWh