CALMAC July 18, 2007 Meeting Attribution and Net to Gross Examples for Discussion Clark Bernier, RLW Analytics, Inc.

Slides:



Advertisements
Similar presentations
Using computer simulations to assess energy and carbon reductions in building CDM projects Joe Huang March 14, 2011.
Advertisements

Savings Estimation Methods for Energy Efficiency Programs: A Half-Hour Guide Kansas Corporation Commission Workshop on Energy Efficiency March 25, 2008.
1 Residential New Construction And Codes and Standards High Level Findings And Ongoing Studies Mary Kay Gobris PG&E September 22, 2004 CALMAC Meeting.
Cognitive Modelling – An exemplar-based context model Benjamin Moloney Student No:
The Saga Continues: Measure Interactions for Residential HVAC and Wx measures Regional Technical Forum April 23, 2014.
Model Energy Efficiency Program Impact Evaluation Guide - Basics of EM&V Steve Schiller. Schiller Consulting NARUC.
Experience you can trust. Statewide Single-Family Rebate Program Evaluation: Lighting CALMAC/MAESTRO Meeting San Francisco, CA July 26, 2006 Tami Rasmussen.
PD-360 Impact for Title 1 Schools Steven H. Shaha, PhD, DBA July 2011.
Ductless Heat Pumps in Residential Applications Proposed Research Plan.
+ Impact Evaluations and Measurement and Verification First we will focus on ‘Gross Savings’ Determination - savings determined irrespective of why 1 Kentucky.
Energy and Environmental Economics 1 Avoided Cost and E3 Calculator Workshops Energy and Environmental Economics, Inc. October 3, 2005.
Advanced Modeling System for Forecasting Regional Development, Travel Behavior, and the Spatial Pattern of Emissions Brian J. Morton Elizabeth Shay Eun.
DNV GL © SAFER, SMARTER, GREENER DNV GL © ENERGY Industrial, Agricultural and LARGE Commercial- 4(IALC4) 1 PY2013 NRNC WHOLE BUILDING IMPACT EVALUATION.
BPA Pre-Pilot, Monmouth  14 homes with installed DHP, single zone, single compressor.  11 Monmouth, 2 Moses Lake, 1 Tacoma  Savings.
INDUSTRIAL, AGRICULTURAL AND LARGE COMMERCIAL (IALC) ROADMAP CUSTOM IMPACT EVALUATION WEBINAR TO PRESENT RESEARCH PLAN Presentation July 28, 2014.
Work Package 5: Integrating data from different sources in the production of business statistics Daniel Lewis Office for National Statistics (UK)
DNV GL © 2014 SAFER, SMARTER, GREENER DNV GL © 2014 HVAC_3 Quality Maintenance 1 Research Plan.
SDG&E Small Business Energy Efficiency (SBEE) SoCal Gas Non-Residential Financial Incentives Program (NRFIP) Evaluation Results Steve Grover ECONorthwest.
Methodology for Energy Savings claim for Incentive Programs and Codes & Standards(C&S) accounting Presented by: Armen Saiyan P.E. For the California Technical.
1Managed by UT-Battelle for the Department of Energy Michael Blasnik M Blasnik & Associates Greg Dalhoff Dalhoff Associates, LLC David Carroll APPRISE.
Non-Residential Network Computer Power Management UES Measure Update Regional Technical Forum July 16, 2013.
DHP for Houses with Electric FAF Research Plan: Revisions Adam Hadley, Ben Hannas, Bob Davis, My Ton R&E Subcommittee February 25, 2015.
Residential Behavior Programs RTF Subcommittee Ryan Firestone September 17, 2015.
DNV GL © 2013 Confidential April 10, 2014 SAFER, SMARTER, GREENER DNV GL © 2013 Confidential September 8, 2014 Jarred Metoyer ENERGY HVAC Permit Study.
Objectives Analysis tools for determining cost and cost- effectiveness.
1 Summary of C&S Savings Changes Due to New Findings for Standards Douglas Mahone Heschong Mahone Group Inc.
Experience you can trust Refrigerator and Appliance Recycling Program Evaluation CALMAC/MAESTRO Meeting San Francisco, CA July 26, 2006 Tami Rasmussen.
Part III Gathering Data.
Select Issues in Attribution and Net-to-Gross – Practical Examples for Discussion Presented at: CALMAC Meetings July 18, 2007 By: Daniel M. Violette, Ph.D.
+ Impact Evaluations and Measurement and Verification Net Savings - savings determined due to the program 1 Kentucky PSC 9/11/09 Schiller Consulting, Inc.
Evaluation Results of the 2004 & 2005 California Statewide ENERGY STAR® New Homes Program Clark Bernier Presented at the October 17, 2007 CALMAC Meeting.
Bill Savings Public Workshop Costs and Bill Saving in the Low Income Energy Efficiency Programs for 2003 to 2005 April 21, :00 AM to Noon 77 Beale.
Active Learning Lecture Slides For use with Classroom Response Systems Statistical Inference: Confidence Intervals.
BPA M&V Protocols Overview of BPA M&V Protocols and Relationship to RTF Guidelines for Savings and Standard Savings Estimation Protocols.
2004 CAS RATEMAKING SEMINAR INCORPORATING CATASTROPHE MODELS IN PROPERTY RATEMAKING (PL - 4) ROB CURRY, FCAS.
M&V Part 4: M&V Plan Review. 4-2 M&V Plan Review Ø FEMP Documents F M&V Overview Checklist (Phase 2) F Final M&V Plan Checklist (Phase 3) Ø Risk & Responsibility.
IFS Social security reforms and incentives Mike Brewer and Tom Clark Institute for Fiscal Studies May 22 nd, 2002.
Schools Lighting Hours of Use Data Regional Technical Forum May 13, 2014.
1 Proposed Deemed Savings Values for Residential Refrigerator Recycling Programs June 7, 2005.
GROUP 2 Practical C. Question 1 Cut off will depend on the country situation : 1 pig may be significant Frequency distribution – take the lower 10 – 20%
Bill Savings Costs and Bill Saving in the Low Income Energy Efficiency Programs for 2002 to 2004 Bill Savings Public Workshop April 15, San Diego.
PAGE 1 Sustainable Buildings 2030 © 2008 THE WEIDT GROUP Building Energy Benchmarks THE WEIDT GROUP.
Electric / Gas / Water MAESTRO Evaluation Showcase July 26-27, 2006 Project Manager: Pierre Landry, SCE Lead Consultants: Mike Rufo, Itron; Keith Rothenburg,
Applying impact evaluation tools A hypothetical fertilizer project.
New Construction Studies Performed by: MAESTRO/CALMAC Evaluation Showcase ● Pacific Energy Center ● July 26-27, 2006 EM&V of the Statewide Savings By Design.
National Association of Regulatory Commissioners – February 2008 Page 1 of 13 National Association of Regulatory Utility Commissioners Winter Committee.
Comparison of CA Evaluation Protocols, CA Framework, IPMVP and CPUC Policy Manual* A preface to group discussion *In terms of how they define.
Electric / Gas / Water Summary of Final Evaluation Report Prepared by: Rafael Friedmann, PG&E Kris Bradley & Christie Torok, Quantum Consulting 2003 Statewide.
Experience you can trust. NTG Estimation for California IOUs’ Upstream Lighting Program CALMAC Meeting Pacific Energy Center July 18, 2007 Tami.
B O N N E V I L L E P O W E R A D M I N I S T R A T I O N Direct Mail CFLs Ryan Firestone and Carrie Nelson August 30, 2011.
Randomized Assignment Difference-in-Differences
Status Report on EM&V for UC/CSU/IOU Energy Efficiency Partnership Presented to MAESTRO/CALMAC Evaluation Showcase Pacific Energy Center July 26-27, 2006.
REBUILD AMERICA. Why look at the bills? l Bills are the bottom line –they prove the savings!
Chapter 12 Vocabulary. Matching: any attempt to force a sample to resemble specified attributed of the population Population Parameter: a numerically.
Program Evaluation and Impact Assessment: Internet-delivered, On-Demand Professional Development Participating Schools versus Their Respective Districts.
Overview Review results Statewide Pricing Pilot Review results Anaheim Rebate Pilot Compare performance of models used to estimate demand response peak.
RTF Management Updates Jennifer Light Regional Technical Forum February 17, 2016.
Cost-Effectiveness Analysis of BGE’s DSM Programs Marshall Keneipp, PE Summit Blue Consulting, LLC Prepared for: Energy Efficiency and Conservation Stakeholders.
Metering and Measuring of Multi-Family Pool Pumps, Phase 1 March 10, 2016 Presented by Dan Mort & Sasha Baroiant ADM Associates, Inc.
IMPACT EVALUATION PBAF 526 Class 5, October 31, 2011.
Existing Condition Baseline Programs & Codes and Standards
Analysis of 2008 Title 24 Nonresidential Compliance Site Audits
Presentation title Methodological tool and data for the development of a SB for the emission factor of an electricity system CDM Standardized Baselines:
Sampling and Experimentation
2000 CAS RATEMAKING SEMINAR
Py2015 California statewide on-bill finance
Illustrative EE/DSM/DR Planning Process
Catalog Desk Impact and Opportunity Analysis
An overview to this point
Chapter 9 Test for Independent Means Between-Subjects Design
Presentation transcript:

CALMAC July 18, 2007 Meeting Attribution and Net to Gross Examples for Discussion Clark Bernier, RLW Analytics, Inc.

2 Energy Star ® Homes Evaluation “Difference of Differences” Usage/savings results from all Participant and a sample of Non- Participant Title 24 models ESH 02/03 and 04/45 evaluations verified a sample of Participant models Baseline study verified Non-Participant models Matched Non-Participants to Participants by CEC CZ and/or RMST Calculated average compliance margins for participants and non- participants in each CZ (relative to “standard” Package D) Difference between the average compliance margins was the net savings margin (energy saved / baseline energy usage) Multiplied by adjusted tracking baseline usage to get net savings

3 Energy Star ® Homes Evaluation “Difference of Differences” - Issues Need a well-matched Participant and Non-Participant group Separate baseline study made this difficult Different sampling frames RMST w/clustering v. Population Distribution over CEC CZs not comparable RMST zones good for characteristics overview, bad for predicting energy usage/savings Didn’t meter non-participants: assumed metering adjustments affected Parts and Non-Parts equally

4 Savings by Design Evaluation: Self-Reported Model Adjustments Surveyed the builders of all sites in the sample For each site, determined influence of the program measure-by-measure  Dichotomous for yes/no measures  Continuous for continuous measures Adjusted each measure accordingly in each site’s DOE- 2 model Re-ran simulation with net-adjusted measures—savings compared to baseline were net savings

5 Savings by Design Evaluation: Self-Reported Issues Significant “gaming” of system  Learned to ask “how” program affected savings Some buildings are built from common plans  Learned to ask about the program’s impacts on measures in the plans/prototypes instead of in the buildings Potentially more accurate, but more difficult to compute net-to-gross ratio  Without running many different combinations of measures by source, it is difficult to attribute savings beyond a simple net/gross split

6 Utility-Specific Savings from Statewide Programs/Evaluations Statewide Program/ Evaluation Statewide Sample Utility Sample Utility Samples Utility Ratios Statewide Ratio Utility Ratios Utility Tracking Utility Sample Utility Savings