IEc INDUSTRIAL ECONOMICS, INCORPORATED Measuring the Dosage Effect: Using Tenure as a Variable in Assessing Program Impact Angela Helman, Principal June 23, 2011

INDUSTRIAL ECONOMICS, INCORPORATED2 WasteWise Background Established in 1994 Designed to assist organizations in identifying cost-effective strategies for: Reducing municipal solid waste (MSW) generation Increasing recycling of MSW Increasing purchasing of recycled-content products Program has approximately 2700 partners across many sectors Partners include private firms, local governments, colleges and universities, and other agencies and organizations

INDUSTRIAL ECONOMICS, INCORPORATED WasteWise Partner Services Technical Assistance -Website -Helpline -Waste tracking and reporting system (Re-TRAC) -GHG calculations Recognition -Awards Program -WasteWise publications Networking -Annual Conference 3

INDUSTRIAL ECONOMICS, INCORPORATED WasteWise Program Evaluation Questions 1. WasteWise uses a variety of approaches to influence the behavior of partners. Which approaches—for example technical assistance, information, awards and recognition—are most effective for which types of partners? 2. In addition to participation in WasteWise, what other factors may influence a partner organization’s decisions to improve management of MSW (e.g., cost savings, consumer pressure, other voluntary program opportunities)? 3. What can be determined about how WasteWise participation contributes to partner behavior regarding MSW management (e.g., by effecting waste management improvements sooner, better incorporating waste management as a permanent feature of corporate culture, facilitating non-participant changes by providing information)? 4. What can EPA do to encourage WasteWise partners to submit sufficient environmental data for performance measurement and evaluation purposes? 4

INDUSTRIAL ECONOMICS, INCORPORATED USPS Survey USPS is very active in WasteWise; all relevant USPS facilities have been enrolled since 2008 Conducted an online survey of USPS facilities that manage large quantities of MSW Survey focused on recycling and source reduction behavior, and influences on waste management behavior Divided universe into early joiners and later joiners “Dosage Effect” hypothesis: If WasteWise promotes better MSW management, then early WasteWise joiners should report greener waste management behaviors compared to later WasteWise joiners, due to longer exposure to WasteWise technical assistance and services 5

INDUSTRIAL ECONOMICS, INCORPORATED Natural Controls for Self-Selection Bias Facilities surveyed were of two specific types: bulk mail centers and processing and distribution centers Facilities surveyed have the same characteristics in terms of their operations and wastes generated Decisions of when to join WasteWise were typically made at higher levels 6

INDUSTRIAL ECONOMICS, INCORPORATED Survey Sample Design Early joiners (Group A): surveyed universe of facilities that joined in the 1990s Later joiners (Group B): surveyed a geographically stratified sample of facilities that joined in For Group B, chose a sample size that considered need for statistical validity and need to limit burden on USPS staff 7 FACILITY LEVEL GROUPS POPULATION SIZE EXPECTED RESPONSE RATE INITIAL SAMPLE SIZE EFFECTIVE SAMPLE SIZE Group A (early joiners)5575%5541 Group B (later joiners)40550%200100

INDUSTRIAL ECONOMICS, INCORPORATED Actual Response Rates Actual response rates were very similar among Group A and Group B, and averaged at 52% This response rate was high enough to support statistical analysis 8 GROUPFACILITIES SURVEYEDRESPONDEDDID NOT RESPOND Group A Group B Total

INDUSTRIAL ECONOMICS, INCORPORATED Select Findings on the Dosage Effect Early USPS WasteWise joiners conduct more recycling activities than later joiners 9

INDUSTRIAL ECONOMICS, INCORPORATED Findings on the Dosage Effect Early USPS WasteWise joiners have higher recycling frequencies than later joiners 10

INDUSTRIAL ECONOMICS, INCORPORATED Findings on the Dosage Effect Early USPS WasteWise joiners are more aware of their recycling rates than later joiners 11

INDUSTRIAL ECONOMICS, INCORPORATED Additional Findings that Underscore Dosage Effect Timing of when facilities started recycyling is generally consistent with when facilities joined WasteWise Even though WasteWise technical assistance was generally not “branded” with the program name at the facility level, 27% of facilities in Group A compared to just 14% in Group B cited the program as a reason for originating recycling activities Results from focus group of several sectors represented in WasteWise (not just USPS), and interviews with USPS management, validate survey findings that WasteWise contributes to positive changes in waste management behavior 12

IEc INDUSTRIAL ECONOMICS, INCORPORATED