Understanding Impact Statements H. Michael Harrington Executive Director, WAAESD Revised 2009 Over the last several years we all have been challenged to measure the outcomes of our activities

Demand for Increased Accountability Government Performance and Results Act of 1993 (GPRA) Required an accountability system based on performance measurement, including setting goals and objectives and measuring progress toward achieving them AREERA of 1998 Required Plans of Work, Annual Reports President’s Management Agenda - 2001 The Performance Assessment Rating Tool (PART) (http://www.whitehouse.gov/omb/part/) Assessment based resource allocations

What is Impact? The quantifiable difference a program makes in the quality of life for its users. A measurable change in condition. Quantitative, measurable benefits of the research outputs as experienced by those who receive them. - However, the challenge has been to assess, determine and effectively communicate the impacts of our efforts.

Simply put, impact statements answer the questions: Impact Reporting Simply put, impact statements answer the questions: So what? Who cares? and Why? Section 1: The Importance of Impact The “So what?” and “Who cares?” tests are what we apply to every potential impact statement. Emphasize the fact that this is where impact reporting hits home. Public officials, funding agencies, and the public ask these questions to determine if you’re making a difference or not. These impact statement tests are used for regional and national impact reporting programs.

Who cares? The Public Congress Federal, state and local officials Stakeholders External funding sources Industry representatives College leadership

Why does their opinion matter? Seeking quantifiable benefits of programs Have competition for their attention and money Exercise some type of control over your programs “The Golden Rule”!!!! $$$$$$$$$$$$

What is an Impact Statement? A brief summary in lay terms that describes the difference that your efforts have made. Highlights the difference your program is making for the public good. Concisely summarizes what you did to achieve this difference. Clearly states payoffs to society. Answers key questions: So what? Who cares? Why?

Impacts in the context of the Logic Model ISSUE What we do Who we reach What results INPUTS OUTPUTS OUTCOMES Program investments Activities Participation Short Medium What we invest Long Term University of Wisconsin-Extension, Program Development and Evaluation 8

Outcomes Adoption of technology Creation of jobs Reduced cost to the consumer Less pesticide exposure to farmers Access to more nutritious food Cleaner environment and healthier communities

IMPACT Reports, publications, patents, data, workshops or information Description of the program or process Number of persons attending a meeting Number of persons enrolled in a program These are outputs!!!

Elements of a good Impact Statement? Impact Reporting Elements of a good Impact Statement? It illustrates change in at least one of the following: Economic value or efficiency Environmental quality Societal/individual well-being Section 2: Elements of an Impact Statement Emphasize the point here that: an impact statement ILLUSTRATES CHANGE Economics -- “This new spray nozzle cut application of corn herbicides here by 19 percent for an annual savings of $3 per acre.” Environmental quality --the same spray nozzle reduced the risk of damaging trees with spray drift by 85 percent. Social -- 90 percent of the first-time youth offenders who participated in our 4-H program instead of going to detention, did not end up back in the correction system after 7 years. Normally 50 percent do.

An Impact Statement relating to economic return Impact Reporting An Impact Statement relating to economic return Five years ago, Anderson County pork producers spent $17 more than the state average to raise a market hog. We helped them improve their record keeping and production practices, and costs dropped by $20 to $3.19 BELOW the state average. Each farm’s profit increased $345,000 over five years, bringing more hogs, more jobs, and more spending to the county.

An Impact Statement relating to environmental quality Impact Reporting An Impact Statement relating to environmental quality Chopped waste paper is an economical substitute for wood chips commonly used as bedding by the horse industry. Our scientists have found that the paper absorbs moisture better too. By using some of the 76 million tons of paper Americans throw away each year, researchers can reduce landfill demands, save a few trees and keep horses comfy all at once. Can this be improved, if so how?? Section 2: Elements of an Impact Statement An environmental quality statement -- reducing trash by using paper for horse bedding. It’s likely there’s an economic issue here too: positive -- saving costs of land filling paper positive -- paper costs less to buy and dispose of than straw negative -- may need to spend money to dispose of used paper bedding as opposed to spreading straw waste negative -- may need different equipment to handle negative -- will cut into area straw sales Question: What is weak about this statement? (Answer: There’s no dollar value supporting the “economical substitute” claim.)

An Impact Statement relating to health and social wellbeing Impact Reporting An Impact Statement relating to health and social wellbeing Social/Individual wellbeing… (health) No standards exist for wooden basketball, dance and aerobics floors. So, we’re setting them. Our scientists study the role of floor type and construction in chronic-use injuries that often make people stop exercising. Computer models predict how a floor reacts to various forces or environmental changes. Those predictions, and what doctors know about chronic athletic injuries, bring a prescription for safer exercise for athletes of all ages and abilities. Can this be improved, if so how?? Section 2: Elements of an Impact Statement You may want to note the positives and negatives in this statement. For instance, having a percentage of the potential reduction in injuries would help. Hint: As an aside, ask your audience to tell you what would improve this statement. (having the percentage reduction in injuries from this work, for instance)

Reporting potential impact... Impact Reporting Reporting potential impact... Potential impact should be considered, especially in basic research and teaching or youth education work. Section 2: Elements of an Impact Statement Potential impact is a bit tricky to report. But in some of your programs it may be the only option. You’re investing in a future return. The trick is to use reality in illustrating future return on current investment. More on this later.

Example of “potential impact” Impact Reporting Example of “potential impact” We bought special software for classroom computers. The students learned to analyze the total true cost of producing food products. Using the same software industry uses makes these students ready for the job market and ready to enhance the food industry. Section 2: Elements of an Impact Statement