Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension ANNIES Impact Reporting: Stepping Up to the Challenge National Women in Agriculture Educators Conference March 25, 2010 in Baltimore, MD Madeline Schultz and Bob Wells

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension Annie’s Project Mission To empower farm women to be better business partners through networks and by managing and organizing critical information.

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension Purposes of Evaluation “An evaluation approach should be rigorous in its efforts to determine the worth of a program and to guide program implementation and management, as well as relevant and useful to program practitioners.” Anne C. Peterson Senior Vice President for Programs, W.K. Kellogg Foundation

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension Layers of ANNIES Evaluation Outcomes: 1. Knowledge 2. Actions 3. Impacts Demographics: 1. Numbers 2. Characteristics

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension Importance of Impacts Reports and requests –Universities & organizations –Government & private funders Impacts demonstrate true success –Profitability –Rural lifestyle satisfaction ANNIES Learning & growth

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension ANNIES has Meaningful Data Class Evaluations –Local, state and national reports Journal of Extension –The Effectiveness of Women’s Agricultural Education Programs: A Survey from Annie’s Project ANNIES Fall 2009 Survey 2009 NIFA portfolio review

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension 21 Annie’s Project States Demographics Measures

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension StateCY 2009Jan-Mar 2010 No. Level I Classes Number of Participants No. Level I Classes Number of Participants Arkansas0000 Delaware00235 Florida00567 Illinois Indiana87300 Iowa Kansas11500 Kentucky Maryland Michigan Minnesota Demographics Measures

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension StateCY 2009Jan-Mar 2010 No. Level I Classes Number of Participants No. Level I Classes Number of Participants Mississippi0000 Missouri Montana00969 Nebraska North Dakota Ohio Oklahoma21600 Pennsylvania0000 South Dakota Wisconsin Totals Demographics Measures

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension Demographics Age Average: 49 Range: Marital Status 11 (All) Married Children Average: 2 Range: 1-5 Counties McLeod -4 Wright - 4 Sibley - 3 Wright, Pope – 1 Wright, Pope, Stearar – 1 Business Information Years Farming Average: 18 Range: 2-33 Total: 217 Acres Total Owned: 5646 Average Owned: 471 Total Farmed*: 10,940 Average Farmed*:2817 Type of Business Organization 9 Sole Owners 2 Partnerships Incomes $50,001-$150,000: 6 $15,001-$300,000: 2 Over $300,000: 2 Sample Pre-Class Survey Analysis Demographics Measures

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension Journal of Extension Article Table 1: Summary of 'Yes' Responses for Selected Questions QuestionPre-test Percent Yes Post-test Percent Yes Difference Production records70.00%83.70%13.70% Marketing plan10.00%22.80%12.80% Balance Sheet55.80%77.20%21.40% Income Statement43.20%68.50%25.30% Comfort w/debt level66.30%84.80%18.50% Next generation plan45.30%64.10%18.80% Life Insurance90.50%95.70%5.20% Will70.00%76.10%6.10% Source: Hambleton-Heins Southern Illinois University, 2009 Outcome Measures of Knowledge

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension Source: Hambleton-Heins Southern Illinois University, 2009 Table 2: Pre-test/Post-test Comparison by Risk Category and by Total Risk Category # of questions Pre-test % yes Post-test % yesDifference % Change Production %52.81%5.18%10.80% Marketing626.58%35.33%8.75%32.90% Financial %72.32%15.58%27.40% Legal650.96%64.67%13.71%26.90% Human Resource %59.67%10.46%21.20% All Categories %59.49%10.92%22.50% Journal of Extension Article Outcome Measures of Knowledge

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension ANNIES Fall 2009 Survey 61% of respondents –developed a network of local peers and professionals –that motivate and support them with risk management issues Outcome Measures of Actions

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension Percent of Participants Attending Additional Educational Classes Outcome Measures of Actions

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension Responses to the Question: What was the most important thing you took away from Annie’s Project? “I did feel better informed; "empowered" to ask questions and apply research; and overall encouraged to use the skills given in the class as well as from other farm wives.” “I now know who I need to go talk to when I have a question on any farming topic. Annie's Project brought in a great group of speakers who know the industry well and are very helpful even after the classes.” “The support of other women, going thru the same challenges...it changed my life forever, knowing I have valuable skills inside me that are now emerging...to learn, grow and share with other people. Outcome Measures of Actions

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension NIFA Portfolio Review –NIFA demonstrated ANNIES relevance to Risk management education FSA borrower training NRCS collaborations National network of educators working together Intersection of farm and family finances –Reported in NIFA Sustainable Agriculture Primary KA 902 and Secondary KAs 607, 801 Outcome Measures of Action

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension Testimonials Stories of improved conditions resulting from new knowledge and the actions women take after participating in Annie’s classes Qualitative data is useful, but we still need quantitative measures Outcome Measures of Impacts

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension Stepping up to the Challenge ANNIES would like to re-survey more participants to collect impacts over time –Qualitative stories –Quantitative measures ANNIES would like to implement –Collection of more complete and relevant data –Third party objectivity through an evaluation partner –Greater accuracy in analysis and reporting –Attention to creation of scholarly work

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension Integrate Evaluation with Planning Logic models Evaluation teams Stakeholders Good questions Eval. processes Budgets Analysis and Reporting

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension NIFA Logic Model

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension Evaluation Teams ANNIES has good evaluation resources Access to third party evaluator –Adds credibility –ISU Research Institute for Studies in Agriculture Creates opportunity to build evaluation capacity

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension Good Questions ANNIES is working to –Develop new evaluation instruments –Pilot these in IA & IL We want input from the network The goal is national consistency

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension Good Program Evaluation Benefits ANNIES and Women in Agriculture Gain new knowledge about women in agriculture and their learning needs Strengthen effectiveness of courses Create new courses to meet identified needs Support further educator network development and organization Build shared meaning and understanding about ANNIES with other organizations Expand ANNIES to serve more women in more ways

Annie’s National Network Initiative for Educational Success (ANNIES) at Iowa State University Extension Thank You for Your Interest! Madeline Schultz Iowa State University Extension Program Coordinator Bob Wells Iowa State University Extension Farm Management Specialist