Evaluation Independence and Political Influence: Thoughts and Reflections David J. Bernstein, Ph.D. Senior Study Director, Westat Rockville, Maryland Sponsored by the Government Evaluation TIG 2012 American Evaluation Association Conference Session 476, 200J October 26, 2012 8:00 to 9:30 a.m.

Disclaimer Even AEA presentations can be political, so… The opinions expressed are my own, and do not reflect an official position of Westat or its clients.

Accountability IS Political The Public: Voters, Taxpayers, Citizens, Clients Internal/External Processes External Processes Strategic Plans Elections Elections Performance Measurement/Service Effort & Accomplishment (SEA) Reports Elected and Appointed Officials Internal Processes Public Budget Documents Public Budget Documents Internal Management Reports Internal Management Reports Personnel Operations Personnel Operations Program Evaluations/ Audits Budget & Decision Documents Budget & Decision Documents Programs, Program Managers, & Govt. Staff Policy Analysis Policy Analysis

Evaluation Policy IS Political Great Society Programs (1960s): Evaluation activities mandated with set-asides of 1 to 3 percent of program budgets. Big evaluations were scientifically rigorous but were resource intensive and not timely. Expanded Evaluation Funding and Infrastructure (1970s): Funding for evaluations and infrastructure (organizational evaluation units) expanded in the 1970s as pressure from Congress led to block grant vehicles that gave more programmatic flexibility to state and local governments. Evaluation Policy As Politics (1980s): Reductions in force and budget cuts in the Reagan Administration hit evaluation functions and activities particularly hard. Reagan Administration approach: let political agenda rather than data drive decision-making processes.

Evaluation Policy IS Political Vice President Gore’s National Performance Review (1992): Focused on reinventing government, including shifting emphasis from inputs (resources) to customer services and results. Government Performance and Results Act (GPRA, 1993): Required federal agency strategic planning, performance reporting, and evaluation. Has it worked? Ask GAO. Program Assessment Rating Tool (2002-2008): Rated federal programs. Some good ideas, but with misleading consequences. GPRA Modernization Act of 2010: Provides for more frequent and transparent reporting of performance information, enhanced consultations between Congress and agencies, cross-agency planning and reporting, and defined roles for federal agency Chief Operating Officers and Performance Improvement Officers. Obama Administration: Stopped PART. Increased emphasis and funding for rigorous strategic evaluation of high priority programs.

When the going gets weird… …the weird turn pro (Hunter S. Thompson). Knowing that everything is political can be used to your advantage. Find out what stakeholders want/need, and focus on that. Focusing on intended uses by intended users (Patton) can provide more open discussion of relevant interests. Use dialogue and communication early and often to point out where stakeholder interests may differ so a compromise and resolution may be sought. The AEA Guiding Principles are a useful tool for communicating about systematic inquiry, competence, integrity/honesty, respect for people, and responsibilities for general/public welfare.

On Being an Evaluation Consultant The hardest lesson to learn is when not to talk, especially if you’re me. It’s not easy, glamorous, or secure. If I can make it look that way it’s because I am an experienced professional evaluator. Surprise (not): There are internal as well as external politics. First impressions are everything, so every first impression could be your last. Reputation, integrity, and your word are everything. “I don't want any yes-men around me. I want everybody to tell me the truth even if it costs them their job.” Samuel Goldwyn …and finally, “If I look confused it's because I'm thinking.” Samuel Goldwyn

For a copy of this PowerPoint or other information, contact: Contact Information For a copy of this PowerPoint or other information, contact: David J. Bernstein, Ph.D. Senior Study Director, Westat 1600 Research Blvd, RA1292 Rockville, MD 20850 davidbernstein@westat.com