1. Evaluation Independence and Political Influence: Thoughts and Reflections
David J. Bernstein, Ph.D.
Senior Study Director, Westat
Rockville, Maryland
Sponsored by the Government Evaluation TIG
2012 American Evaluation Association Conference
Session 476, 200J
October 26, :00 to 9:30 a.m.

2. Disclaimer Even AEA presentations can be political, so…
The opinions expressed are my own, and do not reflect an official position of Westat or its clients.

3. Accountability IS Political
The Public:
Voters, Taxpayers,
Citizens, Clients
Internal/External Processes
External Processes
Strategic Plans
Elections
Elections
Performance Measurement/Service Effort & Accomplishment (SEA) Reports
Elected and
Appointed Officials
Internal Processes
Public Budget Documents
Public Budget Documents
Internal Management Reports
Internal Management Reports
Personnel Operations
Personnel Operations
Program Evaluations/
Audits
Budget & Decision Documents
Budget & Decision Documents
Programs,
Program Managers,
& Govt. Staff
Policy Analysis
Policy Analysis

4. Evaluation Policy IS Political
Great Society Programs (1960s): Evaluation activities mandated with set-asides of 1 to 3 percent of program budgets. Big evaluations were scientifically rigorous but were resource intensive and not timely.
Expanded Evaluation Funding and Infrastructure (1970s): Funding for evaluations and infrastructure (organizational evaluation units) expanded in the 1970s as pressure from Congress led to block grant vehicles that gave more programmatic flexibility to state and local governments.
Evaluation Policy As Politics (1980s): Reductions in force and budget cuts in the Reagan Administration hit evaluation functions and activities particularly hard. Reagan Administration approach: let political agenda rather than data drive decision-making processes.

5. Evaluation Policy IS Political
Vice President Gore’s National Performance Review (1992): Focused on reinventing government, including shifting emphasis from inputs (resources) to customer services and results.
Government Performance and Results Act (GPRA, 1993): Required federal agency strategic planning, performance reporting, and evaluation. Has it worked? Ask GAO.
Program Assessment Rating Tool ( ): Rated federal programs. Some good ideas, but with misleading consequences.
GPRA Modernization Act of 2010: Provides for more frequent and transparent reporting of performance information, enhanced consultations between Congress and agencies, cross-agency planning and reporting, and defined roles for federal agency Chief Operating Officers and Performance Improvement Officers.
Obama Administration: Stopped PART. Increased emphasis and funding for rigorous strategic evaluation of high priority programs.

6. When the going gets weird…
…the weird turn pro (Hunter S. Thompson).
Knowing that everything is political can be used to your advantage.
Find out what stakeholders want/need, and focus on that.
Focusing on intended uses by intended users (Patton) can provide more open discussion of relevant interests.
Use dialogue and communication early and often to point out where stakeholder interests may differ so a compromise and resolution may be sought.
The AEA Guiding Principles are a useful tool for communicating about systematic inquiry, competence, integrity/honesty, respect for people, and responsibilities for general/public welfare.

7. On Being an Evaluation Consultant
The hardest lesson to learn is when not to talk, especially if you’re me.
It’s not easy, glamorous, or secure. If I can make it look that way it’s because I am an experienced professional evaluator.
Surprise (not): There are internal as well as external politics.
First impressions are everything, so every first impression could be your last.
Reputation, integrity, and your word are everything.
“I don't want any yes-men around me. I want everybody to tell me the truth even if it costs them their job.” Samuel Goldwyn
…and finally, “If I look confused it's because I'm thinking.” Samuel Goldwyn

8. For a copy of this PowerPoint or other information, contact:
Contact Information
For a copy of this PowerPoint or other information, contact:
David J. Bernstein, Ph.D. Senior Study Director, Westat
1600 Research Blvd, RA1292
Rockville, MD 20850