1. Evaluating and Institutionalizing OD Interventions9
Evaluating and Institutionalizing OD Interventions

2. Illustrate the research design and measurement issues associated with evaluating organization development (OD) interventions.
Explain the key elements in the process of institutionalizing OD interventions.

3. Issues in Evaluating OD Interventions
Implementation and Evaluation Feedback
Measurement
Select the right variables to measure
Design good measurements
Operational
Reliable
Valid
Research Design

4. Implementation and Evaluation Feedback
Feedback aimed at guiding implementation efforts
Milestones, intermediate targets
Measures of the intervention’s progress
Evaluation
Feedback
Feedback aimed at determining impact of intervention
Goals, outcomes, performance
Measures of the intervention’s effect

5. Organization Environments and Inputs
Environmental Types
General Environment
Task Environment and Industry Structure
Rate of Change and Complexity
Enacted Environment
Environmental Dimensions
Information Uncertainty
Resource Dependency

6. Implementation and Evaluation Feedback
Diagnosis
Design and
Implementation
of Interventions
Implementation of Intervention
Implementation
Feedback
Evaluation
Feedback
Clarify
Intention
Plan for
Next Steps
Measures of
the Intervention and Immediate
Effects
Measure of
Long-term
Effects
Alternative
Interventions

7. Sources of Reliability
Rigorous Operational Definitions
Provide precise guidelines for measurement
How high does a team have to score on a five-point scale to say that it is effective?
Multiple Measures
Multiple items on a survey
Multiple measures of the same variable (survey, observation, unobtrusive measure)
Standardized Instruments

8. Validity Face Validity or Content Validity
Does the measure “appear” to reflect the variable of interest?
Criterion or Convergent Validity
Do measures of “similar” variables correlate?
Discriminant Validity
Do measures of “non-similar” variables show no association?
Predictive Validity
Does the variable of interest accurately forecast another variable over time?

9. Research Designs in OD Interventions
Features of Strong Research Designs
Longitudinal Measurement
Change is measured over time
Comparison Units
Appropriate use of “control” groups
Statistical Analysis
Alternative sources of variation have been controlled

10. Evaluating Different Types of Change
Alpha Change
Movement along a stable dimension
Beta Change
Recalibration of units of measure in a stable dimension
Gamma Change
Fundamental redefinition of dimension

11. Institutionalization Framework
Organization
Characteristics
Indicators of
Institutionalization
Institutionalization
Processes
Intervention
Characteristics

12. Organization Characteristics
Congruence
Extent to which an intervention supports or aligns with the current environment, strategic orientation, or other changes taking place
Stability of Environment and Technology
Unionization

13. Intervention Characteristics
Goal Specificity
Objective vs. subjective
Programmability
Clarify & plan
Level of Change Target
Organization vs. group vs. individual
Internal Support
System to guide change process
Sponsorship
Management with power to allocate resources and nurture change program

14. Institutionalization Processes
Socialization
Communicate information about change across organization
Commitment
Members freely select change behaviors
Reward Allocation
Link rewards to new behaviors
Diffusion
Transmission of change across organization systems
Sensing and Calibration
Implementation feedback

15. Indicators of Institutionalization
Knowledge
Performance
Preferences
Normative Consensus
Value Consensus

16. Indicators of Institutionalization
VALUE CONSENSUS
NORMATIVE CONSENSUS
PREFERENCES
PERFORMANCE
KNOWLEDGE