Selecting Criteria and Setting Standards

Useful Criteria and Standards Criteria need to reflect intent of the program Select criteria that can be influenced Select criteria that can be measured reliably Criteria that stakeholders participate in selecting

Developing Goals and Objectives How much agreement on Goals is needed?  Felt or expressed needs Vs. Ascribed Needs  Understanding Behavior Change  Impacting Key Indicators

Different Types of Goals Implementation Goals  Activities that must be completed (resources, activities, and KOSA especially Knowledge and Opinions) to meet goals Intermediate Goals  KOSA, especially Skills and Aspirations and some forms of Practice Change Outcome Goals  Practice Change and SEEC Change

Goal That Apply to all Programs Some goals are unstated but expected!  Treat program participants with respect The golden rule  No negative side effects  Fiscal responsibility  Ethical treatment of all stakeholders

Evaluation Criteria & Evaluation Questions Does the program plan match the values of stakeholders? Does the program or plan match the needs of people to be served?  Ascribed Needs/Secondary Data Research Literature  Felt Needs/Primary Data Needs assessments using any of a variety of techniques Key and Action Informants Advisory Groups

Evaluation Criteria & Evaluation Questions Does the program as implemented fulfill the plans?  Plan your work and work your plan! Exceptions to this rule: Programs that cannot be implemented as planned Value conflicts that make implementation impossible Unintended side effects

Evaluation Criteria & Evaluation Questions Do the Outcomes Achieved Match the Goals?  The level of outcome achieved  Specifying level of outcome  Outcomes and black boxes / The importance of program theory

Using Program Theory Social programming should explicitly state a conceptual framework linking interventions or educational strategies with outcomes. This avoids the black box and allows proper planning

Using Program Theory Bennet’s Hierarchy is a general Behavioral Change logic model This scheme can and should be enhanced with specific knowledge of a program area Some things will be constant:  Multiple contacts with the same audience  A variety of techniques will reach more people  KOSA is necessary for practice change  Practice Change is necessary for SEEC change

Program Logic in Program Development Bennett’s Hierarchy Program Logic Model Social,Economic, Environmental Conditions Practices Knowledge, Opinions, Skills, Aspirations Activities Resources PlanningPerformance

Using Program Theory Implausible Program Theories  PSAs Creates Awareness but not practice change Must have some form of follow-up that is more intensive  Tenuous links or not following the logic all the way through Alligators in Florida

Final Considerations in Criteria and Standards Is the Program Accepted?  Immediate Program Satisfaction Are the resources devoted to the program being expended appropriately?  Program costs in the planning phase Vs. implementation phase  Is the program fair to all stakeholders  Monies spent as described in plans  Outcomes justify the expense

Final Considerations in Criteria and Standards Evaluation Budget Time Credible Criteria with Stakeholders