1. Process Eval Quality assurance and process evaluation

2. Process Eval Quality –appropriateness of a set of professional procedures for a problem & objective to be achieved

3. Process Eval Quality control –methods used to produce documentation of the quality of program procedures

4. Process Eval Performance standard –minimum acceptable level of performance set by experts to judge quality of a person or program’s practice

5. Process Eval QA review –documentation of the competence of the program/provider with changes to improve if found inadequate

6. Purpose Monitoring Is it reaching the target audience? What’s effective? What’s relative costs? What needs more work?

7. Process Eval Methods Which methods of data collection already mentioned could you use in process eval & monitoring?

8. Methods of Process Eval Form used to monitor, Fig. 4.1, Windsor & Percentage exposed data next Table 4.5, Windsor

9. Process Eval Percentage exposed –number who come to program divided by potential number

10. Fig. 4.1 Form for process evaluation

11. Table 4.5 Percentage of participants exposed to program

12. Process Eval Using performance standards & calculating an ‘Implementation Index’ & ‘Program Implementation Index’

13. Process Eval See handout Table 4.7, Windsor - Hypothetical process evaluation of employee participation in a health promotion program

14. Process Eval Percentage Reached - B/A = C Performance Standard - the % that should have been reached

15. Process Eval Implementation Index - C/D = E If less than 1 - what does that mean?

16. Process Eval Program Implementation Index Sum of all E/total number of E What is the PII of this program?

17. Process Eval Before start a program determine the performance standards, II and PII acceptable Helpful for monitoring program

18. Process Eval This health program recorded a 20% behavior change rate Only 20 out of 100 enrollees changed behavior

19. Process Eval What phases of the program may have been a reason for the low behavior change rate? Is a PII of.78 a high enough number?

20. Process Eval If this program director had been monitoring the program, when should changes have been made?

21. Process Eval What else could have been done?

22. Process Eval Monitoring use of information services

23. Process Eval Audience reach with a message campaign

24. Process Eval Records of staffing & workloads (Moving to the Future, read this) Questions about how the participants likes the teacher or facilities

25. Methods of Process Eval Type III error –failure to implement a health education program the way intended –if outcomes evaluation shows no effect, maybe because not implemented

26. END Process Eval Questions?