2. FUTURE SUCCESS: WHAT IS REQUIRED? A Case for Collaborative Multisite Evaluation National Institute for Occupational Safety and Health

3. Presenters: Vicky Buchan, Ph.D. Sue Tungate, MSW

4. NIOSH Agricultural Centers By Regional Boundaries

5. MULTISITE EVALUATION TEAM Past and Present Vicky Buchan - HI-CAHS Barbara Brooner - Pacific Northwest Center Henry Cole - Southeast Center Carol Donnelly - Southeast Center Giulia Earle-Richardson - Northeast Center Tara Erb - Northeast Center Virginia Fischer – National Farm Medicine Center Karen Gilmore - Southwest Center Susan Hewitt - HI-CAHS Adrienne Hidy - Pacific Northwest Center Barbara Kennedy - Deep-South Center Rose Krebill-Prather - UC Davis Center Marian McDonald - Southeast Center Sharon Morris - Pacific Northwest Center Deb Multerer - National Farm Medicine Center Pat O’Connor-Marer - UC Davis Center Barbara Pies - Great Plains Center Risto Rautiainen - Great Plains Center Pete Rentos - Deep-South Center Mary Lynne Thames - Southwest Center David Tipton - Southeast Center Christine Townsend - Northeast Center Sue Tungate - HI-CAHS Katheryn Wilson – Southeast Center Nancy Young - National Farm Medicine Center A special thanks to HI-CAHS support staff and interns Angi Buchanan Helen-Holmquist Johnson Tammy Brannen-Smith Chris Bartholomew Marilyn Davis Mary Gardner

6. Where we came from NIOSH focus on agriculture 1989, Agriculture at Risk: A Report to the Nation Based on 1988 Iowa conference to develop agricultural occupational and environmental health policy strategies for the future

7. NIOSH Agricultural Initiative Original Extramural programs Agricultural Safety & Health Centers Farm Family Health and Hazard Surveillance O. H. Nurses in Agricultural Communities Agricultural Health Promotion Systems Cancer Control Demonstration Projects

8. Kennedy Report The first recommendation addressed the need for evaluation. NIOSH and the Centers need to work together to develop an evaluation scheme for: The various component programs and projects [within site] and The Centers overall [multi- or cross-site]

9. Issues Important to ACE Congressional intent that Initiative have “a significant and measurable impact” BSC recommendation for overall strategic planning process BSC recommendation for better internal and external communication

10. The Beginnings of ACE

11. NIOSH Agricultural Center Initiative Objectives 1. Conduct research 2. Implement model education outreach 3. Evaluate control technologies 4. Implement model programs 5. Evaluate 6. Provide consultation and training 7. Develop linkages and communications 8. Dissemination

12. DISEASE & INJURY WORK ENVIRONMENT & WORKFORCE RESEARCH TOOLS & APPROACHES Allergic and Irritant Dermatitis Asthma and Chronic Obstructive Pulmonary Disease Fertility and Pregnancy Abnormalities Hearing Loss Infectious Diseases Low Back Disorders Musculoskeletal Disorders of the Upper Extremities Traumatic Injuries Emerging Technologies Indoor Environment Mixed Exposures Organization of Work Special Populations at Risk Cancer Research Methods Control Technology and Personal Protective Equipment Exposure Assessment Methods Health Services Research Intervention Effectiveness Research Risk Assessment Methods Social & Economic Consequences of Workplace Illness & Injury Surveillance Research Methods NORA CATEGORYPRIORITY RESEARCH AREAS

13. GOAL OF COLLABORATIVE MULTISITE EVALUATION To coordinate center evaluation efforts seeking standardization of methodology to enable continual monitoring of progress and impact of the whole INITIATIVE without losing individual uniqueness of each center

14. OBJECTIVES Document Initiative progress Facilitate Inter-Center/NIOSH collaboration Increase Initiative effectiveness Assist Initiative program planning

15. Short Term Measures Mid Term Measures Long Term Measures

16. NIOSH Objectives -- NORA Indicators and Key Variables Initiative PR Report Annual Multisite Initiative Report Information for Center Reporting MULTISITE EVALUATION NIOSH Agricultural Initiative Mission HEALTH SAFETY PREVENTION Initiative Multisite Database

17. Database Variables Identifying Information Center & PHR Title & Description Center or Project Objectives PI or Contact Person Status Key Variables Strategy (Research, Intervention, Education, Evaluation) Topic or Key Word Activities Professional Education or Training Products Target Group Demographics & Number of Contacts Indicators Collaboration Dissemination Leveraging Regionalization Replication Research Need Special Sector NIOSH NIOSH Objectives (number) NORA – Priority Research Area (for Research)

18. MULTISITE CHALLENGES After-the-fact evaluation projects (or retrospective evaluations) Variation in program implementation (even if similar objectives across sites) Contextual differences between sites lead to further adaptation Multiple theoretical perspectives Differential “buy-in” to need for and purpose of evaluation

19. The Process Communication Conference Calls E-mails Meetings Planning Travel Agenda Timelines Documentation Database Design and Documentation Orientation Data Aggregation Collate Team Output Organization Archiving Annual Reports

20. RESEARCH QUESTIONS 1. Target population contacts - By NIOSH Objective? By strategy? 2. Research projects - By NORA 3. Special Sector activities 4. Products achieved 5. Target groups of Initiative 6. Collaborative efforts – NIOSH & Centers or others 7. Education & Training under Center Auspices 8. Value of leveraged funds & services 9. Regionalization – States where Center activity occurred

30. THE FUTURE