Summative Evaluation of Communication CSS 387 May 3, 2012.

Slides:



Advertisements
Similar presentations
Program Evaluation: What is it?
Advertisements

Training Companies are in business to make money, and every business function is under pressure to show how it contributes to business success or face.
MHealth Evaluation & Text4Baby Doug Evans September 20, 2010.
Leave No Trace Outdoor Skills and Ethics A National Education Program Designed to Teach Stewardship, Land Ethics, and Outdoor Skills on Public Lands.
Leon County Schools Performance Feedback Process August 2006 For more information
IMPLEMENTATION OF DYNAMIC IN THECLASSROOM AND ITS INCIDENCE ON CHILDRENS PERFORMANCE AND MOTIVATION OF FIFTH GRADEOF BASIC EDUCATION AT ANDRES SEVILLA.
OECD/INFE High-level Principles for the evaluation of financial education programmes Adele Atkinson, PhD OECD With the support of the Russian/World Bank/OECD.
Promoting Recycling Behavior: What Works.
Reasons for Evaluating Training Companies are investing millions of dollars in training programs to help gain a competitive advantage. To justify the costs.
Introduction to Theories of Communication Effects: The Theory of Reasoned Action A service of the Communication Science & Research Resource Group.
Research Plan: Using Data to Create Impactful Pride Campaigns
1 Copyright © 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole.
Theory of Planned Behaviour and Physical Activity EPHE 348.
CfE Higher Physical Education
Examples of Behavioral Interventions Wednesday, September 12, 2007 CSS 387.
Attitudes and Attitude Change
Strategic Management Process Lecture 2 COMT 492/592.
Entertainment Education Components of Successful Campaign Design.
Human Resource Management: Gaining a Competitive Advantage
Community Planning Training 1-1. Community Plan Implementation Training 1- Community Planning Training 1-3.
Chapter 4 Learning: Theories and Program Design
A Study of the 2004 Street Smart Communications Program Prepared by Riter Research for: Metropolitan Washington Council of Government’s May 2004 Advertising.
Contributions of Contextual Teaching to Improved Student Learning Richard L. Lynch, PI University of Georgia (706)
Introduction to Theories of Communication Effects: Social Learning Theory A service of the Communication Science & Research Resource Group.
Account Planning Concepts and Definitions. Account planners….. Discover how to connect with consumers and inspire them to respond. Identify behavior patterns.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Elizabeth Godfrey 1.  Periodic assessment of results Appropriateness, effectiveness, efficiency, impact, sustainability  Identifies intended and unintended.
California Integrated Waste Management Board 1 Summary Of Community- Based Social Marketing (CBSM) Pilots to Increase Used Oil Recycling Rate (FY 2003/2004.
The Interpersonal Mode
Do They Say Thank You? Evaluation of a Social Skills Curriculum in a Youth Development Program.
“Tell real stories about real people” -Anonymous “Tell real stories about real people” -Anonymous The Medium or the Message: What Effects Youth’s Responses.
The Partnership for a Healthy Mississippi: A Comprehensive Prevention Program for the Washington County and Greenville, Mississippi, School District Teddy.
Designing and Implementing Effective Social Norms Communications Lessons from Oil Recycling Programs Jennifer J. Tabanico California State University,
Evaluation of Cave Interpretive Programs: Impact on Tourists’ Cave Knowledge and Attitudes. By Fara Linn Dyke And Janice Schnake Greene.
© 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
 2008 Johns Hopkins Bloomberg School of Public Health Evaluating Mass Media Anti-Smoking Campaigns Marc Boulay, PhD Center for Communication Programs.
The World of Living Things Animals & Plants in Their Environment.
PPA 502 – Program Evaluation Lecture 2c – Process Evaluation.
Quantitative and Qualitative Approaches
Center for Leadership Development Guarantee The Money: Making Your Case Through Program Evaluation.
Business Project Nicos Rodosthenous PhD 02/12/ /12/20141Dr Nicos Rodosthenous.
Writing a Good Survey 1Module 2, Unit 4, Session 7.
The Challenge of Non- Response in Surveys. The Overall Response Rate The number of complete interviews divided by the number of eligible units in the.
Community Planning Training 5- Community Planning Training 5-1.
Program Evaluation.
Session 11 Risk Communication Messages and Materials Session 11 Slide Deck Slide 11-1.
Final Thoughts. Health Communication Process Pre-work Formative Research Strategy Development Pre-testing Implementation Evaluation.
Applying TPB Belief elicitation phase –Compliers & non-compliers Chose 4 salient beliefs. “If I pick up rubbish from this track, I will…” (1) prevent harm.
Presented by: Amy Cabaniss, PhD Mitchell College, New London, CT University of Rhode Island, Kingston, RI.
Evaluation Designs Adrienne DiTommaso, MPA, CNCS Office of Research and Evaluation.
Surveying instructor and learner attitudes toward e-learning Presenter: Jenny Tseng Professor: Ming-Puu Chen Date: April 12, 2008 Liaw, S., Huang, H.,
The Impact of Student Self-e ffi cacy on Scientific Inquiry Skills: An Exploratory Investigation in River City, a Multi-user Virtual Environment Presenter:
The Training Process 1. Needs Assessment
Social Marketing Social Marketing’s Distinguishing Features Case Studies: Food Thermometer Education Evaluating a Social Marketing Intervention: Cardiff.
Ma Lei Hsieh Instruction Librarian Rider University Patricia H. Dawson Science Librarian Rider University VALE User.
SP 2015 CP PROBABILITY & STATISTICS Observational Studies vs. Experiments Chapter 11.
 Determine what you want to accomplish first.  Two broad types of health campaigns:  (1) Health Awareness and Behavioral Change: Raising awareness.
Students Beliefs and Attitudes toward Information Technology Douglas Havelka, Miami University.
Psychology 3051 Psychology 305A: Theories of Personality Lecture 1 1.
PED 212 Entire Course PED 212 Week 1 DQ 1 Current Issues  PED 212 Week 1 DQ 1 Current Issues  PED 212 Week 1 DQ 2 Critical Thinking  PED 212 Week 2.
Integrated Marketing Communications Introduction (2) An Introduction (2) Sunarto Prayitno 1.
Unit 4 Working With Communities
Evaluation of An Urban Natural Science Initiative
Designing and Implementing Local Faculty Development Programs
Unit 5 Working With Communities
Methods Choices Overall Approach/Design
Assessing a Combined Theories Approach to Climate Change Communication
Chapter 7 Attitudes and Attitude Change
6 Chapter Training Evaluation.
Reminder for next week CUELT Conference.
Presentation transcript:

Summative Evaluation of Communication CSS 387 May 3, 2012

Three treatments –Awareness of consequences –AC + “heritage guardian” –AC + HG + incentive Control Monitored w/camera –kids had badges 1: Shiloh Military Park Vander Stoep, G. & Gramann, J The effect of verbal appeals and incentives on depreciative behavior among youthful park visitors. Journal of Leisure Research, 19, 69-83

Lessons? Messages were effective “Theory” based messages did not function better than awareness messages Social influences might have been pronounced Credible source

2: polystyrene recycling Old signs –Small, placed on recycling bin (not trash) –“choose to recycle” Werner, C. M., Rhodes, M. U., & Partain, K. K. (1998). Designing effective instructional signs with schema theory: Case studies of polystyrene recycling. Environment and Behavior, 30(5), New signs –Large, brief text –3 concepts: recycle, polystyrene, only –Glued objects to sign –Trash bin: “STOP – do not contaminate!”

2: polystyrene recycling Test: –Pre-test (1 week) –New signs (3 weeks) –Post-test (1 week) –Collected items in bins –Administered survey (knowledge, attitudes)

1 full bin/day 3.5 full bins/day Large effect on specific knowledge & behavior

Lessons? Identify the right issue Need to interrupt mindless behavior Design features matter

3: damage to coral reefs Approach – verbal education Methods –Observed divers for 8 weeks – recorded number of contacts with coral (divers did 10 dives) During 5 weeks, gave briefing at end of dive #3 (experimental group) During 3 weeks, no briefings (control) Medio, D., Ormond, R. F. G., & Pearson, M. (1996). Effect of briefings on rates of damage to corals by scuba divers. Biological Conservation, 79,

Dark bars = dives 1-3 Light bars = dives 4-10 (post briefing for experimental groups) 500 incidents per day at a typical dive site

Lessons? Divers were highly motivated Lack of knowledge and skill was overcome Used credible, authoritative source Importance of social influence

4: Littering at campsites Approach –Developed messages based on behavioral beliefs (wildlife) and normative beliefs (other visitors) Starkey, P. (2009). Effect of persuasive messages on campers’ littering behavior in Wenatchee National Forest, Washington. MS Thesis, University of Idaho.

4: Littering at campsites Approach –Installed at 35 campsites –Monitored arrival/departure –Collected trash for 12 days with each sign, and 12 control days –Counted and weighed trash

% of camps with litter

Median weight of litter per camp Collected 337 lbs of trash over 36 days

Median # pcs litter/camp

Lessons? Signs reduced littering Even with appeals, there is a major littering problem Findings were complex & contrary to expectations

5: energy military bases Approach –Theory-based Knowledge social comparison values –Focus groups and interviews –Multi-part campaign (chain of command; fairs; newsletters; video; kids’ games; ‘competition’) McMakin, A. H., Malone, E. L., & Lundgren, R. E. (2002). Motivating residents to conserve energy without financial incentives. Environment & Behavior, 34(6),

5: energy conservation Assessment –Energy use vs. prior year (controlled for weather differences) –Survey (awareness; self-reported behaviors; explanations)

5: energy conservation Effectiveness? –Fort Lewis 40% were aware of campaign 10% savings ($130,387) –Yuma 66% were aware of campaign Mixed result: Months 1-3, no change in energy use; in 4 th month, energy use declined 13% Estimated $50K savings Motivators: –Pride –Awareness

Lessons Modest effects can be achieved even without monetary incentives –But participation was still low People have complex motivations; appeal to values Use a multi-pronged approach Structural barriers are significant

6: day Australian parks Approach –Elicitation interviews – compliers & non- compliers –Identified salient beliefs –Developed normative and behavioral messages –Used observation (behavior) and survey (attitudes) Hughes, M., Brown, T. J., & Ham, S. (2009). Influencing park visitor behavior: A belief based approach. Journal of Park and Recreation Administration, 27(4),

Effect on behavior Boomerang?

Effect on attitudes No effect overall at either site However, 1 st time visitors at Badger Weir were affected by sign 2 (though not sign 1) 1 st timers were less likely to feed birds (71% vs. 94%) Non-compliant dog walkers had firm intentions not to leash dogs

Lessons Signs had only modest effects (one had no effect), despite front-end assessments Change may occur without attitude or knowledge change For some behaviors, communication may not be the answer Different audience segments may be influenced differently

Examples illustrate points from semester Need to consider attention, memory, & information processing Importance of knowing one’s audiences Role of social norms in behavior change Value of personal & non-personal communication Importance of artistic and conceptual design Value of evaluation