1. Research and Evaluation: The Basics A Workshop for Educators Session 519 Saturday, June 30, 2007 Rita DeMaria, Ph.D. Scott Gardner, Ph.D

2. Research  Careful, thorough, patient, systematic investigation undertaken to establish facts or principles in field of study  Use of the scientific method  quantitative: statistics  qualitative: interviews

3. Evaluation  Is my program accomplishing the goals and objectives?  How do participants view and experience the service?

4. What’s good and what’s bad research? DDDDon’t do anything TTTTouchy Feely SSSSample problems (biased) NNNNo Control TTTToo Broad (change the world) BBBBad Measures RRRRandom Assignment

5. Something is Much Better than Nothing!

6. Ways of Collecting Data  Insider vs. Outsider  Questionnaires  Self-Anchored Rating Scales (Likert)  Interviews  Behavioral Observations (self and others, ratings)  Example of Husband TV Habits  Timed Daily logs  “Hard” measures

7. Use Multiple Methods & Levels  Individual  Sibling Dyad  Couple Dyad  Parent-Child Dyad  Family  Community  Etc.

8. What is reliability and validity?

9. The benefit of using reliable and valid established measures

10. Examples From our Research  From Scott’s research  From Rita’s research: Comparison of Marriage Education Program Participants

11. Scales You Can Use  Dyadic Adjustment Scale  Marital Status Inventory  Conflict Tactics Scale

12. Resources for finding measurement scales

13. Overview of different research designs  Basics of pretest – posttest  Observation, interview, surveys

14. Other issues  Informed consent  Protection of human subjects

15. Statistics  Generalizability  What is statistical significance?

16. Some statistical programs  SPSS  Excel

17. Stat Help 101

18. Dissemination

19. What’s Your Plan?  Small Groups  My program  My population  My plan  Pre, Post, follow-up  Getting the word out

20. free consultation and support  Please contact either of us for help or questions:  Rita DeMaria, Ph.D.  215-628-2450  DrDeMaria@marriagedoctor.com  Scott Gardner, Ph.D.  605-688-5956  GardnerS@BYUI.edu