Experimental Studies Heppner et al. (2015) Chap20

Slides:



Advertisements
Similar presentations
Heppner et al. Chap 12, 18 Hogg & Deffenbacher (1988)
Advertisements

Lecture 09: Internal Validity and Experiments. Outline Causal Relations Internal Validity Threats to Internal Validity Video Games and Violence Designs.
1 Research Methods in Clinical Psychology Carolyn R. Fallahi, Ph. D.
Experimental Design.
Effectiveness of Therapy and Nonspecific Factors
Psychology 3.3 Managing stress. Psychology Learning outcomes Understand the following three studies on managing stress: Cognitive (Meichenbaum, D. (1972)
Chapter 2 Research Process Part 2: Sept. 1, 2010.
 What Problems Cause Distress and Impair Functioning?  What Problems Cause Distress and Impair Functioning?  Why do People Behave in Unusual Ways?
McGraw-Hill © 2006 The McGraw-Hill Companies, Inc. All rights reserved. Experimental Research Chapter Thirteen.
Experimental Research
Nasih Jaber Ali Scientific and disciplined inquiry is an orderly process, involving: problem Recognition and identification of a topic to.
Chapter 2 Research Methods. The Scientific Approach: A Search for Laws Empiricism: testing hypothesis Basic assumption: events are governed by some lawful.
Class 13 and 14 Jacobson et al (1996) APA (2006)Evidence Based Practice in Psychology 1.
Chapter 5 Research Methods in the Study of Abnormal Behavior Ch 5.
Chapter 4 Hypothesis Testing, Power, and Control: A Review of the Basics.
Chapter 2 Research Methods. The Scientific Approach: A Search for Laws Empiricism: testing hypothesis Basic assumption: events are governed by some lawful.
Class 13 and 14 Jacobson et al (1996) APA (2006)Evidence Based Practice in Psychology 1.
Research Design for Quantitative Studies
Review Exam 1.
Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 3 The Research Endeavor.
Chapter 2 The Research Enterprise in Psychology. Table of Contents The Scientific Approach: A Search for Laws Basic assumption: events are governed by.
Interaction Effects and Theory Testing Kaiser et al. (2006) social identity theory –tested hypotheses about attention to prejudice cues in the environment.
Research in psychology
Experimental Research Strategy. Experiment Establish existence of a cause-and-effect relationship between two variables Demonstrating that changes in.
Table 2: Correlation between age and readiness to change Table 1: T-test relating gender and readiness to change  It is estimated that 25% of children.
Background Treatment fidelity in group based parent training: Predicting change in parent and child behaviour Dr. Catrin Eames, Bangor University, UK
Review of Research Methods. Overview of the Research Process I. Develop a research question II. Develop a hypothesis III. Choose a research design IV.
Heppner et al. Chap 12, 18 Hogg & Deffenbacher (1988)
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
EXPERIMENTS AND EXPERIMENTAL DESIGN
PTP 661 EVIDENCE ABOUT INTERVENTIONS CRITICALLY APPRAISE THE QUALITY AND APPLICABILITY OF AN INTERVENTION RESEARCH STUDY Min Huang, PT, PhD, NCS.
The Effectiveness of Parent-Child Interaction Therapy With Families At Risk of Maltreatment Rae Thomas and Melanie J. Zimmer-Gembeck School of Psychology,
Class 3 Between Group Designs, Expo Facto Designs, Status Variable Chapters HWK 7 ( ),10 ( , 243-4) 12(308) ANOVA PDF.
Treatment Integrity.
Class Chapters 5 & Elkins (1989). Threats to Statistical Conclusion Validity Are the observed relations among variables accurate? Power Unreliability.
Choosing and using your statistic. Steps of hypothesis testing 1. Establish the null hypothesis, H 0. 2.Establish the alternate hypothesis: H 1. 3.Decide.
Class 11 and 12 Jacobson et al (1996) Spring
The Evolution And Promise Of Practice Research Networks.
Datum: The influence of therapist factors on the effectiveness of the IY parent program Mentor Meeting 2016 Maartje Raaijmakers The Netherlands.
Chapter 2 Research Methods.
Experimental and Quasi-Experimental Research
Module 2 Research Strategies
RESEARCH DESIGN Experimental Designs  
Analysis of a New Method for Studying Placebo Effects
An evaluation of the online universal COPING parent programme:
Experimental Research
Complex Experimental Designs Chp 10
Experimental Design.
Between-Subjects, within-subjects, and factorial Experimental Designs
Self-discrepancies in the Social Role of Mother: Associations between Self-discrepancies and Negative Affect Nicole J. Holmberg, Laura D. Pittman, Emily.
DUET.
Class 6 Hepp et al -15 Cha 13 Quant Descriptive Designs.
PHLS Research in Counseling Psychology Spring Consuelo Arbona, Ph
Class 4 Experimental Studies: Validity Issues Reliability of Instruments Chapters 7 Spring 2017.
Chapter Eight: Quantitative Methods
2 independent Groups Graziano & Raulin (1997).
Experiments and Quasi-Experiments
Testing the Attachment Theory of Parent-Child Interaction Therapy Erin Floyd and Sheila Eyberg Department of Clinical and Health Psychology University.
Attachment Dependency
Common Problems in Writing Statistical Plan of Clinical Trial Protocol
AQA A 2014.
Clinical Assessment and Diagnosis
Experiments and Quasi-Experiments
Performance Improvement Projects: From Idea to PIP
Construct an idea/concept constructed by the scientist to explain events observed, e.g. self-concept; intelligence; social identity not necessarily clearly.
Group Experimental Design
Psychological Research Methods and Statistics
Factorial Designs Factorial design: a research design that includes two or more factors (Independent Variables) A two-factor design has two IVs. Example:
Misc Internal Validity Scenarios External Validity Construct Validity
Psychological Experimentation
Presentation transcript:

Experimental Studies Heppner et al. (2015) Chap20 Class 3 Experimental Studies Heppner et al. (2015) Chap20

Psychology’s History of Being Mesmerized

Placebo Effect https://www.youtube.com/watch?v=HqGSeFOUsLI In 2002, researchers at the Houston VA Medical Center and at Baylor College of Medicine found that a common type of knee surgery known as debridement to be no more beneficial than a placebo surgery. Throughout a two year follow-up, the 180 patients in the study were unaware whether they had received the "real" or placebo surgery. Patients who received actual surgical treatments did not report less pain or exhibit better functioning of their knees compared to the placebo group.

Experimental Between Group Designs Post-Test Only Control Pre-Test -- Post-Test Control Solomon Four Group (combination of 1 and 2 above) Factorial Design more than one independent variable; interactions gender x treatment Dependent Sample Design (Matching) 4

Experimental Between Group Designs Post-Test Only Control Pre-Test -- Post-Test Control Solomon Four Group Factorial Design (e.g., Treatment X Therapist) Dependent Sample Design (Matching) # of previous episodes and severity depression, gender, marital status 5

Between Group Design Factorial Design: More than one IV Experimental AlI IVs are manipulated Ex Post Facto: All IVs are status variable (not manipulated)

Between Group Designs: Therapy Outcome Treatment Package Strategy Dismantling Strategy Additive Strategy Parametric Strategy Comparative Outcome Strategy Common Factors Control Group Design -- Placebo Moderation Designs

Cultural Modifications PCIT- GANA Assessment of culturally influenced concepts at intake and continuously to individualize treatment Framed program as educational/skill-bdng, vs therapy Parent Child Interaction Therapy to GANA Guiando Ninos Activos Engagement protocol for fathers and extended family Orientation/preparation for treatment – manage expectations Increased attention to rapport building – longer sessions Eliciting feedback – complaints “simpatia” script Translation and simplification of handouts- represent Hispanics in pictures

Types Between Group Designs Treatment Package Strategy Dismantling Strategy Additive Strategy Parametric Strategy (structural components)

Types Between Group Designs Treatment Package Strategy Compared PCIT – GANA - TAU Dismantling Strategy Additive Strategy Parametric Strategy (structural components)

Types Between Group Designs Treatment Package Strategy Compared PCIT – GANA - TAU Dismantling Strategy components of the same treatment Additive Strategy Parametric Strategy (structural components)

Types Between Group Designs Treatment Package Strategy Compared PCIT – GANA - TAU Dismantling Strategy components of the same treatment Additive Strategy Added new components (e.g. cultural evaluation: engagement protocol) Parametric Strategy (structural components)

Types Between Group Designs Treatment Package Strategy Compared PCIT – GANA - TAU Dismantling Strategy components of the same treatment Additive Strategy Added new components (e.g. cultural evaluation: engagement protocol) Parametric Strategy (structural components) (e.g. longer sessions for rapport bdng.)

Types Between Group Designs Comparative Outcome Strategy Common Factors Control Group Design -- Placebo Moderation Designs Client /therapist characteristics

Types Between Group Designs Comparative Outcome Strategy Common Factors Control Group Design -- Placebo Moderation Designs Client /therapist characteristics

Types Between Group Designs Comparative Outcome Strategy Compared PCIT- GANA-TAU Common Factors Control Group Design -- Placebo Moderation Designs Client /therapist characteristics

Types Between Group Designs Treatment Package Strategy Dismantling Strategy Additive Strategy Parametric Strategy Comparative Outcome Strategy Common Factors Control Group Design -- Placebo Moderation Designs

Dismantling vs. Package Strategies Identify change mechanisms Do specific ingredients work as expected? VS. How well the treatment works

Dismantling Strategy: How Treatment Effects Change Effectiveness of (Jacobson et al. 1996): BA ------- BA + AT ------- BA + AT + CT Component Measure Ttreat. Group Behavioral activation – Pleasant Event SCd BA Coping skills- - AT (Dist Thinking) AT Core schemas - Exp Attrb Style CT Change from pre-to post- treatment in depression and in each change mechanism

Which group to use in outcome analyses ? # Sessions Intent-to treat Total sample n = 58 (pre-test) Partial completers 5+ Sessions n = 44 Completers Full treatment n = 33 57% Post-treatment assessment n = 54 93%

Table 2 Self Report Measures

Cohen’s d – effect size 0.2 small 0.5 medium 0.8 large If two groups' means don't differ by 0.2 standard deviations or more, the difference is trivial, even if it is statistically significant.

Table 3 – Observational Measures

Significance Statistically Significant Findings Clinically Significant Findings

Significance Statistically Significant Findings Clinically Significant Findings behavior problems (ECBI) and externalizing symptoms (CBCL) GANA /PCIT- below normative mean TAU below clinical mean

External and Internal Validity E I Experimental Field E i Correlational/ Descriptive e I Laboratory e i

External and Internal Validity E I Experimental Field E i Correlational/ Descriptive e I Laboratory e i Clinical Trials