Visually Interpreting Your Client’s Progress

Slides:



Advertisements
Similar presentations
Quality control tools
Advertisements

Chapter 7 Flashcards. overall plan that describes all of the elements of a research or evaluation study, and ideally the plan allows the researcher or.
Standardized Scales.
Plan Evaluation/Progress Monitoring Problem Identification What is the problem? Problem Analysis Why is it happening? Progress Monitoring Did it work?
Psychology: A Modular Approach to Mind and Behavior, Tenth Edition, Dennis Coon Appendix Appendix: Behavioral Statistics.
Table of Contents Exit Appendix Behavioral Statistics.
Statistical Issues in Research Planning and Evaluation
PTP 560 Research Methods Week 4 Thomas Ruediger, PT.
Single -Subject Designs - Ch 5 “Data collection allows teachers to make statements about the direction and magnitude of behavioral changes” (p. 116). In.
Informal Academic Diagnostic Assessment: Using Data to Guide Intensive Instruction Part 2: Reviewing Graphed Data 1.
How do you know it worked
Chapter Sampling Distributions and Hypothesis Testing.
Chapter 12: Single-Subject Designs An alternative to experimental designs Purpose: To draw conclusions about the effects of treatment based on the responses.
Single-Case Designs. AKA single-subject, within subject, intra-subject design Footnote on p. 163 Not because only one participant (although might sometimes)
AP Biology Intro to Statistic
Chapter 7 Correlational Research Gay, Mills, and Airasian
Chapter 5 Flashcards. graph that connects successive data points (e.g., status of an outcome at a particular time) with lines to show changes in the value.
Chapter 6 Flashcards. systematic process for interpreting results of single-case design data that involves the visual examination of graphed data within.
Relationships Among Variables
Chapter 2 Research Methods. The Scientific Approach: A Search for Laws Empiricism: testing hypothesis Basic assumption: events are governed by some lawful.
Nursing Process- Evaluation. Evaluation Evaluation measures the client’s response to nursing actions and progress toward achieving health care goals.
The Data Analysis Plan. The Overall Data Analysis Plan Purpose: To tell a story. To construct a coherent narrative that explains findings, argues against.
Chapter 2: The Research Enterprise in Psychology
Chapter 2 Research Methods. The Scientific Approach: A Search for Laws Empiricism: testing hypothesis Basic assumption: events are governed by some lawful.
Copyright © 2011 Pearson Education, Inc. All rights reserved. Doing Research in Behavior Modification Chapter 22.
Doing Research in Behavior Modification
Managing Software Projects Analysis and Evaluation of Data - Reliable, Accurate, and Valid Data - Distribution of Data - Centrality and Dispersion - Data.
Analyzing Reliability and Validity in Outcomes Assessment (Part 1) Robert W. Lingard and Deborah K. van Alphen California State University, Northridge.
Chapter 1: Research Methods
The Research Enterprise in Psychology. The Scientific Method: Terminology Operational definitions are used to clarify precisely what is meant by each.
Chapter 2 The Research Enterprise in Psychology. Table of Contents The Scientific Approach: A Search for Laws Basic assumption: events are governed by.
MATH IN THE FORM OF STATISTICS IS VERY COMMON IN AP BIOLOGY YOU WILL NEED TO BE ABLE TO CALCULATE USING THE FORMULA OR INTERPRET THE MEANING OF THE RESULTS.
Statistics - methodology for collecting, analyzing, interpreting and drawing conclusions from collected data Anastasia Kadina GM presentation 6/15/2015.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Chapter 2 The Research Enterprise in Psychology. Table of Contents The Scientific Approach: A Search for Laws Basic assumption: events are governed by.
Single- Subject Research Designs
Basic Concepts of Outcome-Informed Practice (OIP).
1 Collecting and Interpreting Quantitative Data Deborah K. van Alphen and Robert W. Lingard California State University, Northridge.
IES Single-Case Research Institute: Training Visual Analysis Rob Horner University of Oregon
ANNOUCEMENTS 9/3/2015 – NO CLASS 11/3/2015 – LECTURE BY PROF.IR.AYOB KATIMON – 2.30 – 4 PM – DKD 5 13/3/2015 – SUBMISSION OF CHAPTER 1,2 & 3.
SINGLE SUBJECT RESEARCH PREPARED FOR: DR EDDY LUARAN PREPARED BY: AFZA ARRMIZA BINTI RAZIF [ ] HANIFAH BINTI RAMLEE IZYAN NADHIRAH BINTI.
STATS DAY First a few review questions. Which of the following correlation coefficients would a statistician know, at first glance, is a mistake? A. 0.0.
Chapter 2 Research Methods.
Data analysis is one of the first steps toward determining whether an observed pattern has validity. Data analysis also helps distinguish among multiple.
Experimental Research
DAY 2 Visual Analysis of Single-Case Intervention Data Tom Kratochwill
Chapter 33 Introduction to the Nursing Process
AP Biology Intro to Statistics
AP Biology Intro to Statistics
Chapter 12 Single-Case Evaluation Designs
Understanding Results
AP Biology Intro to Statistics
How could data be used in an EPQ?
Numerical Measures: Centrality and Variability
STATS DAY First a few review questions.
Charting Your Client’s Progress
AP Biology Intro to Statistics
Analyzing Reliability and Validity in Outcomes Assessment Part 1
Single-Case Designs.
AP Biology Intro to Statistic
Using statistics to evaluate your test Gerard Seinhorst
AP Biology Intro to Statistic
ABAB Design Ethical considerations
AP Biology Intro to Statistic
Presenter: Kate Bell, MA PIP Reviewer
Constructing and Interpreting Visual Displays of Data
Inferential Statistics
Analyzing Reliability and Validity in Outcomes Assessment
Collecting and Interpreting Quantitative Data
Presentation transcript:

Visually Interpreting Your Client’s Progress

Visual Analysis Systematic process for interpreting results of single-case design data Visual examination of graphed data within and between different conditions (e.g., baseline, intervention) Allows you to analyze your client’s progress in real time and use this practice-based evidence to make the right decisions to help your clients in a dynamic process

Dimensions of Change Is change occurring? Is change for the better or worse? Is the pace of change sufficient? Is the change large enough—is it meaningful and sufficient to the client?

When Change is Off Track Try a different intervention or modify the current intervention Check the status of the “helping alliance,” “client motivation to change,” environmental and biological factors in the client’s life including social support, etc. Extend the date for goal achievement

When Change is Off Track (cont’d) Revise the goal or objective Refocus your efforts on other problems Collect more information Return to the assessment/case conceptualization phase Refer to another social worker or other professional

Figure 6.2.

Data Pattern Particular arrangement of data in terms of in terms of level, trend, variability, cyclicity, overlap, immediacy, permanency, and practical significance

Within Phase Data Patterns Level Trend Variability

Level Value on the vertical axis around which a series of outcome data converge Last two or three data points in a phase are especially important indicators of level if they are higher or lower than the overall level

Figure 6.3.

Median Measure of central tendency which divides a distribution of values in half when the values are arranged in numerical order (or the average of the middle two values in a set with an even Number of values)

Trend Overall direction of a data path within a phase or across phases of a single-system design line graph: No trend Negative trend (also referred to as a “descending” or “decelerating” trend because values are decreasing over time) Positive trend (also referred to as an “ascending” or “accelerating” trend because values are increasing over time)

Figure 6.4.

Improving Trend Overall direction of a data path within a phase is moving in the desired direction (e.g., descending if lower values of the outcome are desirable, and ascending if higher values of the outcome are desirable)

Deteriorating Trend Overall direction of a data path within a phase is moving in an undesirable direction (e.g., descending if higher values of the outcome are desirable, and ascending if lower values of the outcome are desirable)

Slope Typical amount of change in an outcome from day-to-day, week-to-week, or whatever unit is involved

Variability Degree to which data points deviate from the overall trend

Figure 6.5.

Stable Baseline Pattern of baseline data that exhibits relatively little variability over time and little or no trend

Variable Baseline Pattern of baseline outcome data that do not fall within a relatively small range of values (i.e., they are variable)

Baselines Revisited Period of time during which an outcome is measured repeatedly in the absence of an intervention Confirm or disconfirm that the problem exists Establish the extent of the problem Develop and explore hypotheses useful for case conceptualization and intervention planning Determine whether the problem is getting better or worse and the pace of change Estimate what would happen to the client’s outcome without intervention

Figure 6.6.

Between Condition Data Patterns Level Trend Variability Immediacy of change Overlap

Figure 6.7.

Figure 6.8.

Figure 6.9.

Figure 6.10.

Figure 6.11.

Figure 6.12.

Figure 6.13.

Figure 6.14.

Figure 6.15.

Figure 6.16.

Figure 6.17.

Figure 6.18.

Immediacy of Change Amount of time it takes for a change in level, trend, or variability to occur after a condition change (e.g., baseline to intervention)

Figure 6.19.

Overlap Degree to which data in adjacent phases share similar quantitative values—the more the overlap the less the difference between adjacent phases, and the less the overlap the greater the difference

Figure 6.20.

Figure 6.21.

Figure 6.22.

Change Without a Pre-Intervention Baseline B-only design Design consisting of an intervention phase (B) during which the outcome is measured repeatedly B+ design Design consisting of one pre-intervention outcome measurement followed by an intervention phase (B) during which the outcome is measured repeatedly

Figure 6.23.

Figure 6.24.

Figure 6.25.

Figure 6.26.

Number of Observations More information—more accurate decisions When in doubt, if practical and ethical, continue to collect information More within-phase variability, more observations necessary During intervention--enough observations to make sure problem is resolved sufficiently After intervention—monitor outcome long enough to ensure that change is lasting

Number of Observations (cont’d) Baseline Enough to establish the presence and extent of the problem Enough to identify environmental influences on the problem to use in case conceptualization and intervention planning Unnecessary if outcome never occurs Unethical with outcomes such as self-injurious behaviors

Potential Limitations of Visual Analysis Under some circumstances different people, experts and novices alike, draw different conclusions from the same data Decision errors possible

Decisions Regarding Change

Increasing the Validity of Decisions Regarding Change Increase number of observations Reduce within-phase variability Measure outcomes accurately Use intervention appropriate to the problem Implement intervention with fidelity Use intervention with larger effect