1. Chapter 4: Distinguishing Mixed Methods Designs
Purpose: To distinguish mixed methods studies by design features like timing and priority.

2. An Introduction to Fully Integrated Mixed Method Research
Goals of the Chapter
Present a classification system that distinguishes basic types of mixed method studies.
Identify priority as a key feature that distinguishes mixed method studies.
Review a widely used notation system that represents timing and priority.
4. Describe the design features of an exemplary publication. 5. Review design features of QUAL, QUANT, and equal priority studies.
An Introduction to Fully Integrated Mixed Method Research

3. The Meaning of the Word Design
Design – A thoughtfully constructed link between the purposes of of a research study and the strategies used to implement it.
An Introduction to Fully Integrated Mixed Method Research

4. Key Features that Distinguish Mixed Method Design: Priority & Timing
PRIORITY – conventionally defined to distinguish three types of studies: those where the most weight or attention is given to (a) the QUANT phase, (b) the QUAL phase, or (c) where the phases are given equal priority.
A fourth priority: mixed priority is introduced in this chapter.
TIMING – conventionally been conceived primarily in terms of two-phase studies.
refers to the timing of data collection and whether data from the first phase is required in a subsequent phase.
Research is conventionally conceived as occurring in four phases: (1) design, (2) data collection, (3) data analysis, and (4) drawing of conclusions.
An Introduction to Fully Integrated Mixed Method Research

5. Key Features that Distinguish Design: TIMING
Concurrent – QUAL and QUANT data are collected simultaneously or independently.
Sequential – the research is conducted in two phases with the data collection in the second phase linked in some way on the first phase.
Multi-phase – the research is conducted in more than two phases with some interdependence between the phases.
EXAMPLES of a concurrent design: A survey with both close-ended (QUANT) questions and open-ended (QUAL) questions.
EXAMPLES of a sequential design: Focus groups are conducted in the first phase in order to develop and administer a survey in the second phase.
EXAMPLES of a multi-phase design: Survey data is collected from different types of groups, analyzed for key factors which are then used to collect and analyze data to construct detailed case studies.
An Introduction to Fully Integrated Mixed Method Research

6. Timing- Distinguishing Two-Phase Studies
EXPLANATORY – first phase is quantitative; second qualitative
EXPLORATORY- first phase is qualitative; second phase quantitative
QUANT
QUAL
QUAL
QUANT
An Introduction to Fully Integrated Mixed Method Research

7. Second Design Feature: Priority
The most weight or attention is giving to
QUANT phase
QUAL phase
Both phases given equal weight
We consider a fourth priority in the next chapter.
An Introduction to Fully Integrated Mixed Method Research

8. The Morse Notation System
Insert Table 4.2 Morse Notation System
In the Morse notation system, priority is designated by capitalization; sequential timing by an arrow; concurrent time by a plus sign
An Introduction to Fully Integrated Mixed Method Research

9. An Introduction to Fully Integrated Mixed Method Research
Evidence of a Quantitative Priority from Content Analyses of Eight Studies
This pie chart summarizes results from Table 4.3
An Introduction to Fully Integrated Mixed Method Research

10. Explaining the Prevalence of a QUANT Priority
Some mixed methods designs, like the development design (for instrument development) are inherently QUANT.
Most studies that involve Random Control Trials (RCTs) are inherently QUANT.
QUANT studies are easier to publish and to get funded.
Random control trials are rare in education. They involve the random assignment of subject to a treatment group and generally include a no-treatment group.
An Introduction to Fully Integrated Mixed Method Research

11. Priority as a Key Feature of Mixed Method Designs
An Introduction to Fully Integrated Mixed Methods Research

12. Why is Priority Important
Provides a common unit of analysis to compare mixed methods articles.
With timing, a features that is frequently used to distinguish designs.
Points to relevant evaluation criteria.
Contributes to the ability to trace a conclusion to the source of data (or analytical procedure).
An Introduction to Fully Integrated Mixed Methods Research

13. Signs of Priority that Reflect an Overriding Logic*
*Title
*Reflexive statements about paradigm
*Purpose statement
*Space allocated to QUAL and QUANT in the results and/or the discussion/conclusions sections.
Predominance of methodological language.
Weight of QUAL, QUANT, mixing in the final conclusions.
The first four items in the list come from: Creswell, Shope, Plano Clark, & Green (2006). Creswell, J. W., Shope, R., Plano Clark, V. L., & Green, D. O. (2006). How interpretive qualitative research extends mixed methods research. Research in Schools, 13 (1), 1-11.
The fifth item recognizes an additional type of priority: mixed
An Introduction to Fully Integrated Mixed Methods Research

14. Mixed Method Studies with Unequal Priority- Characteristics
Phase
Design Characteristics
DESIGN PHASE: Purpose Statement & Research Questions
Presence of only one type of research question (QUAL or QUANT)
Over-riding purpose that points to QUAL or QUANT dominance
INFERENCE PHASE: Meta-inference
Major conclusions drawn from either QUANT or QUAL; no meta- inferences
INFERENCE PHASE: Discussion and Conclusion Section
More space devoted to either QUAL or QUANT
An Introduction to Fully Integrated Mixed Methods Research

15. Mixed Method Studies with a QUAL Priority
Phase
Design Characteristics
DESIGN PHASE: Purpose Statement & Research Questions
Focus on the perceptions of participants; strong exploratory phase
INFERENCE PHASE: Meta-inference
Conclusions derive mostly from QUAL analysis.
INFERENCE PHASE: Discussion and Conclusion Section
More space is devoted to the QUAL findings.
*When not explicitly stated by authors
An Introduction to Fully Integrated Mixed Methods Research

16. Mixed Method Studies with a QUANT Priority
Phase
Design Characteristics
DESIGN PHASE: Purpose Statement & Research Questions
Designed to test theory (confirmatory); interested in the relationship between variables and prediction
INFERENCE PHASE: Meta-inference
Conclusions derive largely from analysis of QUANT data.
INFERENCE PHASE: Discussion and Conclusion Section
More space is devoted to the QUANT results.
*When not explicitly stated by authors
An Introduction to Fully Integrated Mixed Methods Research

17. Indicators of Equal Priority
Phase
Design Characteristics
DESIGN PHASE: Purpose Statement & Research Questions
Both QUAL and QUANT research questions
INFERENCE PHASE: Meta-inference
Conclusions derive from both QUAL and QUANT analysis
INFERENCE PHASE: Discussion and Conclusion Section
Separate sections address the QUAL and QUANT. May be no mixing.
This is not the same thing as MIXED PRIORITY.
An Introduction to Fully Integrated Mixed Methods Research

18. An Introduction to Fully Integrated Mixed Method Research
Design Features of the Exemplary Publication (i.e. Catallo, Ciliska, & MacMillan., 2013)
Design Feature
Rationale/Purpose
Complementarity
Priority
Equal
Timing of Data Collection
Separate, Sequential
Timing of Data Analysis
QUANT QUAL Qual/Quant
Mixing
Fully Integrated- Mixing at all Stages
Catallo, C., J., S. M., Ciliska, D., & MacMillan, H. L. (2013). Mixing a grounded theory approach with a randomized controlled trial related to intimate partner violence: What challenges arise for mixed methods research? Nursing Research and Practice, doi: /2013/798213
An Introduction to Fully Integrated Mixed Method Research

19. Exemplar – The Meta Inference Signals Equal Priority
QUANT Conclusion: Women who experienced the most intimate partner violence were least like to disclose it to emergency personnel.
QUAL Conclusion: The reluctance to disclose was associated with the fear of stigma.
META INFERENCE: Women who experienced the most intimate partner violence were least likely to disclose it to emergency room personnel because of the fear of stigmatization.
Catallo, C., J., S. M., Ciliska, D., & MacMillan, H. L. (2013). Mixing a grounded theory approach with a randomized controlled trial related to intimate partner violence: What challenges arise for mixed methods research? Nursing Research and Practice, doi: /2013/798213
This meta inference links the QUAL and QUANT results.
An Introduction to Fully Integrated Mixed Method Research

20. A Fourth Possible Priority: Some Indicators of a Mixed Priority
Design Characteristics
DESIGN PHASE: Purpose Statement & Research Questions
Contains QUAL, QUANT, and a mixing research questions.
INFERENCE PHASE: Meta-inference
Conclusions derive primarily from analysis that blends or mixed QUAL and QUANT data.
INFERENCE PHASE: Discussion and Conclusion Section
There is a separate section in the results devoted to mixing.
In this chapter, the discussion has been consistent with previous literature in the focus on three types of priority (QUAL, QUANT, or EQUAL).
In the next chapter, we consider the addition of a fourth type of priority: MIXED PRIORITY.
An Introduction to Fully Integrated Mixed Methods Research

21. An Introduction to Fully Integrated Mixed Method Research
Review Questions
Which mixed method priority (QUAL, QUANT, or EQUAL) is most prevalent?
In the traditional notation system, how is priority represented?
In the traditional notation system, how is timing represented?
How is timing described in studies where QUAL and QUANT data are collected at the same time?
How is timing described in studies where QUAL and QUANT data are collected in two different phases?
ANSWERS 1. Mixed method priority that is most prevalent: QUANT
2. How priority is represented: with capitalization
3. How is timing represented: with either an arrow or comma
4. The name of the timing when QUAL and QUANT data are collected simultaneously: concurrent
5. The name of timing when QUAL and QUANT data are collected in two different phases: sequential
An Introduction to Fully Integrated Mixed Method Research

22. An Introduction to Fully Integrated Mixed Method Research
Next Chapter
We shift in the next chapter to the first of three chapters about mixing.
In Chapter 5, the focus is mixing at sampling and during data collection.
Jenny Blass, 2016
An Introduction to Fully Integrated Mixed Method Research