Download presentation
Presentation is loading. Please wait.
1
What are Mixed Methods? Donna M. Mertens, Ph.D., Professor Emeritus, Gallaudet University Economic and Social Research Council National Centre for Research Methods Research Methods Festival Bath, England July 2018
2
Definition of Mixed Methods
Collect and analyze qualitative and quantitative data Integrate the data at various levels and stages of the study In a single study or a sequence of studies Methodologically eclectic Synergy between quantitative and qualitative aspects of the study (Mertens, 2015) Mertens What is MM Bath July 2018 July 2018
3
Quantitative and Qualitative Design Options that can be combined in mixed methods designs
Quantitative approaches such as experimental, quasi-experimental, causal-comparative, correlational, survey, and single-case designs Qualitative approaches such as group processes (e.g., focus groups or some indigenous methods), case studies, ethnography, phenomenological approaches, and PAR Mixed methods are most likely to be the approach of choice when you need to integrate community perspectives into the inquiry process, thus necessitating collection of qualitative data during the evaluation process. (Mertens, 2009, TRE) Mertens What is MM Bath July 2018 July 2018
4
Frameworks for MM research
Anti-paradigm war Pragmatic Constructivist Post- positivism Transformative Mertens What is MM Bath July 2018 July 2018
5
Post-Positivism and MM
Methodology Quantitative; Randomized controlled trials (RCTs); MM that emphasis quantitative data Mertens What is MM Bath July 2018 July 2018
6
The causal chain is a black box which we do not need to look inside to establish the causal link between intervention outcome White (2014) In Mertens & Hesse Biber (Eds.), New Directions in Evaluation: Mixed Methods Contribution to Credibility in Evaluation Mertens What is MM Bath July 2018 July 2018
7
RCTs and research What difference did the intervention make to the state of the world? This question is best answered with a quantitative experimental or quasi-experimental design. A randomized control trial is very likely to be the best available method for addressing this attribution question if it is feasible. White (2014) Mertens What is MM Bath July 2018 July 2018
8
Mixed Methods and Impact research
Mixed methods combine the counterfactual analysis from a RCT with factual analysis using quantitative and qualitative data to analyze the causal chain… The factual analysis will address such issues as the quality of implementation, targeting, barriers to participation or adoption by intended beneficiaries. White (2014) In Mertens & Hesse Biber (Eds.), New Directions in Evaluation: Mixed Methods Contribution to Credibility in Evaluation Mertens What is MM Bath July 2018 July 2018
9
Issue: Gender based violence (GBV) and sexual harassment (SH) in schools
What can be done to reduce GBV and SH in middle school? How effective is the treatment? How was the treatment implemented? Were appropriate students included? What barriers to participation occurred? Mertens What is MM Bath July 2018 July 2018
10
Post-Positivist Mixed Methods Design
MM Review literature; select intervention Pretest GBV & SH knowledge and attitudes Demographic survey Random assignment to treatment and control conditions Qual Interview re: barriers to participation Implementation evaluation (observation and interviews and document reviews) Quant Post-test of GBV & SH knowledge and attitudes Compare treatment and control
11
Pragmatic Paradigm Methodology
Match methods to questions; mixed methods Mertens What is MM Bath July 2018 July 2018
12
Qualitative Quantitative Concurrent Design
Quantitative and Qualitative occur more or less simultaneously Quantitative Qualitative Sequential Design: Quantitative Followed by Qualitative OR Sequential Design: Qualitative Followed by Quantitative Qualitative Quantitative Mertens What is MM Bath July 2018 July 2018 Mertens, 2009, TRE, p. 167
13
research Questions Does the intervention change attitudes of middle school students towards GBV and SH? Do the students gain knowledge about GBV and SH? Was the program implemented according to plan? How willing are teachers to participate? How can the program be improved? Mertens What is MM Bath July 2018 July 2018
14
Pragmatic Mixed Methods Design
Concurrent Review literature; select intervention Demographic survey Give pre-test to students on knowledge and attitudes Interview teachers to assess willingness to participate Qual Interview re: barriers to participation Implementation evaluation (observation and interviews and document reviews) Sequential Post-test of GBV & SH knowledge and attitudes Compare pre to post-test results Interview students and teachers to determine strengths and weaknesses of program
15
Constructivist MM Design
Methodology Primarily qualitative but with quantitative data added to make a MM design Mertens What is MM Bath July 2018 July 2018
16
Sample Constructivist Questions
Questions about effectiveness and implementation are still used in this design. Constructivists add questions such as: How well do recruitment procedures work? How well does the intervention respond to the culture and context of the target population? To what extent does the target population reflect the range of diversity with regard to the overall goals of the project? Who is left out? Why? How well does the target population understand what they are consenting to? To what extent do participants accept the outcome/s of randomization? Are participants willing to be randomized? Hesse Biber (2010) Mertens What is MM Bath July 2018 July 2018
17
Constructivist Mixed Methods Design
Concurrent Review literature; select intervention Interview staff and students re: recruitment strategies & experiences with GBV and SH Demographic survey; diversity; excluded? Give pre-test to students on knowledge and attitudes Interview teachers to assess willingness to participate Interview students re: consent to be randomized and understanding of concept Randomize willing students to treatments Qual Interview students re: cultural responsiveness of treatment and implementation processes Interview re: barriers to participation; strategies used to overcome barriers Implementation evaluation (observation and interviews and document reviews) Sequential Post-test of GBV & SH knowledge and attitudes Compare pre to post-test results Interview students and teachers to determine strengths and weaknesses of program; ask about cultural responsiveness Interview students about their experiences with GBV and SH
18
Transformative MM Design
Methodology Transformative lens; focus on human rights and social justice; culturally responsive; action oriented; mixed methods Mertens What is MM Bath July 2018 July 2018
19
Cyclical research: Putting it into a transformative mixed methods design
Build relationships Context analysis and needs assessment Pilot intervention Process or implementation research Effectiveness: Outcomes or impacts Utilization Mertens What is MM Bath July 2018 July 2018
20
Generic Transformative Mixed Methods Design
Build relationships Review literature Individual and group consultation Develop working strategies Contextual analysis Focus groups, surveys, extant data, literature, GIS mapping Identify value positions Develop intervention Pilot intervention Observations, interviews, photo voice, focus groups, surveys, pre/post data collection, team meetings Implement intervention Similar data collection as for pilot Add process evaluation of implementa- tion Collect data on unexpected outcomes Determine effectiveness Post data collection (indicators, art work, poetry, photos, mapping) Examine relationship quality Use Use findings for transformative purposes Use for policy change Use to refine intervention Use to improve and expand relationships Generic Transformative Mixed Methods Design July 2018 Mertens What is MM Bath July 2018
21
Transformative research Questions: Building Relationships
How could you use transformative mixed methods to: identify the cultural norms and beliefs that might be operating in the community? identify dimensions of diversity associated with discrimination and oppression and associated power structures? How would you: take into account the expertise, knowledge, and strengths of the community in order to provide a platform for authentic engagement between the researcher and the community? Mertens What is MM Bath July 2018 July 2018
22
Transformative MM Context Questions
What is relevant in this context in terms of history, politics, organizations, cultural groups, power structures, community resilience What issues of discrimination and oppression are relevant in this context? What is the organizational capacity and history with research; what needs to be done in terms of capacity building? What interventions appear to be responsive to the culture and values in this context? Mertens What is MM Bath July 2018 July 2018
23
Transformative Use Questions
What methods can we use to insure: Use findings for transformative purposes (action orientation) Use for policy change Use to refine intervention Use to improve and expand relationships Mertens What is MM Bath July 2018 July 2018
24
Resources Mertens, D.M. (2018). Mixed Methods Design in Evaluation. Thousand Oaks, CA: SAGE. Mertens, D. M. & Wilson, A. (2012). Program Evaluation Theory and Practice: A Comprehensive Guide. NY: Guilford. Mertens, D. M. (2015). Research and evaluation in education and psychology: Integrating diversity with qual, quant and mixed methods. 4th ed. Thousand Oaks, CA: Sage. Mertens, D. M. (2009). Transformative research & evaluation. NY: Guilford. Mertens, D. M. & Ginsberg, P. (2009).(Eds.) Handbook of Social Research Ethics. Thousand Oaks, CA: Sage. Mertens, D.M., Cram, F., & Chilisa, B. (Eds.) (2013). Indigenous pathways. Walnut Creek, CA: Left Coast Press. Mertens What is MM Bath July 2018 July 2018
25
Contact information Donna M. Mertens, PhD Independent Consultant Mertens What is MM Bath July 2018 July 2018
Similar presentations
