Causal Analysis in Qualitative Inquiry Martyn Hammersley The Open University NCRM Research Methods Festival, St Catherines College, Oxford, July 2012.

Slides:



Advertisements
Similar presentations
Diversity in Management Research
Advertisements

Research Strategies: Joining Deaf Educators Together Deaf Education Virtual Topical Seminars Donna M. Mertens Gallaudet University October 19, 2004.
Performance Assessment
Can't Count, Won't Count? Some Results From A National Survey Of Student Attitudes To Quantitative Methods Malcolm Williams, Liz Hodgkinson, Geoff Payne,
LITERACY IN THE MIDDLE YEARS OF SCHOOLING INITIATIVE
Online Workshop Giving Quality Feedback
Action Research Not traditional educational research often research tests theory not practical Teacher research in classrooms and/or schools/districts.
1 CASE STUDY RESEARCH An Introduction. 2 WHY CASE STUDY RESEARCH? The case study method is amongst the most flexible of research designs, and is particularly.
ON DEMAND Introduction. Learning targets  I can identify the modes of writing and distinguish the differences among all 3 modes  I can compare and contrast.
Levels of causation and the interpretation of probability Seminar 2 Federica Russo Philosophy, Louvain & Kent.
Why We Do Research Chapter 1. Ordinary Versus Systematic Biased Question: A question that leads to a specific response or excludes a certain group Nonscientific.
Grounded Theory   Charmaz (2008).
What is research? Lecture 2 INFO61003 Harold Somers.
Is Teaching a Vocation: The Distribution of Higher Qualified New Teachers by Challenge of UK High Schools Dr John Brown Institute of Education.
Cory Koedel, Eric Parsons, Michael Podgursky and Mark Ehlert
evidence and inter-level inference
Minnesota State Community and Technical College Critical Thinking Assignment Example and Assessment.
Interrogating the Quantitative-Qualitative Divide Martyn Hammersley The Open University NCRM Research Methods Festival, St Catherine’s College, Oxford,
Reviewing and Critiquing Research
What Is Perception, and Why Is It Important?
Analysing and Interpreting Data Chapter 11. O'Leary, Z. (2005) RESEARCHING REAL-WORLD PROBLEMS: A Guide to Methods of Inquiry. London: Sage. Chapter 11.2.
Chapter 1 Conducting & Reading Research Baumgartner et al Chapter 1 Nature and Purpose of Research.
Research Methods for Business Students
Session 8: Strategies to reduce violence
Introduction to Communication Research
Produce & Achieve: A Case Study of Inner-City Education A Born Digital Dissertation * Proposal Daryl Tate, Pepperdine University Introduction There is.
Topic #3 - CRITICAL THINKING Key Evidence 1 Provided by Amarillo College Offices of Institutional Research and Outcomes Assessments.
Servant Leadership Paper The student will concentrate on their individual workplace or business as the focus of a 5-7 page research paper discussing Servant.
Changes in Student and Teacher Attitudes and Behaviors in an Integrated High School Curriculum Presented by: Nicolle Gottfried & Catherine Saldutti.
Student Engagement Survey Results and Analysis June 2011.
WHAT IS QUALITATIVE RESEARCH? Martyn Hammersley The Open University University of Southampton, January 2012.
Does Formative Feedback Help or Hinder Students? An Empirical Investigation 2015 DEE Conference Carlos Cortinhas, University of Exeter.
WHAT IS QUALITATIVE INQUIRY? Martyn Hammersley The Open University NCRM Research Methods Festival, St Catherine’s College, Oxford, July 2010.
Undergraduate Dissertation Preparation – Research Strategy.
Writing the background chapters of your thesis Brian Paltridge The University of Sydney.
Methods of Media Research Communication covers a broad range of topics. Also it draws heavily from other fields like sociology, psychology, anthropology,
Implementation and process evaluation: developing our approach Ann Lendrum University of Manchester Neil Humphrey University of Manchester Gemma Moss Institute.
Inductive Generalizations Induction is the basis for our commonsense beliefs about the world. In the most general sense, inductive reasoning, is that in.
Interpretive approaches: key principles 10 March 2009 Dr. Carolyn M. Hendriks The Crawford School of Economics and Government The Australian National University.
Assumptions of value-added models for estimating school effects sean f reardon stephen w raudenbush april, 2008.
Interrogating the Quantitative-Qualitative Divide Martyn Hammersley The Open University Revised version of a paper presented at the NCRM Research Methods.
Qualitative Research Designs Day 4 The Curious Skeptics at work.
Gile Sampling1 Sampling. Fundamental principles. Daniel Gile
Qualitative Research: Grounded Theorising, Analytic Induction, or What? Martyn Hammersley Kurt Andersen The Open University NCRM Research Methods Festival.
The Structure of Inquiry Research Design.
IS IT POSSIBLE TO TEACH SOCIAL RESEARCH METHODS WELL TODAY? Martyn Hammersley The Open University HEA, Social Sciences Summit, June 2012.
Week 2 The lecture for this week is designed to provide students with a general overview of 1) quantitative/qualitative research strategies and 2) 21st.
1 Qualitative Research: Challenges and Opportunities Presented by: Anne Smyth Liz Dimitriadis.
Week 3 Qualitative Approaches to Field Research GEOG 4520B 3.0 Research Design and Field Studies Department of Geography Faculty of Liberal Arts & Professional.
Research Design. What is Research Design ? Plan for getting from the research question to the conclusion Blueprint for data collection and interpretation.
Triangulation (Üçleme)
Research Designs/Approaches
Comparing Counts Chapter 26. Goodness-of-Fit A test of whether the distribution of counts in one categorical variable matches the distribution predicted.
Unreflective Practice? Case Study and the Problem of Theoretical Inference Martyn Hammersley The Open University Higher Education Close Up 5, University.
What is Research?. Intro.  Research- “Any honest attempt to study a problem systematically or to add to man’s knowledge of a problem may be regarded.
How Psychologists Do Research Chapter 2. How Psychologists Do Research What makes psychological research scientific? Research Methods Descriptive studies.
1 Prepared by: Laila al-Hasan. 1. Definition of research 2. Characteristics of research 3. Types of research 4. Objectives 5. Inquiry mode 2 Prepared.
Exploratory data analysis, descriptive measures and sampling or, “How to explore numbers in tables and charts”
Sociology. Sociology is a science because it uses the same techniques as other sciences Explaining social phenomena is what sociological theory is all.
Computing Honours Project (COMP10034) Lecture 4 Primary Research.
NURS 306, Nursing Research Lisa Broughton, MSN, RN, CCRN RESEARCH STATISTICS.
Research Design. How do we know what we know? The way we make reasoning Deductive logic Begins with one or more premises, reasoning then proceeds logically.
Comparing Counts Chi Square Tests Independence.
How to Research Lynn W Zimmerman, PhD.
Student Engagement Data in the UK: Policy and Practice
How High Schools Explain Students’ Initial Colleges and Majors
Teaching and Educational Psychology
Causal Analysis in Qualitative Inquiry
BEYOND MIXED METHODS: USING QUALITATIVE COMPARATIVE ANALYSIS (QCA) TO INTEGRATE CROSS-CASE AND WITHIN-CASE ANALYSES © BARRY COOPER, JUDITH GLAESSER, LOUIS.
STATISTICS derived from the Latin word STATUS, Italian word STATISTA, German word STATISTIK, and French word STATISTIQUE which express one meaning “ Political.
Presentation transcript:

Causal Analysis in Qualitative Inquiry Martyn Hammersley The Open University NCRM Research Methods Festival, St Catherines College, Oxford, July 2012

Contrasting Attitudes Towards Causal Analysis Among Qualitative Researchers The interesting case of analytic induction: Znaniecki and Lindesmith. Unearthing causal relations by studying a single case (Waller 1934; Connolly 1998). The ambiguous example of grounded theorising. Widespread denial of the relevance or possibility of causal analysis (Hammersley 2008).

In Practice, Most Qualitative Researchers Use Causal Analysis Both within-case and cross-case data are employed, and often combined. However, generally speaking, these are not used in a very systematic or explicit manner. Indeed, the predominant mode seems to be a sort of pattern-matching, in which a fit between an explanatory idea and the internal features of some case, and/or a pattern across cases, is treated as conclusive evidence.

What is Required Systematic development of models of causal processes on the basis of interpretation of evidence about particular cases, using both within- and cross-case analysis. Systematic testing of these models, again using both within- and cross-case analysis. While these two tasks will often be integrated, they are different, and to some degree have divergent requirements.

A Model for Within-Case Analysis Laceys (1970) study of subculture formation among secondary school students offers one of the most sophisticated examples of within- case causal analysis. He documents: Differences in attitude towards school values among fourth year secondary students The development of such differences over time, and their reflection in peer groups The complex relations between this subculture formation, processes of academic differentiation, and social class background.

Explaining Aggregate Differences in Outcomes This has been a common goal, notably in the sociology of education. Use of within-case analysis alone runs the risk of committing the compositional fallacy. This fallacy is a counterpart to the ecological fallacy, which may occur through reliance upon cross-case analysis on its own.

Parallel Fallacies (Gomm 2012) The ecological fallacy or, perhaps better, the division fallacy = a false inference from a pattern found at the aggregate level to the assumption that it is also to be found within cases belonging to that aggregate. The compositional fallacy = a false inference from some observed pattern found within one or a few cases to the conclusion that this will also be found at aggregate level, or that it explains some aggregate outcome.

Source of the Compositional Fallacy Fundamentally, the compositional fallacy consists in a false assumption that there is substantial homogeneity across the cases belonging to an aggregate: that they all contribute in the same way to the aggregate outcome. In fact, heterogeneity amongst cases frequently means that they differ from one another in the sort of contribution they make. This means that, often, we cannot explain an aggregate pattern solely in terms of a pattern within cases, it is likely to result, at least in part, from differences among the cases.

An Example As Roger Gomm (2012:98-9) points out, in the study of ethnic inequalities in educational achievement, researchers have often assumed that patterns found at the local level explain aggregate inequalities (see, for example, Gillborn and Gipps 1996). The specific claim in much of this research is that aggregate inequalities are to be explained by teachers differential treatment of pupils from different ethnic groups. This may well be a factor, but it is probably not the only one.

Interpretation of the Table These schools achieve different overall mean scores at GCSE, ranging from 18.9 to Forty eight percent of ethnic minority students are in the lowest achieving school. We have assumed, for the sake of argument, that, in each school, minority ethnic students score 4 points less on average than ethnic majority students. At LEA level the difference is actually 15.7 points: this leaves another 11.7 points of difference to explain. […] (Gomm 2012:106-7)

Qualitative Cross-Case Analysis Cross-case analysis can take a variety of forms. One of these is what might be called the qualitative survey. An example: explaining social-class variation in applications to high-status universities (Reay et al. 2005). These researchers relied on questionnaire data from 502 students, and interviews with 120 students, from 6 schools and colleges in the London area.

Weaknesses of Many Qualitative Surveys The sampling strategies employed rarely offer much prospect of representative conclusions about the target population, and this population is not always clearly defined. Actual frequencies are not given, instead there are vague claims about tendencies. There is often little systematic comparison designed to check causal hypotheses. (See Cooper et al 2012:ch3)

Conclusion Qualitative researchers cannot ignore the task of causal analysis. Currently, for the most part, it is not carried out very effectively, but there are examples of good practice. There is a need for more systematic approaches to both within-case and cross-case analysis. And it is generally necessary to combine the two.

References and Select Bibliography Abbott, A. (2001) Time Matters, Chicago, University of Chicago Press. Bryant, A. and Charmaz, K. (eds.) (2007) The Sage Handbook of Grounded Theory, London, Sage. Connolly, P. (1998) Dancing to the wrong tune, in Connolly, P. and Troyna, B. (eds.) Researching Racism in Education, Buckingham, Open University Press. Cooper, B., Glaesser, J., Gomm, R., and Hammersley, M. (2012) Challenging the Qualitative- Quantitative Divide: Explorations in case-focused causal analysis, London, Continuum. Gillborn, D. and Gipps, C. (1996) Recent Research on the Achievements of Ethnic Minority Pupils, London, Office for Standards in Education, HMSO. Gomm, R. et al (eds.) (2000) Case Study Method, London, Sage. Gomm, R. (2012) Qualitative causal analysis and the fallacies of composition and division: the example of ethnic inequalities in educational achievement, in Cooper et al. Hammersley, M. (2008) Causality as Conundrum: The Case of Qualitative Inquiry Methodological Innovations Online [Online], 2(3). Available at: 5.pdf Jansen, H. (2010). The Logic of Qualitative Survey Research and its Position in the Field of Social Research Methods [63 paragraphs]. Forum Qualitative Sozialforschung / Forum: Qualitative Social Research, 11(2), Art Lacey, C. (1970 Hightown Grammar, Manchester, Manchester University Press. Reay, D., David, M., and Ball, S. (2005) Degrees of Choice: Social class, race and gender in higher education, Stoke on Trent, Trentham Books. Waller, W. (1934) Insight and scientific method, American Journal of Sociology, XL, 3, pp