Research Methology IV - BNV45211 Chapter 14 Case studies

Research Methology IV - BNV45212 Case studies vs Surveys Survey Survey Get a little bit of info about a large population Get a little bit of info about a large population Case studies Case studies Specific cases in more detail Specific cases in more detail The challenge is to make a case study useful The challenge is to make a case study useful Who says info from few cases has any bearing on other? Who says info from few cases has any bearing on other?

Research Methology IV - BNV45213 Case studies - techniques Structured and unstructured interviews Structured and unstructured interviews Direct observation Direct observation Direct measurements Direct measurements Participant observations Participant observations Group discussions Group discussions Quantitative & Qualitative information Quantitative & Qualitative information

Research Methology IV - BNV45214 Case studies Range from Range from Technical systems Technical systems To social systems To social systems Case studies in IT is relatively scarce Case studies in IT is relatively scarce Structured approach vs Exploratory Structured approach vs Exploratory

Research Methology IV - BNV45215 Case study design Single-case Multiple-case HolisticEmbedded

Research Methology IV - BNV45216 Case study design Single-case Multiple-case HolisticEmbedded Comparisons

Research Methology IV - BNV45217 Case study design Single-case Multiple-case HolisticEmbedded Critical case Extreme Unique Revelatory

Research Methology IV - BNV45218 Case study design Single-case Multiple-case HolisticEmbedded Focus?

Research Methology IV - BNV45219 Case study design Single-case Multiple-case HolisticEmbedded Generalization?

Research Methology IV - BNV The protocol Sets out precisely what is to be studied and how its to be done Sets out precisely what is to be studied and how its to be done Helps in retaining focus Helps in retaining focus Spell out Spell out What you expect to learn (the theory/hypothesis) What you expect to learn (the theory/hypothesis) Questions to be asked Questions to be asked Aspects to be observed Aspects to be observed Commit to paper before study commences Commit to paper before study commences Multiple-cases: pilot study? Multiple-cases: pilot study?

Research Methology IV - BNV Data collection Quantitative Quantitative Surveys Surveys Measurements Measurements Qualitative Qualitative Observations Observations Feelings Feelings Variety of methods used in a case adds strength Variety of methods used in a case adds strength

Research Methology IV - BNV Example P 100 P 100 If your theory is that some system improves patient care… Select a few hospitals that use the system. And …

Research Methology IV - BNV Causation Surveys could only show correlation Surveys could only show correlation Case study (can) collect evidence of causation Case study (can) collect evidence of causation Remove other reasonable explanations Remove other reasonable explanations Get similar results in multiple cases Get similar results in multiple cases

Research Methology IV - BNV The role of the researcher Participant-observer to unobtrusive observer Participant-observer to unobtrusive observer Remember Remember Hawthorne effect? Hawthorne effect? Unobtrusive – difficult to collect info Unobtrusive – difficult to collect info

Research Methology IV - BNV Record keeping Keep complete records of observations Keep complete records of observations If something become apparent later you should be able to go back to previous observations If something become apparent later you should be able to go back to previous observations Reconsider correctness Reconsider correctness If available for others to scrutinize can add scientific merit If available for others to scrutinize can add scientific merit How? – capture data in its original form How? – capture data in its original form Tape recordings of interviews (transcribed) Tape recordings of interviews (transcribed) Printouts Printouts Photographs… Photographs…

Research Methology IV - BNV Case selection Literal replication Literal replication Random? Random? Cases where theory least likely to apply… Cases where theory least likely to apply… Theoretical replication Theoretical replication X iff Y, select a couple where X applies and not X iff Y, select a couple where X applies and not X causes Y, select case where X applies and cases where Y applies X causes Y, select case where X applies and cases where Y applies

Research Methology IV - BNV Data analysis Pattern matching Pattern matching Predicts observations Predicts observations

Research Methology IV - BNV Generalizing results Number of successes in a row… Number of successes in a row… If chosen probably the odss are stacked in your favor If chosen probably the odss are stacked in your favor See p See p