1. www.handels.gu.se E 43 Johan Brink, IIE 22 November Quantitative research Lecture 5 2015-06-17

2. www.handels.gu.se Agenda Chapter 6 Indicators Reliability & Validity Causality Chapter 7 Sampling, Replication Chapter 9 Questionnaires Chapter 10 Asking questions Open closed

3. www.handels.gu.se The Quantitative research process 1.Theory 2.Hypothesis 3.Research design 4.Devise measurements 5.Select research site 6.Select research subjects/respondents 7.Collect data 8.Process data 9.Analyze data 10.Conclusions 11.Write up

4. www.handels.gu.se Operationalization Concept (e.g. intelligence) Measure (e.g. IQ) Indicator (e.g. different test) Multiple indicators of a concept One doesn’t capture all individual interpretations Too narrow or too broad Different dimensions of a concept (such as culture, performance…)

5. www.handels.gu.se Constructs Construct Item IQ

6. www.handels.gu.se Reliability & validity Reliability – Stability over time – Internal reliability: the coherence of multiple indicators – Inter-observer consistency: effected by subjective judgment Validity – Face validity: getting the focus of attention – Concurrent and predictive validity – check with known criterion – Construct & convergent validity: valid measure of the concept, misinterpretations of constructs from theory. Triangulation with other methods

7. www.handels.gu.se Causal studies Symmetrical – Both dependent on another Reciprocal – Reinforce each other Asymmetrical – Reinforce only one Mill’s method of agreement Mill’s method of difference ABCZ CBEZ CZ ABCZ ABCZ CZ

8. www.handels.gu.se Unit of analysis The bits and pieces: ‘countries’, ‘legal system’, ‘payment systems’ Independent and dependent variables Individual or collective constructs – Culture

9. www.handels.gu.se Types of variable Interval variables The distance between categories are identical A wide range of statistical techniques can be applied E.g. Temperature Ratio variables Classification, order. Distance and unique origin E.g.Age in years Ordinal variables Classification & order -but no equal distance or origin E.g. Doneness of meat (well –medium-rare) Nominal/categorical & Dichotomous variables No order, no distance & no origin Two categories – either or E.g. Gender (M/F)

10. www.handels.gu.se Sampling Relevant sample Representative sample Sampling error – Under & over representation Non-response analysis Stratified and quota sampling Firm MarketingOperationsSales

11. www.handels.gu.se Size – Time and cost – Depends on the variation (standard error) – Diminishing improvement in precision 68% of all sample means will be +/- 1* times standard error The 95% confidence interval: = Mean -/+ [1,96*standard error]

12. www.handels.gu.se Generalizations Sample Population ?

13. www.handels.gu.se Quantitative research CRITIQUE Phenomenological: – Do all individual interpret the world alike? How good is the operationalization? Constructivistic – Does it capture the real –daily behavior/social context- or just the constructed research situation

14. www.handels.gu.se Questionnaires Pros Cheap and quick No interviewer effect Cons Short & clear Self explained No additional information – closed questions Response rate ok > 50% Cover letter /introduction – Why, who, how… – Confidentiality – Follow up Piloting Test Interpretations Do not include in the sample!

15. www.handels.gu.se Research diaries Intrusive Attention gradually drops Expansive

16. www.handels.gu.se Open & Closed questions Open - Reply as they wish + Their own terms + Unusual responses + Do not suggest any answer + Exploring topics + Generate closed questions -Time consuming -Have to be coded -Great effort from respondents Closed -Fixed alternatives + Easy process to analyze + Comparability of answers, limited # answers -No spontaneity -Force in the answers -Not exhaustive, eventually irritating

17. www.handels.gu.se Types of questions Factual Personal information About others Informants (such as size of firm. Test knowledge about) Attitudes, Beliefs, values… Vignette Scenarios Filter questions

18. www.handels.gu.se Likert scale Suitable for attitudes, beliefs & values Types: Yes -No 1-5, 1-10 Strongly agree – Undecided - Strongly disagree Do not mix type of questions Always keep you RQ in mind! What do you want to know? Is it open for interpretations? How would you answer it? General to specific No threatening questions early Avoid ambiguous terms: ‘often’, ‘management’… Avoid long questions Avoid negative questions: ‘not’ included Avoid double negotiations Avoid ‘and’ Avoid general questions Avoid leading questions: ‘do you agree Avoid technical terms