2. ©2006 Richard Watson Todd Three purposes of triangulation in language teaching research Richard Watson Todd KMUTT

3. ©2006 Richard Watson Todd What is triangulation? b b Triangulation comes from surveying b b Triangulation means measuring something from different perspectives b b Possible different perspectives include different instruments, subjects, methods of analysis, places, times

4. ©2006 Richard Watson Todd Claims made for triangulation b b Internal validity b b Reliability b b Stability b b Plausibility b b Researcher confidence

5. ©2006 Richard Watson Todd How triangulation works b b “demonstrating the same findings through different sources” b b “confirming data collected in one way with data collected in a completely different way” b b “maximising the possibility of obtaining credible findings by cross-validating them”

6. ©2006 Richard Watson Todd Purposes of triangulation b b To identify valid and reliable findings b b To compare different findings b b To identify valid data sources and methods

7. ©2006 Richard Watson Todd The data b b Extracts of classroom language analysed for topics using: b b Functional analysis (Sinclair and Coulthard, 1975) b b Theme-rheme progression b b Given-new progression b b Lexical analysis (Hoey, 1991) b b Topic-based analysis using logical relations b b Topic-based analysis using associations b b Prime focus: To identify topic discontinuities

8. ©2006 Richard Watson Todd Purpose 1: To identify valid and reliable findings b b Large number of discontinuities identified b b 13 points where all analyses agree on a discontinuity b b 14 points where 5 analyses agree on a discontinuity b b These 27 points are most likely points for discontinuities to be identified by participants

9. ©2006 Richard Watson Todd Purpose 2: To compare different findings b b Problems of using triangulation to identify valid findings for topics and coherence b b Examine points where a discontinuity is identified by only one analysis b b Sinclair and Coulthard (1975): most points b b Given-new progression: fewest points (proportionately)

10. ©2006 Richard Watson Todd Purpose 2: To compare different findings (cont.) b b Research into perceptions of teachers and learners (e.g. Block, 1994) b b Teachers and learners perceive classroom activities differently b b Teachers and learners operate according to different systems

11. ©2006 Richard Watson Todd Purpose 3: To identify valid data sources and methods b b Examine overall patterns of similarities and differences between all analyses b b Calculate z-scores showing relationships between each pair of analyses b b Design a benchmark control analysis b b Construct an extended tree diagram b b Compare validity of each analysis

12. ©2006 Richard Watson Todd Purpose 3: To identify valid data sources and methods (cont.) b b For discontinuities: b b Control analysis = placing the average number of discontinuities at equidistant intervals through the discourse

13. ©2006 Richard Watson Todd

14. Purpose 3: To identify valid data sources and methods (cont.) b b Another example: b b Identifying topics for stretches of discourse bounded by discontinuities b b Control analysis = topic is the most frequent content word in the stretch of discourse

15. ©2006 Richard Watson Todd

16. Purposes of triangulation b b Identifying valid and reliable findings: may be possible, but overemphasised b b Comparing different findings: more likely to be of use in ELT research b b Identifying valid data sources and methods: potentially useful, especially in methodological studies