Freelance Consultant to the Minerva ODL Project & to Leeds College of Technology Using the revealed worldviews of e-Learning stakeholders in the design and evaluation of ODL provision Tim Deignan
Correspondence Freelance educational consultant, trainer and researcher, working mainly in UK Post-Compulsory Education and Training. Wide range of client organisations, particular interest in student support systems.
Acknowledgements My thanks to Dr Louise Bryant, Academic Unit of Psychiatry and Behavioural Sciences, University of Leeds, for providing materials for this presentation
The Project : “DOODLE” D eveloping O nline O pen D istance L earning E -models for vocational skills education
DOODLE: Participants The ODL Providers: Leeds Huddersfield Dublin Romania Greece Finland The Learners: Print Construction Print Networking Software Business
Project Aims Using Q-methodology to reveal the attitudes of various stakeholders towards e-Learning Using revealed attitudes to review the design and evaluation of ODL provision NB: Work in Progress! Final report to project sponsors due September 2004.
What is Q-methodology? a foundation for the systematic study of subjectivity (Steven Brown, 1991) a set of philosophical, psychological, statistical, and psychometric ideas oriented to research on the individual (Fred Kerlinger, 1986) Identifies the different stories that can be told about a topic (Rex Stainton Rogers, et al., 1996)
…a structured approach to the study of subjectivity, using the Q sorting technique……making internal beliefs observable…. What is Q-methodology?
Q-methodology ~ origins William Stephenson ( ) William Stephenson, psychologist and physicist…. Stephenson, W. (1935). Correlating persons instead of tests, Character and Personality 4, Stephenson, W. (1953). The Study of Behavior: Q-technique and Its Methodology
Q-methodology ~ stages 1.Identifying and sampling the ‘concourse’ 2.Selecting participants 3.Q sorting 4.Factor analysis 5.Factor interpretation
1. Identifying and sampling the concourse Sampling aims * Points of view not knowledge * Represent the concourse Identifying the concourse *What is written and said about the topic? *Diversity of sources Q set
1(cntd). Sampling the flow of communicability around the topic categories statements items ODL item examples: E-training is not suitable for all learners. E-training threatens the existence of traditional training providers.
2. Selecting Participants *Participants are the variables *Selected for diversity of views…..including directors, curriculum leaders, web developers, online tutors, and e-learners embarking on ODL programmes provided by the DOODLE partner organisations
2 (cntd). 125 participants DOODLE Leeds Huddersfield Dublin Romania Greece Finland staffstudents
3. Q-sorting: a sorter in action
3 (cntd). A Q-sorting matrix Strongly Disagree Agree
4. Factor Analysis * Enter the data using Q dedicated software * Extract the initial factors * Select and rotate the factors to calculate distinct ‘voices’ among the participants
5. Factor Interpretation Interpret the factors using: *Factor arrays (most agree/most disagree & neutral) *The consensus items and distinguishing items (similarities and differences between factors) * The sorters’ comments NB: ANALYSIS OF PROJECT DATA IS ONGOING (Final Report to sponsors due September 2004) - SEE VISUALISER FOR INITIAL DATA / FACTORS
DOODLE www Reference For the official project listing, see p30 of the ‘Socrates Compendium 2002’ which can be found at: cbots/Documents/Compendium/Odl/co mp_M_2002.pdf
Author References (1) Brown, S. R. (1980). Political Subjectivity: Applications of Q Methodology in Political Science, Yale University Press, New Haven. Kerlinger, F. N. (1986) Foundations of Behavioural Research, Holt, Rinehart & Winston, New York
Author References (2) Stainton Rogers, R. (1995). Q Methodology. In Rethinking Methods in Psychology, eds. Smith, J. A. & Van Langenhove, L., pp Sage, London. Stephenson, W. (1953). The Study of Behavior: Q-Technique and its Methodology, University of Chicago Press, Chicago
Electronic Resources an introductory websitehttp:// the official Q website of the International Society for the Scientific Study of Subjectivitywww.qmethod.org muenchen.de/~p41bsmk/qmethod/webq/inde x.html a web-based application for Q sorting questionnaire itemshttp:// muenchen.de/~p41bsmk/qmethod/webq/inde x.html