EERA Workshop on Q methodology & Q factor analysis

Slides:



Advertisements
Similar presentations
2007 ISSSS Conference Bethesda, MD Joe Jurczyk University of Akron
Advertisements

Workshop on Q methodology
1 Senn, Information Technology, 3 rd Edition © 2004 Pearson Prentice Hall James A. Senns Information Technology, 3 rd Edition Chapter 7 Enterprise Databases.
A CROSS CULTURAL INVESTIGATION OF STUDENT AND FACULTY PERCEPTIONS OF GENERAL EDUCATION: WHY PERCEPTION MATTERS Susan Gano-Phillips and Xiaoyan Wang AAC&U.
Budapest University of Technology and Economics Department of Ergonomics and Psychology 1 A short introduction into the Q-methodology and.
Item Analysis.
Test Development.
Real Estate Market Analysis
1 University of Utah – School of Computing Computer Science 1021 "Thinking Like a Computer"
1 Developing Tests for Departmental Assessment Deborah Moore, Assessment Specialist Institutional Research, Planning, & Effectiveness University of Kentucky.
Writing a Method Section
Developing a Questionnaire
The world leader in serving science TQ ANALYST SOFTWARE Putting your applications on target.
James Richards, William Angliss Institute An old chestnut revisited: teachers’ opinions and attitudes toward grading within a competency based training.
Developing a Global Vision Through Marketing Research
Copyright © 2014 by Educational Testing Service. ETS, the ETS logo, LISTENING. LEARNING. LEADING. and GRE are registered trademarks of Educational Testing.
Psychology Practical (Year 2) PS2001 Correlation and other topics.
What is a Survey? A scientific social research method that involves
Chapter Review: What is Sociology?
Determining How Costs Behave
What Behaviors Indicate a Student is Meeting Course Goals and Objectives? “Indicators”
Basic SLA Statistics for the University Educator Peter Neff Harumi Kimura Philip McNally Matthew Apple CUE Forum 2007 © 2007 JALT CUE SIG and individual.
Surveys and Questionnaires. How Many People Should I Ask? Ask a lot of people many short questions: Yes/No Likert Scale Ask a smaller number.
Psy 427 Cal State Northridge Andrew Ainsworth PhD Cal State Northridge - Psy 4271.
CH. 9 MEASUREMENT: SCALING, RELIABILITY, VALIDITY
SOWK 6003 Social Work Research Week 4 Research process, variables, hypothesis, and research designs By Dr. Paul Wong.
Methodology Tips for Constructing Instruments. Matching methods to research paradigm MethodQuantitativeQualitative Written Instrument Standardized Instrument.
The process of evaluation Program Evaluation and Quality Assurance HPR 322 Chapter 13.
Designing Questionnaires for Research By Janna McColgan EDUC 491/EDUC 403 Research Spring 2012.
Quantitative Research
©2007 Prentice Hall Organizational Behavior: An Introduction to Your Life in Organizations Chapter 19 OB is for Life.
Social Science Research Design and Statistics, 2/e Alfred P. Rovai, Jason D. Baker, and Michael K. Ponton Internal Consistency Reliability Analysis PowerPoint.
Mass Customization-Based, "Lowest" Cost, Pre-Employment Assessment System for Entry Level, Front Line Jobs through Lower Level Management Positions HR.
Clustering analysis workshop Clustering analysis workshop CITM, Lab 3 18, Oct 2014 Facilitator: Hosam Al-Samarraie, PhD.
CASIE Workshop Psychology
Reliability, Validity, & Scaling
CBR 106: Developing a Client Satisfaction Survey.
Research Methods and Design
An Introduction to Research Methodology
Qualitative Methods vs. Quantitative Methods. Qualitative Methods? Quantitative Methods?
Freelance Consultant to the Minerva ODL Project & to Leeds College of Technology Using the revealed worldviews of e-Learning stakeholders in the design.
Craigiebuckler, Aberdeen, AB15 8QH, UK Explaining the Q-method.
Chapter 11: Qualitative and Mixed-Method Research Design
Methods of Media Research Communication covers a broad range of topics. Also it draws heavily from other fields like sociology, psychology, anthropology,
Joe Jurczyk Cleveland State University University of Akron Association of Institutional Research Annual Conference Measuring Perspectives: The Q Methodology.
1 Applied Statistics Using SAS and SPSS Topic: Factor Analysis By Prof Kelly Fan, Cal State Univ, East Bay.
Directorate of Human Resources The use of the Nominal Group Technique in evaluating student experience Diana Williams OCSLD.
Quantitative and Qualitative Approaches
Loughborough London School of Sport & Exercise Sciences Evaluating the Competencies of Sports Managers in Taiwan: A Delphi Approach Ling-Mei Ko Professor.
Research and Evaluation: The Basics A Workshop for Educators Session 519 Saturday, June 30, 2007 Rita DeMaria, Ph.D. Scott Gardner, Ph.D.
VALIDITY AND VALIDATION: AN INTRODUCTION Note: I have included explanatory notes for each slide. To access these, you will probably have to save the file.
A New Approach to Performing Course Evaluations: Using Q Methodology to Better Understand Student Attitudes Joe Jurczyk Susan Ramlo University of Akron.
Copyright © Allyn & Bacon 2008 Intelligent Consumer Chapter 14 This multimedia product and its contents are protected under copyright law. The following.
Slide 10-1 © 1999 South-Western Publishing McDaniel Gates Contemporary Marketing Research, 4e Using Measurement Scales to Build Marketing Effectiveness.
Multivariate Analysis and Data Reduction. Multivariate Analysis Multivariate analysis tries to find patterns and relationships among multiple dependent.
CHAPTER 5: Marketing Information & Research Mrs. Piotrowski Principles of Marketing 1.
Usability Testing Instructions. Why is usability testing important? In a perfect world, we would always user test instructions before we set them loose.
Applied Opinion Research Training Workshop Day 3.
Lecture №4 METHODS OF RESEARCH. Method (Greek. methodos) - way of knowledge, the study of natural phenomena and social life. It is also a set of methods.
Principal Component Analysis
Social Psychology The Self. How is Social Psychology Different From Philosophy/Psychology? Defining Characteristic: Scientific Method –Refers to a set.
Analyzing Data Module 8. 2 Where are we in the Cycle? Resources Establish Need Analyze Data Interpret Data Communicate Results Use Results Plan Collect.
Are you ready for a challenge?. Are you willing to try?
Acknowledgement: Khem Gyawali
Chris Phelan School of Sport, Tourism & The Outdoors
Applied Statistics Using SAS and SPSS
Principal Component Analysis
Applied Statistics Using SPSS
Presentation transcript:

EERA Workshop on Q methodology & Q factor analysis Sue Ramlo Joe Jurczyk Al Herbert Isadore Newman

Workshop Outline Introduction to Q methodology Q factor analysis Sorting items onto a normal Gaussian distribution Concourse of items & the Q sample Analyzing the sorts using PQ Method – factors & interpretation Q factor analysis How is Q FA different from Q method? Using QUANAL to find topologies in Q FA Using PQ Method for Q FA Why groups of people?

Introduction to Q methodology - Overview Allows a researcher to investigate the views, or perspectives, of a person or a group of people. The process involves sorting items (typically statements) into a normal Gaussian distribution. Analysis involves factor analysis that groups people, not items. FA – grouping based on correlation among the participants’ sorts.

Sorting items onto a normal Gaussian distribution Pre-sort into 3 piles Distribute (& re-distribute) to fit specific normal Gaussian distribution. (usually most disagree to most agree) LEAST like my view (~14 statements here) MOST like my view Neutral view about this statement

Now you try it! Condition of instruction - “Because you’ve been working so hard, you have been ordered by your boss/department chairperson to take a 5-day vacation by yourself or with your family, all expenses paid. Rate the following items on a scale of “most enjoyable” (+5) to “most unenjoyable” (-5)….” Pre-sort into 3 piles Distribute (& re-distribute) to fit specific normal Gaussian distribution. (usually most disagree to most agree) Most unenjoyable (~7 items) MOST enjoyable Neutral view about this statement

Introduction to Q methodology – historical background Developed in 1935 by William Stephenson Physicist-psychologist Student of Spearman A Study of Behavior, 1955 Q because of its philosophical similarity to the physics field of Quantum Mechanics Most often used in fields of psychology, marketing, advertising, political science… Mixes quantitative & qualitative aspects of research

Why not another method to determine views? Alternatives for determining perspectives are not as powerful as Q. Likert scale evaluations and rank ordering lead to the loss of meaning (McKeown, 2001). Because Q measures personal opinion regarding a concourse of items related to a topic, validity is not a consideration (Brown, 1999).

What is meant by subjectivity? What do you see? Bunny? Duck? Is one right & the other wrong or are they both just different views?

Any Q study starts with a concourse: Can consist of words / statements, pictures, sounds, smells… Subjective Not “It’s raining” But can be “the rain makes me feel sad” –or- “I love to walk in the rain.” Items are interpreted by participant – removes the view of the researcher & the issue of validity / reliability. Select the Q sample from the concourse Try to “balance” the Q sample

Concourse of items – 3 possibilities “Naturalistic” statements - taken from participants’ oral or written communications. Interviews Focus Groups “Ready made” statements - from sources other than those of the participants’ communications. Likert survey items Based on knowledge of researcher w/o interviews Hybrid - combine both “naturalistic” and “ready made” items. One is not inherently superior to the other (McKeown & Thomas, 1988). Researcher selects the type best suited to the project at hand

Q sample – select items from the concourse to use in the study. Example: Selection from a Q sample of 44 (chosen from a concourse of 53) 1 What I learn from textbook depends on how I use it to study in this class. 23 I can tell when I understand the material in this class. 2 I need to learn how to study more effectively to succeed in this class. 24 I feel comfortable applying what I learned in this class to the real-world. 3 Working hard on difficult problems does not help me learn in this class. 25 Doing homework helps me learn in this class. 4 I don't have to work hard to learn in this class. 26 Reading the textbook helps me learn in this class. 5 I need to learn how to learn in this class. 27 I like the exactness of math-type subjects. 6 I have very little control over how much I learn in this course. 28 I often think about how well I understand the topics in this class. 7 In this class, if I can't understand something right away, I will keep on trying 29 What I learn in this class will help me in other classes. 8 Working with classmates inside &/or outside this class helps me learn. 30 What I learn in this class will help me when I get a job in my field.

Condition of instruction Participants sort based upon a condition of instruction (or multiple conditions). E.g. Sort the following statements as they relate to your views about learning in this class. The statements are matters of subjective opinion and may mean different things to different people. e.g. I worked hard in this class.

Analyzing Q sorts SPSS & SAS not really designed for Q sorts – you mess with weightings, etc. Need software designed for Q methodology QUANAL PCQ PQMethod

Factor Analysis Higher order correlation Used to determine patterns in a data set R-factor analysis groups items (people are rows, items are in columns). Factors represent similar items. Q-factor analysis groups people (people are in columns, items are in rows). The factors represent people with similar topologies. Q methodology is not Q FA but does group people based upon their VIEWS on a subject. Factors represent similar views about a topic.

PQ Method to determine factors & assist in their interpretation Free download (start at www.qmethod.org) DOS based Designed for handling Q sort entry and analyses Choices Centroid versus Principle Components factor extraction Graphical hand rotation versus Varimax Start PQMethod

PQMethod Analyses Creates print out with: Factor loadings Factor correlations Distinguishing statements Consensus statements, etc Example - knowledge Tech Physics sorts Ramlo 2006.lis.

Q factor analysis How is Q FA different from Q method? Using QUANAL to find topologies in Q FA

QFA run in PQMethod Create z-scores for each item (if the items all have the same scale, skip this step). Rank order items for each person (lowest to highest) and then give a grid score (e.g 1 to 6, -2 to 2, etc). Note that PQ Method allows for a scale up to 13 places. Unlike Q sorts, QFA does not lend itself to a grid that has any columns deeper than one layer. This is important because we are analyzing the topologies of the items. The *.lis file contains similar outputs to that of QUANAL including distinguishing items for pairs of factors, consensus items, etc.

Why groups of people? If groups are known a priori, use discriminative analyses If groups are unknown, need Q FA to determine groups without sorts; Q method with sorts