Kozan, K. , & Richardson, J. C. (2014)

Slides:



Advertisements
Similar presentations
Focus on Instructional Support
Advertisements

Checking For Understanding
Overview of field trial analysis procedures National Research Coordinators Meeting Windsor, June 2008.
Social Presence Social Presence What is it? And How Do We Measure It? Patrick R. Lowenthal | University of Colorado Denver.
Developing and validating a stress appraisal measure for minority adolescents Journal of Adolescence 28 (2005) 547–557 Impact Factor: A.A. Rowley.
Community of Inquiry Framework: Validation & Instrument Development
Measurement Models and CFA Ulf H. Olsson Professor of Statistics.
A Structural Equation Modeling Approach to Students’ Homework Assignment Web Sites Usage Emel DIKBAS TORUN Hacettepe University Eralp ALTUN Ege University.
Jingzi Huang, Ph.D School of Teacher Education, CEBS UNC 2013 Fall GTA Conference Presentation.
Blended by Design: Designing and Developing a Blended Course Jennifer Strickland, PhD,
Multivariate Methods EPSY 5245 Michael C. Rodriguez.
Social Science Research Design and Statistics, 2/e Alfred P. Rovai, Jason D. Baker, and Michael K. Ponton Factor Analysis PowerPoint Prepared by Alfred.
Confirmatory factor analysis
Student Engagement Survey Results and Analysis June 2011.
MOTIVATIONAL FACTORS THAT INFLUENCE THE ACCEPTANCE OF MICROBLOGGING SOCIAL NETWORKS: 1 THE µBTAM MODEL FRANCISCO REJÓN-GUARDIA FRANCISCO J. LIÉBANA-CABANILLAS.
Family Foster Care (FFC) and Therapeutic Foster Care (TFC) Parents' Motivation, Stress and Satisfaction with Fostering: Part 3 Michael Brand, Ph.D. David.
Student Perceptions of Teaching Transparency Alecia D. Anderson, Andrea N. Hunt, Rachel E. Powell, and Cindy Brooks Dollar North Carolina State University,
TOWARD A VALIDATED MEASURE OF TEACHER/COACH ROLE CONFLICT Thomas J. Templin Purdue University Department of Health and Kinesiology Chantal Levesque-Bristol.
Advanced Correlational Analyses D/RS 1013 Factor Analysis.
Reliability Analysis Based on the results of the PAF, a reliability analysis was run on the 16 items retained in the Task Value subscale. The Cronbach’s.
Evidence-Based Teaching: Evaluative Strategies ED A SEPTEMBER 29, 2011 Dr. Anne Belcher, Dr. Linda Adamson, Instructors.
Karen Swan Kent State University Research Center for Educational Technology Assessing the Impact of Technology on Learning.
Project Based Learning: Challenges & Opportunities John R. Mascazine, Ph.D. Ohio Dominican University Science Education Council of Ohio January 25 – 26,
ALISON BOWLING CONFIRMATORY FACTOR ANALYSIS. REVIEW OF EFA Exploratory Factor Analysis (EFA) Explores the data All measured variables are related to every.
By Bundhun Amit Varma HMOA  Define Online Discussion  Recognise models of online discussions ◦ Synchronous ◦ Asynchronous  Distinguish three.
Mobile Learning and the Online Community of Inquiry M. Cleveland-Innes M. Ally source:
Inquiry Road Map A Guidance System for 21 st Century Learning By Mary Ratzer.
Taeho Yu, Ph.D. Ana R. Abad-Jorge, Ed.D., M.S., RDN Kevin Lucey, M.M. Examining the Relationships Between Level of Students’ Perceived Presence and Academic.
Assessment Online. Student Assessment Design learner-centered assessment that include self-reflection Design grading rubrics to assess discussions, assignments,
Success through Technology and Assessment August 1 st -3 rd Attended workshops and training to prepare for the grant o Achievement Series o eMetric o Obtaining.
Development of the Construct & Questionnaire Randy Garrison & Zehra Akyol April
Common Core.  Find your group assignment.  As a group, read over the descriptors for mastery of this standard. (The writing standards apply to more.
An instructional design theory for interactions in web-based learning environments 指導教授 : 陳 明 溥 研 究 生 : 許 良 村 Lee, M.& Paulus, T. (2001). An instructional.
Documenting Your Teaching and Student Evaluations
FACTOR ANALYSIS & SPSS.
The Nuts and Bolts of Willingness to Use Technology
Using Collaborative Learning Techniques in the Writing Classroom
MGT-491 QUANTITATIVE ANALYSIS AND RESEARCH FOR MANAGEMENT
Exploratory Factor Analysis Participants, Procedures, & Measures
Jackson College CCSSE & CCFSSE Findings Community College Survey of Student Engagement Community College Faculty Survey of Student Engagement Administered:
Academic Advising Assessment: Perceived Support and Scale Development Tracie D. Burt, Erin M. Buchanan, Michael T. Carr, Marilee L. Teasley, Carly A.
Psychometric Properties of the Seeking of Noetic Goals Test Brandy J
Chapter 15 Confirmatory Factor Analysis
Improving Student Engagement Through Audience Response Systems
Thinking with Technology Course Module 9
Social Presence within Two Massive Open Online Courses (MOOCs)
Online Driver Education and Virtual Classroom
How did WE work? Assessing Collaborative Projects in the Online or Hybrid Classroom
GOOD MORNING.
Contemporary Issues November 8, 2010.
Faculty Instructional Rubric
Collaborative Instructional Strategies Inquiry
Mapping it Out! Practical Tools to Use Assessment Well
Dr. Chin and Dr. Nettelhorst Winter 2018
What Are Rubrics? Rubrics are components of:
EPSY 5245 EPSY 5245 Michael C. Rodriguez
Confirmatory Factor Analysis
Creating a Community of Inquiry
Teaching and Learning Online
Elements of Constructivist Teaching and learning Practices
Core Competencies for Primary School Teachers in Crisis Contexts
Online Driver Education and Virtual Classroom
Undergraduate Survey Data
Curriculum & Instruction Course Survey
Learning Community II Survey
Fred Ford Matt Klauza Phillip C. Mancusi Helena Zacharis
Approaches to Learning (ATL)
Psychometric testing and validation (Multi-trait scaling and IRT)
Dr. Sheri Conklin; Erika Hanson, Ginu Easow & Zach Morgan
Presentation transcript:

New Exploratory and Confirmatory Factor Analysis Insights into the Community of Inquiry Survey Kozan, K., & Richardson, J.C. (2014). New Exploratory and Confirmatory Factor Analysis Insights into the Community of Inquiry Survey. The Internet and Higher Education, 23, 39-47. *Initial and final model visuals were taken from the manuscript submission files. *Personal pics.

2007 PPT pic

0 (Strongly Disagree) to 4 (Strongly Agree)

# 12 The instructor provided feedback that helped me understand my strengths and weaknesses relative to the course’s goals and objectives. The instructor provided feedback that helped me understand my strengths and weaknesses

# 28 Online discussions were valuable in helping me appreciate different perspectives Discussing course content with my classmates was valuable in helping me appreciate different perspectives

Research Context Personal pic

Sample PPT 2007 pic EFAs (N = 219) / CFAs (N = 178)

Results PPT 2007 pic

EFAs: Descriptive statistics (N = 219) Possible minimum Minimum Possible Maximum Maximum Mean SD Teaching Presence (13 items) 13 20 65 56.84 9 Social Presence (9 items) 29 45 39.80 4.43 Cognitive Presence (12 items) 12 29.35 60 52.63 6.17 Total Presence 34 98 170 149.25 17.05

Range of average item ratings Presence Range Teaching Presence 4.17 (SD = 1.05) to 4.56 (SD = .66) Social Presence 4.19 (SD = .76) to 4.57 (SD = .54) Cognitive Presence 4.26 (SD = .76) to 4.54 (SD = .57)

The scree plot Personal pic

Parallel Analysis Measured Eigenvalues Random Factor 1 16.39 1.83 3.61 1.72 Factor 3 2.03 1.63 Factor 4 1.25 1.57

Factor Loadings No Items F1/TP F2/CP F3/SP TP7 The instructor helped to keep course participants engaged and participating in productive dialogue. .939   TP3 The instructor provided clear instructions on how to participate in course learning activities. .910 TP2 The instructor clearly communicated important course goals. .884 TP8 The instructor helped keep the course participants on task in a way that helped me to learn. .881 TP13 The instructor provided feedback in a timely manner. .844 TP1 The instructor clearly communicated important course topics. .827 TP6 The instructor was helpful in guiding the class towards understanding course topics in a way that helped me clarify my thinking. .818 TP10 Instructor actions reinforced the development of a sense of community among course participants. .769 TP5 The instructor was helpful in identifying areas of agreement and disagreement on course topics that helped me to learn. .750 TP4 The instructor clearly communicated important due dates/time frames for learning activities. .686 TP11 The instructor helped to focus discussion on relevant issues in a way that helped me to learn. .676 TP9 The instructor encouraged course participants to explore new concepts in this course. .660 TP12 The instructor provided feedback that helped me understand my strengths and weaknesses. .557 CP29 Combining new information helped me answer questions raised in course activities. .832 CP25 I felt motivated to explore content related questions. .807 CP23 Problems posed increased my interest in course issues. .762 CP31 Reflection on course content and discussions helped me understand fundamental concepts in this class. .760 CP26 I utilized a variety of information sources to explore problems posed in this course. .754 CP24 Course activities piqued my curiosity. .743 CP33 I have developed solutions to course problems that can be applied in practice. .732 CP30 Learning activities helped me construct explanations/solutions. .662 CP28 Discussing course content with my classmates was valuable in helping me appreciate different perspectives. .648 CP34 I can apply the knowledge created in this course to my work or other non-class related activities. .616 CP32 I can describe ways to test and apply the knowledge created in this course. .615 CP27 Brainstorming and finding relevant information helped me resolve content related questions. .441 SP19 I felt comfortable interacting with other course participants. .937 SP17 I felt comfortable conversing through the online medium. .893 SP18 I felt comfortable participating in the course discussions. .765 SP21 I felt that my point of view was acknowledged by other course participants. .704 SP16 Online or web-based communication is an excellent medium for social interaction. .701 SP20 I felt comfortable disagreeing with other course participants while still maintaining a sense of trust. .697 SP15 I was able to form distinct impressions of some course participants. .586 SP14 Getting to know other course participants gave me a sense of belonging in the course. .549 SP22 Online discussions help me to develop a sense of collaboration. .379 .546 % of variance explained 48.21 10.64 5.98 Croanbach’s Alpha .963 .938 .911

1st Set of CFAs

Levesque, Stanek, & Ryan (2004) Indices Value GFI (goodness of fit index)   ≥ .90 NNFI (non-normed fit index) CFI (comparative fit index) IFI (incremental fit index) RMSEA (root mean square error of approximation) ≤.05 (desired) .05 – .08 (reasonable) ≥.10 (poor) Levesque, C., Stanek, L. R., Zuehlke, A. N., & Ryan, R. M. (2004). Autonomy and competence in German and American university students: A comparative study based on self-determination theory. Journal of Educational Psychology, 96(1), 68-84.

CFA-1 (χ2 = 1500.97; df = 524; p =.00) Indices Value GFI 0.70 NNFI 0.96 CFI IFI RMSEA 0.096

CFA-6 (χ2 = 1201.36; df = 519; p =.00) Indices Value GFI 0.75 NNFI 0.96 CFI IFI RMSEA 0.079

2nd Set of CFAs

CFAs: Descriptive statistics (N = 178) Possible minimum Minimum Possible Maximum Maximum Mean SD Teaching Presence (13 items) 13 28.33 65 57 8.80 Social Presence (9 items) 9 27 45 39.60 4.52 Cognitive Presence (12 items) 12 35 60 53.15 6.27

Range of average item ratings Presence Range Alpha Teaching Presence 4.28 (SD = .86) to 4.52 (SD = .71) .961 Social Presence 4.19 (SD = .77) to 4.57 (SD = .54) .900 Cognitive Presence 4.34 (SD = .66) to 4.59 (SD = .53) .944

CFA-1 (χ2 = 1587.11; df = 524; p =.00) Indices Value GFI 0.64 NNFI 0.95 CFI 0.96 IFI RMSEA 0.11

CFA-11 (χ2 = 1193.71; df = 514; p =.00) Indices Value GFI 0.73 NNFI 0.97 CFI IFI RMSEA 0.082

Highlights Factor solution included three factors. Parallel analysis, employed for the first time, favored three factors over four. Results did not indicate any substantial refinements to survey items. We need further factor analytic research on the survey and its revised versions with sound rationale for statistical techniques to be employed. The first CFA employed is more confirmatory compared to further CFAs with modifications. First 3 highlights from the article.

! ? kkozan@purdue.edu jennrich@purdue.edu