Degree of Commitment among Students at a Technological University – Testing a New Research Instrument Hannu Vanharanta, Jarno Einolander Industrial Management.

Slides:



Advertisements
Similar presentations
Psychometric Aspects of Linking Tests to the CEF Norman Verhelst National Institute for Educational Measurement (Cito) Arnhem – The Netherlands.
Advertisements

Unit “ 10 “ CONTROLLING. Controlling Final step in the management process: actions taken to ensure that actual outcomes are consistent with those Planned.
Writing a Research Proposal
Hypothesis Testing II The Two-Sample Case.
Profile of an Engineering Education and Professions Introduction to Mechanical Engineering The University of Texas-Pan American College of Science and.
Student Engagement Survey Results and Analysis June 2011.
Research & Statistics Looking for Conclusions. Statistics Mathematics is used to organize, summarize, and interpret mathematical data 2 types of statistics.
Noel-Levitz Student Satisfaction Survey of Classroom and Online Students Conducted Spring 2008.
HOW TO WRITE RESEARCH PROPOSAL BY DR. NIK MAHERAN NIK MUHAMMAD.
Research PHE 498. Define Research Research can be considered as systematic inquiry: A process that needs to be followed systematically to derive conclusions.
Eloise Forster, Ed.D. Foundation for Educational Administration (FEA)
SOCIOLOGICAL INVESTIGATION
Teacher Engagement Survey Results and Analysis June 2011.
Office of the State Minister of Reforms Coordination of Georgia /GORBI Monitoring Governance Reforms Pilot Survey in Tbilisi Schools.
Descriptive Research Study Investigation of Positive and Negative Affect of UniJos PhD Students toward their PhD Research Project Dr. K. A. Korb University.
With the growth of internet service providers, a researcher decides to examine whether there is a correlation between cost of internet service per.
Center for Learning Outcomes Assessment – Bayh College of Education – Indiana State University – Terre Haute, Indiana.
Validity and Reliability in Instrumentation : Research I: Basics Dr. Leonard February 24, 2010.
What is Research?. Intro.  Research- “Any honest attempt to study a problem systematically or to add to man’s knowledge of a problem may be regarded.
ANNOUCEMENTS 9/3/2015 – NO CLASS 11/3/2015 – LECTURE BY PROF.IR.AYOB KATIMON – 2.30 – 4 PM – DKD 5 13/3/2015 – SUBMISSION OF CHAPTER 1,2 & 3.
Leadership v. Mentoring & New Doctoral Students Francis T. Harten Long Island University / C.W. Post Campus.
T Relationships do matter: Understanding how nurse-physician relationships can impact patient care outcomes Sandra L. Siedlecki PhD RN CNS.
Research Design
Multivariate Analysis - Introduction. What is Multivariate Analysis? The expression multivariate analysis is used to describe analyses of data that have.
Smart Goal Draft EDLS 642 O’Donnell. Parent Involvement Strengths Parents choose to attend the school and generally start with greater agreement with.
Understanding Populations & Samples
Statistics & Evidence-Based Practice
Summary of VCU Student Satisfaction Fall 2012
Quality Assurance processes
Advancing Social Justice
Virtual University of Pakistan
Classroom Assessment A Practical Guide for Educators by Craig A
Items in red require your input
Leacock, Warrican and Rose (2009)
MGT-491 QUANTITATIVE ANALYSIS AND RESEARCH FOR MANAGEMENT
Multivariate Analysis - Introduction
Culture Survey This document provides examples of how we analyze and report our clients’ culture survey data. It includes data from several clients in.
Classification of Research
Dissertation Findings
BY DR. M. MASOOM RAZA  AND ABDUS SAMIM
Chapter 8 Introduction to Motor Learning
Effects of Targeted Troubleshooting Activities on
NSSE Results for Faculty
Survey research CAS 204.
The Accessibility and Utilization Frequency of Academic Services for Student Military Veterans Presented by: Jessie Boswell, Sandra Garcia, Xavier Simon-Perry,
2015 PARCC Results for R.I: Work to do, focus on teaching and learning
Business and Management Research
Objectives Assignment and quizzes review
K-3 Student Reflection and Self-Assessment
Finding Answers through Data Collection
2017 UC Staff Engagement Survey
The Incomplete Constellation
Items in red require your input
EVAAS Overview.
Items in red require your input
Writing a Literature Review
2017 UC Staff Engagement Survey
Ontario`s Mandated High School Community Service Program: Assessing Civic Engagement After Four Years S. D. Brown, S.M. Pancer, P. Padanyi, M. Baetz, J.
Preparing a PROFILOR® Feedback Report
Family Functioning and Social Life Regulation among Adolescents
Eloise Forster, Ed.D. Foundation for Educational Administration (FEA)
McPherson College, Fall 2017
COMPARING VARIABLES OF ORDINAL OR DICHOTOMOUS SCALES: SPEARMAN RANK- ORDER, POINT-BISERIAL, AND BISERIAL CORRELATIONS.
2017 Postgraduate Research Experience Survey (PRES) Results
Grace Orlyn SITOMPUL 5th ISC – Oct 30-31, 2017 APIU
Multivariate Analysis - Introduction
Misc Internal Validity Scenarios External Validity Construct Validity
The Impact of Peer Learning on Assessment Literacy and Feedback Orientation
NHS DUDLEY CCG Latest survey results August 2018 publication.
Presentation transcript:

Degree of Commitment among Students at a Technological University – Testing a New Research Instrument Hannu Vanharanta, Jarno Einolander Industrial Management and Engineering, Tampere University of Technology Pori, Finland jarno.einolander@tut.fi

Introduction Education is considered to be a critical contributor e.g. to economic competitiveness, growth, as well as social inclusion. It has been argued that students stay in their higher education institutes for similar reasons to those that make employees committed and engaged in organizations. Students’ satisfaction and commitment to their studies is a significant issue for academic institutions.

Theory Earlier studies on student retention focused on academic abilities in predicting their retention. However, research indicates that, for example academic goals, self-confidence, institutional commitment, social support, institutional selectivity financial support, and social involvement, all have a positive relationship to student retention. Students who cannot develop these factors are more inclined to drop out. Probably the two most dominant theories of student persistence and retention are Tinto’s (1975, 1987) Student Integration Model and Bean’s (1980, 1982) Student Attrition Model. Bean (1980) argued that students stay in their higher education institutes for similar reasons to those of employees in organizations. Tinto (1982) argued that retention involves two different commitments from a student. The first one, goal commitment, is the students’ commitment to obtain a degree, and the second one, institutional commitment, is their decision to obtain that degree at a particular institution.

Previous research In our previous research we created a literature-based generic online application to evaluate different concepts related to organizational commitment and engagement, to gain insights how employees see their membership in their organizations currently and what kind of proactive vision they have for the future.

Instrument Our target is to create an Internet-based student commitment measurement system, using self-evaluation. Once self-evaluation has been conducted, students and academic staff will be more aware of possible development gaps and can base their objectives for improvement on concrete bottom-up results. On a practical level, respondents are asked to evaluate the current and target state of the statement This evaluation results in the creation of a proactive vision, i.e. the gap between the current reality and future vision Linguistic scale values are utilized. The scales vary according to the statements, for example, from “not at all” to “completely”, or “highly unsatisfied” to “satisfied”.

Empirical study In the fall of 2013, we tested our organizational commitment instrument with 40 Master’s students at Tampere University of Technology in Finland. All of the students had a prior bachelor level degree in some field of engineering or business administration and had been in working life before attending their master’s level studies. The sample consisted of 24 males and 16 females. The average age of the participants was 34 years old with an average of 10 years in working life. Students were asked to consider their university as their organization, and relate their responses to that. Based on the results of our student research, we concluded that the instrument as a whole is not at its best in assessing student commitment.

Empirical study The wording of applicable statements and the overall structure of our ontology model was modified in order to create an appropriate instrument for use in an educational institution. We took variables from Bean’s Student Attrition Model as the framework for building a new modified instrument. Adapting the instrument for the academic context required a new grouping of concepts and their features.

As a result, 15 concepts were identified along with 107 applicable statements or ‘features’ describing them.

Sample results Academic advising In the following figures the data obtained in our study is visually analyzed in different types of graphs. This figure was made by drawing an ascending trend line from a single statement, where each respondent's answer was a single plot. By drawing them into a single graph, their difference becomes immediately visible.

The median value shows the significance of the curve Tthe following statements are constantly over the median curve meaning they are highly valued: - Senior management is good at communicating with the rest of the organization - My manager shares information adequately - My organization or manager provides support when needed. The graph shows that the respondents value information sharing very highly in academic advising. Item 3 (My manager shares information adequately) and Item 4 (I receive useful and constructive feedback that helps to improve my performance) are the two statements that have the most different views about their current state. About 30 percent of the respondents see the biggest gap between the current states in these statements. This shows that most of the respondents feel that information is shared adequately but this information lacks concrete feedback that helps to improve their performance.

Social integration 12 statements were extracted from the whole ontology model, such as (1) I am satisfied with the way I get to know other people while at work, (2) I like the people I talk to and work with at work (3) This organization respects its employees, and (4) I would not like to lose the friends or work group I have at work. Next figure is an example of a proactive vision, i.e. the tension between the current and target states of respondents. These curves illustrate the collective view of the direction in which respondents wish these factors to evolve.

Social integration

The figure shows that most of the respondents feel that the statements concerning social integration are on the level they feel they should be in the future or the level should improve relatively slightly (value near zero). However, small number of respondents answered at opposite ends of the scale. This shows that there are also respondents who see a great gap between current and future, both negative (possible misinterpretation) and positive.

Institutional quality Next figure represents each respondent’s answers to statements assessing the institutional quality. Each data point in the chart represents one individual’s answer to one particular statement. The bigger data point marker represents the median of all the statements of all respondents.

Most of the respondents consider the quality of their institution high and wish that it would stay that way or show a little more improvement. An interesting group of respondents are those who wish the target state to be lower than the current state. The median of all the statements shows the collective view of all the respondents on the matter in hand. within the respondents there is a very high congruent view and feeling about the statements measuring the quality characteristics of their institution.

Institutional commitment Statements in next figure are such as (1) Deciding to work for this organization was a definite mistake, (2) I am proud to tell others who I work for, (3) I do not feel a strong sense of belonging to my organization, and (4) I am personally committed to this organization. In this figure the answers are very scattered across the whole response scale. This indicates that there is a lot of disagreement among the survey respondents. This high level of disagreement may indicate that it is necessary to dig deeper into the results of these items, or they may simply indicate inconclusive findings.

again most respondents see that the current state is adequate or that they would like it to be slightly better. This figure also shows that there are many respondents who grade these statements very low, both the current and future, and also the future lower than the current state.

Conclusion With the methods presented, it is quite easy to analyze a large amount of data in a visual form. Visual analysis is easy to use and informative, especially for people who are not very familiar with different statistical analysis methods. Collective data gathered with a statistically sufficient sample size are able to provide insights to the reasons behind academic dropout. It also provides knowledge on how academic dropout can be managed so that it becomes a downward trend in the future.