Kayleigh Darling Richard Heinrich Britney Reed Laura Vazquez

Slides:



Advertisements
Similar presentations
Altruism as a Characteristic of Individuals Who Intend to Adopt Heather Buford Hanover College.
Advertisements

Some (Simplified) Steps for Creating a Personality Questionnaire Generate an item pool Administer the items to a sample of people Assess the uni-dimensionality.
Chapter 5 Measurement, Reliability and Validity.
Research Methodology Lecture No : 11 (Goodness Of Measures)
Measurement Reliability and Validity
It Takes All Sorts to Make a (Survey) World: Differential Effects of Survey Mode for the Factorial Vignettes and a Self-Report Personality Inventory Andrey.
Self-Transcendence and Work Engagement in Acute Care Staff Registered Nurses Beth Palmer DNP, RN, ANP-BC, CNS, CCRN November 13, 2008.
Statistics Versus Parameters
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
Validity, Sampling & Experimental Control Psych 231: Research Methods in Psychology.
Psych 231: Research Methods in Psychology
Validity, Reliability, & Sampling
Method Introduction Results Discussion The Effect of Self-Esteem, Marital Status, and Gender on Trait Anxiety and Stress Emily B Gale University of Nebraska-Lincoln.
Reliability, Validity, & Scaling
Assessing College Wide SLOs using a Student Perception Survey: A Tale of Two SLOs Jeanne Edman and Brad Brazil Cosumnes River College.
The Learning Behaviors Scale
Student Engagement Survey Results and Analysis June 2011.
Greek Affiliation and Success in College Ev A. Lynn Practicing Until Perfect University.
MEASUREMENT CHARACTERISTICS Error & Confidence Reliability, Validity, & Usability.
Analyzing Reliability and Validity in Outcomes Assessment (Part 1) Robert W. Lingard and Deborah K. van Alphen California State University, Northridge.
Populations and Samples Anthony Sealey University of Toronto This material is distributed under an Attribution-NonCommercial-ShareAlike 3.0 Unported Creative.
Final Study Guide Research Design. Experimental Research.
1 Cronbach’s Alpha It is very common in psychological research to collect multiple measures of the same construct. For example, in a questionnaire designed.
MARY GUINTU ANUSHA GUMMADI NABIL MONTEZ JENNIFER ZELAYA Physical Activity and It Effects on Mood.
1 of 65 Inferential Statistics I: The t-test Experimental Methods and Statistics Department of Cognitive Science Michael J. Kalsher.
Examination of Public Perceptions of Four Types of Child Sexual Abuse Prevention Programs Brandon Kopp Raymond Miltenberger.
Academic Competition at St. Francis Xavier University Presented by: Katie Smith Jennifer Dunn Justin Saddlemyer.
CHAPTER OVERVIEW The Measurement Process Levels of Measurement Reliability and Validity: Why They Are Very, Very Important A Conceptual Definition of Reliability.
Chapter 2: Behavioral Variability and Research Variability and Research 1. Behavioral science involves the study of variability in behavior how and why.
Brandon Vaughn University of Texas at Austin
©2011 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
Advanced Science and Technology Letters Vol.47 (Education 2014), pp Instructor’s Evaluation on Importance.
Steven W. Evans, Christine Brady, Lee Kern, Christiana Andrews and the CARS Research Team Measurement Development and Inclusion Criteria: Developing Meaningful.
Reliability a measure is reliable if it gives the same information every time it is used. reliability is assessed by a number – typically a correlation.
Greek Affiliation and Success in College Ev A. Lynn Practicing Until Perfect University Introduction When students enter college, they have the choice.
◦ th and 11 th grade high school students (54% girls) ◦ 63% Caucasian; 24% African-American; 13% Hispanic; remaining were Asian or “other” ◦ Mean.
Language Assessment Lecture 7 Validity & Reliability Instructor: Dr. Tung-hsien He
© 2009 Pearson Prentice Hall, Salkind. Chapter 5 Measurement, Reliability and Validity.
Methods Participants & Procedures Participants were draw from a larger study that included rd, 4 th, and 5 th grade students and sixty seven teachers.
Descriptive Statistics Report Reliability test Validity test & Summated scale Dr. Peerayuth Charoensukmongkol, ICO NIDA Research Methods in Management.
PAIN & INTEROCEPTIVE BODY–AWARENESS
Reliability Analysis.
Further Validation of the Personal Growth Initiative Scale – II: Gender Measurement Invariance Harmon, K. A., Shigemoto, Y., Borowa, D., Robitschek, C.,
Karin Karako Hunter college, the city university of new york
Chapter 2 Personality Research Methods
Introduction Method Results Conclusions
Authors *Dr. Asma Parveen *Uzaina
Research Methods I Chapter 5 – Correlational Research: Surveys
CHAPTER 5 MEASUREMENT CONCEPTS © 2007 The McGraw-Hill Companies, Inc.
Religiosity and Romantic Beliefs
Friendship Quality as a Moderator
The Role of Perceived Consensus in Reactance
Advanced Science and Technology Letters Vol. 47 (Education 2014), pp
پرسشنامه کارگاه.
Lecture 6 Structured Interviews and Instrument Design Part II:
Calculating Reliability of Quantitative Measures
Analyzing Reliability and Validity in Outcomes Assessment Part 1
Reliability Analysis.
Laura M. Sylke & David E. Szwedo James Madison University Introduction
Experiment Basics: Variables
UNH Graduate Research Conference 2016
A comparative study of UNA students vs
15.1 The Role of Statistics in the Research Process
Kristin E. Gross & David E. Szwedo James Madison University
Research Methods in Management
Analyzing Reliability and Validity in Outcomes Assessment
Pediatric HITSS (PedHITSS)
Demographic Characteristics of the Sample DISCUSSION/CASE STUDY
Presentation transcript:

Kayleigh Darling Richard Heinrich Britney Reed Laura Vazquez Altruism Kayleigh Darling Richard Heinrich Britney Reed Laura Vazquez

Altruism Defined as: "Helpful behavior that an individual exhibits toward another individual in the absence of an external or internal reward." It is difficult to define altruism. This definition is a blend of the definition found in the dictionary and the ideas of different philosophers.

Convergent Validity Defined as: data indicating that a test measures the same construct as other tests purporting to measure the same construct The following are from the Self-Report Altruism Scale 21. I have helped a classmate who I did not know that well with a homework assignment when my knowledge was greater than his or hers 22. I have given directions to a stranger. 23. I have allowed someone to go ahead of me in a lineup (at a Xerox machine, in the supermarket). 24. I have delayed an elevator and held the door open for a stranger. 25. I have offer my seat on a bus or train to a stranger who was standing.

Descriptive Statistics In total, there were176 (N=176) participants ranging in age from 18 to 70. The questions used a 5 point Likert scale Most questions had a low variance, however some such as question 19 and 25 had σ²>1. In addition, there were 62 (35.0%) males and 104 (58.8%) females Twenty seven (15.3%) participants identified themselves as African American, 13 (7.3%) as Asian, 109 (61.6%) as Caucasian, 10 (5.6%) as Hispanic and 7 (4.0%) as Other. Eighteen (10.2%) participants identified themselves as psychology majors, while 148 (93.8%) did not. Seventy-five (42.4%) identified themselves as college students while the remaining 91 (51.4%) did not.

Reliability Item Analysis The initial measure of reliability was approximately α=.382 This was computed from 168 participants (9 were excluded by SPSS probably due to missing data). Problem items were then identified and deleted, increasing the reliability to α=.660. Deleted items included questions such as “If I do not know someone I will not help them” and “If I help someone and do not get recognized for it, I am disappointed” These items had good face validity, however when the statistics were analyzed, these items proved to be unreliable. A one-way ANOVA was also performed for Gender, Ethnicity, Age, and College Grad status but no significant result was found in either categories.

Reliability Item Analysis The variance was quite large before the item elimination, and the questions that were eliminated seemed to account for a large part of the variance. σ²(before): 76.235 vs. σ²(after): .032 The reduction in variance seemed to increase the reliability of the overall measure, as variance is used in the computation of Cronbach’s alpha as evidenced from the formula

Scale Modification The reliability of 20 items was measured by Cronbach’s alpha which was initially found to be 0.382, which shows a low degree of internal consistency. In the table below it was shown that separate factors existed, since some items had a Cronbach’s alpha of greater than 0.382. Items 5, 11, 12, and 16 were eliminated in an attempt to increase the reliability. After the problem items were eliminated, the Cronbach’s alpha increased to 0.660.

The Questionnaire Self-report measure Consisted of 25 questions First 20 questions developed by the authors Last 5 questions from the “Self-Report Altruism Scale” (Rushton, Chrisjohn, & Fekken, 1981). - Reliability: α=.51 - Positively correlated with measures of empathy and social responsibility. 5-point Likert Scale Higher Score indicates higher altruism

  Corrected Item-Total Correlation Cronbach's Alpha If Item Deleted 1. If I have needed a favor in the past, the first person I turned to is someone who I did a favor for .214 .359 2. I find myself believing in the motto "I'll scratch your back if you scratch mine" .241 .351 3. I would help someone even if it put me in danger. .218 .357 4. In my opinion, people should rewarded for helping others .156 .364 5. If I do not know someone I will not help them. -.044 .392 6. If I saw someone with a flat tire I would help them. .158 7. I would help someone even if I did not like them. .334 .342 8. I try to teach children to show concern for others. .197 .356 9. I aspire to resemble the actions of people such as Mother Theresa or Martin Luther King Jr. .220 .352 10. I have thought that helping others is a waste of my time. -.079 .396 11. If I help someone and I am not recognized for it, I feel disappointed. -.029 .391 12. If you can help someone, you should. .089 .589 13. I feel good when I help someone. .298 .341 14. I find myself believing that in this world it is everyone for himself or herself. .150 .365 15. I tend to put the needs of others ahead of my own .256 16. I find myself doing things for other people, even when it is not convenient for me. .046 .384 17. I' ve helped someone in order to get on his/her good side. .163 18. If I see someone who needs help I feel compelled to help. .311 .345 19. I am more likely to help a friend or family member than a stranger. .079 .376 20. When I see someone in need, I do not think about what it will cost me to help, I just do something about it. .290 .348

Construct Validity In order to find the other concepts that were being measured, the scale was divided into two components. A factor analysis was performed to divide the data into two components: Component 1 consists of items 7, 8, 9, 13, 15, 18, and 20. It was renamed Selflessness and had a reliability of 0.551. Component 2 consists of items 3, 4, 10, 11, 14, and 17. It was renamed Self-centered and has a reliability of 0.585. The total variance explained was 29.546%. Using a criterion of 0.4

  Component 1 2 1. If I have needed a favor in the past, the first person I turned to is someone who I did a favor for 2. I find myself believing in the motto "I'll scratch your back if you scratch mine" 3. I would help someone even if it put me in danger. .335 4. In my opinion, people should rewarded for helping others .533 5. If I do not know someone I will not help them. 6. If I saw someone with a flat tire I would help them. 7. I would help someone even if I did not like them. .670 8. I try to teach children to show concern for others. .715 9. I aspire to resemble the actions of people such as Mother Theresa or Martin Luther King Jr. .500 10. I have thought that helping others is a waste of my time. .692 11. If I help someone and I am not recognized for it, I feel disappointed. .636 12. If you can help someone, you should. 13. I feel good when I help someone. .591 14. I find myself believing that in this world it is everyone for himself or herself. .532 15. I tend to put the needs of others ahead of my own .595 16. I find myself doing things for other people, even when it is not convenient for me. .732 17. I' ve helped someone in order to get on his/her good side. .653 18. If I see someone who needs help I feel compelled to help. 19. I am more likely to help a friend or family member than a stranger. 20. When I see someone in need, I do not think about what it will cost me to help, I just do something about it. .642

Validation Plan The validity of this measure is in question due to several factors: First, massive user fatigue would dramatically increase the probability that the test users answered in response sets. Response sets can easily be identified if reverse scoring is used. It would be advisable to standardize the administration procedure. Since the participants were volunteers and did not take the assessment in one place, there is no way to know whether every participant had a standardized environment in which to take the assessment. A stratified random sampling procedure could also be employed in order to get a more accurate estimate of ethnic/gender differences.

Validation Plan Cont’d Another plan for validating the assessment would be to norm the test on a representative population (preferably one that mimics the real population demographics). In order to establish greater convergent validity, one could compare the assessment to a measure of empathy. Comparing the altruism assessment to a measure of selfishness could also be used to establish discriminant validity.

Altering Questions More situational examples Example: I feel good when I help someone finish their home work. Vs. I feel good when I help someone. Example: If I see someone who is injured, I feel compelled to help. Vs. If I see someone who needs help I feel compelled to help.

References Cohen, R. & Swerdlik, M. (2005). Pychological Testing and Assessment. McGraw-Hill, New York, 6th ed. Rushton, J. P., Chrisjohn, R. D., & Fekken, G. C. (1981). The altruistic personality and the self- report altruism scale. Personality and Individual Differences, 2, 293-302.