Validation of Ethical Decision-Making Measures: Internal and External Validity Jason H. Hill University of Oklahoma Center for Applied Social Research.

Slides:



Advertisements
Similar presentations
Clinical Governance VTS Scheme Presentation Feb 2003 Matt Walsh.
Advertisements

Team “Japan” BA352 Section 005
TWS Aid for Supervisors & Mentor Teachers Background on the TWS.
Lew Hardy Institute for the Psychology of Elite Performance School of Sport, Health & Exercise Sciences, Bangor University, Wales, UK Some Future Directions.
John E. BucknerTilman L. Sheets Louisiana Tech University.
HOW PEOPLE MAKE SENSE OF ETHICAL EVENTS Jay Caughron University of Oklahoma 2009 Conference on Research Integrity May 17 th, 2009.
MGT-555 PERFORMANCE AND CAREER MANAGEMENT
1 Aligning Assessment Methods with Learning Outcome Statements and Curricular Design Presented at CCRI April 8, 2005 Material from Maki,
3-2 Individual Differences: What Makes Employees Unique Copyright © 2008 by the McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Organizational.
Responsible Conduct of Research Training: A Solution for Teaching Ethics in the 21st Century Ethan Waples University of Oklahoma.
Leadership Development Nova Scotia Public Service
Chapter 7 Performance Management
 Objectives  Presented in terms of student outcomes. What do you want students to know or be able to demonstrate.  Educational Taxonomies  Cognitive.
S.G. Cowen: New Recruits OBHR - E100 March 3, 2009.
SUNITA RAI PRINCIPAL KV AJNI
Early Determinants of Ethical Decision-Making Stephen Murphy Center for Applied Social Research University of Oklahoma ORI Conference Tampa Bay, FL 12/02/06.
© 2008 The McGraw-Hill Companies, Inc. All rights reserved 2 - 2ChapterChapter McGraw-Hill/Irwin Personality, Stress, Learning, and Perception.
Mirror, Mirror on the Wall: The Role of Self-Reflection in Ethical Decision Making Laura Martin University of Oklahoma 2009 Research Conference on Research.
A Decade of Implementing Research- Based Dispositions Instruments: Student Admissions Processes DISPOSITIONS: A DECADE OF PROGRESS? Seventh Symposium on.
CHANGING SUBJECTIVE RATINGS TO OBJECTIVE SCORES FOR RANKING GRADUATE APPLICANTS Stephen D. Oller, Ph.D. Associate Professor & Lydia “Odette” Gonzalez,
NCCSAD Advisory Board1 Research Objective Two Alignment Methodologies Diane M. Browder, PhD Claudia Flowers, PhD University of North Carolina at Charlotte.
Thinking Actively in a Social Context T A S C.
Developing Management Skills
ENHANCE Update Research Underway on the Validity of the Child Outcomes Summary (COS) Process ECO Center Advisory Board Meeting March 8, 2012 Arlington,
The Iowa Pediatric Integrated Health Home Program (PIHH) is for children and youth, 0 to 18 years old, who are Medicaid eligible and have a Severe Emotional.
Values and Ethics EDU 131 Constitution Day 15 Sept 2006.
Foundations Of Individual Behavior Chapter 2. Aim of this chapter To explain the relationship between ability and job performance Contrast three components.
Chapter 2 Foundations of Individual Behavior
ORGANIZATIONAL BEHAVIOR S T E P H E N P. R O B B I N S E L E V E N T H E D I T I O N W W W. P R E N H A L L. C O M / R O B B I N S © 2005 Prentice Hall.
Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Testing and Selecting Employees.
A COMPETENCY APPROACH TO HUMAN RESOURCE MANAGEMENT
Using the Scientific Method and Appropriate Measurements The Scientific Method Question Hypothesis Testing Method Conclusion  Law  Theory.
Appreciating Individual Differences: Self-Concept, Personality, Emotions Chapter Five Copyright © 2008 The McGraw-Hill Companies, Inc. All rights reserved.
Considering Causes in Forecasting for Ethical Decision-Making Cheryl Beeler University of Oklahoma 2009 Research Conference on Research Integrity Niagara.
Building Trust and Sales Ethics
 Descriptive Methods ◦ Observation ◦ Survey Research  Experimental Methods ◦ Independent Groups Designs ◦ Repeated Measures Designs ◦ Complex Designs.
Assessment Examining its Impact on Student Learning ASDW Aug. 28, 2012.
Essentials of Health Care Marketing 2 nd Ed. Eric Berkowitz Chapter 4 Buyer Behavior.
Paddie Blaney Chief Executive NIPEC. NIPEC supports nursing and midwifery in Northern Ireland by promoting the best standards of practice, education &
“Outcomification”: Development and Use of Student Learning Outcomes Noelle C. Griffin, PhD Director, Assessment and Data Analysis Loyola Marymount University.
Testing, Experiments, and Media Planning. Market Tests and Experiments Test –Simple field test of advertising Experiment –Carefully designed study of.
Evidence Based Coaching Certificate Program School of Human and Organization Development Dr. Leni Wildflower, Director Dr. Katrina.
Social Development during Adolescence Chapter 4. Social Development and Rites of Passage Formal Rites of Passage – Religious (Bar/Bat Mitzvah; Confirmation;
Today.. Overview of my realist synthesis Reflections on the process
Chapter Thirteen – Organizational Effectiveness.  Be able to define organizational effectiveness  Understand the issues underpinning measuring organizational.
Human Resource Management Recruitment and Selection.
Alison Antes University of Oklahoma 2009 Research Conference on Research Integrity Niagara Falls, NY May 17, 2009.
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 16 Communicating Assessment.
Kuliah 4 Etika Profesi dan Bisnis Oleh Coky Fauzi Alfi cokyfauzialfi.wordpress.com Ethical Decision-Making Process.
Ethical Issues in Treatment Selection Northern Arizona University Timothy C. Thomason.
CDIO: Overview, Standards, and Processes (Part 2) Doris R. Brodeur, November 2005.
KITS V JUNE , 2014 BREAKING DOWN AND UNDERSTANDING THE PSYCHOLOGICAL : WHAT YOU DON’T KNOW CAN HURT YOU M. Connie Almeida, PhD, LSSP, Licensed Psychologist.
Audience Engagement We will be using Polleverywhere throughout the presentation. If you would like to participate you can go to PollEv.com/kristabailey359.
Evaluating Educationally Significant Outcomes: The Need to Balance Academic Achievement with Social-Emotional Learning Dr. Tiffany Berry Research Associate.
Ethical Decision Making
Theory of Stress & Coping Alice C
Clinical Assessment Dr. H
Clinical Research: Part 3
مركز تطوير التدريس والتدريب الجامعي ورقة بعنوان
مركز تطوير التدريس والتدريب الجامعي ورقة بعنوان إعداد
Creating Self awareness
ST MARGARET OF SCOTLAND HOSPICE
Interactive lecture ii Jolanta Babiak Winter semester 2018/2019
Health Profession Education for Patient Safety” Blink or Think?
VTS Scheme Presentation Dr Matt Walsh
Research Design. Research Design Validity Validity refers to the amount that a measure actually measures the concept it is designed to measure.
TPS Workshop Objectives
Perceptions of Satisfaction with and Effectiveness of Accelerated Second-Degree Programs Deborah Raines, PhD, RN, ANEF Professor Florida Atlantic University.
Assessment Chapter 3.
VTS Scheme Presentation Feb 2003 Matt Walsh
Presentation transcript:

Validation of Ethical Decision-Making Measures: Internal and External Validity Jason H. Hill University of Oklahoma Center for Applied Social Research

Researchers Professors -Dr. Michael Mumford-Dr. Shane Connelly -Dr. Lynn Devenport-Dr. Ryan Brown Graduate Students -Stephen Murphy -Alison Antes -Ethan Waples

Current Measures Integrity in scientific research is difficult to assess Responses to ethical dilemmas –Complex –Field Specific –Personal Values vs. Professional Goals Research suggests that ethical decision- making measures are effective for assessing integrity

Study Intent Validate Ethical Decision-Making Measure –Substantive Frameworks –Potential Causes of Ethical Decision-Making Exposure to Ethical Events –Potential Outcomes of Ethical Decisions Reactions to Ethical Misconduct

Methodology Sample –102 first year Ph.D. students Measures –Ethical Decision-Making –Individual Difference Measures –Ethical Events 93 events across four EDM domains Rated frequency of events exposure –Review Panel Task 8 incidents of misconduct

Ethical Decision-Making Twelve scenarios Scenarios map directly to taxonomy –Ethical issues people encounter Data Management Study Conduct Business Practices Professional Practices Multiple responses under each stem (2) –Responses scored on ethicality Low (1)Moderate (2) High (3)

McNair is part of a team working on an NIMH- funded project tracking the effectiveness of her State’s mental health care program for the poor. The longitudinal study requires extensive interviews on a yearly basis of a large sample, and the team is running behind schedule. The project director wants to accelerate the pace, but McNair has several other pressing responsibilities and is afraid she may not be able to meet them all.

McNair knows that she will have to find some way to get all the interviews done on time or future funding for the project may be in jeopardy. She thinks up several different approaches she could take to get the interviews done on time. Choose the two best approaches from the following: -Sample Responses Interview the individuals at their homes after work hours and on weekends Ask all participants to come in on one day and do a large-scale interview with everyone Ask the project director if she can train a second interviewer to help her

Alternative Scoring Seven Decision-Making Strategies Recognize Circumstances Consideration of Others Deal with Emotions Analysis of Personal Motivations Anticipating Consequences Seeking Help Questioning One’s Judgment Extent to which response reflects decision-making strategies

Alternative Scoring Seven Social Behavioral Dimensions Involvement of others Deception Avoidance of Personal Responsibility Active Involvement Retaliation Selfishness Closing Oneself to Opportunities for Future Action Extent to which response reflects social behaviors giving rise to each decision

Analyses Correlations of Cognitive Decision-Making Strategies and Social Behavioral Dimensions with EDM Correlations of EDM measure with Individual Differences Correlations and Regressions of EDM measure with exposure to Events Correlations and Regressions of EDM with Review Panel Decisions

Substantive Validity Cognitive Decision-Making Strategies Average r with EDM Recognition of Circumstances.50 Consider Effects of Actions.46 Anticipating Consequences.45 Analysis of Personal Motives.40 Social Behavioral Dimensions Average r with EDM Selfishness-.50 Avoidance of Responsibility-.50 Deception-.46

Correlations of Individual Differences Measures with EDM Data Management Study Conduct Professional Practices Business Practices Impression Mgmt Self - Deceptive Enhancement Neuroticism Cynicism -.26* -.21* -.29* -.26* Narcissism * -.08 Intelligence * Conscientiousness Agreeableness *.02 Openness Divergent Thinking * Extraversion Trust *.26* Anxiety

Exposure to Unethical Events Data Management Study Conduct Professional Practices Business Practices r β Data Management Events -.31* -.29*-.25* * * -.01 Study Conduct Events -.42* -.26*-.24* * -.31*-.28* -.13 Professional Practice Events -.27* * -.27**-.39* * Business Practice Events -.35* * *.02 Multiple R Significance of R

Outcomes of EDM Severity of Violation Severity of Punishment Importance of Punishment Frequency rβrβrβrβ Data Management.38*.13.31*.12.44*.22*–.04 Study Conduct.29*–.02.24* –.01.28*–.01– Professional Practices.48*.35*.37*.25*.48*.30*– Business Practices.42*.34*.30*.26*.37*.27*–.09 –.11 Multiple R Sig. of R

Summary Present study provides validity evidence for our measure –Cognitive Strategies and Social Psychological Dimensions –Causes of Ethical Decision-Making relate as expected Individual Differences Exposure to Unethical Events –Ethical Decision-Making relates to punitive attitudes of violators

Implications EDM measure provides unique and effective approach to measure integrity Cognitive Decision-Making Strategies and Social Behaviors can account for ethical responding