Management development programs Providing recommendations based on scientific evidence Presented to Altria October 2, 2014.

Slides:



Advertisements
Similar presentations
YOU CANT RECYCLE WASTED TIME Victoria Hinkson. EXPERIMENT #1 :
Advertisements

Bridging Research, Information and Culture An Initiative of the Research and Planning Group for California Community Colleges Your Name Your Institution.
8. Evidence-based management Step 3: Critical appraisal of studies
BUSINESS AND FINANCIAL LITERACY FOR YOUNG ENTREPRENEURS: EVIDENCE FROM BOSNIA-HERZEGOVINA Miriam Bruhn and Bilal Zia (World Bank, DECFP)
Research Design and Validity Threats
Performance Appraisal System Update
EVAL 6970: Meta-Analysis Meta-Regression and Complex Data Structures Dr. Chris L. S. Coryn Spring 2011.
Unit 2: Research Methods in Psychology
First use of the multiple mini- interview (MMI) system in a UK veterinary school Carol Gray MRCVS Programme Director BVSc University of Liverpool.
Providing Leaders with the Missing Link: Making Customer Information that is Linked to the Bottom Line Part of Leaders’ 360-Degree Feedback Jim Miller.
Contrasting Examples in Mathematics Lessons Support Flexible and Transferable Knowledge Bethany Rittle-Johnson Vanderbilt University Jon Star Michigan.
PPA Advisory Board Meeting, May 12, 2006 Assessment Summary.
Meta-analysis & psychotherapy outcome research
Ensures adjustment or conformity to specifications Ensures adjustment or conformity to specifications Regulates activities Regulates behavior Ensures adjustment.
OS 352 4/24/08 I. Exam III is on Monday, 4/28, 11:45- 2:45pm, in Science Center /28 Office Hours: 9am-11am, my office. II. HR Scorecard, continued.
What Is Organizational Behavior
Human Resource Management: Gaining a Competitive Advantage
Experimental Research
©2007 Prentice Hall Organizational Behavior: An Introduction to Your Life in Organizations Chapter 19 OB is for Life.
MGT 321: Organizational Behavior
TAYLOR HOWARD The Employment Interview: A Review of Current Studies and Directions for Future Research.
Our course web site: sciences/472a/
Assessment for teaching Presented at the Black Sea Conference, Batumi, September 12, Patrick Griffin Assessment Research Centre Melbourne Graduate.
1 Classroom-Based Research: How to Be a Researcher in Your Classroom Basic Skills Initiative Teaching and Learning Workshop October 2009 Darla M. Cooper.
1 Maximizing Learning in Online Training Courses: Meta-Analytic Evidence Traci Sitzmann Advanced Distributed Learning.
Copyright © 2001 by The Psychological Corporation 1 The Academic Competence Evaluation Scales (ACES) Rating scale technology for identifying students with.
Making a difference? Measuring the impact of an information literacy programme Ann Craig
9.0 A taste of the Importance of Effect Size The Basics of Effect Size Extraction and Statistical Applications for Meta- Analysis Robert M. Bernard Philip.
Overview of MSP Evaluation Rubric Gary Silverstein, Westat MSP Regional Conference San Francisco, February 13-15, 2008.
Analyzing COSF Data in Support of Validity Charles R. Greenwood July 25, 2007.
STUDENTS’ INTERCULTURAL LEARNING THROUGH SHORT-TERM STUDY ABROAD PROGRAMS OCTOBER 21, 2012 MARISSA R. LOMBARDI, ED.D ALLIANCE FOR INTERNATIONAL EDUCATION.
Experimental Methods Sept 13 & 14 Objective: Students will be able to explain and evaluate the research methods used in psychology. Agenda: 1. CBM 2. Reading.
Evaluating a Research Report
1 Politeness Effect: Pedagogical Agents and Learning Gains 報 告 人:張純瑋 Wang, N., Johnson, W.L., Mayer, R.E., Rizzo, P., Shaw, E., and Collins, H. (2005).
Core Capabilities and Core Rigidities: A Paradox in Managing New Product Development Author: Dorothy Leonard-Barton Strategic Management Journal (1992),
The State of Maine Managerial Effectiveness Survey Results.
HOW TO WRITE RESEARCH PROPOSAL BY DR. NIK MAHERAN NIK MUHAMMAD.
Assisting GPRA Report for MSP Xiaodong Zhang, Westat MSP Regional Conference Miami, January 7-9, 2008.
EVIDENCE ABOUT DIAGNOSTIC TESTS Min H. Huang, PT, PhD, NCS.
Maria E. Fernandez, Ph.D. Associate Professor Health Promotion and Behavioral Sciences University of Texas, School of Public Health.
Developing learner competency in the clinical environment GRACE Session 3 GRACE Program.
Carolyn Carter
Research in Communicative Disorders1 Research Design & Measurement Considerations (chap 3) Group Research Design Single Subject Design External Validity.
1 COMPLEXITY IN STUDENT ACHIEVEMENT WHEN HANDICAPPED WITH MISCONCEPTIONS Sam Ramaila, Padmanabhan Nair and Leelakrishna Reddy Department of Physics University.
Lecture # 35. Difficulties in implementing Strategic Change: 1. Organization immune system -Human system seeks homeostasis and equilibrium -We prefer.
Second Language Classroom Research (Nunan, D. 1990) Assoc. Prof. Dr. Sehnaz Sahinkarakas.
How Effective Are One-to-One Tutoring programs in Reading for Elementary Students at Risk for Reading Failure? A Meta-Analysis of the Intervention Research.
EXPERIMENTS AND EXPERIMENTAL DESIGN
Evaluating Impacts of MSP Grants Ellen Bobronnikov January 6, 2009 Common Issues and Potential Solutions.
T tests comparing two means t tests comparing two means.
The Impact of Student Self-e ffi cacy on Scientific Inquiry Skills: An Exploratory Investigation in River City, a Multi-user Virtual Environment Presenter:
RESEARCH METHODS IN INDUSTRIAL PSYCHOLOGY & ORGANIZATION Pertemuan Matakuliah: D Sosiologi dan Psikologi Industri Tahun: Sep-2009.
1 Research Methods in Child Psychopathology Carolyn R. Fallahi, Ph. D.
Dominion Training Survey BADM 621 October 19,2005 Shawn Miller Kylee Fink Soumya Prasad Thomas O’Neill Casey Brown.
“The retained student” Ethnic minorities: black/Hispanic Gender: male Low SES Late birthday Parents normally a dropout; little or no involvement Behavior.
Quality Evaluations in Education Interventions 1 March 2016 Dr Fatima Adam Zenex Foundation.
IMPACT EVALUATION PBAF 526 Class 5, October 31, 2011.
Performance Appraisal & Workplace Performance
Leadership.
RESEARCH METHODS 8-10% 250$ 250$ 250$ 250$ 500$ 500$ 500$ 500$ 750$
Brotherson, S., Kranzler, B., & Zehnacker, G.
What Is Organizational Behavior
What Is Organizational Behavior
Administration Guidelines:
Psychology as a Science
Statistics.
Julie Booth, Robert Siegler, Ken Koedinger & Bethany Rittle-Johnson
Presentation transcript:

Management development programs Providing recommendations based on scientific evidence Presented to Altria October 2, 2014

Questions of interest What management skills are most valuable? Can management skills be trained? If so, how effective are training programs?

Summary of group presentations Identified key management skills: Time management Leadership Communication Strategic thinking & planning

Examining the best scientific evidence We’ll examine two studies: Tonidandel et al. (2012) - Relative importance of managerial skills for predicting effectiveness Collins & Holton (2004) - The effectiveness of managerial leadership development programs: A meta-analysis of studies from 1982 to 2001

Examining the best scientific evidence Why did I pick these studies? Tonidandel et al. (2012) – Study focused on our question and had multiple sources of data (Level 4) Collins & Holton (2004) – A meta-analysis, which is an accumulation of the evidence (Level 1)

What management skills are most valuable?

Tonidandel et al. (2012) - Relative importance of managerial skills for predicting effectiveness Study details 733 managers Ratings of their managerial skills rated by peers Ratings of managerial effectiveness rated by their supervisor Managerial skills Human skills (e.g., interaction, collaboration) Administrative skills (e.g., organizing, delegating) Technical skills (e.g., technical knowledge) Citizenship behaviors (e.g., helping employees)

Tonidandel et al. (2012) - Relative importance of managerial skills for predicting effectiveness Study findings All management skills had a statistically significant positive correlation with managerial effectiveness (range from 0.26 to 0.36)

Tonidandel et al. (2012) - Relative importance of managerial skills for predicting effectiveness 0.26 looks like: From

Tonidandel et al. (2012) - Relative importance of managerial skills for predicting effectiveness 0.36 looks like: From

Tonidandel et al. (2012) - Relative importance of managerial skills for predicting effectiveness 0.26 vs From

Tonidandel et al. (2012) - Relative importance of managerial skills for predicting effectiveness So not a huge difference between the skills with the largest and smallest correlations. But… Then they asked what management skills explained supervisor-rated effectiveness more.

Tonidandel et al. (2012) - Relative importance of managerial skills for predicting effectiveness And found that: Administrative skill explained almost 39% of managerial effectiveness Human skills explained a little more than 32% of managerial effectiveness

Tonidandel et al. (2012) - Relative importance of managerial skills for predicting effectiveness Overall: Administrative & human skills most important Administrative skills Delegating Organizing Setting goals for others Attracting and hiring the best people Human skills Motivating employees Communicating with others Showing interest in employee needs From Scullen et al. (2003) - Evidence of the construct validity of developmental ratings of managerial performance

Tonidandel et al. (2012) - Relative importance of managerial skills for predicting effectiveness Overall: Administrative & human skills most important. This overlaps with our overall findings: Time management (Administrative skill) Leadership (Human skill) Communication (Human skill) Strategic thinking & planning (Administrative skill)

Can these skills be trained?

Collins & Holton (2004) - The effectiveness of managerial leadership development programs: A meta- analysis of studies from 1982 to 2001 Study details Statistically combined 83 studies All 83 studies had a formal training intervention aimed at improving managerial skills

Collins & Holton (2004) Key findings Objective managerial knowledge

Collins & Holton (2004) Key findings In comparison to a control group (group with no training) – managers that went through formal training program had an almost 1 standard deviation increase in objective managerial knowledge From

Collins & Holton (2004) Key findings 84% of the treatment group will be above the mean of the control group, 62% of the two groups will overlap There is a 76 % chance that a person picked at random from the treatment group will have a higher score than a person picked at random from the control group If 100 people go through the treatment, 34 more people will have a favorable outcome compared to if they had received the control treatment From

Collins & Holton (2004) Key findings Objective (other-rated) & subjective (self-rated) gain in managerial expertise

Collins & Holton (2004) Key findings In comparison to a control group (group with no training) – managers that went through formal training program had about a 0.4 standard deviation increase in managerial expertise from the pre-test and post-test From

Collins & Holton (2004) Key findings 66% of the treatment group will be above the mean of the control group, 84 % of the two groups will overlap There is a 61 % chance that a person picked at random from the treatment group will have a higher score than a person picked at random from the control group If 100 people go through the treatment, 15 more people will have a favorable outcome compared to if they had received the control treatment From

Conclusions What management skills are most valuable? o Administrative skills o Human skills Can management skills be trained? If so, how effective are training programs? o Yes o Compared to those who didn’t have any training, there’s a large increase in knowledge o Compared to before training, there’s a moderate increase in managerial expertise