A Meta-Analysis of Periodic Noise Stress on Human Performance J.M. Ross, G.E. Conway, J.L. Szalma, B.M. Saxton, A. Braczyk, & P.A. Hancock University of.

Slides:



Advertisements
Similar presentations
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
Advertisements

Effect Size Overheads1 The Effect Size The effect size (ES) makes meta-analysis possible. The ES encodes the selected research findings on a numeric scale.
RIMI Workshop: Power Analysis Ronald D. Yockey
Comparison of Spatial and Temporal Discrimination Performance across Various Difficulty Levels J.E. THROPP, J.L. SZALMA, & P.A. HANCOCK Department of Psychology.
Critiquing Research Articles For important and highly relevant articles: 1. Introduce the study, say how it exemplifies the point you are discussing 2.
Introduction to Meta-Analysis Joseph Stevens, Ph.D., University of Oregon (541) , © Stevens 2006.
METHODOLOGIES EXPLAINED How to Conduct Systematic Political Research 1.
Determination of Construction Contract Duration for Public Projects in Saudi Arabia By: Ahmed Saleh Al-Sultan, June 1989 Presented by Sameh Elish January.
A quick introduction to the analysis of questionnaire data John Richardson.
Company LOGO B2C E-commerce Web Site Quality: an Empirical Examination (Cao, et al) Article overview presented by: Karen Bray Emilie Martin Trung (John)
Reporting and Evaluating Research
Slide Copyright © 2010 Pearson Education, Inc. Active Learning Lecture Slides For use with Classroom Response Systems Business Statistics First Edition.
Introduction to Communication Research
Relationships Among Variables
Quality of life of older adults who use social care support and their unpaid carers Stacey Rand & Juliette Malley.
The Data Analysis Plan. The Overall Data Analysis Plan Purpose: To tell a story. To construct a coherent narrative that explains findings, argues against.
9.0 A taste of the Importance of Effect Size The Basics of Effect Size Extraction and Statistical Applications for Meta- Analysis Robert M. Bernard Philip.
Determining Sample Size
Aggregate and Systemic Components of Risk in Total Survey Error Models John L. Eltinge U.S. Bureau of Labor Statistics International Total Survey Error.
RESEARCH A systematic quest for undiscovered truth A way of thinking
Meta Analysis MAE Course Meta-analysis The statistical combination and analysis of data from separate and independent studies to determine if there.
Evaluating the Validity of NLSC Self-Assessment Scores Charles W. Stansfield Jing Gao Bill Rivers.
Advanced Statistics for Researchers Meta-analysis and Systematic Review Avoiding bias in literature review and calculating effect sizes Dr. Chris Rakes.
Program Evaluation. Program evaluation Methodological techniques of the social sciences social policy public welfare administration.
The Effect of Computers on Student Writing: A Meta-Analysis of Studies from 1992 to 2002 Amie Goldberg, Michael Russell, & Abigail Cook Technology and.
1 Homologues Group Meeting Slovenia, October 2009 Republika SlovenijaEuropean Union Ljubljana, October 2009 Risk of Error on Closure Ljubljana,
Statistical Applications for Meta-Analysis Robert M. Bernard Centre for the Study of Learning and Performance and CanKnow Concordia University December.
United States Department of Agriculture Food Safety and Inspection Service 1 National Advisory Committee on Meat and Poultry Inspection August 8-9, 2007.
Psychology 301 Chapters & Differences Between Two Means Introduction to Analysis of Variance Multiple Comparisons.
IEEE 64 th ECTC – Orlando, FL, USA May 27–30, 2014 Add Company Logo Here.
(Theoretical Framework - Hypothesis Development)
IMPRINT Developer’s Workshop December 6-7, 2005 Meta-analytic Reviews of the Effects of Temperature and Vibration on Performance J.L. Szalma & G. Conway.
49 th Annual HFES Meeting, Orlando FL Application of Theories of Motivation and Emotion to Hedonomics J.L. Szalma University of Central Florida.
Copyright  2003 by Dr. Gallimore, Wright State University Department of Biomedical, Industrial Engineering & Human Factors Engineering Human Factors Research.
Specific Language Impairment & Cognition: A Meta-Analysis Michael W. Casby Communicative Sciences & Disorders Michigan State University imail:
How to read a paper D. Singh-Ranger. Academic viva 2 papers 1 hour to read both Viva on both papers Summary-what is the paper about.
20-24 September 2004Szalma, Oron-Gilad, & Hancock – HFES Annual Meeting1 Examination of Attentional Mechanisms Underlying Stress and Performance J.L. Szalma,
The Influence of Dispositional Optimism and Pessimism on Task Engagement for Spatial and Temporal Discrimination J.L. Szalma, J.M. Ross, & P.A. Hancock.
Evidence Based Practice RCS /9/05. Definitions  Rosenthal and Donald (1996) defined evidence-based medicine as a process of turning clinical problems.
META-ANALYSIS, RESEARCH SYNTHESES AND SYSTEMATIC REVIEWS © LOUIS COHEN, LAWRENCE MANION & KEITH MORRISON.
One-Way Analysis of Covariance (ANCOVA)
©2010 John Wiley and Sons Chapter 2 Research Methods in Human-Computer Interaction Chapter 2- Experimental Research.
CPE 619 One Factor Experiments Aleksandar Milenković The LaCASA Laboratory Electrical and Computer Engineering Department The University of Alabama in.
MIT2 Lab, UCF 1 The use of Meta-analysis to update the whole-body vibration stressor effects within IMPRINT Gareth Conway James Szalma MIT 2 Lab, University.
International Conference on Ageing, Disability, and Independence (ICADI) Newcastle upon Tyne, United Kingdom Wednesday, 8 September 2010 Accommodating.
Performance Operating Characteristics for Spatial and Temporal Discriminations: Common or Separate Capacities? J. E. Thropp, J. L. Szalma, and P. A. Hancock.
EBM --- Journal Reading Presenter :呂宥達 Date : 2005/10/27.
Introduction Background info Grabs attention….current statistics where appropriate Why was experiment conducted Main idea CLEARLY stated Show gaps!! In.
Comparison of Fuzzy and Signal Detection Theory L.L. Murphy, J.L. Szalma, and P.A. Hancock Department of Psychology Institute of Simulation and Training.
GENERALIZING RESULTS: the role of external validity.
26134 Business Statistics Week 4 Tutorial Simple Linear Regression Key concepts in this tutorial are listed below 1. Detecting.
Szalma & Hancock HFES Europe, Fuzzy Signal Detection Theory and Human Performance: A Review of Empirical Evidence for Model Validity J.L. Szalma.
FOUNDATIONS OF NURSING RESEARCH Sixth Edition CHAPTER Copyright ©2012 by Pearson Education, Inc. All rights reserved. Foundations of Nursing Research,
Chapter 11 Meta-Analysis. Meta-analysis  Quantitative means of reanalyzing the results from a large number of research studies in an attempt to synthesize.
James L. Szalma Department of Psychology and Institute for Simulation and Training University of Central Florida Analysis of Individual Differences Data:
Critiquing Quantitative Research.  A critical appraisal is careful evaluation of all aspects of a research study in order to assess the merits, limitations,
Research Methods & Design Outline
Fuzzy Signal Detection Theory: ROC Analysis of Stimulus and Response Range Effects J.L. Szalma and P.A. Hancock Department of Psychology and Institute.
Some Terminology experiment vs. correlational study IV vs. DV descriptive vs. inferential statistics sample vs. population statistic vs. parameter H 0.
Impact of agricultural innovation adoption: a meta-analysis
Evidence Synthesis/Systematic Reviews of Eyewitness Accuracy
Meta-analysis: Conceptual and Methodological Introduction
How to read a paper D. Singh-Ranger.
Statistical Methods for Model Evaluation – Moving Beyond the Comparison of Matched Observations and Output for Model Grid Cells Kristen M. Foley1, Jenise.
Supplementary Table 1. PRISMA checklist
Chapter 6 Making Sense of Statistical Significance: Decision Errors, Effect Size and Statistical Power Part 1: Sept. 18, 2014.
Gerald Dyer, Jr., MPH October 20, 2016
Chapter 10 Introduction to the Analysis of Variance
Experimental research methods.
Presentation transcript:

A Meta-Analysis of Periodic Noise Stress on Human Performance J.M. Ross, G.E. Conway, J.L. Szalma, B.M. Saxton, A. Braczyk, & P.A. Hancock University of Central Florida Orlando, Florida, USA

Overview Problem Space and Background Research Questions Methodology and Procedure Results Discussion Conclusion

Problem Space and Background: Noise Stress Noise Stress in general is defined as unwanted sound. –Physiological Effects –Affective Effects –Performance Effects Periodic noise – Continuous –Machinery –Helicopter Engines Aperiodic noise – Intermittent –Speech –Gunfire

Problem Space and Background: Noise Stress and Task Type Noise Effects of Not Consistent –Noise Improves Performance –Noise Hinders Performance –Noise Does Not Effect Performance Moderator Variables –Task Type (Backer & Holding, 1983) –Dependent Measure (Staal, 2004).

Meta-Analysis A quantitative literature review. –Accumulates experimental results across independent studies that address a related set of research questions through effect-size estimates. Benefits –Provides a summary estimate. –Allows hierarchical analysis by moderator variables. Detriment –Limited by available literature.

Research Questions Will task-type (e.g., cognitive, psychomotor, perceptual) moderate the noise stress relationship? Will the dependent measure (i.e., speed vs. accuracy) moderate the noise stress relationship? Will there be a task type by dependent measure affect on the noise stress relationship? 1 2 3

Task Types

Methodology and Procedure Literature Accumulation –Examined 423 noise stress articles –k = 73 Criteria for Inclusion –Original empirical periodic noise stress study reported in paper. –A lower dB control condition was required for comparison with a higher dB noise condition. –The dependent variable must measure performance of a healthy adult human participant. –Each study had to present enough information to obtain effect size statistics

Effect Sizes and Variance Estimates Effect Size (ES) –Hedges g –Standardized mean difference between the experimental and control conditions (Hedges & Olkin, 1985). Direction of the Effect –Positive ES noise > control. –Negative ES noise < control. Cohen’s Guidelines to Effect-Sizes –Small g ≤ 0.20 –Medium g ≈ 0.50 –Large g ≥ 0.80 Variability –Sampling Error –Effect Size Error

Hierarchical Analysis Division of Studies Avoid violating assumption of independence Limitation of division of results Overall Periodic Noise k = 73 Perceptual Tasks k = 20 Cognitive Tasks k = 49 Psychomotor Tasks k = 6 Communication k = 8

Results Periodic Noise Stress –Overall there is a decrement in performance for periodic noise stress.

Results Task Type and Periodic Noise –Perception and Psychomotor contain zero within the CI. –Cognitive has a small negative overall effect. –Communication has a moderate negative effect.

Results Dependent Measure and Periodic Noise –True negative effect for both speed and accuracy.

Results Task Type by Dependent Measure –Three true effects:

Discussion Noise Effects –Periodic noise expected general negative effect –Task Types Higher order tasks break down (i.e., cognitive and communication tasks). Lower order tasks not impacted (i.e., perception and psychomotor). –Dependent Measure equal decrement –Gap in communication speed studies. Future Research –Add additional moderating variables to analysis. Intensity of Noise Duration of Noise –Compare with Intermittent Noise Effect by Task and Dependent Measure

Acknowledgements The views expressed here are those of the authors and do not necessarily reflect the official policy or position of the Department of the Army, the Department of Defense, or any official agency of the United States government. This work was supported by a sub- contract through Micro-Analysis and Design (MAAD) from the Human Research Engineering Directorate, Army Research Laboratory (HRED-ARL), P.A. Hancock, Principal Investigator (Grant # ). We wish to thank John Lockett, Laurel Allender, Celine Richer and Sue Archer, for providing their administrative and technical direction for this Grant.

Questions?