Author: MARA ĆUJIĆ An Analysis of the Task List impact upon RAMS Workload Calculations November, 2004.

Slides:



Advertisements
Similar presentations
By: Edith Leticia Cerda
Advertisements

HOW TO EVALUATE A MOBILITY PROJECT Training Unit 11.1 Procedures, tools and roles for the evaluation of a mobility project.
Innovation data collection: Advice from the Oslo Manual South East Asian Regional Workshop on Science, Technology and Innovation Statistics.
The sole responsibility for the content of this presentation lies with the authors. It does not necessarily reflect the opinion of the European Union.
7 tasks identified Flight Arrival Interaction Detection Resolution Planning Resolution Implementation Monitoring Other Trajectory Changes Co-ordination.
CRDS Budapest First ATM R&D Workshop - 27 and One Sky for Europe EUROCONTROL CONCLUSIONS A momentum has been created A small step towards.
FAA/Eurocontrol TIM 9 on Performance Metrics – INTEGRA Rod Gingell 16 May 2002.
An Outline for: A User-Based Systems Approach to the Evaluation, Selection, and Institutionalization of Safer Medical Devices.
ENAV S.p.A. ASAS TN I Workshop, April 20031/13 Airborne Spacing and Safety Alberto Pasquini - Deep Blue (ENAV)
Copyright 2010, The World Bank Group. All Rights Reserved. Agricultural Data Collection Procedures Section A 1.
EUROCONTROL CRDS 22-24/11/2004 ICRAT 1/15 ICRAT 2004, Zilina, November 22-24, 2004 Towards the traffic synchronisation in a Functional Airspace Block Lenka.
Measures to increase ATC capacity. a) taking all reasonable steps to fully exploit the existing capacity of the air navigation system; b) developing plans.
Institut de la statistique du Québec (ISQ) surveys: compendium of good practices and quality self-assessment checklist European Conference on Quality in.
Survey Design Steps in Conducting a survey.  There are two basic steps for conducting a survey  Design and Planning  Data Collection.
Reinforcement Learning Rafy Michaeli Assaf Naor Supervisor: Yaakov Engel Visit project’s home page at: FOR.
ARISTOTELION UNIVERSITY OF THESSALONIKI SCHOOL OF TECHNOLOGY FACULTY OF RURAL AND SURVEYING ENGINEERING DEPARTMENT OF TRANSPORTATION AND HYDRAULIC ENGINEERING.
PERFORMANCE OF THE DELPHI REFRACTOMETER IN MONITORING THE RICH RADIATORS A. Filippas 1, E. Fokitis 1, S. Maltezos 1, K. Patrinos 1, and M. Davenport 2.
An evaluation framework
RESEARCH METHODS Lecture 19
Lecture(3) Instructor : Dr. Abed Al-Majed Nassar
JOB ANALYSIS AND HUMAN RESOURCE PLANNING
MICS Data Processing Workshop Multiple Indicator Cluster Surveys Data Processing Workshop Data Quality Tables.
Project Management Framework. PMBOK ® Guide, Third Edition.
Choosing Your Primary Research Method What do you need to find out that your literature did not provide?
Chapter Three Chapter Three.
Factors that Associated with Stress in Nursing Faculty in Thailand
BSBIMN501A QUEENSLAND INTERNATIONAL BUSINESS ACADEMY.
Evaluation Framework Prevention vs. Intervention CHONG POH WAN 21 JUNE 2011.
MULTILATERAL EVALUATION MECHANISM (MEM) MEM UNIT GENERAL PROPOSALS TO THE OPERATIONAL PROCESS Second Part - Sofia I. Kosmas.
PLAN AND ORGANISE ASSESSMENT. By the end of this session, you will have an understanding of what is assessment, competency based assessment, assessment.
Cognitive demands of hands-free- phone conversation while driving Professor : Liu Student: Ruby.
Chapter Twelve Census: Population canvass - not really a “sample” Asking the entire population Budget Available: A valid factor – how much can we.
Peak RCCo Performance Metrics Draft –November 2013.
ASSTAR User Forum #1 Rome 4th April 2006 ASAS-TN2 Second Workshop ASSTAR Safety Approach and Preliminary Issues Dr Giuseppe GRANIERO, SICTA
Chapter 5 Job Analysis.
CRISTAL ATSAW Project Sep 2007 ASAS TN Christelle Pianetti, DSNA Simona Canu-Chiesa, Airbus.
Overview of Evaluation Designs. Learning objectives By the end of this presentation, you will be able to: Explain evaluation design Describe the differences.
Final draft rev UNECE MARS meeting General MS procedure Draft 2 Information and discussion Meeting 3 October Bratislava I. Hendrikx.
CARE/ASAS Validation Framework Guidelines & Case Studies Mark Watson NATS.
RTI, MUMBAI / CH 41 IMPLEMENTING THE PERFORMANCE AUDIT PLAN FOR THE SELECTED SUBJECT DAY 4 SESSION NO.1 (THEORY) BASED ON CHAPTER 4 PERFORMANCE AUDITING.
Survey of Traffic and Radar Controller Communication and Workload
Situational Awareness Numerous aircraft and operational displays, when combined with effective and efficient communications and facilities, provide Air.
Copyright 2010, The World Bank Group. All Rights Reserved. Managing Data Collection Section A 1.
Lesson 2-5: Planning Study Conduct Teacher Note: Module 2 Overview Content Area: Hypothesis-Testing: Cross-Sectional Study Essential Questions: How can.
Responsiveness to Instruction RtI Tier III. Before beginning Tier III Review Tier I & Tier II for … oClear beginning & ending dates oIntervention design.
Sample Cost/Benefit Analysis of adding Human Factors Tasks to a Software Development Project Adapted from: Mantei, Marilyn M. and Teorey, Toby J., “ Cost/Benefit.
Automatization of air traffic control sector capacity indicators determination process (Автоматизація процесу визначення показників пропускної спроможності.
THE RESEARCH ON THE INFLUENCE OF WORKLOAD ON THE OCCURRENCE OF DIFFERENT TYPES OF ATC ERRORS Samartseva Elena IAN-519 Samartseva Elena IAN-519.
Quality control and audit visit: process & actions.
Malmö 5 September. 27 th 2005 NUP ITP TT Reykjavik “NUP -- ITP”
Value of Time for Commercial Vehicle Operators in Minnesota by David Levinson and Brian Smalkoski University of Minnesota.
METHODOLOGY AM0031: BRT BOGOTÁ (COLOMBIA): TransMilenio PHASE II - IV MAIN PROBLEMS.
Copyright 2010, The World Bank Group. All Rights Reserved. Statistical Work Plan Development Section A 1.
ASAS Crossing and Passing Applications in Radar Airspace (operational concept and operational procedure) Jean-Marc Loscos, Bernard Hasquenoph, Claude Chamayou.
Ensieea Rizwani An energy-efficient management mechanism for large-scale server clusters By: Zhenghua Xue, Dong, Ma, Fan, Mei 1.
Revision N° 11ICAO Safety Management Systems (SMS) Course01/01/08 Module N° 9 – SMS operation.
Session 6: Data Flow, Data Management, and Data Quality.
1 June 23, 2010 Q Project Review OPERATIONAL APPLICATION, STC/TC & DATA COLLECTION PROJECT Project Review March 6, 2011.
EUROCONTROL EXPERIMENTAL CENTRE1 / 29/06/2016  Raphaël CHRISTIEN  Network Capacity & Demand Management  5 th USA/Europe ATM 2003 R&D seminar  23 rd.
Planning, Monitoring and Performing Surveys
Free Routing Airspace in Europe
Industrial Assessment Center Database
SOCIAL NETWORK AS A VENUE OF PARTICIPATION AND SHARING AMONG TEENAGERS
Child Outcomes Summary (COS) Process Training Module
Fundamentals of a Business Impact Analysis
Higher physical education
Retrospective report of the past year
PRESENTATION OF MONTENEGRO
1. INTRODUCTION.
Child Outcomes Summary (COS) Process Training Module
Presentation transcript:

Author: MARA ĆUJIĆ An Analysis of the Task List impact upon RAMS Workload Calculations November, 2004

CONTENTS √ Information about CEATS √ Objectives √ Research process and data collected √ Setting scenarios for running RAMS √ Sensitivity analysis √ Comparison of workload results √ Survey in national ACC √ Conclusions and Recommendations

CEATS ♦ CSPDU ♦ CRDS ♦ CUAC ♦ CTC CRDS √ FTS2, FTS3 √ SSRTS1, SSRTS2, SSRTS3, RTS1 It was done: In progress: √ FTS4, SSRTS4, RTS2 RTS i FTS

OBJECTIVES PROBLEMOBJECTIVES Questionnaire with controllers who had experience in RTS 1. Task list (FTS3) 2. Task duration times 3. Task distribution 4. There was not task list for CEATS 1. New task list definition 2. Estimation of task duration times 3. New task distribution 4. Unique task list for CEATS Disagreement RTS and FTS

SURVEY QUESTIONNAIRE (10 CEATS controllers + RTS expert ) 1.Start questionnaire 2.Progress questionnaire 3.Final questionnaire ♦ defining first new, ♦ new ideas for designing ♦ 31 tasks (29+2) were task list the final questionnaire included in task list ♦ ( 29 tasks) ♦ data for analysis TASK LIST IN FTS3 (15) WAS TAKEN IN CONSIDERATION INTERVIEW (10 CEATS controllers) ♦ IT WAS REALISED IN ORDER TO COMPLETE QUESTIONNAIRE RESULTS

Final Questionnaire FIRST PART OF THE QUESTIONNAIRE No.TASK NAMEmin (s)max (s)PCECPC/EC 1Check flight plan 123 2Update flight plan 123 √ Information about minimum and maximum task duration times √ Task distribution between controllers 35 47

SECOND PART OF THE QUESTIONNAIRE No.TASK NAME Very smallSmallMediumHighVery high importance 1Check flight plan 2Update flight plan X X √ Estimate the importance of the tasks √ Busy sector and high workload were considered √ Values from 1 to 5 were aligned to each task Final Questionnaire

THIRD PART OF THE QUESTIONNAIRE √ Estimate the frequency of task execution √ Peak hour period was taken in consideration No.TASK NAME Very smallSmallMediumHighVery high frequency 1Check flight plan 2Update flight plan X X √ Values from 1 to 5 were aligned to each task Final Questionnaire

RESULTS √ Average minimum and maximum values of task duration times √ Average values for importance of each task √ Average values for frequency of task execution √ Task distribution between controllers √ Factors affecting controller workload

THE TASK LIST THE MOST IMPORTANT TASKS 1. Conflict resolution (4.91) 2. Pilot readback to instruction (4.82) 3. Surveillance of A/C in sector (4.73) 4. Level change coordination (4.73) 5. Monitoring of all A/C influenced by an A/C climbing or descending (4.64) THE MOST FREQUENT TASKS 1.Pilot readback instruction (4.55) 2. Surveillance of A/C in sector (4.45) 3. Identification of A/C (4.36) 4. R/T handover to CEATS sector (4.18) 5. First call of A/C (4.18)

ACTORS (31) TASKS (1) TASK (14) TASKS (16) TASKS PC EC PC/EC Task distribution between controllers

Running RAMS 1. RAMS WORKLOAD CALCULATION RAMS calculates workload as a sum of the task duration times triggered during simulation, which is expressed as a percentage loading. 1 PEAK HOUR LOADING > 55% Sector is overloaded = 70% Capacity level is reached

2. SETTING SCENARIOS FOR RUNNING RAMS a) Task list b) Task duration times c) Actors (PC and/or EC) d) Appropriate “trigger” e) Appropriate “time offset” Running RAMS TASKS SECTORISATION TRAFFIC SAMPLE ROUTE NETWORK

SIMULATIONS BASIC FEATURES OF (FTS3) 1. Traffic sample- 28 June 2002, increased by 32% 2. ARNVbis Route network 3. Sectorisation was based on FTS2- 31 sectors

SCENARIO 1 1. TASK LIST IN FTS3 for CEATS (15) 2. NEW AVERAGE TASK DURATION TIMES (defined by interview) 3. NEW TASK DISTRIBUTION (defined by final questionnaire) SIMULATION 1 BASIC FEATURES OF (FTS3) + SCENARIO 1

SIMULATION 2 BASIC FEATURES OF (FTS3) + SCENARIO 2 SCENARIO 2 1. NEW TASK LIST (31) (defined by survey) 2. NEW AVERAGE TASK DURATION TIMES (defined by interview) 3. NEW TASK DISTRIBUTION (defined by final questionnaire)

Comparison of workload 1. Workload increase ~70 % (PC) 2. Workload decrease in one sector (PC) 3. Workload decrease in six sectors (EC) 4. Similar workload results in most of the sectors (EC) 1. High workload increase ~130 % (PC) 2. Workload results are increased by ~50% (EC) FTS3 and Simulation 1 FTS3 and Simulation 2

FTS3 (PC and EC) SECTOR OVERVIEW Simulation 2 (PC2 and EC2) Simulation 1 (PC1 and EC1) ■ wk < 55% ■ 55% <wk < 70% ■ wk > 70%

SSRTS3, Simulation 1 and 2 √ Workload in SSRTS3 is defined by ISA method √ Transformation of RTS workload values into FTS percentage values was made subjectively √ Comparison of workload results was done in three sectors (C_5U, C_6U, C_8H) √ Workload results after Simulation 2 were more aligned to estimated workload results in SSRTS3

WORKLOAD RATING FTS3 ~100% Simulation 1 ~ 35% Simulation 2 ~ 30% EC in comparison with PC

SENSITIVITY ANALYSIS Objective: Testing the influence of change of task duration times on controller workload using RAMS Selected tasks: 1. Screen set up (19.64s) 2. Conflict resolution (18.73s) 3. Surveillance of A/C in sector (16.36s) 4. Monitoring of all A/C influenced by an A/C climbing or descending (16.36s)

Simulation 3 √ The selected tasks (2) were included in the list with average maximum task duration times √ It was used the same task list (31) with the same task duration times like in Simulation 2 ActorsTASK NAME Task duration times in simulation 3 (s) Task duration times in simulation 2 (s) PCSurveillance of A/C in sector ECSurveillance of A/C in sector PCConflict resolution ECConflict resolution

SECTOR OVERVIEW Simulation 2 (PC2 and EC2) Simulation 3 (PC3 and EC3) ■ wk < 55% ■ 55% <wk < 70% ■ wk > 70%

FTS3, Simulation 1, 2 and 3

NATIONAL ACC REASON FOR SERVEY Differences in controller opinions OBJECTIVES Gathering data about minimum and maximum task duration times and actors who perform the tasks PLACES OF RESEARCH ACC Bratislava, ACC Budapest and ACC Vienna

RESULTS 1. Average task duration times are very similar in ACC Bratislava, Budapest and CRDS, except ACC Vienna 2. There is a group of tasks which has the same task distribution between controllers in each ACC and CRDS (13 tasks) 3. The tasks “Usage R&B” and “Usage MTCD” are performed in National ACC very rarely and task duration times for the group of “ Monitoring” tasks were not estimated by many controllers

CONCLUTIONS √ The task duration times, number of the tasks and task distribution between controllers have high influence on RAMS workload calculations √ The recommended standard task list for CEATS sectors consists of 24 tasks √ The controllers’ answers are very various and significantly affected by different training of controller teams and air traffic procedures in each ACC, different equipment…

RECOMMENDATIONS √ Observing controllers during performance of tasks in RTS environment √ Conducting a similar survey by questionnaire but with participation of more controllers √ Defining the other approach for transformation of workload values obtained in RTS into percentage values calculated in FTS

THANK YOU