NAS WITI vs. Combined WITI-FA and Delta (“forecast goodness”) Negative delta = Under-forecast of weather/traffic impact Positive delta = Over-forecast.

Slides:



Advertisements
Similar presentations
1 NEXTOR Monitoring and Modeling NAS Performance at the Daily Level Mark Hansen Performance Metrics TIM May 2002.
Advertisements

FAA Viewpoint – Weather is like any other traffic. It occupies space in the NAS and generally needs to be separated from other traffic. NWS “bread and.
NWS Winter Weather Products and Upcoming Chat Changes Gary Woodall WFO Fort Worth/Dallas, TX Winter
Air Traffic Analysis, Inc Using WITI for Airport Arrival Performance Analysis A report on work-in-progress December 2010.
Eastern Region – Mt. Holly Regional Aviation Conference Rick Curtis Southwest Airlines 6/6/06
Details for Today: DATE:3 rd February 2005 BY:Mark Cresswell FOLLOWED BY:Assignment 2 briefing Evaluation of Model Performance 69EG3137 – Impacts & Models.
Lead Time Aviation Verification Onset and Cessation of Ceiling and Visibility Flight Category Conditions (IFR, MVFR, VFR) at FAA Core Airports NWS Aviation.
CCFP and CAWS WET Date: Fall Overview Evolution of CCFP Collaborative Aviation Weather Statement Timeline of Implementation Summary.
GreenCig/Vis Categories match Pale Green Situational awareness Orange 2 categories off, Multiple impacts Yellow 1 category off, Singular impact Red 3 categories.
MIT Lincoln Laboratory Evans benefits ARAM1 jee 6/4/2015 Assessment of Aviation Delay Reduction Benefits for Nowcasts and Short Term Forecasts James Evans.
RADIATION FOG STUDY. Office Stats 00z ELM TAF 00z ELM TAF POD for FG – 0.53 POD for FG – 0.53 FAR – 0.55 FAR – z ELM TAF 06z ELM TAF POD for FG.
Core 30 Airport Weather Impact Assessment
Meteorology – Jet Streams Fronts and Air Masses Connecting the Weather Air Masses Fronts Jet Stream Quiz Midweek Seminars.
A4A Meteorology Work Group Rick Curtis 2/26/15. ◦ Affects of in-route icing can greatly vary in degree among carriers – due to equipment type, route structure.
The 10th annual Northeast Regional Operational Workshop, Albany, NY Verification of SREF Aviation Forecasts at Binghamton, NY Justin Arnott NOAA / NWS.
1 FPAW Fall Meeting, October 22, Develop an analytical model that explicitly incorporates weather forecasts, and their uncertainty, in estimating.
Printed Reports and Forecasts
Airline On Time Performance Systems Design Project by Matthias Chan.
Date: 18 February 2008 Federal Aviation Administration Collaborative Decision Making at the FAA/ATO A look at how CDM is applied in the U.S.
Presented to: By: Date: File: apo130\Airport Efficiency\TAER SAER Updated Briefing(2).ppt 1030 Federal Aviation Administration Presentation of System Airport.
1 AvMet Applications, Inc Alexander Bell Dr., Ste. 130 Reston, VA Applying FAA Aviation Weather Metrics Program Research to Operational Benefits.
Measures of Central Tendency
Air traffic controllers (ATC) consideration and ATC solutions Session 5 Presentation 4.
Rick Curtis Southwest Airlines
Federal Aviation Administration FOR OFFICIAL USE ONLY (Public availability to be determined under 5USC 552) Data Communications Program DCL Benefits Modeling.
Weather Briefing #4 Significant Snow Storm Potential ChrisTheWeatherTeen’s Forecast Office Rome, NY Created: March 9 th :30PM EDT Briefing By: Mary.
WEATHER CHARTS. WEATHER CHARTS T L O Enabling Learning Objective (ELO) A Action: The student will interpret the information contained in a surface.
1 AvMet Applications, Inc Alexander Bell Dr., Ste. 130 Reston, VA Weather-Aware Post Event Analysis Mike Robinson AvMet Applications, Inc.
1 Brainstorming for Presentation of Variability in Current Practices Scenario B. Contor August 2007.
NWS Situational Awareness Update: Winter Weather Impacts National Weather Service Forecast Office – Fort Worth/Dallas 230 PM Thursday February 6, 2014.
MIT ICAT ICATMIT M I T I n t e r n a t i o n a l C e n t e r f o r A i r T r a n s p o r t a t i o n Virtual Hubs: A Case Study Michelle Karow
Federal Aviation Administration Date: July 2011 Terminal Arrival Efficiency Rate (TAER) 101 Metric Explanation.
Presented to: NWS Aviation Weather Users By: Danny Sims, Manager of Traffic Flow Management Weather Programs, FAA Date: 18 November 2008 Federal Aviation.
Federal Aviation Administration ATO Future Schedule Generation Performance Analysis and Strategy January 27, 2010.
LMINET2: An Enhanced LMINET Dou Long, Shahab Hasan December 10, 2008.
Example 16.7 Exponential Smoothing | 16.1a | 16.2 | 16.3 | 16.4 | 16.5 | 16.6 | 16.2a | 16.7a | 16.7b16.1a a16.7a16.7b.
FPAW – Weather Forecast Performance Requirements Validation 25 August 2015 Chris Ermatinger, Ops. Research Analyst Aviation Weather Division, Policy and.
Presented to: NAS-Wide Simulation Workshop By: Kimberly Noonan, FAA NextGen and Ops Planning Date: January 28, 2010 Federal Aviation Administration NextGen.
F E D E R A L A V I A T I O N A D M I N I S T R A T I O N A I R T R A F F I C O R G A N I Z A T I O N 1 Federal Aviation Administration System Airport.
Baseline Future Scenarios for JPDO Evaluation and Analysis March 18, 2005 (408) Matthew Blake.
Quantifying Monetary Impacts of Forecasts Rick Curtis Southwest Airlines 11/1/12.
NWS St. Louis Decision Support Workshop Watch, Warning, and Advisory Products and Criteria.
Property of Lear Siegler
MIT Lincoln Laboratory CIWS D. Meyer 10/21/05 Corridor Integrated Weather System (CIWS)
Collaborative Convective Forecast Product (CCFP).
Route and Network Planning
ATS/ESS 452: Synoptic Meteorology Friday 2/8/2013 Quiz & Assignment 2 Results Finish Thermal Wind MOS decoding (Assignment) New England weather.
2016 Long-Term Load Forecast
Use of Terminal Forecasts in TFM Planning One Airline Rep’s Perspective Tom Fahey, Mgr. Meteorology, Delta Air Lines, Inc. FPAW Segment 9 01 Nov 2012.
Eastern Region Activities Fred McMullen Sub-Regional Aviation Workshop WFO Columbia, SC 26 February 2009 Fred McMullen Sub-Regional Aviation Workshop WFO.
Weather Impacts on System Operations Importance of the Forecast in TFM Planning Jim Ries Oct 19, 2006.
© 2008 The MITRE Corporation. All rights reserved. F065-B Risk Management for TFM through Incremental Decision Making NBAA 61 ST Annual Meeting &
13.58 parts per billion is the average for Nitrogen Dioxide (NO2) in Sheffield air (all readings, all times of day/night , When monitor is working)
How do we mitigate weather impacts to the NAS?
Blue Grass Energy Cooperative Corporation 2006 Load Forecast Prepared by: East Kentucky Power Cooperative, Inc. Forecasting and Market Analysis Department.
Eastern Region Aviation Overview Fred McMullen Regional Aviation Meteorologist Fred McMullen Regional.
Aviation AFD Guidance An Airline Perspective Southwest Aviation Safety Workshop Phoenix, AZ Ken Widelski Meteorologist NWS: Lubbock, TX NWS: Lubbock, TX.
Federal Aviation Administration 1 Collaborative Decision Making Module 5 “The Collaborative Environment”
Using Simulation in NextGen Benefits Quantification
Presented to: By: Date: Federal Aviation Administration Quantification of Benefits of Aviation Weather A discussion of benefits Friends and Partners in.
1 CWSU Near-term Improvement Program. 2 Objective Low-cost improvements at CWSUs which will noticeably improve quality of support provided to FAA ARTCCs.
F066-B © 2003 The MITRE Corporation. All Rights Reserved. Predictability and Uncertainty in Air Traffic Flow Management Len Wojcik, Josh Pepper,
Presented to: Friends of Aviation Weather Forum By: Dan Citrenbaum, FAA, Investment Planning and Analysis Office, Operations Research Group Date: October.
Metron, Inc. 12/7/19991 RTO-37: En route User Deviation Assessment Mark Klopfenstein* Phil Smith** Dennis Gallus* Roger Chapman** Christine Lambert* Jodi.
NAS WITI vs. Combined WITI-FA and Delta (“forecast goodness”) Negative delta = Under-forecast of weather/traffic impact Positive delta = Over-forecast.
NAS Weather Index (WITI) vs. Combined WITI-FA and Delta (“forecast goodness”) Negative delta = Under-forecast of weather/traffic impact Positive delta.
FAA Flight Standards AFS-220/430 FPAW 2017 Summer
Le Jiang (IMSG) and Frank Brody (NWS) (August 2, 2016)
FAA Air Traffic Organization (ATO)
Weather Forecast Guidance and Impact on NAS Management
Presentation transcript:

NAS WITI vs. Combined WITI-FA and Delta (“forecast goodness”) Negative delta = Under-forecast of weather/traffic impact Positive delta = Over-forecast of weather/traffic impact 30-day period ending 09/12/2012 WITI = 100 is a “normally- impacted ” day Delta > +/-50 may indicate a forecast “issue”

2 En-route and Terminal WITI-FA 30-Day Period Ending 09/12/2012 En route Convection E-WITI (NCWD) vs. E-WITI-FA (CCFP) Terminal Weather T-WITI (METARs) vs. T-WITI-FA (TAFs) 6/25/2016 Positive “Delta”: Over-forecast Negative “Delta”: Under-forecast Positive “Delta”: Over-forecast Negative “Delta”: Under-forecast

6/25/20163 WITI Breakdown by Component Last 7 Days, Ending 09/12/2012 Delay data for the last 2 days of any 7-day period is preliminary

TWITI, 7-Day Period Ending 09/12/2012, by NWS Region TWITI shows potential operational impact of IMC, Wind, Winter precipitation, and Local convective Wx Positive Deltas (bars): over-forecast 4 Negative Deltas (bars): under-forecast Terminal Weather T-WITI (METARs) vs. T-WITI-FA (TAFs)

5 Weather Impact Analysis for Selected Dates Thursday, September 6, /25/2016

NAS Wx Impact / Convective Summary 09/06/2012 (Daily “Smear”, NCWD VIP 3+)

OEP34 Airport Wx Impact / Forecast Accuracy Summary 09/06/2012 Airport Combined WITI vs. WITI-FA (includes both en-route and terminal Wx impacts) Size of the circle is proportional to Wx impact at each airport vs. today’s OEP34 average. Average daily WITI forecast accuracy: better than 15% between 15% and 30% worse than 30%

NAS Wx Impact / Convective 09/06/2012 (Hourly “Smear”, NCWD VIP3+ vs. 4-hr CCFP) 22Z 4-hr CCFP

NAS Wx Impact / Convective 09/06/2012 (Hourly “Smear”, NCWD VIP3+ vs. 4-hr CCFP) 00Z 4-hr CCFP Convective Wx did not wind down as early as predicted

Back-Up Section

OEP34 Wx Impact / Forecast Accuracy Summary 09/06/2012 – Terminal Wx Airport Terminal WITI vs. WITI-FA (based on METARs/TAFs only) Size of the circle is proportional to Wx impact at each airport vs. today’s OEP34 average. Average daily WITI forecast accuracy: better than 15% between 15% and 30% worse than 30%

OEP34 Wx Impact / Forecast Accuracy Summary 09/06/2012 – En-Route Convective Wx Airport En-Route WITI vs. WITI-FA (based on METARs/TAFs only) Size of the circle is proportional to Wx impact at each airport vs. today’s OEP34 average. Average daily WITI forecast accuracy: better than 15% between 15% and 30% worse than 30%

13 AvMet Applications’ Website For more detailed drill-down and analysis, please go to 6/25/2016

WITI / WITI-FA Components WITI model consists of two principal components: En-route (E-WITI) and Terminal (T- WITI). En-route WITI (E-WITI) reflects the impact of en-route convective weather and en- route traffic demand (‘flows’ between OEP34 airports) on the NAS. Terminal WITI (T-WITI) reflects the impact of local airport weather and local traffic demand on the airport’s operation: Airport capacity can decrease due to inclement weather (low ceilings, rain, snow, wind etc). Arrival and departure rates may be reduced, resulting in delays and/or cancellations. If scheduled traffic demand exceeds airport capacity (be it in good or bad weather), queuing delays ensue. These delays can quickly grow exponential; in some cases, wide-spread cancellations are the only way to limit non-linear growth of delays. T-WITI reflects both the linear increase in delays (some impact of inclement weather but airport’s capacity remains higher than traffic demand) and, in more severe cases, non-linear increase in delays (impact of weather and/or traffic demand grows exponentially when demand exceeds airport’s capacity) WITI is computed using actual (recorded) weather. WITI-FA (“Forecast Accuracy”) is computed using forecast weather, both en-route convective and terminal.

WITI Breakdown by Cause Explanation to Slide 3 WITI software can distinguish the following factors: En-route convective weather. This shows convective weather impact on an airport’s inbound/outbound flows within approx. 500-NM range. This component does not affect queuing delay at the airport. Local convective weather. This reflects how convective weather in the vicinity (<= 100 NM) or directly over the airport reduces airport’s capacity. It may affect queuing delay. Wind. Any time there is a wind greater than 20 Kt, or there is precipitation and wind greater than 15 Kt, the corresponding impact is recorded. Airport capacity may decrease, i.e. queuing delays may increase. Winter Precip (snow, freezing rain, ice etc). The corresponding impact is recorded. Airport capacity may decrease, i.e. queuing delays may increase. IMC. Ceiling or visibility below airport specific minima; fog; and heavy rain. The corresponding FAA capacity benchmarks for IMC are used. Queuing delays may increase. Queuing Delay (No Weather) plus Ripple Effects. No particular weather factor recorded locally for the given airport / given hour but WITI software computed that there would be queuing delays. This can be simply due to high traffic demand or in an aftermath of a major weather event when queuing delays linger on (even as the weather has moved out). Additionally, Ripple Effects are recorded in this component. For example, if ORD experiences departure queuing delays, its corresponding destination airports will get some additional arrival queuing delay. Other. Includes minor impacts due to light/moderate rain or drizzle but ceilings/visibility above VFR minima; also unfavorable RWY configuration usually due to light-to-moderate winds (15-20 Kt or even 10 Kt) that prevent optimum-capacity runway configurations from being used. “Convective” “Non- convective” “Other”

Rolling 4-hr Look-ahead Forecast “4-hr TAF” is mentioned throughout this slide set. In actuality, Terminal Area Forecasts (TAFs) are issued every 6 hours, with amendments issued at irregular time intervals if/as necessary. From this TAF “stream”, the WITI software constructs a rolling 4-hr look-ahead forecast. If, for instance, it is 1300Z and an operator at airport NNN would like to know the expected weather situation at 1700Z, what is the TAF information available to him/her at 1300Z? It could be the standard 1200Z TAF valid through 1800Z) with perhaps an amendment issued at 1300Z. An hour later, at 1400Z, if the operator needs to know the forecast for 1800Z, he or she might still have the same information as at 1300Z but perhaps a new amendment has been issued, and so on. Rolling 2-hr, 4-hr and 6-hr CCFP (convective forecast) is interpreted in a similar fashion. There are no amendments as in TAF. CCFP is issued every 2 hours at odd hours (1300Z, 1500Z, …) as a set of three forecasts. A CCFP forecast for even hours is an interpolation of these 2-hr CCFPs.

Arrival Rate Charts (Analysis) Things to keep in mind: WITI model estimated rates show potential airport capacity given the perceived or expected weather impact. Direct comparison between WITI model-estimated and actual arrival rates should be made with caution: the WITI model does not reflect all the factors, events and human decisions that are behind a specific actual arrival rate. Comparison with facility-called rates can help to understand these effects. Recorded (actual or forecast) weather data is discrete: for example, wind is recorded in hourly intervals and its direction can vary, affecting what WITI model selects as the optimal runway configuration. Or, snow can start and stop. But actual impact of weather can be longer-lasting (e.g. snow removal) and an airport cannot react to wind changes by changing runway configuration in an abrupt manner. The result may be a larger variability in WITI model-forecast rates vs. actual arrival rates. Non-weather factors, as well as weather in other parts of the NAS, may impact airport capacity on a particular day; this is not reflected in WITI model-based arrival rates (they are based only on local weather). Suggested uses for the arrival-rates charts: Significant differences between METAR- and TAF-based arrival rates may be an indication of an over- or under-forecast of terminal weather. When actual arrival rates may be noticeably lower than scheduled, this may in some instances indicate an impact of an inaccurate weather forecast. Scheduled and actual arrival rates (solid purple and dashed blue lines on the chart) are extracted directly from ASPM data. METAR and Rolling-4hr-lookahead-TAF based rates (red and yellow lines) are WITI model estimates based on historical data and FAA airport capacity benchmarks. “GDP rate” (light blue line) is either a program rate or, if no GDP was in place, maximum VMC arrival rate for the airport.

Snow/Ice Impact Quantification Moderate snow/ice may in some instances cause higher impact on airports (delays) than indicated by WITI. The reason is that even as the snowfall stops and winter weather moves out, snow and ice removal may take a long time; this is not reflected in METAR/TAF data and hence the WITI may be lower. Also, it takes time for airlines to restore their schedules back to normal, which again leads to higher delays compared to perceived weather impact. Conversely, on days with very heavy impact of winter weather, WITI can be much higher than the normalized Delay. This is due to massive cancellations that lower traffic demand. However, in these cases WITI correctly reflects the overall weather impact on the NAS. Typically, on the next day, when the winter weather moves out, NAS Delay metric is significantly higher than WITI (as airlines work to restore schedules back to normal).