Learning from failure (to learn) Mahabubul Alam CS/SE 6361, Fall 2014  Final Term Paper Presentation  The University of Texas at Dallas Asiana Airlines #214

Recap On July 6, 2013 Asiana Airlines Flight 214, crashed short of runway 28L’s threshold while attempting to land at SFO. There were 3 Fatalities & 187 Injured. 1 NTSB Report: Confused Flight Crew over relied on Automation Flew too slow and too low, hit seawall

Through the eyes of the Reference Model 2 S, D ⊭ R but P, C ⊨ S Machine Performed per Specification Domain failed to collaborate Requirements were not met

Let’s look at the domain 3

Root Cause Analysis – P.I.G. 4

A Convergence of Circumstances 5 Inadequate Domain Assumptions lead to poor design Aircraft failed to maintain speed Did not provide adequate low speed warning Conflict of Design philosophy and Business Practice Over reliance on Automation without Training Nurturing Requirements Errors for Decades It has happened 4 times before! * Boeing is non-compliant with FAA SFO ILS Offline – Forced Visual Approach Lack of practice leads to confusion * 09/23/2007 – UK B737, 1/27/2009 – TX, ATR-42, 2/12/2009 – NY, DHC-8, 3/25/2009 – Netherlands – B737

Goal is to avoid crash 6

Recommendations 7 Comply with FAA AC & AC Low Speed Protection, Adequate Warning Improve Transition training, encourage manual flights Better mental model of automation, more prepared Human error cannot be prevented, so improve design Improved safety, saves lives Fill in the gaps in Requirements Inadequate requirements can spell disaster!

One probable solution 8 Introduce multiple channels in the flight system. In landing zones, it can take over before its too late. 58% of fatalities happen during descend to approach to landing Follow Pareto Principle. Minor changes in design philosophy can have Major impact on outcome

For Tacit knowledge apply Ethnomethodology 9

What did we learn? 10 The only way to have a perfect system is to have perfect humans design and operate the systems. That is not possible. So failures will happen. - Dr. Lawrence Chung. November 11, 2014 We need to keep asking questions, and the answers will help us design and build the system-to-be and the system-next and so on… But Boeing seems to claim their system is perfect…….

References Asiana Airlines Flight Crash of Asiana Flight 214 Accident Report Summary NTSB: Asiana crew 'over-relied' on automated systems Pilot in deadly plane crash had no experience landing 777 in San Francisco Asiana Flight 214 Investigation Focuses on Airspeed in Final Seconds Asiana cites crew failures and autothrottle design in flight 214 crash Retired Senior Boeing Flight Instructor blames on the Auto-throttle System Statistical Summary of Commercial Jet Airplane Accidents Descent Below Visual Glidepath and Impact With Seawall - Asiana Airlines Flight

Questions?