1 MITRE © 2015 The MITRE Corporation All rights reserved. Approved for Public Release: Case Distribution Unlimited. For Internal MITRE Use Trustworthy Autonomy Chris Jella September 2015 Approved for Public Release – Distribution Unlimited , , The contents of this material reflect the views of the author and/or the Director of the Center for Advanced Aviation System Development, and do not necessarily reflect the views of the Federal Aviation Administration (FAA) or Department of Transportation (DOT). Neither the FAA nor the DOT makes any warranty or guarantee, or promise, expressed or implied, concerning the content or accuracy of the views expressed herein.

2 © 2015 The MITRE Corporation All rights reserved. Approved for Public Release: Distribution Unlimited. Case Number Increasingly Autonomous Systems Unmanned Aircraft Flight Deck Automation Automated Driving Driverless Vehicles Medical Devices Clinical Diagnostic Intelligence Analysis Financial Systems Increased dependence upon o Software o Data o Command & Control Links For safe, efficient, effective, and secure operations More than Cyber-Security Think Cyber-Resiliency Our increasingly complex automation systems must continue to function safely despite design defects, unanticipated situations/data, & deliberate attacks.

3 MITRE © 2015 The MITRE Corporation All rights reserved. Approved for Public Release: Distribution Unlimited. Case Number U.S. Air Force photo by Airman 1st Class Michael Shoemaker Photo: USCG Degree of Pilot Control Fully Automatic Pilot Manages Flight Can operate w/o pilot-in-the-loop Auto T/O Land Waypoint-to- Waypoint Auto Taxi Direct Guidance Pilot controls heading, speed, and altitude Auto-stabilized Direct Control Pilot continuously controls pitch, bank, yaw, and power Pilot- Managed Automatic Pilot Manages Flt Auto T/O Land Waypoint-to- Waypoint Auto Taxi Pilot required Autonomous Software using perception and judgment to alter flight path Operates w/o pilot-in-the-loop Photo: USAF Draganflyer X6 Photo: Photo: US Army Photo: USAF Chasm

4 MITRE © 2015 The MITRE Corporation All rights reserved. Approved for Public Release: Distribution Unlimited. Case Number Clash of Two Cultures Information Technology Aviation Speed to market Innovation Open Evolutionary Proven Proprietary Revolutionary Tightly regulated Small Unmanned Aircraft Safety Risk avoided Risk rewarded Minimally regulated Entrepreneurial Conservative Used with Permission