1. © 2015 The MITRE Corporation. All rights reserved. For internal MITRE use Justin Selig | Mentor: Will Symionow MITRE Intern Project Expo MITRE Center for Advanced Aviation System Development (CAASD) August 2015

2. | 2 || 2 | © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use Introduction  Justin Selig  Cornell University, Electrical and Computer Engineering ’17  From New York City  I like to play tennis!

3. © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use Project 1: Out-The-Window Aircraft Simulation View and Data Smoothing Algorithm

4. | 4 || 4 | © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use Problem Statement  Some simulation and modelling tools do not output at a sufficient rate to drive image generation software. –Simulation Tool: Flight Management System –Image Generation: X-Plane  Additionally, the output of some models contains too much ‘noise’ to produce an acceptable ‘signal’ for the image generation software. –Special considerations have to be made when designing software that will be coupled with image generation (eg. Frame rate, refresh rate). –Those considerations never went into the design and implementation of the FMS simulator software.

5. | 5 || 5 | © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use Criteria and Impact  Design a software capability to address the deficits: –Intercept the data from the FMS simulator and processes the ‘signal’ to achieve the desired output. –Use linear interpolation to estimate state data between infrequent updates. –Exponential smoothing filter used to reduce noise in the signal. –Closed loop latency monitoring and algorithm adjustment minimize source to image delay.  Impact: –Capability will be used to provide ‘out the window’ view with FMS simulators  This will be utilized by sponsors to conduct higher fidelity experimentation and mission rehearsal utilizing operation avionics. (FAA, AFS-460)  Candidate for utilization by the Reconfigurable Cockpit Avionics Testbed (RCAT) fixed based aircraft simulator to connect the FMS simulators to the image generation system in the RCAT. (J41A, MITRE Bedford) –Creates a more realistic experience when driving simulation from an FMS

6. © 2015 The MITRE Corporation. All rights reserved. For internal MITRE use Technical Objective Design an algorithm which takes real-time image data from an inconsistent, noisy source and plays back a seamless video with an imperceptible delay to the user. Image Generatio n FMS Simulato r Refresh Rate 1-10HzFrame Rate 50Hz

7. | 7 || 7 | © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use X-Plane http://www.x-plane.com/wp-content/gallery/avsim-screenshot-contest/747.jpg®UNITED is a registered trademark of United Airlines

8. © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use | 8 || 8 | 200 ms Data Source Present Time Select Linear Interpolation Time queue

9. © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use | 9 || 9 | 200 ms Present Time Select Linear Interpolation Time queue

10. © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use | 10 | A Closer Look at the Time Queue Sampling Rate > Data Construction Rate Exponential Smoothing Filter: Linear Interpolation:

11. © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use | 11 | DEMO

12. | 12 | © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use Next Steps  Aids situational awareness for rehearsal activities –Obstacle avoidance with subject matter experts –Testing new flight procedures with a high-fidelity FMS  General application to FMS simulation (B737, B757, A320 CRJ, E170, etc)  General application of algorithm –Decoupling of source from user allows us to control what the user sees and overcome an inconsistent data source

13. © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use Project 2: Flight Management System Multi-Function Control Display Unit Prototype

14. | 14 | © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use Problem Statement  The evolution of the Flight Management System (FMS) is a key consideration to the planning and implementation of the Next Generation Air Transportation System (NextGen)  The Multifunction Control Display Unit (MCDU) is particularly important because it is the key human-machine interface between the flight crew and the FMS.  MITRE’s FMS simulators represent an extremely accurate simulation of the MCDU (because it is driven by the actual, operational software).  However, because it is driven by the closed source, proprietary FMS software, it is difficult to modify the MCDU to prototype new features and capabilities. –In order to prototype new features, we need to build on top of what is present, but cannot modify existing software.

15. © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use | 15 | Boeing 737 FM S

16. © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use | 16 | Boeing 737 FM S

17. © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use | 17 | FM S

18. © 2015 The MITRE Corporation. All rights reserved. For internal MITRE use CRJ Technical Objective Design an extensible MCDU that will allow researchers to prototype new features while retaining previous MCDU functionality driven by an FMS. B73 7 Fixed MCDU Extensible MCDU B75 7 A32 0 E17 0 Black Box

19. | 19 | © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use Solution  Design a software capability to address the deficits:  Intercept the MCDU data coming from the FMS and redirect the output to a java-based software representation of the MCDU.  Manipulate the output of the MCDU to produce new MCDU ‘states’ while still utilizing the FMS to drive MCDU ‘states’ we do not wish to modify.  Flight crew interactions are reflected back to the real FMS or modified to trigger a certain behavior without any awareness by the user.  What does this look like…

20. | 20 | © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use System Diagram Extensible MCDU Peripheral Application(s) FMS MCDU Black Box

21. © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use | 21 | FMS Test-Bench Courtesy of GE Aviation

22. © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use | 22 | A320 FM S B737CRJE170B757 Intercep t and Modify “Man-in-the-middle”

23. | 23 | © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use Sim Builder – A Discovery Service  Surveillance Data Distribution (SDDF) is an internal MITRE network communication protocol.  SDDF clients may either publish or consume a service on the network.  The extensible MCDU and FMS both publish and consume services which allows for a bidirectional transmission of data.

24. | 24 | © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use Impact  Capability will be used to provide a system to prototype new FMS capabilities.  Allows engineers and researches to have a highly accurate FMS and MCDU simulation (because it is driven by an operational FMS) and yet still be able to ‘mock up’ new capabilities on top of the existing simulator.  The system is FMS-agnostic, that is, it works with all the existing FMS simulators with little modification. –All existing MCDU functionality remains, but modifications can be made at will.  Cost-effective method for testing new features

25. © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use | 25 | DEMO

26. © 2015 The MITRE Corporation. All rights reserved.For internal MITRE use | 26 | Picture of whole physical setup as will be present during expo