1. MM/DD/YYYY Intelligent Systems Technical Committee January 2015 to December 2015 Annual Report

2. MM/DD/YYYY Committee Overview 2 Liaisons Software (Dr. Ella Atkins) Chair(s) Dr. Kelly Cohen (Jan-Apr) Dr. Nhan Nguyen (May-Dec) Phone: (650)604-4063 Email: nhan.t.nguyen@nasa.gov Vice Chair(s)/Chair-Elect Dr. Nhan Nguyen (Jan-Apr) Dr. David Casbeer (Aug-Dec) Phone: (937)708-0191 Email: xxxxxxxx@xxxx.xxx Secretary/Treasurer Dr. Nicholas Ernest (Jan-Dec) Dr. Sean Swei (Current) Phone: (650) 604-0314 Email: sean.s.swei@nasa.gov Awards Dr. Chelsea Sabo Conference Planning Dr. David Casbeer Membership Dr. David Casbeer Procedures Dr. John (Jack) Ryan Professional Development Education Outreach Dr. Kristin Rozier Public Policy Dr. Christopher Tschan Publications Dr. Ella Atkins Roadmap Dr. Christopher Tschan Webmaster Dr. Nicolas Ernest Workshop Dr. John Valasek Members 49 Total / 48 –35 Regular 33 – 4 Associate 4 – 4 International 4 – 6 International 7 Category – 12 Industry (24% 13 ) – 19 Academia (39% 15 ) – 18 Government (37% 20 ) International members – 2 Germany 2 – 1 Japan 1 – 1 UK 1 Subcommittees Intelligent Systems Technical Committee Imbedded Roster file required, see Comment Note January 29, 2015

3. MM/DD/YYYY Recent Conference Performance Issues / Help Needed SciTech 2015SciTech 2016 Abstracts Received: 48 Abstracts Accepted: 34 Sessions: 7 (0 Invited) Withdrawals/No-Shows: 9/0 Presented: 34 (0 Invited) ISTC lacks consistent funding to support monetary prizes for the Best Student Paper Competition at SciTech ($500) and the Synopsis Challenge science fair for high school students ($300). Donations from TC members in 2014 made it possible to fund Best Student Paper Competition prizes at SciTech 2015, but there were no prizes given for Synopsis Challenge winners in 2015. As of this reporting, this issue has been remedied by funding from ISG in 2016. Accomplishments The second Intelligent Systems Workshop at NASA Ames during August 5-7, 2015 was a great success. There was about 170 attendees (more than triple the attendance of the first workshop) representing over 40 organizations from across government, industry, and academia. The workshop featured keynote speakers from Google, Boeing, and NASA. Participants actively engaged in several discussion panels and breakout sessions. The first edition of the Roadmap for Intelligent Systems in Aerospace was complete in December 2015 and is being readied for public release. The 111-page document outlines vision and recommendations based on 11 technical contributions for advancing research and development of intelligent systems. An ISTC position paper on “Implementing a Roadmap for Intelligent Systems in Aerospace” was initiated with a first draft completed in December 2015. The position paper is being reviewed and further revised for submission to the ISG in February or March 2016. ISTC chair attended General Aviation (GA) TC meeting at the Aviation Forum in June 2015 to present an overview of ISTC and discussed how ISTC and GATC could jointly sponsor a special session on intelligent systems for GA at the Infotech@Aerospace 2017. Roadmap for Intelligent Systems in Aerospace is a major TC initiative that started in 2013 to develop a vision for intelligent systems and advocacy for research funding. This initiative is expected to produce the first public release of the roadmap in 2016 as it moves forward. Intelligent Systems Workshop is another important TC initiative that began with the first workshop held in Dayton, OH in August 2014 and continued with the second workshop held at NASA Ames in August 2015. The third workshop is being planned to be held at NASA Langley in August 2016. ISTC is exploring the possibility of an Intelligent Systems Flight Competition to promote novel applications of intelligent systems. Initiatives & Plans Financial Status and Other Activities ISTC generated $444.66 from donations primarily from TC members at the second Intelligent Systems Workshop. $250 has been expended for monetary prizes for the Best Student Paper Competition at the SciTech 2016. ISTC receives TAC funds for the amount of $500 for Best Student Paper Competition at SciTech 2017, and $420 for Synopsis Challenge Science Fair in 2016. Abstracts Received: 65 Abstracts Accepted: 52 No. of Sessions: 11 Withdrawals/No-Shows: 11/0 Papers presented: 52 (0 ITAR) Intelligent Systems Technical Committee Activity Summary - January 2015 to December 2015 (12/31/2015) January 29, 2015

4. MM/DD/YYYY Forum Participation ISTC actively participates in SciTech Forum 2015 and 2016 as the main sponsor of Infotech@Aerospace conference, Space Forum 2015 and 2016, and Aviation Forum 2015.  11 sessions at SciTech 2015 and 7 sessions at SciTech 2016  7 sessions at Space Forum 2015  1 session at Aviation Forum 2016 What are the top 3 successes from last years’ conference?  Abstract requirement increases from AIAA standard extended abstract of 1000 words minimum to 5 pages minimum to improve quality.  The Intelligent Systems Autonomy Roadmap panel was very well attended with over 250 people in the audience and standing room only.  The review process strives to be more rigorous with a rejection rate of 10% as compared to 3% for Infotech@Aerospace 2015 What are the top 3 disappointments from last years’ conference?  The number of abstracts and sessions decreases from Infotech@Aerospace 2015 – 48 vs. 65 abstracts, and 7 vs. 11 sessions.  Communication between Infotech@Aerospace program committee and ISTC could be improved. ISTC was not communicated of the status of abstract submissions but found out only a few days before the deadline that the number of submissions was well below expectation. ISTC made a last minute appeal to members and requested for a two-week extensions. This resulted in a pickup of additional abstracts.  The paper rejection process could be more transparent. As an example, one author complained that his paper was unfairly rejected without any explanation despite meeting the abstract requirement and having experimental data. The rejection quota imposed by AIAA might also have compounded the problem. 4 Intelligent Systems Technical Committee January 29, 2015

5. MM/DD/YYYY Forum Participation How can we improved the Forums?  ISTC recommends increased active solicitation of abstracts by technical program personnel for SciTech 2017.  Improve communication between Infotech@Aerospace / SciTech program committee and TCs so that TCs can better support the conference with abstract submissions and invited sessions as needed.  Increase participation from other TCs within the ISG to create momentum in and awareness of information systems research dissemination at the SciTech Forum. This could stimulate more attendance from outside communities that share similar interest, e.g., IEEE intelligent systems community.  Improve peer review process and transparency such as having an independent review panel to review to-be-rejected submissions, and having the ability to provide feedback to authors to help improve quality of the final submissions. This issue is well-known to AIAA and efforts are being made to improve ScholarOne.  Organize information systems-related panels and keynote presentations by high-profile speakers (e.g., Google or Tesla speakers on autonomy) to stimulate interests across AIAA community and government funding agency.  Allow sufficient number of session rooms for Infotech@Aerospace so as to prevent forced rejection of quality papers. List top 5 Sessions / Panels sponsored or co-sponsored for the Forum  The top 5 sessions / panels for the intelligent systems are: 1) the Intelligent Systems Autonomy Roadmap, 2) Intelligent and Adaptive Aerospace Control, 3) Novel Aerospace Applications of Intelligent Systems, 4) Machine Learning and Probabilistic Reasoning for Intelligent UAS, and 5) Intelligent Human-Automation Interaction 5 Intelligent Systems Technical Committee January 29, 2015

6. MM/DD/YYYY Forum Participation List top 5 Sessions / Panels sponsored or co-sponsored for the Forum (continued)  The Intelligent Systems Autonomy Roadmap panel was very well received. What worked is that it limited the amount of presentations by the panelists and moderators to provide more opportunity for discussion among the panel and audience.  What could have done better was to provide a 15-minute transition from the Big Data panel before the Intelligent Systems Autonomy Roadmap panel. As a result, time was lost due to computer setup. Also, name displays for panelists were not available. The panel switchover was somewhat chaotic.  The allotted time for the Intelligent Systems Autonomy Roadmap panel was too short, only one hour and a half. In spite of this, there was still a fair amount of discussion. Autonomy is a current topic of interest that tends to attract active discussion. Other relevant topic areas (if any) TC would like to sponsor in the future and why?  Suggested topics for ISTC-sponsored sessions / panels are: intelligent systems roadmap, autonomy, trust and certification, and computational intelligence. Members of the Forum Organizing Committees (TAOs) and succession plan  Nisar Ahmed (SciTech 2016 Intelligent Systems Technical Discipline Chair)  Amanda Lampton  Chris Tschan (SciTech 2015 Infotech@Aerospace Technical Program Chair)  Kevin Melcher (SciTech 2017 nominee for Infotech@Aerospace Deputy Technical Program Chair)  Mitch Ingham (Space 2015 Intelligent Systems Technical Discipline Chair)  Sean Swei  Danette Allen (Aviation 2016 session organizer)  ISTC still decides on participation at Aviation 2017 6 Intelligent Systems Technical Committee January 29, 2015

7. MM/DD/YYYY Committee Meetings Summary of last year’s meetings and plan for next year’s meeting  Winter meeting at SciTech 2015 in Kissimmee, FL on January 7, 2015 at 8:00 pm. Meeting minutes embedded in Appendix.  Summer meeting at NASA Ames, Moffett Field, CA on August 6, 2015 at 5:30 pm in conjunction with the second Intelligent Systems Workshop. Meeting minutes embedded in Appendix.  Winter meeting at SciTech 2016 in San Diego, CA on January 6, 2016 at 6:30 pm. Meeting minutes embedded in Appendix.  Next summer meeting to be held at NASA Langley, Hampton, CA on August 3, 2016 in conjunction with the third Intelligent Systems Workshop.  Telecon meeting with subcommittee chairs on July 16, 2015  Frequent telecon meetings with workshop subcommittee from January to August, 2015 to discuss planning for the second Intelligent Systems Workshop.  Frequent telecon meetings with roadmap subcommittee throughout 2015 to discuss planning for the development and completion of the first edition of the Roadmap for Intelligent Systems in Aerospace. 7 Imbedded meeting minutes file required, see Comment Note January 29, 2015 Intelligent Systems Technical Committee

8. MM/DD/YYYY Honors & Awards Activities Summary of Honors and Awards Activities  ISTC sponsors three awards: Intelligent Systems Award, Intelligent Systems Best Paper Award, and Best Student Paper Competition Award.  The Intelligent Systems Award is presented to an outstanding researcher who has made significant contributions to the advancement of the field of intelligent systems. The award selection occurs in a two-year cycle. The 2015 winner is Frank Lewis of University of Texas Arlington who was presented the award at the SciTech 2016 in San Diego. He was selected from 5 nominations including Azad Madni (USC), Robert Stengel (Princeton University), Sebastian Thrun (Google), Kevin Wise (Boeing).  The Intelligent Systems Best Paper Award is presented for intelligent systems best paper presented at Infotech@Aerospace conference. The 2015 winning paper is entitled “Trajectory Prediction and Alerting for Aircraft Mode and Energy State Awareness” authored by Kimberly Shish (Millennium Engineering and Integration Company), John Kaneshige (NASA Ames), Diana Acosta (NASA Ames), Stefan Schuet (NASA Ames), Thomas Lombaerts (DLR), Lynne Martin (San Jose State University), and Avinash Madavan (NASA Ames). The authors were presented the award at the SciTech 2016 in San Diego.  The Best Student Paper Competition Award is selected for the best Infotech@Aerospace paper authored by students. The award winner Jayaprakash Suraj Nandiganahalli from Purdue University was presented the award at the SciTech 2016 for the paper entitled “Intent-based Abstraction for Formal Verification of Flight Deck Mode Confusion.” He will also receive a monetary prize of $200. In addition, the runner-up winner Caris Moses from Northeastern University will receive a monetary prize of $50 for the paper entitled “Belief Space Hierarchical Planning in the Now for Unmanned Aerial Vehicles.” 8 January 29, 2015 Intelligent Systems Technical Committee

9. MM/DD/YYYY 31 July 2014