1. 1Collaborative Human-Computer Decision-Making - Sylvain Bruni Collaborative Human-Computer Decision- Making Sylvain Bruni 03.17.08 Aptima

2. 2Collaborative Human-Computer Decision-Making - Sylvain Bruni France Personal Journey

3. 3Collaborative Human-Computer Decision-Making - Sylvain Bruni Diplôme d’Ingénieur (2004) (S.M. Electrical Engineering and Computer Science) S.M. Aeronautics and Astronautics (2004) Ph.D. Aeronautics and Astronautics (2008) Education “Neuro-Vestibular Adaptation to Incremental Exposure to Centrifugation” (September ‘04) “Collaborative Human-Computer Decision-Support System for Command and Control” (September ‘08) Research Background Keywords Human Factor Designgineering Advanced Interface Design, Information Management and Visualization Human-Computer Collaboration, Decision-Support Systems

4. 4Collaborative Human-Computer Decision-Making - Sylvain Bruni Director Missy Staff SallyPing Researchers JillMarkJakeBirsen Undergraduate Students AndrewJavierLindleyJonathanBrianYaleNedJasonJenny Doctoral Students SylvainCarlYvesPatriciaBrian Master Students AnnaGeoffHudson Visiting Students PaulGisele The Humans and Automation Laboratory Other Tookie Family Portrait

5. 5Collaborative Human-Computer Decision-Making - Sylvain Bruni HAL Projects MACCS TRACS HACT StrikeView MUPPETS Research sponsored by the Office of Naval Research Mobile Advanced Command and Control Station A C2 experimental testbed integrated in a vehicle for mobile system testing. Tracking Resource Allocation Cognitive Strategies A dynamic tool aimed at capturing operators’ cognitive strategies. Human-Automation Collaboration Taxonomy A revised information processing model for collaborative resource allocation. StrikeView A Tomahawk land attack missile strike mission planning experimentation. Multi-UAV Path Planning for Emergent Target Scenario A multi-unmanned aerial vehicles mission replanning experimentation.

6. 6Collaborative Human-Computer Decision-Making - Sylvain Bruni MACCS Mobile Advanced Command and Control Station A C2 experimental testbed integrated in a vehicle for mobile system testing.

7. 7Collaborative Human-Computer Decision-Making - Sylvain Bruni TRACS Tracking Resource Allocation Cognitive Strategies A dynamic tool aimed at capturing operators’ cognitive strategies.

8. 8Collaborative Human-Computer Decision-Making - Sylvain Bruni sub-decisions solution elements feasible solutions selected solution final solution Collaboration = “Mutual engagement of agents in a coordinated and synchronous effort to solve a problem based on a shared conception of it.” HACT Human-Automation Collaboration Taxonomy A revised information processing model for collaborative resource allocation. Data Acq.ActionDecision-Making Process sensors data evaluation vetointeg. data analysis and requests solution implem entation The three fundamental roles GeneratorModeratorDecider eval.

9. 9Collaborative Human-Computer Decision-Making - Sylvain Bruni HACT Human-Automation Collaboration Taxonomy A revised information processing model for collaborative resource allocation. The three fundamental roles GeneratorModeratorDecider -2 0 1 2 Human only Mixed, but more human Equally shared Mixed, but more automation Automation only -2 0 1 2 Human only Mixed, but more human Equally shared Mixed, but more automation Automation only -2 0 1 2 Human only Mixed with Human Veto Equally shared w/ Dual Veto Mixed with Automation Veto Automation only Interactivity Information Transparency Functional Transparency Interactivity Functional Transparency Information Transparency Functional Transparency Adaptability

10. 10Collaborative Human-Computer Decision-Making - Sylvain Bruni HACT Human-Automation Collaboration Taxonomy A revised information processing model for collaborative resource allocation. Generator Moderator Decider -2 0 1 2 Human only Mixed, but more human Equally shared Mixed, but more automation Automation only Interactivity Information Transparency Functional Transparency 0 3 5 3 0 120 1 02 0

11. 11Collaborative Human-Computer Decision-Making - Sylvain Bruni StrikeView Interface 1 (manual) StrikeView A Tomahawk land attack missile strike mission planning experimentation.

12. 12Collaborative Human-Computer Decision-Making - Sylvain Bruni StrikeView Interface 2 (collaborative) StrikeView A Tomahawk land attack missile strike mission planning experimentation.

13. 13Collaborative Human-Computer Decision-Making - Sylvain Bruni StrikeView Interface 3 (configural) StrikeView A Tomahawk land attack missile strike mission planning experimentation.

14. 14Collaborative Human-Computer Decision-Making - Sylvain Bruni Performance Results StrikeView A Tomahawk land attack missile strike mission planning experimentation.

15. 15Collaborative Human-Computer Decision-Making - Sylvain Bruni TRACS Interface 2 Interface 3 Interfaces 1&3 StrikeView A Tomahawk land attack missile strike mission planning experimentation.

16. 16Collaborative Human-Computer Decision-Making - Sylvain Bruni StrikeView A Tomahawk land attack missile strike mission planning experimentation. HACT Interface 1 (manual) (M,G,D) = (-2,-1,-2) Interface 2 (collaborative) (M,G,D) = (-2,0,-2) Interface 3 (configural) (M,G,D) = (-2,1,-2)

17. 17Collaborative Human-Computer Decision-Making - Sylvain Bruni MUPPETS Multi-UAV Path Planning for Emergent Target Scenario A multi-unmanned aerial vehicles mission replanning experimentation. MUPPETS Interface 1 (manual)

18. 18Collaborative Human-Computer Decision-Making - Sylvain Bruni MUPPETS Multi-UAV Path Planning for Emergent Target Scenario A multi-unmanned aerial vehicles mission replanning experimentation. MUPPETS Interface 2 (collaborative)

19. 19Collaborative Human-Computer Decision-Making - Sylvain Bruni MUPPETS Multi-UAV Path Planning for Emergent Target Scenario A multi-unmanned aerial vehicles mission replanning experimentation. MUPPETS Interface 2 (collaborative)

20. 20Collaborative Human-Computer Decision-Making - Sylvain Bruni MUPPETS Multi-UAV Path Planning for Emergent Target Scenario A multi-unmanned aerial vehicles mission replanning experimentation. MUPPETS Interface 3 (configural)

21. 21Collaborative Human-Computer Decision-Making - Sylvain Bruni Thank you. Sylvain Bruni sbruni@mit.edu