CARE-INO ANIMS: Animation and Sound in ATC Human Machine Interfaces December 6, 2005 Célin e Schlienger In t uiLab, t uilab.com t uilab.com Ch r istoph e Mertz In t uiLab, m t uilab.com m t uilab.com Yves Rinato Intac t il e Des i gn, r t ile.com r t ile.com Clair e Ollagnon Intac t il e Des i gn, t ile.com t ile.com

2 CARE-INO Workshop 6 th Dec 2005 Outline The ANIMS project: why, who? ANIMS Phase 1 ANIMS Phase 2 Available results Remaining work

3 CARE-INO Workshop 6 th Dec 2005 ANIMS: why? Improving the efficiency and safety of ATM user interfaces with visual animations and sound More efficient interfaces through better –communication from machine to user –communication between users

4 CARE-INO Workshop 6 th Dec 2005 ANIMS: who? Eurocontrol –Project steering –ATC & HMI experts IntuiLab –HMI and Human-factor centre of expertise (R&D) –ATC background Intactile Design –graphical and sound designers for HMIs Domain experts –Human-factors experts (Eurocontrol, CENA)

5 CARE-INO Workshop 6 th Dec 2005 ANIMS: Phase 1 Year 2004 State of the art –Animation: definitions, models, techniques, typical uses, human factors –Sound: definition, typical uses, human factors Five ATC scenarios and five corresponding demonstrations

6 CARE-INO Workshop 6 th Dec 2005 Alarms differentiation (STCA&TCAS) Reduce cognitive load (Watermarking) Reducing information overload (Line0) Notification of changes (flight sequence) More information (STCA)

7 CARE-INO Workshop 6 th Dec 2005 ANIMS Phase1 conclusions Animations and sound are powerful –Several applications to improve situation awareness New design spaces: –Many possible animations types –ATC relevant sounds Storyboards for prototyping and describing animation and sound

8 CARE-INO Workshop 6 th Dec 2005 Open questions... Benefits are intuitive, not proven From storyboards to specifications? Implementation, architecture, retrofit? Better understanding of sound design needed –Design dimensions –Design elements and context Reusable designs patterns for animations in ATC?

9 CARE-INO Workshop 6 th Dec 2005 Stakes for Phase 2 Formally assess human-factor benefits of animations and sounds Be ready to develop such interfaces –From definition phases… –… to operational development

10 CARE-INO Workshop 6 th Dec 2005 ANIMS: Phase 2 Years 2005 and 2006 Objective 1: Specification and tools –How to specify animations and inclusion of sound in animations (2005) –propose animation development tools (2006) Objective 2: Experiments –assess the benefits of animations and sounds in user interfaces Obj1 Obj2

11 CARE-INO Workshop 6 th Dec 2005 Specification Method Propose methods and techniques to share animations and sound specifications between designers and developers Progression: –Method for animation only –Applied by motion designers –Integration of sounds in specification of animation Obj1

12 CARE-INO Workshop 6 th Dec 2005 Specification method for animation Obj1 Visual aspects Temporal aspects Technical aspects

13 CARE-INO Workshop 6 th Dec 2005 Specification method Proof of concept Applied on 3 examples: –specified by designers –implemented by programmers Obj1

14 CARE-INO Workshop 6 th Dec 2005 Specification Method Integration of sound Sounds in animations: –Opening, sustaining, closing –Restricted to pre-recorded sound Add-ons (objects, sequencing, storyboarding) Starts Plays Stops Obj1

15 CARE-INO Workshop 6 th Dec 2005 Available results Specification method for animation and sound Will be used to specify the conditions of the experiment –Animation only –Animation + sound …may need wider validation Obj1

16 CARE-INO Workshop 6 th Dec 2005 Experiments Assess human-factors benefits of animation and sound –Formally –In complex animated interfaces –In credible experimentation context Obj2

17 CARE-INO Workshop 6 th Dec 2005 Experiments Animation design and sound context Define experimental protocol Applications development Experiments Analysis of experiment results and conclusions Obj2 Choose the experiments

18 CARE-INO Workshop 6 th Dec 2005 Animation Design Problem: –Code object type or group objects using colors (flight status) using animations (alerts) –Avoid Christmas tree effect Solution: Structure animated displays by giving a personality to graphical objects Obj2 1

19 CARE-INO Workshop 6 th Dec 2005 Set of isolated animations Entrance of a graphical object in the scene Obj2 1

20 CARE-INO Workshop 6 th Dec 2005 Set of isolated animations Expression of the state of the object Obj2 1

21 CARE-INO Workshop 6 th Dec 2005 Set of isolated animations Automatic movements of the objects Obj2 1

22 CARE-INO Workshop 6 th Dec 2005 Set of isolated animations Interaction with other objects Obj2 1

23 CARE-INO Workshop 6 th Dec 2005 En-Route Traffic Planner List of Ground Mobiles Demonstrations of use in ATC context Clearances on ground Obj2 1

24 CARE-INO Workshop 6 th Dec 2005 Sound Context Realistic experimental conditions –Recreate realistic ATC room atmosphere –Design and test sounds in context Recordings in ATC rooms Obj2 1

25 CARE-INO Workshop 6 th Dec 2005 Recordings in ATC rooms Roissy IFR Bordeaux CRNA Obj2 1 Filtering and mixing Sound scenarios –Low/High sound activity –EnRoute/Departure/Arrival

26 CARE-INO Workshop 6 th Dec 2005 Choice of the experiments State of the art –Expected benefits –Experimentation methods Workshop on how to assess –Situation Awareness –Single user performance –Group performance 8 experiments proposed, 2 chosen Obj2 2

27 CARE-INO Workshop 6 th Dec 2005 Experiment 1 Conditions: nothing blinking animations sound + combinations Obj2 3

28 CARE-INO Workshop 6 th Dec 2005 Experiment 2 Nothing Blinking Animations Sound Averty ATM05 – CENA - NR05/534 Obj2 3 No animationWith animation

29 CARE-INO Workshop 6 th Dec 2005 Available results Experimental protocol for 2 experiments Set of animations Sound scenarios for demonstrations, training, sound design 14 hours of recording Obj2

30 CARE-INO Workshop 6 th Dec 2005 Remaining work: Specification and tools Propose tools for animation development in accordance with specification method –Study on software architecture and models –Integration in software tools –Test in the development of the experiment prototypes

31 CARE-INO Workshop 6 th Dec 2005 Remaining work: Experiments Sound and animation specification Development Experiments Result analysis and conclusions

32 CARE-INO Workshop 6 th Dec 2005 Other perspectives Sound: extract isolated typical ATC sounds –Recreate any ATC room atmosphere –Simulate unexpected situations Animation: –Assess benefits of animation on single user and group performance –Role of animations in direct manipulation

33 CARE-INO Workshop 6 th Dec 2005 For more Come to the show room and –meet us for more details –see demos and posters Connect to :

34 CARE-INO Workshop 6 th Dec 2005 Documents Specification Method for Animation and Sound Animated Themes or How to give a personality to graphical objects? ATC Sound Samples Library Assessing human-factors benefits of animation Experimental protocol