1. The Holistic HMI Approach
Evolution of the Human Machine Interface
Jennifer Wahnschaff, Head of Instrumentation & Driver HMI, North America
Interior Division

2. Holistic HMI Approach Influencing Factors + + +
Distraction
Efficient mobility
User Experience & Trends
Highly Automated Driving (HAD)
Need for seamless
communication
Wasted time & Resources
Car as moving “lounge”
Change of drivers role + +
How to design Confidence
&
Driving Experience +
Take over Capability Mode awareness
 Need for a holistic HMI approach
Jennifer Wahnschaff © Continental Corporation, May 2014

3. Roadmap of HMI Evolution
Holistic HMI Approach
Roadmap of HMI Evolution
Virtual co-pilot (car as companion)
Workload balancing
Safe integration of external devices
Limited HMI personalization
Adaptive information management
Limited connectivity of services
Cloud based
personalization
Potential information overflow
Isolated Information Management & Isolated ADAS
Smart Information Management & Partly Integrated ADAS
Holistic Integration of Information & Assistance Systems
Fully implemented multimodal approach
Integration of Information &
Assistance Systems
Maneuver based automated driving
Highly automated driving
2014
2016
2018
> 2020
Jennifer Wahnschaff © Continental Corporation, May 2014

4. Where is the driver looking at ? Conti system for driver monitoring
Monitoring the Driver’s State
Where is the driver looking at ?
Conti system for driver monitoring
Analysis of 3D-Head pose
Centered micro camera position
Infrared illumination
Currently: ±30° lateral rotation
In development: Extension to ±90°
≈ head position/-orientation + cabin geometrics
Adaptation of Driver assistance systems and HMI features according to driver’s state
Vehicle state
Warning
Intervention
Hazard?
Distraction?
Innovative warning strategies
Enhanced configuration of driver assistance systems
Adaption of warning strategies
Enhanced overall system acceptance
HMI-Adaptation
Driver state
Environment
Glance direction
Jennifer Wahnschaff © Continental Corporation, May 2014

5. How will we interact with the vehicle in the year 2020?
Holistic HMI Approach – Market Trends
HMI 2020 for High-End Cars
How will we interact with the vehicle in the year 2020?
Output HMI: Multimodal approach
HUD and Cluster complementing each other in an optimal way for priority 1 driver info, supplemented by selected warnings (sound, tactile feedback, ambient visual info)
Large Secondary Display areas + speech for supporting driver info
Input HMI: Multimodal approach & natural interaction
Combination of touch + natural speech for complex interaction
Selected mechanical controls & partly gesture for short one-step interaction
Design Study - Generic ID Vision of future HMI
Driver analyzer plays a key role for AR HUD, safety concepts (ADAS) and supports highly automated driving
Jennifer Wahnschaff © Continental Corporation, May 2014

6. Example for HMI Solution Touch & Gesture Based Operation
Touch based operation
Capacitive touch screen
laminated on display surface
Touchpad solution
Implementation of virtual edges to support intuitive HMI (without driver distraction)
Free Air Gestures
Flexible use of the HMI through the Driver for selected gestures and use cases
Shift of HMI content from Secondary display to instrument cluster
Automated driving mode
Jennifer Wahnschaff © Continental Corporation, May 2014

7. Example for HMI Solution Augmented Reality Head-up Display (AR HUD)
Use Case Examples
Adaptive Cruise Control (ACC) Direct visualization of ADAS functionalities
in the outer scenery
Guidance Improvement of comprehensibility of
navigation maneuvers
Maneuver monitoring / indication Increase of trust in HAD
 AR HUD increases driver awareness
Jennifer Wahnschaff © Continental Corporation, May 2014

8. A Prerequisite for Automated Driving
System Integration
A Prerequisite for Automated Driving
Closed Loop Driver & Car (HMI)
Environment
Vehicle
Driver
Car has best available backend information (Connectivity)
Safety Technologies
Jennifer Wahnschaff © Continental Corporation, May 2014

9. Link between driver & car must be closed
Automated Driving
Closed Loop between Driver & Car (HMI)
Link between driver & car must be closed
Car is aware of driver‘s state …
Driver is aware of
driving situation …
Health
Driver monitoring
HALO
Augmented Reality
Jennifer Wahnschaff © Continental Corporation, May 2014

10. Result: A safe, effective and pleasurable driving experience.
Holistic HMI Addresses All Aspects of the Human Machine Interface
Increased safety with situation-specific warning using functional lighting
Augmented reality content and “eyes on the road” with AR HUD
Seamless connectivity for the driver with cloud and personal devices
Interior Camera
Reconfigurable panel for extended personalization
Holistic HMI takes into account the environment, driver expectation, driver state and individual preferences.
Result: A safe, effective and pleasurable driving experience.
Multi-modal HMI approach
Jennifer Wahnschaff © Continental Corporation, May 2014

11. Holistic HMI Addresses All Aspects of the Human Machine Interface
Increased safety with situation-specific warning using functional lighting
Augmented reality content and “eyes on the road” with AR HUD
Seamless connectivity for the driver with cloud and personal devices
Interior Camera
Reconfigurable panel for extended personalization
Multi-modal HMI approach
Jennifer Wahnschaff © Continental Corporation, May 2014

12. The Interior Vision “Always On” is based on our strategy:
HMI Competence
Provide the expertise for superior comfort, ergonomics and ease-of-use.
We inform you well
Connectivity
Connect the driver by wire or wireless and provide value-add services.
We connect
System integration
Integration of components into a superior system.
All at lower cost
Jennifer Wahnschaff © Continental Corporation, May 2014

13. Holistic HMI Approach Summary & Conclusion
Mobility behavior and user experience is changing
New HMI solutions support the holistic HMI approach
- Augmented Reality HUD
- Interior Camera
- Touch & Gesture based input devices
Automated driving is an enabler for future driving experience
Jennifer Wahnschaff © Continental Corporation, May 2014

14. Thank you for your attention.
Jennifer Wahnschaff © Continental Corporation, May 2014