Intelligent IVI with AI Oct 11th, 2017 | Use cases of applying AI to IVI Jungsik Kang Research Engineer, LGE This work is licensed under a Creative Commons Attribution-Share Alike 4.0 (CC BY-SA 4.0) GENIVI is a registered trademark of the GENIVI Alliance in the USA and other countries. Copyright © GENIVI Alliance 2017.

Contents Current IVI System Future of IVI with AI Various approaches of Intelligent IVI - Speech Recognition - Virtual Assistant - Internet of Things - Cloud Technologies - LGE Concept - Driver monitoring with Eye Tracking Conclusion

Current IVI System Automotive infotainment(IVI) is one of the fastest growing technologies in the industry – A growth trend expected to continue with the smart phones technology boom IVI features include head-up display, infotainment systems for driver assistance, interior personalization and Cloud based infotainment. Most vehicles nowadays have infotainment for entertainment, connected with devices such as personal navigation systems and smart phones Smart phone connectivity bridges the product life cycle gap between car infotainment systems and smart phones.

Future of IVI with AI Key feature of future IVI is Interaction between human and vehicles Increasing interaction between man and machine as car respond to and even anticipate drivers’ needs - Learning from drivers’ information which extracted from apps - Interactions between drivers and vehicles through Speech Recognition and Virtual Assistant - Improving driver monitoring using Eye Tracking Technologies - Driver-tailored various entertainment from Cloud Service. - Cloud will connect all A.I and enabling the sharing of data between millions

Various approaches of Intelligent IVI Speech Recognition Virtual Assistant Internet of Things Cloud Technologies Driver monitoring with Eye Tracking

Speech Recognition Most basic but most important feature of A.I Speech Recognition provides an easier way for human to interact with machines. User specific speech recognition engine (Speaker Adaptive System) - Immediately start to update speech samples - Learning driver’s distinct accent and pronunciation of words provides outstanding accuracy and precision. Cloud based speech recognition engines are also on the rise

Virtual Assistant Drivers were very limited with what they could do with speech recognition. Virtual assistant allows drivers to ask for directions, get general information and even adjust their seating position and A/C settings. Google Assistant and Amazon Alexa recently introduced to the automotive industry. Virtual Assistant (VA) on phone and Virtual Assistant on car is different. - VA on phone is not enough to provide essential information to drivers - VA on car must be aware of current status of vehicle (Engine status, fuel status, etc.) - Accurate GPS information is needed to provide accurate navigation

Internet of Things Control home appliances via IVI system and virtual assistant - Stay connected with family members. - Get important alerts about what’s happening in and around driver’s home. Connected vehicle could report problem or schedule repairs by sending performance data directly to manufacturer using IoT. Smart sensors inside the vehicle could detect medical emergencies, and summon emergency personnel. The opportunities for IoT to make driving safer and more convenient are virtually unlimited

Cloud Technologies Cloud Computing is reliable to handle a large amount of data Efficiently apply automotive sector’s complex needs. - Cloud can provides complex engineering simulations, analytics and data - It’s so hard to get fulfilled all these needs by the on-site IT infrastructure. Low Risk rate and High Security rate - System is supported from the dedicated staff to take care of the systems and its security

Cloud Technologies As the era of self-driving approaches, entertainment in vehicle is getting important - Enroll on demand entertainment from cloud based sources - Share and store media files with cloud based media databases - Sharing media files will lead to saving local space and providing more media choices User behavior data can be trained via AI on IVI system Intelligent IVI could recommend entertainments to drivers.

Concierge Control Interface Manager LGE Concept LEOPARD 1 Driver login using ProfileManager Virtual Assistant 1 Persistence DB Profile Manager Amazon Alexa 2 After selecting Alexa or Google, login with same information saved in Persistence DB Cloud Account Manager 2 Google Assistant 3 Interface for using Concierge services and Leopard App Control 3 Concierge Control Interface Manager 4 Leopard Apps and Personal Phone Control 4 Media Control HVAC Control Phone Control (Mastermind) Concept Features

Driver Monitoring using Eye Tracking Smart Personalization and automatic setting - Eye tracking system can identify the drivers and automatically adjust to user preference settings (music, seat, mirrors, etc). Improve driver safety - By training driver eye gaze patterns, intelligent IVI system can reliably detect if a driver is falling asleep and warns accordingly or take other actions. - Combination of eye tracking and forward sensors could automatically adjust the vehicle’s behavior or warn the driver about potential dangers.

Conclusion Vehicles generate tons of valuable data which is only useful if the infrastructure is in place to process it, analyze it and learn from it. A.I is essential to handle valuable data from vehicles and this is why A.I will drive the future of the IVI system There are plenty of different approaches exists in applying A.I to IVI system. And Artificial Intelligence promises to revolutionize the automotive industry. A.I on IVI will go step further to consider driver condition evaluation, camera-attached machine vision systems, sensor fusion engine control units and radar-based detection units

Thank you! Visit GENIVI at http://www.genivi.org or http://projects.genivi.org Contact us: help@genivi.org This work is licensed under a Creative Commons Attribution-Share Alike 4.0 (CC BY-SA 4.0) GENIVI is a registered trademark of the GENIVI Alliance in the USA and other countries. Copyright © GENIVI Alliance 2017.