Abstract

With rapid advances in the field of autonomous vehicles (AVs), the ways in which human–vehicle interaction (HVI) will take place inside the vehicle have attracted major interest and, as a result, intelligent interiors are being explored to improve the user experience, acceptance, and trust. This is also fueled by parallel research in areas such as perception and control of robots, safe human–robot interaction, wearable systems, and the underpinning flexible/printed electronics technologies. Some of these are being routed to AVs. Growing number of network of sensors are being integrated into the vehicles for multimodal interaction to draw correct inferences of the communicative cues from the user and to vary the interaction dynamics depending on the cognitive state of the user and contextual driving scenario. In response to this growing trend, this timely article presents a comprehensive review of the technologies that are being used or developed to perceive user's intentions for natural and intuitive in‐vehicle interaction. The challenges that are needed to be overcome to attain truly interactive AVs and their potential solutions are discussed along with various new avenues for future research.

Highlights

  • With rapid advances in the field of autonomous vehicles (AVs), the ways in which big technology giants such as Google’s human–vehicle interaction (HVI) will take place inside the vehicle have attracted major interest and, as a result, intelligent interiors are being explored to improve the user experience, acceptance, and trust

  • Many of the technological solutions developed so far are used for various HVI studies that are typically conducted in driving simulator environments,[242] open source annotated datasets, or controlled outdoor environments with preplanned routes

  • While there has been tremendous research in the field of environment perception and control for autonomous driving, the growing need for in-vehicle interaction is leading to more sensors being integrated within the car

Read more

Summary

Level of Automation and In-Vehicle Interaction

There are six levels of automated driving systems ranging from level 0 (completely manual) to level 5 (FSD) automated systems The SAE established the so-called 15 s rule, i.e., any tertiary task that takes more than 15 s to conduct while stationary is not allowed while the vehicle is in motion.[18] with the advent of level 4 and level 5, the primary tasks for the drivers and passengers are to perform nondriving-related tasks such as in-vehicle infotainment, working, and so on and secondary tasks will be supervising the AV and traffic situation.[19] depending on the driving context the vehicle needs to interact with the humans in certain ways according to established regulations and personal preferences of the drivers. Some of the major roles and objectives of the IVA can be characterized as follow

Entertainment
Safety
Personalization and Recommendation System
Natural and Empathetic Interaction
Technologies for Interaction
Vision-Based Technologies
Haptics or Touch-Based Technologies
Auditory Technologies
Physiological Sensing Technologies
Proprioceptive Sensing Technologies
Methods for In-Vehicle Interaction
Implicit Interaction
Driver Fatigue and Distraction Recognition
Emotion Recognition
In-Vehicle Pose Recognition
Explicit Interaction
Voice-Based Interaction
Haptic-Based Interaction
Multimodal Interaction
Discussions
Empirical Studies for HVI
Robust Multimodal Perception and Interaction
Functional Vehicle Interior Designs
Communication Protocols
Data Processing
Conclusions
Findings
Conflict of Interest
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.