In-vehicle Infotainment Systems Research Articles

车载信息娱乐系统项目管理研究和分析

车载信息娱乐系统项目管理研究和分析

WiFi-Based Gesture Recognition for Vehicular Infotainment System—An Integrated Approach

In the realm of intelligent vehicles, gestures can be characterized for promoting automotive interfaces to control in-vehicle functions without diverting the driver’s visual attention from the road. Driver gesture recognition has gained more attention in advanced vehicular technology because of its substantial safety benefits. This research work demonstrates a novel WiFi-based device-free approach for driver gestures recognition for automotive interface to control secondary systems in a vehicle. Our proposed wireless model can recognize human gestures very accurately for the application of in-vehicle infotainment systems, leveraging Channel State Information (CSI). This computationally efficient framework is based on the properties of K Nearest Neighbors (KNN), induced in sparse representation coefficients for significant improvement in gestures classification. In this typical approach, we explore the mean of nearest neighbors to address the problem of computational complexity of Sparse Representation based Classification (SRC). The presented scheme leads to designing an efficient integrated classification model with reduced execution time. Both KNN and SRC algorithms are complimentary candidates for integration in the sense that KNN is simple yet optimized, whereas SRC is computationally complex but efficient. More specifically, we are exploiting the mean-based nearest neighbor rule to further improve the efficiency of SRC. The ultimate goal of this framework is to propose a better feature extraction and classification model as compared to the traditional algorithms that have already been used for WiFi-based device-free gesture recognition. Our proposed method improves the gesture recognition significantly for diverse scale of applications with an average accuracy of 91.4%.

Applying a User-Centered Method to Develop 3D Gestural Inputs for In-Vehicle Tasks

Gestures are a natural input method for human communication and may be effective for drivers to interact with in-vehicle infotainment systems (IVIS). Most of the existing work on gesture-based human-computer interaction (HCI) in and outside of the vehicle focus on the distinguishability of computer systems. The purpose of this study was to identify gesture sets that are used for IVIS tasks and to compare task times across the different functions for gesturing and touchscreens. Task times for user-defined gestures were quicker than for a novel touchscreen. There were several functions that resulted in relatively intuitive gesture mappings (e.g., zooming in and zooming out on a map) and others that did not have strong mappings across participants (e.g., decreasing volume and playing the next song). The findings of this study suggest that user-centric gestures can be utilized to interact with IVIS systems instead of touchscreens, and future work should evaluate how to account for variability in intuitive gestures. Understanding the gesture variability among the end users can support the development of an in-vehicle gestural input system that is intuitive for all users.

Visual and Cognitive Demands of CarPlay, Android Auto, and Five Native Infotainment Systems.

The present research compared and contrasted the workload associated with using in-vehicle information systems commonly available in five different automotive original equipment manufacturers (OEMs) with that of CarPlay and Android Auto when used in the same vehicles. A growing trend is to provide access to portable smartphone-based systems (e.g., CarPlay and Android Auto) that support an expansion of various in-vehicle infotainment system features and functions. The study involved on-road testing of 24 participants in each configuration of five vehicles crossed with the three different infotainment systems: the embedded portion of the native OEM systems, CarPlay, and Android Auto. Our analysis found that workload was significantly greater for the embedded portion of the native OEM systems than for CarPlay and Android Auto. The strengths and weaknesses of each CarPlay and Android Auto traded off in such a way that the overall demand associated with using the two systems did not differ. CarPlay and Android Auto provided more functionality and resulted in lower levels of workload than the embedded portion of the native OEM infotainment systems. Potential applications of this research include refinements to CarPlay and Android Auto to address variations in workload as a function of task type, the modality of interaction, and OEM implementation of the system.

IoT-Based Resource Control for In-Vehicle Infotainment Services: Design and Experimentation.

A variety of in-vehicle infotainment (IVI) devices and services have been developed by many vehicle vendors and software companies, which include navigation systems, cameras, speakers, headrest displays, and heating seat. However, there has not been enough research on how to effectively control and manage numerous IVI resources (devices and contents), so as to provide users with more enhanced services. This paper proposes a framework of resource control for IVI services so as to efficiently manage the IVI resources within an automobile. Differently from conventional IVI systems, in the proposed scheme, the IVI-Master is newly introduced for overall control of IVI resources, and IVI users are divided into owner and users. In addition, the IVI resources are classified as personal resources and shared resources, which are managed by the IVI-Master using the Lightweight Machine-to-Machine (LWM2M) standard. The proposed IoT-based IVI resource control scheme was implemented and tested. The experimental results showed that the proposed scheme can be used to effectively manage IVI resources for users. Additionally, the proposed resource control scheme shows lower bandwidth usage than the existing scheme.

In-Vehicle Infotainment 시스템에서 Configuration Protocol의 설계 및 구현

In-Vehicle Infotainment 시스템에서 Configuration Protocol의 설계 및 구현

Connected Vehicles' Security from the Perspective of the In-Vehicle Network

Connected vehicles are generally equipped with many (dozens of, or even hundreds of) electronic and intelligent devices so that drivers can gain a more comfortable driving experience. Despite their numerous benefits, these technological developments have also created serious safety/security concerns. This article recapitulates the diversified attack surfaces of connected vehicles related to the technological developments from the perspective of the in-vehicle network. For each of the attacks, we discuss the rationale and the concrete methods presented in the literature. In particular, we illustrate how to launch successful attacks through the controlled area network (CAN) bus, electronic control units (ECUs), and in-vehicle infotainment system. The article also suggests some feasible solutions to the attacks demonstrated by the community. Considering the fact that vehicles are safety- critical, more practical and effective steps should be taken within the connected vehicle network toward securing connected vehicles and protecting drivers and passengers.

The impact of drowsiness on in-vehicle human-machine interaction with head-up and head-down displays

Various studies show that drowsiness reduces driver alertness and can significantly affect driver performance. In this paper, we investigate the effect of drowsiness on the interaction with the in-vehicle infotainment system (IVIS) while driving. The motivation was to investigate whether a specific type of user interface can provide better performance and lower distraction when the driver is drowsy. The users were asked to navigate a vehicle in a driving simulator and simultaneously perform a set of tasks of varying complexity first when they were rested and alert and then when they were drowsy, after 7 h without sleep. A hierarchical, list-based menu was presented using a stereoscopic head-up display (HUD) and a head-down display (HDD). Based on the results, no general and statistically significant connection was found between drowsiness and driving performance. Surprisingly, the secondary task performance was even better when participants were drowsy, which was evident from the faster task completion times. This could be attributed to extra efforts invested in executing tasks as a result of the participants being aware of their drowsiness. However, when comparing the participants’ performance using HUD and HDD displays, the results showed that using HUD introduces less mental fatigue than using HDD but only in rested and alert condition. No significant difference between the displays was found in the drowsy state.

Domain-specific language models training methodology for the in-car infotainment

The proposed paper focuses on the methodology for training small domain-specific language models. The methodology has been applied for creating a language model for the demonstration version of the in-vehicle infotainment system speech interface. The proposed methodology is based on constructing an initial n-gram language model only from the vocabulary. Such “random” model can be easily adapted to the user’s speaking style. The methodology is well suitable for situations when constructing the accurate deterministic grammar is not a trivial task or the higher flexibility is required. In the case of in-vehicle infotainment, the key idea is to decrease the cognitive load of the driver during controlling such a system and also to make designing process less time consuming. Evaluation of the proposed approach was done on the INCARSCOM corpus (Slovak In-car Command Database). Obtained results favour designed method instead of constructing the appropriate deterministic grammar.

A computer-aided usability testing tool for in-vehicle infotainment systems

This paper describes the development of a computer-aided engineering (CAE) software toolkit for designers of in-vehicle infotainment systems to predict and benchmark the system usability, such as task completion time, eye glance behaviors, and mental workload. A digital driver model was developed based on the task-independent cognitive architecture of QN-MHP (Queuing Network-Model Human Processor). At the front end of the software a graphical user interface (GUI) was developed that allows designers to create digital mockups of the designs and simulate drivers performing secondary tasks while steering a vehicle. To validate the software outputs, an experiment using human drivers was conducted on a fix-based driving simulator with a radio-tuning task as a test case. Three typical in-vehicle infotainment systems that have the function of radio tuning were investigated (a touch screen, physical buttons, and a knob). The results show that the software was able to generate task completion time, total eyes-off-road time, and mental workload estimates that were similar to the empirical data. The software toolkit has the potential to be a supplemental tool for designers to explore a larger design space and address usability issues at the early design stages with lower cost in time and manpower.

A java application programming interface for in-vehicle infotainment devices

Traveling long distances by vehicle in the modern world has become bearable with the availability of In-Vehicle Infotainment systems to entertain and inform both drivers and other occupants. One of the problems faced by application developers for In-Vehicle Infotainment systems is the lack of an open and standard platform across different vehicle manufacturers. The Application Programming Interface and the concepts proposed in this paper should reduce the closed, proprietary and non-extensible systems being released today and bolster the design and development of open, more complete, feature-full systems in vehicles that will not only assist but also entertain drivers and passengers.

Cognitive Workload Using Interactive Voice Messaging Systems

The current research sought to understand the sources of cognitive distraction stemming from voice-based in-vehicle infotainment systems (IVIS) to send and receive textual information. Three experiments each evaluated 1) a baseline single-task condition, 2) listening to e-mail/text messages read by a “natural” pre-recorded human voice, 3) listening to e-mail/text messages read by a “synthetic” computerized text-to-speech system, 4) listening and composing replies to e-mail/text messages read by a “natural” voice, and 5) listening and composing replies to e-mail/text messages read by a “synthetic” voice. Each task allowed the driver to keep their eyes on the road and their hands on the steering wheel, thus any impairment to driving was caused by the diversion of non-visual attention away from the task of operating the motor vehicle.

A Visual Search Model for In-Vehicle Interface Design

As in-vehicle infotainment systems gain new functionality, their potential to distract drivers increases. Searching for an item on interface is a critical concern because a poorly designed interface that draws drivers’ attention to less important items can extend drivers’ search for items of interest and pull attention away from roadway events. This potential can be assessed in simulator-based experiments, but computational models of driver behavior might enable designers to assess this potential and revise their designs more quickly than if they have to wait weeks to compile human subjects data. One such model, reported in this paper, predicts the sequence of eye fixations of drivers based on a Boolean Map-based Saliency model augmented with top-down feature bias. Comparing the model predictions to empirical data shows that the model can predict search time, especially in cluttered scenes and when a target item is highlighted. We also describe the integration of this model into a web application ( http://distraction.engr.wisc.edu/ ) that can help assess the distraction potential of interface designs.

A Novel Approach to the Design and Development of an Interactive Learning App for Automotive In-Vehicle Infotainment Systems

This paper presents the design, architecture, and implementation of “MyFord Touch Guide,” a novel, cross-platform mobile app that delivers an interactive and experiential learning experience for the Ford SYNCTM with MyFord TouchTM in-vehicle infotainment (IVI) system. This app incorporates the production of MyFord Touch graphical user interface for an interactive learning experience. Additionally, it integrates a host of video tutorials featuring a computer-animated character, which offers an insightful, self-guided tour experience of the essential features and functions of the system. MyFord Touch Guide is a cross-platform app and based on a “hybrid” app architecture that uses both native mobile and web technologies. Feedbacks gathered from multiple nation-wide surveys indicated that our approach was effective as an interactive, mobile learning app.

User resistance to acceptance of In-Vehicle Infotainment (IVI) systems

Recently, automobile companies have begun to expand their partnerships with major information technology (IT) companies by adopting in-vehicle infotainment (IVI) systems for use in ‘smart cars’. An IVI system provides embedded infotainment services that include not only navigation, but also access to a wider variety of content. In order to lead in the vehicle-IT convergence market, players need to be successful in offering IVI services. Although the vehicle-IT convergence market is growing rapidly, the availability and readiness of IVI systems in the Korean market seem to be different from that in other markets, such as North America and Western Europe. For that reason, this paper refers to the innovation resistance model in order to investigate the factors that impact the resistance to IVI systems in the Korean market. The empirical analysis was conducted in Korea and the results show that the technographics, subjective norm, and prior similar experience are direct and powerful antecedents for resistance. Contrary to expectations, prior similar experience triggered negative perception toward IVI systems. The results give implications not only for car makers and network operators, but also for policy makers.

A Study of In-Vehicle Infotainment System Based on HTML5 Using Tizen IVI

Cars are the most essential and important means of transportation to modern people. However, the service paradigm of cars, which were just a simple means of transportation in the past, is being changed in combination with recent IT technology. In-Vehicle Infotainment system (IVI), with this flow, is not only playing an existing navigation role. However, unlike mobile OS market which Android and IOS occupy the most, the Invehicle infotainment market is still in competition. Technical competition of related companies gets deepened to preoccupy this new market, and IT companies are also participating in competition one after another. Typically, GENIVI to establish Linux based open-source IVI platform, Android Auto of Google, Car Play of Apple, Window Embedded, Car2 of QNX, and Tizen IVI of Samsung are those companies. Therefore, the 3rd party companies have inconvenience having to configure their own services so that they will match with each platform. On the other hand, the services based on HTML 5 standard can reactively respond to hardware like screen size, unlike existing native services, and have advantage that they can promptly correct, distribute existing service so that they will meet the demand of consumers in rapidly changing market. Therefore, this study is going to design and implement In-Vehicle Infotainment system based on opensource and HTML 5 standard. So this study is going to provide the service which is independent in any in-vehicle OS platforms and can promptly deal with the demand of consumers through the design and implement of In-Vehicle Infotainment Application based on HTML 5 and open-source.

Effects of user experience on user resistance to change to the voice user interface of an in‑vehicle infotainment system: Implications for platform and standards competition

This study examines the effects of user experience on user resistance to change—particularly, on the relationship between user resistance to change and its antecedents (i.e. switching costs and perceived value) in the context of the voice user interface of an in-vehicle infotainment (IVI) system. This research offers several salient findings. First, it shows that user experience positively moderates the relationship between uncertainty costs (one type of switching cost) and user resistance. It also negatively moderates the association between perceived value and user resistance. Second, the research test results demonstrate that users with a high degree of prior experience with the voice user interface of other smart devices exhibit low user resistance to change to the voice user interface in an IVI system. Third, we show that three types of switching costs (transition costs, in particular) may directly influence users to resist a change to the voice user interface. Fourth, our test results empirically demonstrate that both switching costs and perceived value affect user resistance to change in the context of an IVI system, which differs from the traditional IS research setting (i.e. enterprise systems). These findings may guide not only platform leaders in designing user interfaces, user experiences, and marketing strategies, but also firms that want to defend themselves from platform envelopment while devising defensive strategies in platform and standards competition.

Average heart rate for driver monitoring systems

With semi-autonomous vehicles being pushed onto the market, driver monitoring systems play a relevant role in determining the user's level of engagement whenever an automated-to-manual transition of control is scheduled to occur. As current monitoring systems heavily rely on steering behaviour and ocular parameters as inputs for their algorithms, this study aims to investigate whether average heart rate represents a sensitive measure of driver mental workload. Participants from three different age groups (21-34, 35-53, 54-70 years old) were considered and the combined effects of mental workload (induced by interacting with the in-vehicle infotainment system via voice) and aging on average heart rate were investigated. Average heart rate was recorded using a portable heart rate monitor for commercial use. Results showed that average heart rate increased as the secondary task became more demanding. Furthermore, a significant task × age interaction suggested that as the secondary task became more demanding, younger drivers showed an increased heart rate compared to older drivers. These results are of the primary importance for the design of adaptive workload monitoring systems.

Average heart rate for driver monitoring systems

With semi-autonomous vehicles being pushed onto the market, driver monitoring systems play a relevant role in determining the user's level of engagement whenever an automated-to-manual transition of control is scheduled to occur. As current monitoring systems heavily rely on steering behaviour and ocular parameters as inputs for their algorithms, this study aims to investigate whether average heart rate represents a sensitive measure of driver mental workload. Participants from three different age groups (21-34, 35-53, 54-70 years old) were considered and the combined effects of mental workload (induced by interacting with the in-vehicle infotainment system via voice) and aging on average heart rate were investigated. Average heart rate was recorded using a portable heart rate monitor for commercial use. Results showed that average heart rate increased as the secondary task became more demanding. Furthermore, a significant task × age interaction suggested that as the secondary task became more demanding, younger drivers showed an increased heart rate compared to older drivers. These results are of the primary importance for the design of adaptive workload monitoring systems.

A Comparison between a Touchpad-Controlled High Forward Head-down Display (HF HDD) and a Touchscreen-Controlled Head-down Display (HDD) for In-Vehicle Secondary Tasks

This study compared a touchpad-controlled High Forward Head-down Display (HF-HDD) and a conventional touchscreen Head-down Display (HDD) In-vehicle infotainment system (IVIS). These two systems differ from each other on two design factors. First, the HF-HDD has a shorter visual scanning distance between the forward road scene and the display. Second, the HF-HDD is remotely controlled by a touchpad in locations where the input device is more manually accessible. It has been argued, however, that such an indirect display-control system is less intuitive than the touchscreen HDD that is a direct display-control system. Seventeen users under the age of 35 performed secondary tasks using the HF-HDD with the touchpad and the touchscreen HDD while driving. The results showed that the HF-HDD with a touchpad was associated with more positive driver feedback and better secondary task performance than the touchscreen HDD, although, no difference was found in driving performance.