Abstract
This study proposes a Human Machine Interface (HMI) system with adaptive visual stimuli to facilitate teleoperation of industrial vehicles such as forklifts. The proposed system estimates the context/work state during teleoperation and presents the optimal visual stimuli on the display of HMI. Such adaptability is supported by behavioral models which are developed from behavioral data of conventional/manned forklift operation. The proposed system consists of two models, i.e., gaze attention and work state transition models which are defined by gaze fixations and operation pattern of operators, respectively. In short, the proposed system estimates and shows the optimal visual stimuli on the display of HMI based on temporal operation pattern. The usability of teleoperation system is evaluated by comparing the perceived workload elicited by different types of HMI. The results suggest the adaptive attention-based HMI system outperforms the non-adaptive HMI, where the perceived workload is consistently lower as responded by different categories of forklift operators.
Highlights
This section explains the configuration of Adaptive Visual Stimuli (AVS) for teleoperation Human Machine Interface (HMI), which consists of work state, gaze fixation and camera selection modules
The results suggest that major gaze fixations of different categories of operators at each work state are similar, and the common gaze fixations at each work state for these operators can be modeled by hierarchical clustering of their gaze fixations
The first comparison is made between Training and Test[1], the preferred HMI is used for comparison with Test[2]
Summary
This study focuses on developing an intuitive teleoperation HMI based on human behavior observations. This section explains two assumptions which are the basis of the development of Adaptive Visual Stimuli (AVS) for HMI of forklift teleoperation. The adaptability of the proposed system is supported by behavioral models which are developed using data from manned forklift operation. Assumption 1 and 2 refers to operation pattern and gaze behavior, respectively. Functions h1 and h2 select the optimal visual stimulus for D1 and D2 from a set of views acquired from M cameras mounted on the forklift, where ci is the view of the ith camera
Sign-in/Register to view highlights & summary Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
