Human-computer Interaction Interface Research Articles

Desktop Voice Assistant

Abstract: Desktop voice assistants have become a popular interface for human-computer interaction because they allow users to speak with their computers in natural language. However, modern desktop voice assistants sometimes struggle to understand and respond to complex queries and context. Privacy concerns concerning the collection and use of user data also remain significant barriers. In order to enhance desktop voice assistants, we present a novel personalization and multimodal interaction technique in this research. By combining text, voice, and visual inputs, our approach improves the accuracy and relevance of the responses. By combining several modalities, our system is able to better understand context and user intent, leading to more meaningful interactions. Furthermore, we propose a user-centric personalization strategy whereby the voice assistant progressively learns each user's preferences and usage patterns. Because it depends less on centralized data collection and processing, this customized approach improves user experience while simultaneously addressing privacy concerns. Through a series of experiments and user surveys, we show how effective our approach is in improving the overall performance and user experience of desktop voice assistants. Our results show that the combination of multimodal interaction with personalization produces more accurate and contextually relevant responses, improving the user experience. All things considered, our research advances desktop voice assistant technology by addressing significant interface and personalization issues. Our approach has the potential to significantly improve desktop voice assistant usability and user acceptance, which could result in considerably more intuitive and natural human-computer interaction.

Tomato Sorting System Based on Machine Vision

In the fresh tomato market, it is crucial to sort and sell tomatoes based on their quality. This is important to enhance the competitiveness and profitability of the market. However, the manual sorting process is subjective and inefficient. To address this issue, we have developed an automatic tomato sorting system that uses the Raspberry PI 4B as the control platform for the robot arm. This system has been integrated with a human–computer interaction interface sorting system. Our experimental results indicate that this sorting method has an accuracy rate of 99.1% and an efficiency of 1350 tomatoes per hour. This development is in line with modern agricultural mechanization and intelligence needs.

Self-healing and adhesive MXene-polypyrrole/silk fibroin/polyvinyl alcohol conductive hydrogels as wearable sensor

Conductive hydrogels become increasing attractive for flexible electronic devices and biosensors. However, challenges still remain in fabrication of flexible hydrogels with high electrical conductivity, self-healing capability and adhesion property. Herein, a conductive hydrogel (PSDM) was prepared by solution-gel method using MXene and dopamine modified polypyrrole as conductive enhanced materials, polyvinyl alcohol and silk fibroin as gel networks, and borax as cross-linking agent. Notably, the PSDM hydrogels not only showed high permeability (13.82 mg∙cm−2∙h−1), excellent stretch ability (1235 %), high electrical conductivity (11.3 S/m) and long-term stability, but also exhibited high adhesion performance and self-healing properties. PSDM hydrogels displayed outstanding sensing performance and durability for monitoring human activities including writing, finger bending and wrist bending. The PSDM hydrogel was made into wearable flexible electrodes and realized accurate, sensitive and reliable detection of human electromyographic and electrocardiographic signals. The sensor was also applied in human-computer interaction by collecting electromyography signals of different gestures for machine learning and gesture recognition. According to 480 groups of data collected, the recognition accuracy of gestures by the electrodes was close to 100 %, indicating that the PSDM hydrogel electrodes possessed excellent sensing performance for high precision data acquisition and human-computer interaction interface.

An Intelligent Equipment Inspection System based on Robotic Arm

Intelligent robots have replaced manual labor to complete a lot of complicated work, especially in equipment inspection has advantages. The purpose of this paper is to design an intelligent robotic inspection system. The system is based on ROS and adopts YOLO algorithm, RRT* algorithm, Agile_grasp function package, and MoveIt! framework to realize the basic target recognition, position recognition, robotic arm navigation planning and other functions. The human-computer interaction interface has been designed, and the simulation test in Gazebo and the real machine test in real environment have also been completed. The system still has a large space for improvement, and further research will be conducted in the future in terms of response speed and accuracy.

Design of Alkali Residue Pretreatment Device Based on PLC

In the production process of nuclear fuel elements, a large amount of uranium-containing alkali residue will be produced. In order to solve the problems of low efficiency and long time, a PLC-based alkali residue pretreatment device platform is proposed. Through the overall scheme design of the platform, the work flow is determined, and the communication between the upper computer and the alkali residue pretreatment device, the communication between the upper computer and the PLC are mainly solved. In terms of system hardware, the design and selection of electrical control principle, the selection of PLC model, the design of vacuum pipeline and the design of wiring diagram are carried out. In terms of control system software, STEP 7-Microwin SMART is used to write the control program of PLC as the main controller, and then the human-computer interaction interface is designed by Visual Studio2015, and the measured data is put into the database by connecting with the SQL2012 database. Finally, the human-computer interaction is realized by PC compilation, and the experimental platform is started and debugged. The final experimental results show that the whole platform meets the requirements of industrial production.

Intelligent Optimization Method of Human–Computer Interaction Interface for UAV Cluster Attack Mission

In modern warfare, it is often necessary for the operator to control the UAV cluster from a ground control station to perform an attack task. However, the absence of an effective method for optimizing the human–computer interface in ground control stations for UAV clusters leads to usability difficulties and heightens the probability of human errors. Hence, we propose an optimization framework for human–computer interaction interfaces within UAV ground control stations, rooted in interface-essential elements. Specifically, the interface evaluation model was formulated by combining the Salient, Effort, Expectancy, and Value (SEEV) framework with the essential factor mutation cost of the quantified interface. We employed the SEEV–ant colony algorithm to address the challenge of optimizing the interface design within this context. For a typical UAV cluster attack mission, we optimized the human–computer interaction interfaces of the three mission stages based on the proposed SEEV-AC model. We conducted extensive simulation experiments in these optimized interfaces, and used eye-movement indicators to evaluate the effectiveness of the interface optimization model. Based on the experimental results, divergence is reduced by 11.59%, and the fitness of the optimized interface is increased from 1.34 to 3.42. The results show that the proposed intelligent interface optimization method can effectively improve the interface design and reduce the operator’s workload.

Design of Portable High Precision Scale Hardness Tester Based on STM32

Hardness measurement is a very important index in the process of production and quality inspection. In the past, the precision of portable hardness tester is low, and the stability is poor. Combined with the internal high-speed ADC of the STM32 hardness tester can achieve a more demanding test accuracy requirements. Low power consumption, high accuracy and reliability of data acquisition is realized. And designed with the stemwin library can do more perfect function, human-computer interaction interface is more friendly.

Design and Test of a Tractor Electro-Hydraulic-Suspension Tillage-Depth and Loading-Control System Test Bench

Electro-hydraulic suspension systems are one of the key working systems of tractors. Due to the complex and changeable working conditions in the field, it is of great significance to shorten the development cycle of the control strategy and reduce the development cost by using the indoor bench for test verification at the beginning of the study. Based on this, this paper has proposed a complete set of tractor hydraulic-suspension tillage-depth and loading-control test-bench designs. The system was mainly composed of three parts: an industrial computer, a suspension electro-hydraulic control system, and a loading electro-hydraulic control and data-acquisition system. The human–computer interaction interface of the test-bench measurement and control system was built, and the loading-force control system and suspension tillage-depth and loading integrated-control system were built based on PID and fuzzy PID control algorithms, respectively. The system can realize the control of suspension tillage depth and loading during the operation process and has the functions of the real-time acquisition, display, and data storage of related sensor signals during the working process. The test results showed that the response time of the loading-control system was less than 1.2 s, and the maximum steady-state error was less than 0.8%. The response time of the suspension control system was less than 2.3 s, and the maximum steady-state error was less than 1%. The system has good responsiveness and stability. These research results can provide platform and method of support for the development and test of tractor electro-hydraulic suspension systems.

Application of image processing technology based on hierarchical analysis in visual communication system

Abstract To address the problem of poor visual expression due to traditional methods’ poor image enhancement effect, this paper proposes an image processing model for visual communication of the human-computer interaction interface based on hierarchical analysis. The edge contour feature extraction method is used to extract the convenient information features of the HCI interface, and the cross-sectional information fusion technique is combined to realize the visual communication information enhancement processing of the HCI interface, extract the spatial multi-resolution feature amount of the visual communication image of the HCI interface, and realize the visual communication optimization design of the HCI interface. In the image processing model proposed in this paper, the traditional PCANet and computer vision methods are compared to test the effectiveness of the three image recognition methods. The recognition accuracy of the method proposed in this paper is 82.55%, 85.28%, 87.06%, and 85.87% for the four types of images, respectively; the recognition accuracy of PCANet is 75.53%, 76.48%, 81.26%, and 74.74%, respectively; and the recognition accuracy of computer vision method is 73.79%, 72.83%, 79.36%, and 73.71%. Comparing the data, it can be seen that the model in this paper can improve the fidelity of visual communication and the discriminative ability of interface output, which can greatly improve the performance of the graphical human-computer interaction interface.

FlexCAT: Computerized Adaptive Test Development Platform

Computerized Adaptive Testing (CAT) is a new testing mode that utilizes the adaptive measurement concept of "tailored to fit." Compared with traditional paper-and-pencil testing, CAT has the advantages of improving measurement accuracy, reducing test length, and ensuring test security. Therefore, it is highly regarded by researchers and practitioners both domestically and internationally. However, the platform construction of CAT involves complex statistical measurement theory and tedious numerical calculations, which hinder the application and promotion of CAT in practice. This article mainly introduces the development platform of computerized adaptive testing - flexCAT. Users can quickly build their own CAT system using the convenient human-computer interactive interface provided by the flexCAT platform. This article will introduce the first web-based computerized adaptive testing development platform in China - flexCAT, from the perspectives of its advantages, basic theory, module functions, etc. The aim is to provide free adaptive testing platform development services for research and application personnel in the fields of education, psychology, and further promote the development of psychological and educational measurement theory and technology in China. The URL for the flexCAT platform is: http://www.psychometrics-studio.cn/app/cat_demo/index.html?Id=false&Block=false.

Emotion assessment and application in human–computer interaction interface based on backpropagation neural network and artificial bee colony algorithm

Emotion assessment is a challenging task in the human–computer interaction interface. Previous studies have examined the relationship between emotion and color, but they fail to accurately analyze emotional semantics due to the numerous elements in human–computer interaction interfaces. As a result, a combination model of a backpropagation neural network (BPNN) and an artificial bee colony algorithm (ABC) was presented in this paper to predict the emotion semantics of the human–computer interaction interface. The mechanism of generating the weights and thresholds for each layer of BPNN was converted to the search for an optimal honey source. Meanwhile, according to experiment results and evaluation of elements in human–computer interaction interfaces, this paper has assessed the relationships amongst the eight key elements (ratio of graphics to text, color difference, color distribution, color harmony, theme style, white space ratio, frame style, number of colors) and emotion word pairs (moderation-fancy, calm-pleasure, confusing-clear, cold-kind, coarse-elegant). Furthermore, an emotion application database was established to determine how the amalgamation of critical elements affects the users’ feelings about the human–computer interaction interface to help designers build a user-centric interface. Finally, the database can be applied to relieve mental health problems by meeting the psychological expectations of users as mental healthcare intervention during the COVID-19 pandemic. Also, it can help designers to design a pleasurable visual interaction interface for a particular element to convey health-related information and protective measures.

UAV patrol path planning based on machine vision and multi-sensor fusion

Abstract With the rapid development of unmanned aerial vehicle (UAV) technology, there are more and more fields of UAV application. This research mainly discusses the UAV patrol path planning based on machine vision and multi-sensor fusion. This article studies how to apply ultrasonic, a classic ranging sensor, to obstacle avoidance of UAVs. The designed ultrasonic obstacle avoidance system is a complete set of hardware and software systems. The hardware part consists of a forward ultrasonic module and a central signal processing module. Among them, a single-axis stabilization gimbal is designed for the forward ultrasonic module, which decouples the attitude angle of the UAV and the pitch detection angle of the ultrasonic sensor. In the central signal processing module, Kalman filtering is performed on the ultrasonic data in the four directions of front, rear, left, right, and left, and the obstacle avoidance control signal is sent to the flight controller according to the filtered sensor data. At the same time, a human–computer interaction interface is also designed to set various parameters of the obstacle avoidance system. For the route planning method of the tower, the routine steps are used to inspect the tower with a single-circuit line, and the specific targets are the insulator string, the ground wire, and the conductor. In this study, the average statistical result of the straight-line distance of the UAV patrolling 100 m is 99.80 m, and the error is only 0.2%. The fusion obstacle avoidance control method based on machine vision is suitable for the engineering application of UAV perception obstacle avoidance. The obstacle avoidance method adopted in this article can be extended to most flight control platforms, and it is a control method with broad application prospects.

Research on Design of Photoelectric Turntable for Autonomous Reconnaissance

In this paper, the structural types of autonomous reconnaissance photoelectric turntables and the electrical system design methods of autonomous reconnaissance control are proposed and simplified. Meantime, the key technologies of autonomous reconnaissance photoelectric turntables are proposed and simplified, and the human-computer interaction interface of the autonomous reconnaissance photoelectric turntable is described, the concept of autonomous collaboration and its corresponding collaborative algorithms is explained, and the prospects for future development direction are proposed.

Analysis on the Promotion of Classroom Atmosphere in Multimodal English Teaching Based on Human-Computer Interaction

In recent years, multimodal approaches to English Teaching (ET) take into account well not the distinct capabilities of text, speech, and visuals and how these modalities may be combined to provide engaging and instructional material for students. The lack of language, articulation issues, lack of enthusiasm, and usage or interference of the mother language are cited as the most significant difficulties students face while learning English. The Classroom Atmosphere (CA) plays a crucial role in facilitating the education system by fostering a sense of trust and fellowship between the instructor and students, increasing students’ performance, and reducing disruptive behaviours. Human-Computer Interaction (HCI) aims to enhance the efficiency and satisfaction of users in their interactions with computerized systems integration. This is accomplished by improving the HCI interface given knowledge about the tasks and organizational contexts in which HCI is performed. This paper proposes an HCI-assisted Multimodal English Teaching (HCI-MMET) to promote the classroom atmosphere. Classrooms with a great atmosphere are more conducive to learning. This method helps with high expectations, promoting student participation, making the classroom physically attractive, including parents, and ability to motivate and performance feedback are all ways to establish a healthy classroom atmosphere. The multimodal approach should be used in the classroom for instructing students in a foreign language. Problem-solving and creative thinking are at the basis of HCI, where learners gain the ability to analyze a system, pinpoint problem areas, and provide solutions. Hence the proposed method HCI-MMET gives the outcomes of Classroom interaction and efficiency-83%, Student performance based on a positive atmosphere-75%, Teacher’s interest in classroom settings-81%, Student motivation in the multimodal classroom-79%, Development of peer support-86% comparing to the existing methods.

Design and stability analysis of a solar‐powered versatile patrol robot

AbstractIn order to effectively solve the problem of energy autonomy of patrol robots in open‐air working environment and free them from the limitation of power lines on their activity range. In this article, a solar‐powered patrol robot based on a robot operating system is designed. The system adopts a modular design, using a master–slave distributed controller to control the robot's motion, and building an intelligent sensing system for the robot with various sensors. Meanwhile, flexible thin‐film solar cells and lithium batteries form a folded multi‐mode power supply system, which solves the problem of timely power supply. In addition, a simple and practical human–computer interaction interface is designed to facilitate viewing the robot's status. Finally, in order to verify the performance of the robot, the stability of the designed solar‐powered patrol robot is verified through different experiments, which has a reference value and practical significance for the development of patrol robots.

Multimedia Teaching Mode in Colleges and Universities Based on Psychology-Based Human-Computer Interaction Interface Design

In order to adapt to the development of teaching informatization and meet the needs of students, teachers and parents, it is necessary to strengthen the active participation of students and integrate various curriculum resources, and improve teaching quality and the modes. Comprehensive multimedia software should be produced, including audiovisual and other sensory experiences. This is a concentrated expression of media diversity and networking, which not only breaks the traditional single-source education model, but also improves students’ interest and enthusiasm for learning. As a new teaching tool, multimedia teaching uses the latest computer, multimedia and network technologies to make the presentation of teaching materials more dynamic. This is because it can break through the constraints of time and space and show a high degree of flexibility and interactivity. However, most multimedia teaching and learning in China are faced with problems such as poor interactivity, insufficient programming, product personalization, intellectual property rights and insufficient knowledge of software automation. Therefore, this paper designed the multimedia teaching system from the perspective of psychology through human-computer interaction, so as to improve the teaching quality and promote the diversified development of teaching. The results showed that the multimedia teaching improved by about 9% compared with the traditional model, and the students’ learning effect also improved by about 11% compared with the traditional model.

A novel test method of load-bearing performance of sized warp yarn based on weaving load simulation and its effectiveness

To simulate the weaving process effectively and evaluate the load-bearing performance of sized warp yarn based on the tensile and friction loads of warp in weaving, a weaving load simulation tester of sized warp yarn (SWL) named JN-01 was designed and developed in this paper. It realized the simulation of warp tension, opening tensile load, and abrasion load, respectively. In addition, the SWL included three auxiliary function modules, that is, take-up and let-off, yarn breaking automatic stop, and human–computer interaction interface. The load-bearing life of sized warp yarn was measured by the number of load cycles when the yarn broke. Taking pure cotton sized warp yarn of 14.5 tex as the test sample, the effects of adjustable parameters of the SWL, such as working frequency, opening stroke, yarn tension, reed swing angle, and winding speed, on the load-bearing performance of sized warp yarn were systematically studied. Aiming at the stability of the test results of load-bearing life, the parameters of the SWL were optimized by the analysis of response surface methodology. The optimization results showed that: when the parameters were maintained at the following level, that is, working frequency of 180 rpm, winding speed of 3 mm/min, opening stroke of 32 mm, reed swing angle of 12° and yarn tension of 1.7 cN/tex, the relative deviation between the predicted value and the theoretical value of load-bearing life CV was 0.85%. The results also indicated that the optimized instrument parameters had good reproducibility.

Study on the Availability of Digital Interactive Mode of Scenic Spots Guidance System

Some characteristics and advantages of human-computer interaction interface design based on scenic spot guidance, in order to better apply human-computer interaction interface in product usability, the user model, user interface model, multi-channel interaction information integration, pen-based interaction technology, human-computer interaction software architecture and other contents in human-computer interaction are analyzed. It solves the problem of product homogeneity caused by traditional cognitive interaction and makes the design of interactive products return to focusing on users and interaction itself. The feasibility and rationality of the interactive product design method based on usability theory are verified through design practice, and this method has certain guiding significance.

Design and Application of Virtual Flexible Simulation Experiment Teaching Platform for Relay Protection

Abstract: Power system relay protection (PSRP) is a comprehensive course in electrical engineering undergraduate stage, which has a very strong engineering application. However, due to the influence of many factors, such as the power system security, high experimental cost, limited course hours, insufficient open conditions, and so on, traditional experimental teaching combined with hardware is difficult to meet the needs of students in various scenarios anytime and anywhere. Therefore, a low-cost virtual flexible simulation experiment teaching platform (VFSETP) is developed. The platform uses Simulink to build the simulation model of power system primary system and uses graphical user interface (GUI) to design the human-computer interaction interface. Through the communication between GUI and Simulink model, the protection experiments in various scenarios are successfully simulated. The VFSETP has many advantages such as simple interface, good visualization effect, and simple operation. The teachers can easily use it for classroom demonstration, and the students can use it for verification, analysis, expansion, and exploration of experiments in a variety of application scenarios without relying on the laboratory environment. This experimental mode is very conducive to the understanding of knowledge and the cultivation of practical innovation ability. The results of the student survey show that the design method and application mode of the platform can provide a reference for similar courses.

Design and development of a novel infrared mild moxibustion device

To make up for the shortcomings of traditional mild moxibustion, according to the principle and technical operation characteristics of traditional mild moxibustion, combined with temperature control technology, a novel infrared mild moxibustion device is developed, which is capable of real-time accurate temperature control. This novel infrares mild moxibustion device is composed of a host computer and an infrared radiation head. The host computer includes four modules: power supply, human-computer interaction interface, micro control unit (MCU) and drive circuit. The infrared radiation head mainly includes an infrared heater and a temperature sensor. This novel infrared mild moxibustion device is easy to operate. The electrothermal heating tablet can generate infrared radiation of 3 000-13 000 nm. After the temperature of the infrared heater is stabilized, the range of temperature change is ±0.50 ℃, realizing the goal of precise temperature control. In addition, it can operate moxibustion treatment at multiple acupoints at the same time, which is conducive to the dose-effect evaluation of mild moxibustion.