Human-computer Interaction Platform Research Articles

Automated Assesment of Eye-hand Coordination Skill using a Vertical Tracing Task on a Gaze-sensitive Human Computer Interaction Platform for children with Autism

Children with Autism often demonstrate atypical gaze pattern and eye-hand coordination skill deficits marked by difficulties in reaching out for an object, tracing on a vertically mounted canvas, etc. Currently existing conventional methods can assess one's coordination skill during hand movement in 3D-space. But such methods can be subjective and devoid of gaze tracking. Investigation of coordination skill and gaze tracking of this target group in tasks set in 3D-space has been largely unexplored. To quantitatively assess one's eye-hand coordination skill, we have designed Virtual Reality-based Automated gaze-sensitive Tool that can help understand the linkage between their gaze and 3D performance. Results of a study with 10 pairs of age-matched children with Autism (GroupASD) and typically developing children (GroupTD) showed that GroupASD demonstrated reduced eye-hand coordination skill (increased tracing error in vertical tracing task) accompanied with reduced fixation duration on task-relevant regions and atypical gaze path than GroupTD.

Fully Automated Paper Document Sorting Robot Design

A fully automated paper document sorting robot was developed in this project. This robot classifies documents efficiently and accurately. The objective of this project was to improve the efficiency of classifying or sorting paper documents, reduce costs, and save time. The robot can classify documents according to user-defined rules, such as keywords, dates, serial numbers, bar codes, and the meaning of paragraphs. Since it can classify or sort documents intelligently, it can complete large-scale document classification quickly. The robot is constructed using an aluminum profile to create a box-type truss gantry structure frame. It was built on the LubanCat 4 motherboard and controlled through Python language programming. Driven by a stepper motor to move the manipulator. The camera module is combined with an artificial intelligence algorithm to recognize paper in real time, and the text is recognized after taking pictures of the paper. The sorting function is performed by several sensors. In addition, a web-based human-computer interaction platform was developed using the Flask web framework in Python. Users could access this platform in a variety of ways, allowing them to easily and swiftly configure parameters and send operational instructions to perform various functions.

Simulation on human respiratory motion dynamics and platform construction

Bronchoscopy has a crucial role in the current treatment of lung diseases, and it is typical of interventional medical instruments led by manual intervention. The scientific study of bronchoscopy is now of primary importance in eliminating problems associated with manual intervention by scientific means. However, for its intervention environment, the trachea is often treated statically, without considering the effect of tracheal deformation on bronchoscopic intervention during respiratory motion. Therefore its findings can deviate from practical application. Thus, studying kinetic problems in respiratory motion is of great importance. This paper developed a mathematical model of mechanical properties of respiratory motion to express respiratory force from the perspective of dynamics of respiratory motion. The dynamical model was solved using MATLAB. Then, a finite element model of respiratory motion was built using Mimics, and the results of respiratory force solution were used as the load of model for dynamics simulation in ABAQUS. Then, a human–computer interaction platform was designed in MATLAB APP Designer to realize parametric calculation and fitting of respiratory force, and a personalized human respiratory motion dynamics simulation was completed in conjunction with ABAQUS. Finally, experimental validation of the interactive platform was performed using pulmonary function test data from three patients. Validation analysis by respiration striving solution, kinetic simulation and experiment found that Dynamical model and simulation results can be better adapted to the individualized study of human respiratory motion dynamics.

Remote Human-Computer Interaction and STEM Teacher Online Training Based on Embedded Internet of Things

In order to expand the concept and form of teacher training, a remote human-computer interaction and STEM teacher online training platform based on the embedded Internet of Things is proposed. Based on the content analysis method, this article sorts out the development status of the current online teacher training platform and points out the shortcomings of the platform in information aggregation, resource construction, content setting, presentation, learning support services, and other aspects. Based on the combination of new concepts and new technologies, an online training platform for STEM teachers is proposed for the construction of the platform from four perspectives: innovative design concepts, enriching platform promotion ideas, developing educational makers, and improving support services, and the results of the use are investigated. The results show that the subjects believe that the STEM teacher online training system has clarified the STEM curriculum design steps, standardized STEM design methods, improved their cooperative learning ability, and cultivated design thinking. Among them, 13 people think that the training system has made STEM design steps clearer, “the design process is clearer,” “it makes me clearer about the whole design process,” and “the course design and development process is clearer.” Conclusion. This platform can provide a reference for online training and professional development of Chinese teachers.

The Progress of Business Analytics and Knowledge Management for Enterprise Performance Using Artificial Intelligence and Man-Machine Coordination

This study aims to explore the integration of human-computer interaction (HCI) technology and platform ecosystem in artificial intelligence (AI) environment, thus providing a practical basis for the intelligent development of strategic management of platform ecosystem. With clothing e-commerce as an example, first, the business model of brand clothing is simply analyzed. Then, the fashion knowledge management method is adopted to build the fashion data warehouse. The platform intelligent clothing ecosystem is innovatively put forward through the research of business analytics and management mode of clothing e-commerce industry. The optimized genetic algorithm is used to solve the objective function of the model, and a flexible production scheduling model with multiple constraints and maximum cost-saving is established. Finally, the questionnaire results of voice interaction users are analyzed by HCI customer trust model.

Systematic Water-Saving Management for Strawberry in Basic Greenhouses Based on the Internet of Things

A new application of the internet of things in a low-cost greenhouse with no networked intelligent control equipment.The systematic water-saving management focused over the whole growth stage of crops, and it can effectively increase yield and quality.Replace some chemical fertilizer with fully-decomposed organic fertilizer and new types of fertilizer to reduce negative impact on soil and the environment.Regarding pesticide usage, we advocate prevention first and treatment second.Improve systematic water-saving management with regard decreases in crop yield and quality.Abstract. A basic greenhouse is an inexpensive type of greenhouse, which lacks networked intelligent control equipment; it is currently the most common type of greenhouse used in China. To manage planting activities intelligently and improve water use efficiency in these greenhouses, an intelligent planting management platform for strawberry based on the internet of things (IoT) is developed. On the platform, human-computer interaction occurs through the WeChat app on a mobile phone so that manual control of the strawberry environment in the greenhouse can be conducted. In this study, we add a user module in the perception layer of the IoT to obtain the information and manually control the environment in a basic greenhouse. The network layer uses narrowband IoT wireless transmission technology based on 4G. The application layer is designed with a systematic water-saving management knowledge base for strawberry. The systematic water-saving management feature includes seven parts: strawberry variety selection, planting seedlings, flower and fruit thinning, environmental control, disease and pest prevention and treatment, fertilizer management, and water-saving irrigation. Through the human–computer interaction platform, growers can receive decision-making options, planting management evaluation, query information retrieval, and regular relevant planting information. The application results of the platform showed the following: compared with management experience of growers, the water use efficiency of yield (WUEy) increased by 128.55%, the water use efficiency of production value (WUEpy) increased by 226.31%; the amount of chemical fertilizer decreased by 40%, the amount of pesticide decreased by 61.67%, and the cost of pesticide decreased by 32.48%; thus a decrease in the use of both fertilizer and pesticide was achieved. This study can directly provide technical support for strawberry intelligent management in basic greenhouses, and can also be used as a basic platform intelligent management systems for other crops grown in basic greenhouses. Keywords: Basic greenhouse, Intelligent agriculture, Internet of things, Sensor network , Systematic water-saving management, Water-use efficiency.

Research on a multi-attribute comprehensive evaluation system for unmanned ground vehicles

To promote the development of unmanned ground vehicles, it is very necessary to establish a scientific and reasonable evaluation system for unmanned ground vehicles. This paper analyses the structure and operation of unmanned ground vehicles, and also proposes a multi-attribute comprehensive evaluation system for unmanned ground vehicles. Based on six aspects including environment perception, communication command, behavioural decision-making, human-computer interaction, weapon system and mobile platform, a new evaluation indicator system is established. In the quantitative process of qualitative indicators, Z-number theory is introduced to better describe the uncertainty degree of judgment and reasoning in human’s understanding of complex things. In order to make the indicator weights more scientific, the combined weighting model with analytic hierarchy process and information entropy is adopted for weight analysis, which not only takes into account the influence of evaluation experts on weights, but also reduces the subjective arbitrariness of weights. The least-squares grey relational analysis method is used to analyse the correlation between the comparison series and the reference series, and a comprehensive quantitative evaluation result of the unmanned ground vehicles is obtained. The evaluation examples of unmanned ground vehicles show that the proposed evaluation system can quantitatively evaluate the overall technical performance of unmanned ground vehicles. This evaluation system has high reference value for the evaluation of other complex weapons.

Flutter suppression of blade section based on model prediction control

Flutter suppression of wind turbine blade section based on two types of model prediction control (MPC) algorithms is investigated. The pre-twist blade, exhibiting displacements of flap-wise bending and lead-lag bending, employs 2D airfoil analysis method, and is subjected to destructive divergent instability displacements. Dynamic modelling of two-dimensional (2D) blade section is based on data analysis characterized by data fitting. The MPC methods including standard MPC and terminal-weight MPC are used to realize flutter suppression for divergent instability. Vibration control and control effects of terminal-weight MPC on divergent instability are analyzed in detail, with different parameters of prediction horizon and control horizon discussed. The superiority of terminal-weight MPC can be apparently demonstrated by comparison of standard MPC and sliding mode control with disturbance observer (SMCDO). The feasibility of hardware implementation of MPC algorithm is discussed by human-computer interaction platform. The performance improvement method of the terminal-weight MPC based on offset control has been refined from the point of view of practical application, with its remarkable effect compared with the original terminal-weight MPC.

Three-dimension Point Cloud Technology and Intelligent Extraction of Trace Evidence at the Scene of Crime

Three-dimensional (3D) point cloud technology is a kind of high-tech for the extraction of trace evidence from crime scenes. It is also an artificial intelligence technology for criminal justice investigation and diagnosis with great development prospects. It is one of the frontier issues in the field of criminal science and technology research. The purpose of this paper is to explore and analyze how to use 3D point cloud technology to extract trace evidence of crime scenes on the basis of understanding 3D point cloud technology, and to discuss the intelligent features of 3D point cloud trace evidence extraction. The principle and characteristics of 3D point cloud technology are introduced and described by the method of comparison and example. According to the technical characteristics of laser scanning, the methods and steps of extracting trace evidence from crime scenes are designed, and the overall workflow is given. This paper analyzes the intellectualization of 3D point cloud technology for trace evidence extraction from the perspective of the fusion of technology and perception, and draws some conclusions through simple practical description. Research shows, trace evidence extraction based on 3D point cloud technology is the full embodiment of digitalization and intellectualization of crime scene investigation. Doing a good job in information collection, data sample database construction, human-computer interaction platform design, and the data and knowledge of crime scene diagnosis experience are the basis for the development of this intelligent technology. In addition, with the different characteristics of different crime scenes, the improvement and innovation of the 3D laser scanning method is also an important work in the future.

Intelligent employment rate prediction model based on a neural computing framework and human–computer interaction platform

An intelligent employment rate prediction model based on a neural computing framework and human–computer interaction platform is demonstrated in this manuscript. Predictive analytics is the future of things, and its significance is manifested in two main aspects: understanding the future so that people can prepare for its arrival, and predicting the current decision so that people can understand the possible consequences, and by the consequences of the analysis to determine the current decision, and strive to make the current decision. However, there are lots of challenges for the prediction tasks. The novelty of this research is mainly concentrated on two major aspects: (1) the neural network model is optimized and enhanced. The proposed nerve tree network model is essentially based on a tree-structured code for a multi-layered feed-forward sparse neural network; with the tree-structured code, the nerve tree network model does not require interconversion between its genotype and phenotype in the coding and decoding operations, and also effectively reduces the computing time. (2) The human–computer interaction is integrated to construct a user-friendly system. In interactive technology, the interactive contact surface and the model, interactive methods and social acceptance have also given rise to many questions that must be solved and problems that require further research and technological innovation. Through numerical verification, the performance of the proposed framework is validated, and the simulation proves the overall performance of the proposed model. Compared with other models, the proposed algorithms can achieve higher prediction accuracy.

IoT Avatars: Mixed Reality Hybrid Objects for CoRe Ambient Intelligent Environments

The Internet of Things (IoT) continues its growth, adoption, toward ubiquitous usage but is not without the inevitable communication bandwidth challenge. Human-computer-interaction in this space must account for the multiple facets of human-in-the-loop considerations in IoT, yet current mechanisms are at present limited by display dimensions and unclear indicators. Mixed Reality (MR) may be a solution to this human communication bandwidth problem, as smart glasses and other head mounted displays could provide an ideal interface platform for IoT human-computer interaction, while handheld mobile MR can be used as a testbed. To bring MR interfaces to the IoT, this work contributes; i) a new IoT-Avatar architectural framework; ii) a bi-directional communication approach between an IoT system and a virtual avatar character representation; and iii) an early descriptive exploration of how such systems could be explored in future applications toward MR interfaces in ambient intelligent environments.

Development of digital control system for medium frequency induction furnaces

Traditional medium frequency induction furnace usually adopts analog circuit, which use the theory of PLL to synchronize the drive signal with the induced current signal, so that the upper and lower devices of each phase leg could be gated simultaneously Besides, some problems appear subsequently such as matching debugging difficulty and high failure rate. This paper describes the effect of the burden on the resonant electromagnetic field and resonant frequency through theoretical analysis and magnet field simulation. Based on this, a control and monitoring system designed by digital passive trigger architecture is proposed, phase locking of which is performed according to the frequency of the system itself, fully ensuring that the thyristor will not be simultaneous. In order to improve the stability of the system, this paper optimizes the inverter output control process. At the same time, a friendly human-computer interaction platform is designed, which can achieve distributed data mining, and improve the quality of the product and find the common problems in the product. Finally, the reliability of the control system is verified by experiments.

Real-Time Assessment of the Cross-Task Mental Workload Using Physiological Measures During Anomaly Detection

The ability to detect anomalies in perceived stimuli is critical to a broad range of practical and applied activities involving human operators. In this paper, we propose a real-time physiological-based system to assess the cross-task mental workload during anomaly detection. Forty participants were recruited to detect anomalous images from a set of different distracting images (Task I) and abnormal activities from surveillance videos (Task II). In Task I, the task difficulty levels were manipulated by changing the number of anomalies/distracting stimuli (15, 21, 28, or 36) with and without time constraints (i.e., 4 × 2 = 8 task difficulty levels). Physiological and behavioral data from four task difficulty levels were divided into four categories according to subjective ratings of the mental workload. The support vector machine (SVM) classifiers were trained on these data to predict the mental workload categories of: 1) the same four task difficulty levels (within level); and 2) the other four task difficulty levels in Task I (cross level). Within-level classifications (with an average of 95.29%) were more accurate than cross-level classifications (average of 72.2%), which were much more accurate than random level classifications (25%). In Task II, the same participants monitored one, two, or four video clips simultaneously in accordance with three task difficulty levels. The same physiological signals were processed for real-time recognition of a participant's mental workload after he or she completed each activity detection task. The three-class SVM classifiers were trained on physiological data from Task I to predict the mental workload categories of the Task II (cross task), achieving an overall classification accuracy of 53.83%, compared to a 33.33% accuracy at random. These results are discussed in terms of their implications for developing situation-aware recognition systems of the mental workload and adaptive human-computer interaction platforms.

Integrated 3D display and imaging using dual purpose passive screen and head-mounted projectors and camera.

We propose an integrated 3D display and imaging system using a head-mounted device and a special dual-purpose passive screen that can simultaneously facilitate 3D display and imaging. The screen is mainly composed of two optical layers, the first layer is a projection surface, which are the finely patterned retro-reflective microspheres that provide high optical gain when illuminated with head-mounted projectors. The second layer is an imaging surface made up of an array of curved mirrors, which form the perspective views of the scene captured by a head-mounted camera. The display and imaging operation are separated by performing polarization multiplexing. The demonstrated prototype system consists of a head-worn unit having a pair of 15 lumen pico-projectors and a 24MP camera, and an in-house designed and fabricated 30cm × 24cm screen. The screen provides bright display using 25% filled retro-reflective microspheres and 20 different perspective views of the user/scene using 5 × 4 array of convex mirrors. The real-time implementation is demonstrated by displaying stereo-3D content providing high brightness (up to 240 cd/m2) and low crosstalk (<4%), while 3D image capture is demonstrated by performing the computational reconstruction of the discrete free-viewpoint stereo pair displayed on a desktop or virtual reality display. Furthermore, the capture quality is determined by measuring the imaging MTF of the captured views and the capture light efficiency is calculated by considering the loss in transmitted light at each interface. Further developments in microfabrication and computational optics can present the proposed system as a unique mobile platform for immersive human-computer interaction of the future.

Research on Interactive Design of Temperature Control System for Magnesium Alloy Melting Furnace Based on PLC

Based on the analysis of the whole system of magnesium alloy melting furnace, the functional requirements of the temperature control system are clarified. Based on the analysis of the melting process of magnesium alloy, the thermal stress situation in the heating furnace temperature rise period is analyzed by means of analysis of heat transfer simulation, the reasonable heating rate and magnesium melt temperature variation are determined. The method of control strategy based on PLC algorithm and multipoint temperature measuring are put forward to solve the temperature control system of magnesium melt temperature fluctuation in improper rate control and continuous casting. A set of control system based on PC and PLC is designed according to the functional requirements of magnesium alloy furnace temperature control system. The system uses PLC as the main control unit to realize the automatic heating control and data acquisition. At the same time, PC is taken as a human-computer interaction platform, and VB6.0 is used to develop computer monitoring software to realize on-line control of upper computer and lower computer and centralized control of the whole control system, which simplifies the operation, reduces the failure rate of the equipment, improve the work efficiency and the accuracy and flexibility of the system. The hardware configuration and software design of temperature control system for magnesium alloy melting furnace is completed, the temperature control system performance is tested, and the feasibility of heating system and the rationality that based on the duty ratio of hybrid control of output control and PID control are verified. According to the experimental results, the experimental system of magnesium alloy melting furnace is established, and the temperature control experiment is carried out. The experimental results show that the temperature control system achieves the expected control objectives.

A novel medical human-computer interaction platform based on Kinect depth image analysis refactoring and neural network

The high level of progress in science and technology has escalated the use of medical surgical products, equipped the modern medical operating room with all kinds of high-tech digital and intelligent development and these new technologies have introduced the traditional surgeons to new types of surgeries and helped them become more sensitive to changes in the body. More and more state-of-the-art technologies have been proposed to assist the doctors to optimise the operation environment. It is the purpose of the man-machine interface design to make the computer more intelligent so that it can do a wider range of work. For better capturing the gesture and inner information based on Kinect, we revise the traditional methodologies on depth image analysis refactoring and neural network to construct a new systematic implementation paradigm. The experiment shows that our idea outperforms the other latest methodologies.

A novel medical human-computer interaction platform based on Kinect depth image analysis refactoring and neural network

The high level of progress in science and technology has escalated the use of medical surgical products, equipped the modern medical operating room with all kinds of high-tech digital and intelligent development and these new technologies have introduced the traditional surgeons to new types of surgeries and helped them become more sensitive to changes in the body. More and more state-of-the-art technologies have been proposed to assist the doctors to optimise the operation environment. It is the purpose of the man-machine interface design to make the computer more intelligent so that it can do a wider range of work. For better capturing the gesture and inner information based on Kinect, we revise the traditional methodologies on depth image analysis refactoring and neural network to construct a new systematic implementation paradigm. The experiment shows that our idea outperforms the other latest methodologies.

Win CE and ZigBee Wireless Sensor Network-Based Design

Building supporting technologies of wireless sensor network system, the data acquisition network scenarios, Win CE and ZigBee technology, design a typical multi-level network model to achieve the CC2430 chip integrated positioning enginewireless communications, applications, short-range multi-network node microprocessor WinCE operating system the center gateway human-computer interaction platform to connect to the public network via broadband and the public telephone network, the use of serial wireless communication terminal acquisition part and gateway platformdata transmission, to achieve environmental monitoring, centralized management of data sent and comprehensive information.

A Novel HCI Platform for Power Control System

In this paper we present a novel HCI (human-computer interaction) system and develop a prototype based on the characteristics of the power control system. This system includes multi-touch input module, laser pointer input module and arc projection-based tiled display module. Users can use their fingers, gestures and laser pointers to control the multi-touch platform; they can also use laser pointers to control the arc projection display system and see the feedback results through the multi-touch projection display and arc projection display. The system can make the power control system more effective and convenient because of its natural and comfortable interaction mode as well as its multi-user feature.

Interactive System based on Augmented Reality and Anomalous Screens and Implementation

This paper proposes and implements a novel multi-users real time Human-Computer Interaction (HCI) platform and system based on augmented reality (AR). The platform uses AR and multianomalous screens for exhibition. We focus on research and applications of multi-user real time HCI technique. Platform of AR rendering, HCI and network communications are designed and implemented. The system has been used at the EXPO 2010.