Opening Gesture Research Articles

The Impact of Nonverbal Communication on Effective Public Speaking in English

Nonverbal communication (NVC) plays a crucial role in effective public speaking, particularly for English language learners (ELLs) who may face unique challenges in navigating both linguistic and cultural aspects of communication. This study is carried out through a literature review method, following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, to examine the impact of NVC on public speaking among ELLs in higher education settings, and synthesize findings from diverse studies. The review reveals that effective use of NVC significantly enhances perceived credibility, audience engagement, and message clarity for ELLs. Specific nonverbal behaviors, such as maintaining eye contact, using open gestures, and adopting a confident posture, are associated with increased speaker effectiveness. Additionally, the literature highlights the importance of cultural sensitivity in NVC instruction, as nonverbal cues can carry different meanings across cultures. The findings underscore the need for explicit instruction in NVC strategies within English language curricula, emphasizing cultural responsiveness and creating inclusive learning environments that empower ELLs to become confident and effective communicators. This review contributes to the growing body of research on NVC in educational contexts and offers practical implications for English language educators seeking to enhance their students' public speaking skills.

ARIAS: An AR-based interactive advertising system.

In this paper, we present an interactive advertising system based on augmented reality(AR) called ARIAS, which is manipulated with gestures for displaying advertising videos. Two-dimensional markers are defined in the system. The system captures the frame data through the camera in real time, uses OpenCV library to identify the predefined markers, and calculates the pose of markers captured by the camera. With OpenGL library, a virtual cubic model is created at the position of the marker, and thus videos or images are displayed on the six faces of the cube. The virtual cube, together with the original frame data collected by the camera, is displayed in the interactive window to achieve the augmented reality effect. Customers are accessible to various advertising content by observing the marker from different positions. The system, meanwhile, supports gesture operation in order to make the customers pay attention to the content they are interested in with one hand. The MediaPipe Hand framework is used to extract the landmarks of hands, based on which, a series of gestures are designed for interactive operation. The efficiency and accuracy of the system are tested and analyzed with the result, indicating that the system has high reliability and good interactiveness. This system is open at https://github.com/wanzhuxie/ARIAS/tree/PLOS-ONE.

FMASketch: Freehand Mid-Air Sketching in AR

Sketching is a common way to depict design ideas freely. Augmented reality technology extends the human–computer interaction space from the screen to the real world, providing a new application space for 3D sketching. However, due to the difficulty of depth perception, it is difficult for sketching strokes to maintain good planar and spatial consistency, making drawing 3D sketches in AR challenging. In this article, we propose FMASketch—a method of drawing mid-air sketches similar to building blocks. The auxiliary surfaces can ensure that the strokes drawn by users can always stay on the same plane as drawing in 2D space. Gestures are used to stitch together multiple drawing planes, and the strokes on the planes form a 3D sketch, which is very similar to how 3D modeling is done on the desktop by drawing different views and assembling them. Experiments have verified the effectiveness of the auxiliary surface generation method and gesture operations in this article. The mid-air sketching method is easy to learn and provides a new idea for rapid modeling in AR scenarios.

Operability of pointing task by gesture operation

Operability of pointing task by gesture operation

RESEARCH ON SHORT FORMAT VIDEO APPLICATION DESIGN STRATEGY BASED ON USER EXPERIENCE AND EMOTION REGULATION

BackgroundWith the rapid development of smart phones, the platform for people to obtain information and resources has shifted from traditional media carriers to smart phones and smart devices. Short video applications are favored by all users and capital, and the number of users, industry scale and social influence are increasing. Under the background of covid-19, the application of short format video has received unprecedented attention and influence. At present, short videos have gone beyond “watching” and added links with user experience, user psychology, consumer behavior and other factors. This paper attempts to analyze the development status of China's short video industry from the perspective of user experience and user psychology, and study the types of short video under different operating conditions, the differences of user experience and user psychology, and the changes of interactive thinking., Especially in the aspect of emotional behavior, it puts forward effective design strategies for the application industry.Research Objects and MethodsThis study compares and analyzes the visual interface, gesture operation and interaction mode of typical short video applications (taking Tiktok, Kwai and wechat account as examples) from three aspects: interface visual perception, interactive behavior perception and psychological experience. Through the comparative study of three short video application products, this paper analyzes the similarities and differences, advantages and disadvantages of Tiktok, fast and wechat channel functions, and summarizes the user experience and interaction design strategies of these short video applications. The questionnaire data collected 234 short video users through the online questionnaire in January 2022. The content is the questionnaire survey of “current situation of short video application”, which mainly analyzes the zero order correlation and covariance analysis between psychological duration. Personal users accept short format video and user experience problems. The use of emotional micro behavior in various countries and regions was investigated by questionnaire. The gross John Emotion Regulation Questionnaire (ERQ), a measurement tool of this study, has 10 items, which are divided into two factors: cognitive reappraisal and expression inhibition. Each item is scored with 7 points (1 = very non-conforming; 2 = relatively non-conforming; 3 = slightly non-conforming; 4 = uncertain; 5 = slightly conforming; 6 = relatively conforming; 7 = very conforming). The higher the score, the higher the tendency.ResultsThrough the comparative study of three short video application products and user questionnaire survey results, it is concluded that there are differences in user experience attention, short video duration and psychological demand motivation among different ages. Compared with ordinary users, older users have a shorter time span to buy videos. They found that they spend more time on live video formats than ordinary users.ConclusionShort video application should fully integrate user experience, user psychology and interaction mode, with the goal of improving interaction experience, interface diversification and personalized design. Meet the needs of different groups of users, optimize the user experience, tap the potential needs of users, increase user stickiness, and enhance the value and competitiveness of short video applications.AcknowledgementsFunded by College of Chinese & ASEAN Arts, Chengdu University, the major scientific research achievements.

Comparison of Data Classification Results for Leap Motion Recovery Gestures.

Static and dynamic gestures are frequently used in activities supporting learning, recovery healthcare, engineering, and 3D games to increase the interactivity between man and machine. The gestures are detected via hardware devices and data is processed using different software methods. This paper presents the manner of detection and interpretation of two gestures, a hand rotation gesture and a palm closing and opening gesture, using the Leap Motion device. These two dynamic gestures are very often used in hand recovery exercises. For comparing the two gestures we use data classification methods, Support Vector Machine (SVM) and Multilayer Perceptron (MLP). The data for the gesture classification were 80% training data and 20% testing data. The metrics for comparison are precision, recall, F1-score, and the total number of testing cases (support). The SVM classifier gives an accuracy of 99.4% and the MLP classifier a 96.2%. We built two confusion matrices for better visualizing the results.

Classification of Electromyography Signal with Machine Learning

The problem of classifying electromyography signals in each gesture occurs due to the use of a constant level of signal amplitude. This research presents an efficiency enhancement of electromyography signal classification in each gesture with machine learning. The performance efficiency of 5 models: SVM, RF, MLP, KNN, and Deep Leaning was compared. The signals were recorded by a low-cost signal sensor. Fist clenching and hand opening gestures were alternately performed every 5 second for 5 times each. Therefore, the total was 4,767 records divided into 3,274 records of hand opening gesture, 1,492 records of fist clenching gesture and 4,833 records of wrist rotating gesture. The results showed that the MLP model was found to have the highest accuracy at 81.45% for fist clenching and hand opening gestures. The Deep Learning model was found to have the highest accuracy at 89.03% for wrist rotating and hand opening gestures.

Development and clinical evaluation of a contactless operating interface for three-dimensional image-guided navigation for endovascular neurosurgery.

PurposeIn endovascular neurosurgery, the operator often acquires three-dimensional (3D) images of the cerebral vessels. Although workstation reoperation is required in some situations during treatment, it leads to time loss because a sterile condition cannot be maintained and treatment must be temporarily interrupted. Therefore, a workstation reoperating system is required while maintaining the desired sterility.MethodsA contactless operating interface using Kinect to control 3D images was developed via gesture recognition for endovascular neurosurgery and was applied to a 3D volume rendering technique (VRT) image reconstructed at the workstation. The left-hand movement determines the assigned functions, whereas the right-hand movement is used like a computer mouse to pan and zoom in/out. In addition to the interface, voice commands were used and assigned to digital operations, such as image view changes and mode signal changes.ResultsThis system was used for the actual endovascular treatment of cerebral aneurysms and cerebral arteriovenous malformations. The operator and gesture were recognized without any problems. Using voice operation, it was possible to expeditiously set the VRT image back to the reference angle. Furthermore, it was possible to finely adjust gesture operations, including mouse operation, and treatment was completed while maintaining sterile conditions.ConclusionA contactless operating interface was developed by combining the existing workstation system with Kinect and voice recognition software, allowing surgeons to perform a series of operations, which are normally performed in a console room, while maintaining sterile conditions.Supplementary InformationThe online version contains supplementary material available at 10.1007/s11548-021-02330-3.

Research on FUI Style Design of Big Data Information Visualization

The purpose of the article is as follows, studying the FUI style of the interface for big data information visualization design among various styles of visualization interface in the 21st century. There are three research methods in this paper. Firstly, combing the concept of FUI and summarizing the design features of FUI style interface of big data information visualization from the perspective of design psychology. Secondly, the characteristics of government business big data information visualization and the needs of users are analyzed. Finally, the FUI design style is used in the government business big data information visualization display interface design. The FUI style presentation mode of big data information visualization and the dynamic interaction mode of FUI style interface are discussed. The conclusion is as follows, FUI is more in line with the people's psychological expectation of "future technology visual style" in big data information visualization display, highlighting the FUI data display focus on the prediction function of future events; FUI achieves visual balance through reasonable typesetting, comfortable color matching, uniform decorative shapes, etc. In terms of visual display, it not only meets the requirements of data display design, but also achieves the visual unity of partial data display design and overall data display. FUI mostly adopts flat design and simple dynamic interaction design, which conforms to users' gesture operation and people's visual browsing behavior habits in the era of mobile Internet, and meanwhile improves the utilization rate of single screen display of government departments.

SEMG-Based Neural Network Prediction Model Selection of Gesture Fatigue and Dataset Optimization.

The fatigue energy consumption of independent gestures can be obtained by calculating the power spectrum of surface electromyography (sEMG) signals. The existing research studies focus on the fatigue of independent gestures, while the research studies on integrated gestures are few. However, the actual gesture operation mode is usually integrated by multiple independent gestures, so the fatigue degree of integrated gestures can be predicted by training neural network of independent gestures. Three natural gestures including browsing information, playing games, and typing are divided into nine independent gestures in this paper, and the predicted model is established and trained by calculating the energy consumption of independent gestures. The artificial neural networks (ANNs) including backpropagation (BP) neural network, recurrent neural network (RNN), and long short-term memory (LSTM) are used to predict the fatigue of gesture. The support vector machine (SVM) is used to assist verification. Mean square error (MSE), root mean square error (RMSE), and mean absolute error (MAE) are utilized to evaluate the optimal prediction model. Furthermore, the different datasets of the processed sEMG signal and its decomposed wavelet coefficients are trained, respectively, and the changes of error functions of them are compared. The experimental results show that LSTM model is more suitable for gesture fatigue prediction. The processed sEMG signals are appropriate for using as the training set the fatigue degree of one-handed gesture. It is better to use wavelet decomposition coefficients as datasets to predict the high-dimensional sEMG signals of two-handed gestures. The experimental results can be applied to predict the fatigue degree of complex human-machine interactive gestures, help to avoid unreasonable gestures, and improve the user's interactive experience.

Contactless interactive control technology based on switching filtering algorithm

In the large-screen interactive system with lidar sensor, due to the low accuracy of the lidar and the instability of the users’ gestures, the system’s recognition and tracking of gesture coordinates cannot be well obtained. Aiming at solving the problems of swaying and drifting gestures of the traditional filtering algorithm with a lidar sensor, this paper proposes a contactless interaction control technology based on switching filtering algorithm, which can realize non-contact high-precision multi-point interaction. The proposed algorithm first recognizes and extracts users’ gestures, and then the gestures are mapped to the screen position. Also, the mouse operation is simulated to realize operations such as selecting, sliding, and zooming in and out. Besides, the algorithm can effectively solve jitter and drift problems caused by scanning defects of radar and instability of the user gesture operations. Experimental results show that by applying the switching filtering algorithm to the contactless human-computer interaction system, the interactive trajectory becomes smoother and more stable compared with the traditional filtering algorithms. The proposed algorithm exhibits excellent accuracy and real-time performance, supporting efficient interaction with multiple people.

The Semantic Meaning of Hand Shapes and Z-Dimension Movements of Freehand Distal Pointing on Large Displays

It is difficult to select small targets in freehand distal pointing on large displays due to physical fatigue and jitter. Previous research proposed many solutions but not through the semantic meaning of hand behaviors. The purpose of this study is to investigate the hand behaviors, including hand shapes and motions in the Z-dimension between small and large target selections, by means of two controlled experiments. The generated results indicated that the following: (1) when interacting with a large display from a remote distance, users preferred to complete a low-precision task by the whole hand while using the finger in high-precision tasks. As a result, users moved small targets by the index finger gesture while moving large targets by open hand gesture; (2) selection of small targets led to hand stretching which might reduce the interaction distance; (3) the orientation had significant effects on hand motions in the Z-dimension. The relationship between orientation and hand motions in the Z-dimension is similar to a sinusoidal function; (4) mouse-like pointing had much impact on freehand interaction. Based on these results, some design guidelines for freehand interaction and design suggestions for freehand pointing were discussed.

Designs of Interactive Sound Systems for the Visually Impaired to Enjoy Digital Art by Recognition of Hand Gestures

Somatosensory interaction is a kind of man-machine interfacing technique for information acquisition through human postures, which are widely used in digital art nowadays. To create opportunities for the visually impaired to enjoy digital art, two sound art systems named Dynamic Sound and Concrete Sound, which are based on somatosensory technology, were designed in this study for the visually impaired to appreciate with pleasure. The former system emphasizes resonances between humans and sound, allowing the visually impaired user to trigger different sounds by hand gestures which promote the user’s physio-pleasure and ideo-pleasure. The latter system, also being controlled by hand gestures, combines sounds with three-state physical phenomena as feedbacks which are explained orally by an accompanying person to the visually impaired user, creating an inter-person communication that promotes the user’s socio-pleasure. By public exhibitions, users’ feedbacks were acquired via interviews, and evaluated to prove the effectiveness of the proposed systems with the following findings: 1) interactions by hand gestures offers the visually impaired with opportunities to enjoy digital art; 2) sound art provided by the systems allows the visually impaired to gain pleasure via man-machine interactions; 3) the systems innovatively integrate dynamic visual performances with auditory feedbacks in the interaction process; and 4) through the development of gesture operations, more performance techniques can be devised for sound art, allowing gesture motions to replace control interfaces in future designs.

Operability Evaluation System and Comparison Experiment of Gesture Operation and Button Operation of Robot Manipulator

Robot manipulators are now widely used in manufacturing industries. When programmed to perform required movements via a process called teaching, they can accomplish a wide variety of complex tasks. In conventional teaching processes, a teaching pendant (TP), which is a tethered controller with which the operator inputs specific movement commands, is used. However, such devices normally have so many buttons that operators often experience difficulty in programming operations intuitively, so the teaching process consumes significant amounts of time and effort. To solve this problem, intuitive operation methods in which human body motions (such as hand gestures) are used as input to the robot have been studied. However, no quantitative comparisons between those new gesture-based and conventional teaching methods have yet been made. With that point in mind, the present paper proposes a virtual space-based evaluation system in which operators control the position and orientation of a six-degree-of-freedom virtual robot hand in order to evaluate and compare TP- and gesture-based operation methods. The experimental results show that when compared to TP-based methods, gesture-based operation methods achieved higher evaluations in terms of time and psychological aspects. In addition, four types of gesture-based operating methods were proposed in order to consider different ways in which position changes and orientation changes could be handled. The operability levels of the four gesture types were also compared quantitatively using the proposed evaluation system, and the obtained experimental results suggest that such differences can affect the cognitive burden imposed on the operator.

Wireless Head Gesture Controlled Robotic Wheel Chair for Physically Disable Persons

A robotic wheelchair is assumed to be capable of doing tasks like navigation, obstacle detection, etc. using sensors and intelligence. The initial part of the work was development of a cap controlled wheelchair to test and verify the gesture operation. Following that, a real time operating wheelchair was developed consisting of mode changing option between joystick control mode and head gesture control mode as per as the user’s requirement. The wheelchair consists of MPU6050 sensor, joystick module, RF module, battery, dc motor, toggle switch and Arduino. The movement of the head is detected by MPU6050 and the signal is transmitted to the microcontroller. Then the signal is processed by controller and motion of wheelchair is enabled for navigation. The wheelchair was capable of moving left, right, forward and backward direction. The speed of the wheelchair was 4.8 km/h when tested. Design objective of the wheelchair included cost effectiveness without compromising safety, flexibility and mobility for the users.

Mechanical arm teleoperation control system by dynamic hand gesture recognition based on kinect device

The research achieved to control the mechanical arm by using real-time dynamic gesture recognition based on Kinect. It uses the unmarked gesture segmentation algorithm based on the palm neighbourhood and the threshold detection algorithm based on the palmar contour to identify the operator's gestures and moving trajectories, and to convert it into the specific action of the mechanical arm. Through wireless network, this system sends control instructions to the mechanical arm to realise teleoperation control. The system also provides video feedback of mechanical arm operation site. It improves the teleoperation telepresence and interactivity and avoids operation error such as grasp nothing or fall. The results of the experiment indicate that the operation of the gesture control system is simple and easy, the response of mechanical arm is quick and accurate and the human–machine interaction is intuitive and friendly.

Recognition Characteristics of Interface Designed for Gesture Operations of 3D Objects

Recognition Characteristics of Interface Designed for Gesture Operations of 3D Objects

Research on Battlefield Situation Display Based on Mixed Reality Technology

Aiming at the problem that the current combat command and control system adopts the two-dimensional information display method, which is not intuitive and easy to overlap, and limits the decision potential of the operator, a method of applying hybrid display technology to battlefield command decision is proposed. By analyzing the application characteristics of mixed reality technology in situation display and command control, using 3D Max, Unity to create virtual models and space environment, writing control scripts such as gaze control and gesture operation under VS2017 platform, and implementing applications based on Hololens mixed reality helmet. The battlefield situation display effect of projecting the holographic image onto the real world surface and the command and control mode of the operator interacting with the holographic image in various forms are realized, which proves the possibility that the future mixed reality technology is applied to actual combat command.

Introduction: The Religious Structure of Phenomena—A Phenomenological Investigation

Introduction: The Religious Structure of Phenomena—A Phenomenological Investigation

György Kurtág, Samuel Beckett: Fin de partie – scènes et monologues, opéra en un acte.

Beckett's 1976 poem ‘Roundelay’ is sung as a Prologue to Kurtág's opera, Samuel Beckett: Fin de partie – scènes et monologues, opéra en un acte, which was premiered at La Scala, Milan, on 15 November 2018. As an opening gesture it recalls Duke Bluebeard's Castle, in which a spoken Prologue enigmatically conjures a world of fairy-tale that simultaneously reveals a psycho-drama (where is the stage? outside or inside?). ‘Roundelay’ is yet more enigmatic but similarly prescient: we are entering a time-space in which the sound of words is as important as their meaning, and where lonely characters attempt to cope with their sense of imminent end, mysteriously near and yet also bafflingly unreachable. The voice itself is also prophetic, sung as it is by the opera's only female character, Nell, who in Pierre Audi's production is only partly visible, illuminated as if a ghost in a spot of light amid the darkness, hovering well above the stage. There is a normatively bleak perspective on gender at play throughout: Nell's other-worldliness and incongruous melodiousness here anticipate her barely acknowledged death and the consequent obliteration of love.