Touch Technology Research Articles

3D-ElectroZip touch: multi-directional haptic feedback with electro-ribbon zipping actuators

This paper introduces the 3D-ElectroZip Touch, a multi-directional force feedback device developed using dielectrophoretic liquid zipping actuation. The device is designed to stimulate the sense of normal and shear forces by moving in vertical and multiple horizontal directions. Its performance, including displacement, force, and actuation time has been characterized under input voltages from 6 kV to 9 kV, demonstrating a displacement range of 5–11 mm, force range of 0.05 N to 0.22 N, power output ranges from 0.08 W to 0.077 W, and maximum energy efficiency of 72%. The 3D-ElectroZip Touch shows a quick response to the input signal, moving its contact panel by 1.1 mm in 70 ms (36.5% of human reaction time) at 9 kV. Comparing its basic characteristics with the skin sensitivity and the lightweight, compliance, and scalability of the 3D-ElectroZip Touch technology show its high potential to be exploited in tactile displays and wearable haptic feedback devices.

Boosting flexible electronics with integration of two‐dimensional materials

AbstractFlexible electronics has emerged as a continuously growing field of study. Two‐dimensional (2D) materials often act as conductors and electrodes in electronic devices, holding significant promise in the design of high‐performance, flexible electronics. Numerous studies have focused on harnessing the potential of these materials for the development of such devices. However, to date, the incorporation of 2D materials in flexible electronics has rarely been summarized or reviewed. Consequently, there is an urgent need to develop comprehensive reviews for rapid updates on this evolving landscape. This review covers progress in complex material architectures based on 2D materials, including interfaces, heterostructures, and 2D/polymer composites. Additionally, it explores flexible and wearable energy storage and conversion, display and touch technologies, and biomedical applications, together with integrated design solutions. Although the pursuit of high‐performance and high‐sensitivity instruments remains a primary objective, the integrated design of flexible electronics with 2D materials also warrants consideration. By combining multiple functionalities into a singular device, augmented by machine learning and algorithms, we can potentially surpass the performance of existing wearable technologies. Finally, we briefly discuss the future trajectory of this burgeoning field. This review discusses the recent advancements in flexible sensors made from 2D materials and their applications in integrated architecture and device design.

Thelxinoë: Recognizing Human Emotions Using Pupillometry and Machine Learning

In this study, we present a method for emotion recognition in Virtual Reality (VR) using pupillometry. We analyze pupil diameter responses to both visual and auditory stimuli via a VR headset and focus on extracting key features in the time-domain, frequency-domain, and time-frequency domain from VR-generated data. Our approach utilizes feature selection to identify the most impactful features using Maximum Relevance Minimum Redundancy (mRMR). By applying a Gradient Boosting model, an ensemble learning technique using stacked decision trees, we achieve an accuracy of 98.8% with feature engineering, compared to 84.9% without it. This research contributes significantly to the Thelxinoë framework, aiming to enhance VR experiences by integrating multiple sensor data for realistic and emotionally resonant touch interactions. Our findings open new avenues for developing more immersive and interactive VR environments, paving the way for future advancements in virtual touch technology.

Touch Technology in Affective Human–, Robot–, and Virtual–Human Interactions: A Survey

Given the importance of affective touch in human interactions, technology designers are increasingly attempting to bring this modality to the core of interactive technology. Advances in haptics and touch-sensing technology have been critical to fostering interest in this area. In this survey, we review how affective touch is investigated to enhance and support the human experience with or through technology. We explore this question across three different research areas to highlight their epistemology, main findings, and the challenges that persist. First, we review affective touch technology through the human–computer interaction literature to understand how it has been applied to the mediation of human–human interaction and its roles in other human interactions particularly with oneself, augmented objects/media, and affect-aware devices. We further highlight the datasets and methods that have been investigated for automatic detection and interpretation of affective touch in this area. In addition, we discuss the modalities of affective touch expressions in both humans and technology in these interactions. Second, we separately review how affective touch has been explored in human–robot and real-human–virtual-human interactions where the technical challenges encountered and the types of experience aimed at are different. We conclude with a discussion of the gaps and challenges that emerge from the review to steer research in directions that are critical for advancing affective touch technology and recognition systems. In our discussion, we also raise ethical issues that should be considered for responsible innovation in this growing area.

Tinkering with social touch technology

Tinkering with social touch technology

Retracted: Application of Composite Nanomaterials in the Teaching of Piano Touch Technology and Timbre Expressiveness

Retracted: Application of Composite Nanomaterials in the Teaching of Piano Touch Technology and Timbre Expressiveness

Perceived ease of use on visual learning application for mathematics using holography display for the topic on shape and space

Background: A person's life is built on a solid foundation of mathematics. Common causes of learning difficulties in mathematics include abstract ideas, a lack of imagination, and a lack of comprehension of the concepts being studied. Because 3D shapes are abstract concepts, the aim of this study is to better understand how to recognize them in primary school students. Methods: The development of the Mathematics E-Learning Visual application MEL-VIS(MEL-VIS) application involves the design of the Visual Learning Application Iteration-Evolution Development Model, MEL-VIS (PIEMEL-VIS), the MEL-VIS ID Model, and the MEL-VIS Application Module. The development methodology and ID model are built based on the application of various components such as learning theory, a visualization approach, a play-while-learning approach based on scaffolding techniques, as well as interaction and interface based on various touch technologies using tablet computers. The study's contributions are: (i) an iterative-evolutionary development model of the Visual Learning Application, MEL-VIS (PIEMEL-VIS); (ii) a MEL-VIS ID model; (iii) a MEL-VIS application prototype; and (iv) a usability testing instrument for the ease of use of the MEL-VIS application. Results: The usability testing of the MEL-VIS application was carried out through a case study involving 80 students at a primary school in Putrajaya. A task-based, semi-experimental approach was used to assess the ease-of-use construct. Research instruments such as questionnaires and observation checklists are used in this test. The results of the study found that MEL-VIS has a positive impact on students after using the application. Conclusions: Based on the test conducted, primary school students have given positive feedback to the prototype of the E-Visual MEL-VIS application. Thus, it can be concluded that the prototype of the E-Visual MEL-VIS application as a whole is effective, easy to learn and easy to use for student use for primary school mathematics subjects.

39‐3: Pinhole Matrix Fingerprint on Display Technology for CFOT OLED Display

The emerging Color Filter on Touch (CFOT) technology significantly reduces OLED module transmittance and hence obstructs the use of traditional optical fingerprint on display (FOD). In this work, we demonstrate the integration of pinhole‐based FOD with CFOT OLED, achieving high performance FOD and display simultaneously.

31‐4: Sharp Force Touch for On‐Screen User Interface in LCD and Foldable OLED Display Application

We describe ultra‐high sensitive force sensor on flat display that can detect and differentiate between feather touch and press touch or tapping. The proposed unique sensor pattern design and pressure‐sensitive material enables ultra‐high force sensitivity, multi force detection (10 points). Our force touch technology with button‐shaped bumps cover enables blind input operations and usability as good as mechanical buttons. Therefore, our technology provides reduced input errors and yield more intuitive and safedrive. In addition, the proposed novel algorithm enables an operating temperature range for automotive applications.

Tactile Based Intelligence Touch Technology in IoT Configured WCN in B5G/6G-A Survey

Touch enabled sensation and actuation is expected to be one of the most promising, straightforward and important uses of the next generation communication networks. In B5G/6G need for low latency, the infrastructure should be reconfigurable and intelligent to be able to work in real time and interoperable with the existing wireless network. It has a drastic impact on the society due to its high precision, accuracy, reliability and efficiency and the ability to connect a user from far away or remote areas. Such a touch-enabled interaction is primarily concerned with the real time transmission of the tactile based haptic information over the internet, in addition to the usual audio, visual and data traffic, thus enabling a paradigm shift towards establishing a real time control and steering communication system. The existing system latency and overhead creates delays and limits the usability of the future applications. This study proposes an intelligent touch-enabled system for B5G/6G and IoT based wireless communication network that incorporates the AR/VR technologies. The tactile internet and network slicing serve as the backbone of the touch technology which incorporates intelligence from techniques such as AI/ML/DL. The survey introduces a layered and interfacing architecture complete with its E2E solution for the intelligent touch based wireless communication system. It is anticipated for the next generation system to provide numerous opportunities for various sectors utilizing AR/VR technology in robotics and healthcare facilities, all with the intention of helping in addressing severe problems faced by the society. Conclusively the article presents a few use cases concerning the deployment of touch infrastructure in automation and robotics as well as in intelligent healthcare systems, assisting in the diagnosis and treatment of the prevailing COVID-19 cases.

Cross-Sensor Fingerprint Enhancement Using Adversarial Learning and Edge Loss.

A fingerprint sensor interoperability problem, or a cross-sensor matching problem, occurs when one type of sensor is used for enrolment and a different type for matching. Fingerprints captured for the same person using various sensor technologies have various types of noises and artifacts. This problem motivated us to develop an algorithm that can enhance fingerprints captured using different types of sensors and touch technologies. Inspired by the success of deep learning in various computer vision tasks, we formulate this problem as an image-to-image transformation designed using a deep encoder–decoder model. It is trained using two learning frameworks, i.e., conventional learning and adversarial learning based on a conditional Generative Adversarial Network (cGAN) framework. Since different types of edges form the ridge patterns in fingerprints, we employed edge loss to train the model for effective fingerprint enhancement. The designed method was evaluated on fingerprints from two benchmark cross-sensor fingerprint datasets, i.e., MOLF and FingerPass. To assess the quality of enhanced fingerprints, we employed two standard metrics commonly used: NBIS Fingerprint Image Quality (NFIQ) and Structural Similarity Index Metric (SSIM). In addition, we proposed a metric named Fingerprint Quality Enhancement Index (FQEI) for comprehensive evaluation of fingerprint enhancement algorithms. Effective fingerprint quality enhancement results were achieved regardless of the sensor type used, where this issue was not investigated in the related literature before. The results indicate that the proposed method outperforms the state-of-the-art methods.

Sociotechnical imaginaries of remote personal touch before and during COVID-19: An analysis of UK newspapers

This article considers newspapers’ role in shaping the sociotechnical imaginaries of touch, and emerging technologies that digitally mediate touch. It examines the discourses of touch and personal relationships at a distance that circulated in major British broadsheet newspapers during the 2020 outbreak of coronavirus disease-19, alongside dominant narratives of touch and remote communication in the previous 5 years. In doing so, the article demonstrates how existing discourses of touch and remote communication intensified during the pandemic, while imaginations of remote touch narrowed. The sociotechnical imaginaries of digital touch matter because they illuminate the kinds of social relations touch technologies are perceived to forge, maintain or deny.

Shifting Design Perspectives: Touch, Co-Location, and Sharing Objects during the Pandemic

HCI research has explored a variety of technologies to support human-to-human touch by simulating or mediating the feeling of touch over distance. Restrictions in activities involving touch, close contact, and physical proximity due to the COVID-19 pandemic have made it more pertinent to understand and investigate the goals, opportunities, and limitations of technologically mediated touch. We conducted an exploratory interview study with 18 participants across the United States in April and June of 2021 to understand how the COVID-19 pandemic has changed people’s attitudes towards engaging in touch, being co-located, and sharing physical objects. We observed four themes: new efforts to evaluate safety, new preferences for physically co-locating without touch, technology solutions amplifying separation, and a newfound appreciation for human touch and touch-adjacent activities. These results suggest that future touch technologies may need to shift focus from simulating human touch convincingly to allowing for interactions that incorporate these emergent sensitivities to safety and preferences for physical co-location.

Application of Composite Nanomaterials in the Teaching of Piano Touch Technology and Timbre Expressiveness

The piano is a western musical instrument. The art of piano performance has made great progress in China. Education is essential for the inheritance and development of the arts, including the piano. Piano lessons play an important role in music education and are the foundation of music education. Teachers play a leading role in the learning process. The comprehensive quality of teachers, including ideological and moral accomplishment, cultural accomplishment, work level, teaching theory, and artistic aesthetic level, directly or indirectly affects the teaching level and the growth, learning, attitude, and concept of students. Through the research and experiment on the application of composite nanomaterials in the teaching of piano touch and timbre expressiveness, the experimental data showed that after the improvement of piano touch and timbre performance by nanomaterials, the students’ interest in the piano improvisational accompaniment course has greatly increased. There were 86 people who were interested, accounting for 86.13%. There were 13 people who were not interested and indifferent, accounting for 13.87%. Compared with the increase of 36 people who were interested before the improvement, the number of people, who were not interested and indifferent, was decreased by 36 people. From the abovementioned data, it can be seen that the application of nanomaterials in piano teaching, it has made an indispensable contribution to the development of piano teaching.

Heuristic Optimization of Multipulse Rectifier for Reduced Energy Consumption

Intelligent Manufacturing 5.0 of multipulse rectifier systems requires them to be optimized for a variety of use in transportation and factories producing hearty touch technology. The research presented in this article show advances of using heuristic models to set 12-pulse and 24-pulse rectifiers to work under low- and high-voltage load. As a result of heuristic optimization electric systems increase efficiency and reduce energy consumption by efficiency benefits in adopting artificial intelligence. Applied heuristic models helped in computer simulations to optimize system settings in a short time. Results show that optimized models are more efficient and our proposed approach is reducing voltage pulsation. As a result optimized system improves electromagnetic compatibility for beneficial use in modern industry and sensible human–machine cooperation.

Research on Embedded Detection System Based on Intelligent Pressure Transmitter

Abstract A new development scheme of check equipment for recoil device is designed. In view of the existing reverse recoil device check there is a long time to prepare, data interpretation and difficult problems, the application of advanced touch technology and sensor technology, completed the embedded test system scheme based on intelligent pressure transmitter design, can quickly test reverse recoil device to check the key parameters, and be able to compare the interpretation of data in real-time, Shorten the inspection time of recoil device and improve the accuracy of test data. The simulation research of the scheme design system is carried out in the computer of LINUX system. Through the simulation, it is found that each system module can work correctly and normally, with higher generality and artificial intelligence.

VOLT Valve: Applying the Frugal Innovation in a Green Touchless Low-Tech Solution

In their innovative development strategy, the third world countries should escape the sheep-like behaviour by following the same pathway as the developed western countries. Because they don’t have the same historical, geopolitical and social factors. There's a lot of truth behind Bruce Lee's well-known quote: “Using no way as way; having no limitation as limitation” by using practical technique with flexibility and reliability instead of theoretical and rigid method. The Frugal Innovation is a good demonstration of this practical way with the ability to “do more with less” [1-2] by creating more business and social value while minimizing the use of diminishing resources such as water, energy and funding. Within this context, the aim of the VOLT valve, where VOLT is the abbreviation of “Valve Opening with Low Tech”, is to propose an autonomous, low tech, eco-efficiency and compact product. This innovation have five distinct aspects that can be resumed in two words, WLoG NoTS (Water, Low, Green, No Touch and Social Technology) which is reflecting a homophony with “ Have nots “ who need to meet their energy and water needs in a quick and smart way.

Flexible and highly pressure-sensitive ternary composites-wrapped polydimethylsiloxane sponge based on synergy of multi-dimensional components

Flexible pressure sensor becomes increasingly important with the development of ultra-sensitive touch technology, electronic skin, and human health monitoring, which requires higher sensitivity. Here, a novel strategy is proposed by designing conductive polymer composites consisting of four components with different dimensions. Through a simple one-step hydrothermal method, the ternary composites of silver-carbon nanotubes-reduced graphene oxide (Ag-CNTs-rGO) were synthesized. The ternary composites-wrapped polydimethylsiloxane (PDMS) sponges, Ag-CNTs-rGO/PDMS, were fabricated by a dip-drying method. The conductive polymer sponges as pressure sensors showed improved sensitivity of 33 kPa−1 in the range of 0–0.05 kPa, which is twelve times higher than that of the conductive sponge without Ag nanoparticles. The uniform coating of Ag nanoparticles on CNTs and rGO not only enhanced the conductivity of the Ag-CNTs-rGO composites but also reduced the contact resistance between carbon materials. The CNTs-rGO matrix accelerated electron transport throughout the conductive sponge. The good flexible stability of the CNTs-rGO matrix and porous PDMS structures enabled the Ag-CNTs-rGO/PDMS sponge to assemble flexible circuits and act as elastic electric contacts. The combination of zero-dimensional metal nanoparticles, one-dimensional CNTs, and two-dimensional graphene as conductive fillers in three-dimensional porous structures provides new insight into acquiring the ultrahigh-performance flexible pressure sensors.

Perceptions of visual and multimodal symbolic mediated social touch: Role of technology modality, relationship, and task emotional salience

Mediated social touch technologies represent touch across distance as a mechanism for building and reinforcing social relationships. We investigated how people perceive and respond to mediated affective gestures given the relationship between participants (strangers vs. known partners), the task carried out (high vs. low emotional salience tasks), and the modality of mediated communication technology used (videochat vs. projector-camera duplexed workspace vs. projector-camera with shape-memory alloy haptics). Through a between-subjects 3 × 2 × 2 factorial design with 162 participants, we found that generally a projector-camera mediated social touch system without haptics performed no worse than one with haptics on most measures. However, we saw significant interaction effects, suggesting that haptics may offer some benefit for high-emotional salience tasks on measures of expressiveness and task load. We reflect on our findings by providing concrete recommendations on technologies to use, variables to include, and measures to consider for future mediated social touch research.

Hardening the Security of Multi-Access Edge Computing through Bio-Inspired VM Introspection

The extreme bandwidth and performance of 5G mobile networks changes the way we develop and utilize digital services. Within a few years, 5G will not only touch technology and applications, but dramatically change the economy, our society and individual life. One of the emerging technologies that enables the evolution to 5G by bringing cloud capabilities near to the end users is Edge Computing or also known as Multi-Access Edge Computing (MEC) that will become pertinent towards the evolution of 5G. This evolution also entails growth in the threat landscape and increase privacy in concerns at different application areas, hence security and privacy plays a central role in the evolution towards 5G. Since MEC application instantiated in the virtualized infrastructure, in this paper we present a distributed application that aims to constantly introspect multiple virtual machines (VMs) in order to detect malicious activities based on their anomalous behavior. Once suspicious processes detected, our IDS in real-time notifies system administrator about the potential threat. Developed software is able to detect keyloggers, rootkits, trojans, process hiding and other intrusion artifacts via agent-less operation, by operating remotely or directly from the host machine. Remote memory introspection means no software to install, no notice to malware to evacuate or destroy data. Experimental results of remote VMI on more than 50 different malicious code demonstrate average anomaly detection rate close to 97%. We have established wide testbed environment connecting networks of two universities Kyushu Institute of Technology and The City College of New York through secure GRE tunnel. Conducted experiments on this testbed deliver high response time of the proposed system.