Design Of Interactive Systems Research Articles

Assessing the Effects of Sensory Modality Conditions on Object Retention across Virtual Reality and Projected Surface Display Environments

Haptic feedback reportedly enhances human interaction with 3D data, particularly improving the retention of mental representations of digital objects in immersive settings. However, the effectiveness of visuohaptic integration in promoting object retention across different display environments remains underexplored. Our study extends previous research on the retention effects of haptics from virtual reality to a projected surface display to assess whether earlier findings generalize to 2D environments. Participants performed a delayed match-to-sample task incorporating visual, haptic, and visuohaptic sensory feedback within a projected surface display environment. We compared error rates and response times across these sensory modalities and display environments. Our results reveal that visuohaptic integration significantly enhances object retention on projected surfaces, benefiting task performance across display environments. Our findings suggest that haptics can improve object retention without requiring fully immersive setups, offering insights for the design of interactive systems that assist professionals who rely on precise mental representations of digital objects.

Working Memory Capacity for Mid-Air Gestures in Human–Computer Interaction

Mid-air gesture interactions have emerged as one of the predominant modalities used in human-computer interaction (HCI). However, extant research on gestures predominantly concentrates on the design of gestures for singular functionalities, which requires a comprehensive investigation into gesture interaction design from an integrative HCI system perspective. Working memory capacity plays a pivotal role in constraining the number of gestures accommodated within an HCI system. This study adopts the change detection paradigm to conduct an empirical investigation into the working memory capacities associated with mid-air gestures, aiming to elucidate the working memory capacity for such gestures. The experimental design included two independent variables: five distinct categories of mid-air gestures (physical, symbolic, metaphorical, abstract, and mixed) and memory set sizes ranging from two to nine items. The findings revealed that working memory capacities for different types of gestures fluctuate between three and five items, with symbolic gestures presenting the most negligible cognitive load for recall and abstract gestures proving to be the most challenging. The outcomes of this research have significant implications for both the design of individual gestures and the overarching design of gesture interaction systems, serving as a valuable reference for future endeavors in HCI design optimization.

Upper Limb Rehabilitation Robots Training Analysis based on Multi-sensor Trajectory Data and Human-computer Interaction

Upper limb rehabilitation robots have important practical significance in helping patients recover their motor function, but traditional training methods often lack real-time and accurate evaluation of patient movement status and intention and have low interactive participation. Therefore, the study proposes a training system for upper limb rehabilitation robots based on multi-sensor trajectory data and human-computer interaction. The system is designed from three aspects: inertial sensor trajectory tracking, Kinect sensor image restoration, and interaction system design. A polynomial joint zero value constraint algorithm is introduced to correct errors, and variable parameter pixel filtering combined with a weighted average moving algorithm is used to improve image quality. The training results showed that the robot trajectory tracking accuracy significantly improved, and the improvement in motion trajectory error was greater than 20%. Compared with traditional training methods, interactive training had a recognition accuracy of over 85% in rehabilitation actions, and the system had better stability. This rehabilitation robot can effectively meet the feasibility and effectiveness of improving the interaction system, providing new technological means for intelligent medical services.

Design of a Gaze-Controlled Interactive Art System for the Elderly to Enjoy Life.

The impact of global population aging on older adults' health and emotional well-being is examined in this study, emphasizing innovative technological solutions to address their diverse needs. Changes in physical and mental functions due to aging, along with emotional challenges that necessitate attention, are highlighted. Gaze estimation and interactive art are utilized to develop an interactive system tailored for elderly users, where interaction is simplified through eye movements to reduce technological barriers and provide a soothing art experience. By employing multi-sensory stimulation, the system aims to evoke positive emotions and facilitate meaningful activities, promoting active aging. Named "Natural Rhythm through Eyes", it allows for users to interact with nature-themed environments via eye movements. User feedback via questionnaires and expert interviews was collected during public demonstrations in elderly settings to validate the system's effectiveness in providing usability, pleasure, and interactive experience for the elderly. Key findings include the following: (1) Enhanced usability of the gaze estimation interface for elderly users. (2) Increased enjoyment and engagement through nature-themed interactive art. (3) Positive influence on active aging through the integration of gaze estimation and interactive art. These findings underscore technology's potential to enhance well-being and quality of life for older adults navigating aging challenges.

The design of a new interactive multimedia system based on computer vision and multi-sensing techniques for the traditional ritual process

ABSTRACT With the rapid advancements in technology, digital media have become widely integrated into people’s lives. In oriental countries, individuals frequently visit temples for fortune-telling and blessing-praying during the ritual process. A new interactive multimedia system based on computer vision and multi-sensing techniques for carrying out the traditional ritual process in the temple is proposed, which contributes to cultural preservation. The three major ritual steps, namely, ‘incense waving,’ ‘moon-block casting,’ and ‘fortune-telling poem drawing,’ were implemented by multimedia-related hardware and algorithms, and the system was exhibited for field testing by 405 participants. Interviews with experts and a questionnaire survey of the participants’ opinions were conducted to evaluate the effectiveness of the system using statistical software packages, yielding the following findings: (1) the proposed system can bring the participants to experience the ritual process effectively; (2) the proposed three major ritual steps not only attracts more participations but also promotes people’s learning of the ritual process; (3) the system attracts participants by integrating multimedia effects with good usability; and (4) the uses of computer vision and multi-sensing techniques bring the users new experiences of the fortune-telling application.

Design of political classroom interaction system in social virtual reality entertainment environment based on convolutional neural network

With the continuous progress of AI intelligent technology, the internet industry has undergone tremendous changes. The application of virtual reality and other digital entertainment technology has changed the classroom mode, and at the same time, current political classrooms place more emphasis on interaction with society. Therefore, this article constructs a political classroom AI intelligent system based on CNN network. This system studies the political classroom from the perspective of AI intelligent construction, using a combination of theory and practice. This article selects some research materials from both domestic and international sources. Firstly, it summarizes and analyzes relevant concepts such as convolutional neural networks, summarizes the importance of political classroom education, and analyzes the problems faced by political classrooms in the context of AI intelligence. Then, experimental analysis was conducted on the AI intelligent system in the political classroom. The experiment proved that the AI intelligent system in the political classroom has good working performance in the actual operation process, and the overall performance is also better than other systems. Implementing a network-based AI intelligent system for the political classroom and applying AI intelligent technology in practical applications can improve the personalization and accuracy of the political classroom.

3D dynamic landscape simulation of artificial intelligence in environmental landscape design

Three-dimensional (3D) simulations and precise landscape visualizations are crucial for various applications, like landscape management and planning, computer and connection of the landscape, evaluation, and tracking of land use. The consequences of several plans and a large scene cannot be communicated using older methods of comprehensive environmental planning and development in a timely, rational, and coordinated manner. Architects have trouble incorporating ideas into other comprehensive planning implementation processes. Architects did not thoroughly investigate the neighbourhood's demographics and matching behavioural needs and lacked critical thinking. The 3D dynamic landscape simulation is a detailed computerized three-dimensional simulation of the environment that can be dynamically presented. With the aid of Artificial Intelligence (AI) technology, the system possesses a strong sense of reality, a user-friendly interface, and interactive features that can be tailored to the requirements of the contemporary urban environmental landscape. Regarding exterior publicity, domestic assistance, environmental land use planning, and information systems. The novelty of the proposed Interactive Design System based on AI (IDS-AI) is to create a 3D dynamic landscape model based on a real-life environmental scene, utilizing a Geographic Information System (GIS) to optimize landscape vision. Secondly, 3D environmental landscape design simulation was implemented using GIS spatial analysis in conjunction with the Fuzzy Analytical Hierarchical Process (FAHP) to reduce the data overlap rate and help make an accurate decision. Finally, the design incorporates the development of the interactive interface system application of landscape design and environmental resources for viewing the landscape, the factors that affect them, and the area coverage ratio of various land cover types. The experimental outcomes show that the suggested IDS model increases the gradient sensitivity level of 98.3 % and area coverage ratio of 93.4 % compared to other existing models.

AI-Based Affective Music Generation Systems: A Review of Methods and Challenges

Music is a powerful medium for altering the emotional state of the listener. In recent years, with significant advancements in computing capabilities, artificial intelligence-based (AI-based) approaches have become popular for creating affective music generation (AMG) systems. Entertainment, healthcare, and sensor-integrated interactive system design are a few of the areas in which AI-based affective music generation (AI-AMG) systems may have a significant impact. Given the surge of interest in this topic, this article aims to provide a comprehensive review of controllable AI-AMG systems. The main building blocks of an AI-AMG system are discussed and existing systems are formally categorized based on the core algorithm used for music generation. In addition, this article discusses the main musical features employed to compose affective music, along with the respective AI-based approaches used for tailoring them. Lastly, the main challenges and open questions in this field, as well as their potential solutions, are presented to guide future research. We hope that this review will be useful for readers seeking to understand the state-of-the-art in AI-AMG systems and gain an overview of the methods used for developing them, thereby helping them explore this field in the future.

Development of Standalone Extended-Reality-Supported Interactive Industrial Robot Programming System

Extended reality (XR) is one of the most important technologies in developing a new generation of human–machine interfaces (HMIs). In this study, the design and implementation of a standalone interactive XR-supported industrial robot programming system using the Unity game engine is presented. The presented research aims to achieve a cross-platform solution that enables novel tools for robot programming, trajectory validation, and robot programming debugging within an extended reality environment. From a robotics perspective, key design tasks include modeling in the Unity environment based on robot CAD models and control design, which include inverse kinematics solution, trajectory planner development, and motion controller set-up. Furthermore, the integration of real-time vision, touchscreen interaction, and AR/VR headset interaction are involved within the overall system development. A comprehensive approach to integrating Unity with established industrial robot modeling conventions and control strategies is presented. The proposed modeling, control, and programming concepts, procedures, and algorithms are verified using a 6DoF robot with revolute joints. The benefits and challenges of using a standalone XR-supported interactive industrial robot programming system compared to integrated Unity–robotics development frameworks are discussed.

Designing preschool children's educational games for enlightenment through decision analysis methods

As an innovative form of digital online education, educational games have potentially significant impacts on preschool children's enlightenment education. Identifying key factors for effective design is crucial in game development. This study identifies key factors for the design of educational games aimed at preschool children's enlightenment through decision analysis methods. The specific research steps include using SET analysis method to identify gaps in development opportunities, employing the Analytic Hierarchy Process to construct an interactive system design model for enlightenment educational games, calculating the weight value of each factor, and pinpointing the key factors for design practice. Based on this methodology, an enlightenment educational game has been developed, and Fuzzy Comprehensive Evaluation method has been utilized to assess the practical implementation. The approach outlined in this study enables designers to swiftly recognize the critical elements in designing educational games for preschool children's enlightenment, facilitating a responsive design process, achieving effective game designs, and ultimately enhancing preschool children's learning interest and outcomes.

Design and operation of an adiabatic compressed air energy storage system incorporating a detailed heat exchanger model

Heat exchangers (HEXs) are among the key components of adiabatic compressed air energy storage (A-CAES) systems. However, the existing HEX models applied in the A-CAES systems are overly simplistic, limiting research regarding design and operational simulation. For the first time, this study incorporates a comprehensive HEX model, including calculations for geometric dimensioning, heat transfer, and pressure drop, into the A-CAES system model; in addition, a novel layered, interactive system design and operational simulation algorithms are developed. The developed models and algorithms can facilitate the design process and yield reasonable operational simulation results with only basic parameters. The design algorithm can determine all key parameters of the system and assess the effect of the HEX pressure drop and heat transfer area on the system performance. The operational simulation algorithm considers the performance of all key equipment under off-design conditions. The design exergy efficiency and daily net income of the system are 73.15 % and $26,998, respectively; however, these values decrease during operation to 72.15 % and $25,034, respectively. A comprehensive analysis of the key parameters during operation revealed that the primary causes for the degradation were the sliding pressure in the energy storage process and variations in the air storage tank parameters.

Broadening the mind: how emerging neurotechnology is reshaping HCI and interactive system design

Abstract People are increasingly eager to know more about themselves through technology. To date, technology has primarily provided information on our physiology. Yet, with advances in wearable technology and artificial intelligence, the current advent of consumer neurotechnology will enable users to measure their cognitive activity. We see an opportunity for research in Human-Computer Interaction (HCI) in the development of these devices. Neurotechnology offers new insights into user experiences and facilitates the development of novel methods in HCI. Researchers will be able to create innovative interactive systems based on the ability to measure cognitive activity at scale in real-world settings. In this paper, we contribute a vision of how neurotechnology will transform HCI research and practice. We discuss how neurotechnology prompts a discussion about ethics, privacy, and trust. This trend highlights HCI’s crucial role in ensuring that neurotechnology is developed and utilised in ways that truly benefit people.

Interactive Batik & HR Incubation for Art-Technopreneurship: Mantraman Village Pilot Project

The implementation of this activity presents an innovative approach to promote the sustainability of the Javanese batik industry by developing interactive batik designs and fostering human resources in the arts and technopreneurship fields. The research project undertaken in Mantraman Village, Pagelaran, aims to brand Mantraman Village as a unique destination embodying Javanese Cultural Village characteristics. The cutting-edge approach combines age-old batik techniques with the latest in digital augmented reality technology. By doing so, it aims to boost visitor engagement and offer a hands-on experience in the batik design process. This implementation also focuses on fostering human resources in the arts and technopreneurship fields. These educational activities are designed to impart both theoretical knowledge and practical skills, empowering individuals to venture into or further develop their own art-technopreneurial pursuits. Training programs and workshops are conducted to develop participants’ skills and knowledge in batik design, business management, marketing, and related technological aspects. This implementation methodology involves conducting participatory surveys, observations, and interviews with relevant stakeholders, as well as testing and evaluating prototypes of interactive batik design systems. The data collected will be analyzed qualitatively and quantitatively to measure the project’s impact on increasing public interest, improving the quality of batik products, and developing human resources in the arts and technopreneurship fields. The results of the implementation of this activity made a positive contribution through an inventory of interactive batik motif designs with augmented reality technology, contributing to the development of the batik industry in Mantraman Village, Pagelaran Village as an iconic tourism village branding. Through these efforts, the project contributes positively to the sustainable growth of the batik industry and cultural branding of the village. Keywords: interactive, pattern, batik, mantraman village, pagelaran

Design of interactive online teaching system for big data computer information system based on mobile sensor network

The combination of the Internet and computers has resulted in many new products, including smart homes. The emergence of smart homes can satisfy people's detection of the internal environment of the home, not only to ensure the continuity and safety of indoor monitoring, but also to provide convenience for people to manage their family life. This paper analyzes the current status of smart home research at home and abroad, and people's needs for homes, and builds and designs smart home systems based on Ethernet and ZigBee protocol wireless sensor networks connected to TCP/IP protocol. In this article, the ARM chip is used in the Android system to ensure that the system and functions are matched, and information is transmitted through the serial port of the development board. After receiving the corresponding sending signal, the wireless module will use ZigBee technology to send the corresponding signal to achieve the goal of controlling home appliances. We divides the control system into two parts, the Android Voice Control Platform and the data collection terminal. The former is based on the Android operating system and is designed for voice recognition control; the latter uses a ZigBee microcontroller to achieve control and feedback. This article uses the built-in voice control system of the smart home to subtly replace the conventional control method of the smart home. Moreover, the dialogue with users is very high, easy to use, low cost, and very practical. In addition, the research methods used in this article can also be applied to other related fields.

Design of Neural Network-based Online Teaching Interactive System in the Context of Multimedia-assisted Teaching

Design of Neural Network-based Online Teaching Interactive System in the Context of Multimedia-assisted Teaching

From Concept to Implementation: Streamlining Sensor and Actuator Selection for Collaborative Design and Engineering of Interactive Systems

From Concept to Implementation: Streamlining Sensor and Actuator Selection for Collaborative Design and Engineering of Interactive Systems

Design and Optimization of Human-Computer Interaction System for Education Management Based on Artificial Intelligence

The continuous improvement and refinement of artificial intelligence (AI) technology has facilitated the broader application of human-computer interaction in the field of education management. The construction of an educational management human-computer interaction system based on AI technology can optimize and improve key parameters of educational management human-computer interaction scenarios, thereby creating a more comprehensive mobile learning (m-learning) application system. This paper is based on AI technology, analyzing gesture semantics and speech semantics, and combining fusion algorithms to construct an education management human interaction system. The performance changes of the system were compared with real experimental operations and the NOBOOK platform analysis. The results show that the education management human-computer interaction system constructed in this article can enhance the m-learning experience of participants. It ensures high recognition accuracy, leading to higher scores in all dimensions of indicator evaluation. Therefore, as one of the crucial forms of m-learning, the human-computer interaction system for education management based on AI can establish a foundation for the further enhancement and development of education management.

Action capture and VR interactive system for online experimental teaching

The development of technology has intensified people’s interest in virtual reality technology. Virtual reality technology is also widely used in fields such as teaching and healthcare. To improve the real-time and operability of virtual reality interaction systems, a motion capture and virtual reality interaction system design for online experimental teaching is proposed. The active apparent model is used for facial feature point localization, and the joint capture method is improved by combining threshold segmentation and forward kinematics algorithms. Experimental data confirms that compared to Kinect method, the improved hand joint detection method has higher joint positioning accuracy, with a loss rate of less than 40 % for hand joints. The average judgment accuracy of the six facial expression tests is 82 %, 81 %, 79 %, 78 %, 80 %, and 81 %, respectively. The comprehensive recognition accuracy of facial expression recognition is 80.17 %. The read, write, and update times for each frame of the virtual reality interaction system are 102.6 ms and 427 ms, respectively. The system memory usage is 920.5 M, and the CPU and GPU usage rates are 25.2 % and 4.4 %, respectively. The system can run smoothly. The virtual reality system can run continuously for 24 h, with strong operability and low difficulty in expanding system functions, achieving design goals.

Analysis and Development of a Decision Support System for Selection of Prospective KIP Scholarship Recipients

Global Institute of Technology and Business Campus (Global Institute) is one of the campuses that organizes the KIP (Kartu Indonesia Pintar) scholarship program. This program aims to increase access to education for children from disadvantaged families and provide them with financial support. The research methods used are needs analysis, system design, and prototype implementation. This research collects data from various sources, including personal data of prospective scholarship recipients, academic data, family income data, and other relevant factors. The data collected is then analyzed using appropriate decision making methods, such as the Analytical Hierarchy Process (AHP) and TOPSIS methods. A Decision Support System is an interactive platform that helps make decisions efficiently and effectively in the process by presenting alternatives resulting from data processing, information, and the design of interactive computer-based models or systems. This platform provides support to decision makers in utilizing data and models to overcome unstructured problems.

Design recommendations for voluntary blink interactions based on pressure sensors

Voluntary blink control is vital in eye-controlled human–computer interaction (ECHCI). Pressure sensors, known for their low power consumption and strong resistance to interference, are suitable for blink detection. Existing research has predominantly focused on sensor materials and signal processing, and studies on the characteristics and optimized design of voluntary blink actions in ECHCI remain relatively limited. Therefore, this study presents a blink detection system based on pressure sensors and investigates the efficiency of voluntary blink actions. We examined the effects of two independent variables, blink count (single, double, and triple) and blink side (bilateral and unilateral), on recognition accuracy and three time-related variables. Subsequently, the subjective workload and evaluation experiments were conducted for each blink action. The results indicate that the blink count has a more pronounced impact on interaction efficiency and comfort, with continuous blink actions exceeding three blinks not being recommended. Bilateral blinks were perceived as more natural and comfortable than unilateral blinks. Moreover, we discovered that the participants exhibited greater attentiveness and focus when performing double bilateral blink actions, making it suitable for important commands. Based on the experimental results, the top three recommended voluntary blink actions are single bilateral blink (SB), double bilateral blink (DB), and single unilateral blink (SU). Finally, a test involving controlling the movement of a toy car using the recommended blink actions validates the usability of the actions and detection system. These findings provide valuable guidance for the design and optimization of voluntary-blink interaction systems, further enhancing this interaction method’s feasibility.