Robotic Applications Research Articles

Trends in Smart Restaurant Research: Bibliometric Review and Research Agenda

Background The automation of processes and services has transformed various industries, including the restaurant sector. Technologies such as the Internet of Things (IoT), machine learning, Radio Frequency Identification (RFID), and big data have been increasingly adopted to enhance service delivery, improve user experiences, and enable data traceability. By collecting user feedback and analyzing sentiments, these technologies facilitate decision-making and offer predictive insights into future food preferences. This study aims to explore current research trends in intelligent restaurants, focusing on technological applications that improve service and decision-making. Methods A bibliometric analysis was conducted in accordance with the PRISMA-2020 guidelines. A total of 94 academic documents were reviewed from the Scopus and Web of Science databases, focusing on publications related to intelligent restaurant systems, particularly involving IoT and automation technologies. Results The analysis revealed that the United States, India, and China have contributed the most to the field, with a particular emphasis on China’s implementation of IoT architecture and robotics in restaurant settings. Chinese restaurant innovations, particularly in robotics, are among the most frequently cited in the literature. The study identifies these countries as leading the research in the intelligent restaurant domain. Conclusions Technologies such as IoT, machine learning, RFID, and big data are driving advancements in restaurant automation, enhancing service efficiency and user experience. The United States, India, and China are leading research in this area, with China standing out for its application of robotics and IoT in restaurants. This research provides a foundation for future studies aimed at improving predictive models for food selection and service optimization.

Jellyfish‐Inspired High‐Sensitivity Pressure‐Temperature Sensor

AbstractIn recent years, biomimetic high‐sensitivity tactile sensors increasingly become a research focus. Specifically, hydrogel tactile sensors based on ionic‐electronic mechanisms gain widespread attention due to their excellent pressure sensitivity. However, due to the saturation deformation of sensitive elements, these sensors struggle to accurately measure pressure under high‐pressure conditions. Additionally, as hydrogels cause signal drift under constant pressure and ionic‐electronic mechanisms are susceptible to temperature interference, these characteristics limit their application. Inspired by the jellyfish's “mesoglea” and “ectoderm” structures, a novel tactile sensor is developed that combines the ionic‐electronic mechanism with a filling structure. This sensor integrates the hydrogel with a flexible framework to create a jellyfish‐like umbrella structure. This design achieves extremely high pressure sensitivity and improves signal drift. By utilizing the different response characteristics of the capacitance and resistance values of a single sensing element to pressure and temperature changes, it enables simultaneous measurement of temperature and pressure, thereby enhancing its potential for application in wearable electronics and robotics.

An Efficient Acoustic Camera Simulator for Robotic Applications: Design, Implementation, and Validation

As forward-looking imaging sonar, also called an acoustic camera, has emerged as an important sensor for marine robotics applications, its simulators have attracted considerable research attention within the field. This paper presents an acoustic camera simulator that efficiently generates acoustic images using only the depth information of the scene. The simulator approximates the acoustic beam of a real acoustic camera as a set of acoustic rays originating from the center of the acoustic camera. A simplified active sonar model and error models for the acoustic rays are incorporated to account for the environmental factors which can affect the rays. The simulator is implemented in the Gazebo simulator, a robotic simulator, and does not rely on any other components except depth rendering. To evaluate the performance of the developed simulator, qualitative and quantitative comparisons were conducted between simulated images and actual acoustic images obtained in a test tank.

Overview Analysis of Micro-ROS System as an Embedded Solution for Microcontrollers in Automatics and Robotics Applications

Overview Analysis of Micro-ROS System as an Embedded Solution for Microcontrollers in Automatics and Robotics Applications

Simulation Study of the Upper-limb Isometric Wrench Feasible Set with Glenohumeral Joint Constraints.

The aim of this work is to improve musculoskeletal-based models of the upper-limb Wrench Feasible Set i.e. the set of achievable maximal wrenches at the hand for applications in collaborative robotics and computer aided ergonomics. In particular, a recent method performing wrench capacity evaluation called the Iterative Convex Hull Method is upgraded in order to integrate non dislocation and compression limitation constraints at the glenohumeral joint not taken into account in the available models. Their effects on the amplitude of the force capacities at the hand, glenohumeral joint reaction forces and upper-limb muscles coordination in comparison to the original iterative convex hull method are investigated in silico. The results highlight the glenohumeral potential dislocation for the majority of elements of the wrench feasible set with the original Iterative Convex Hull method and the fact that the modifications satisfy correctly stability constraints at the glenohumeral joint. Also, the induced muscles coordination pattern favors the action of stabilizing muscles, in particular the rotator-cuff muscles, and lowers that of known potential destabilizing ones according to the literature.

4D Printing of Liquid Crystal Emulsions for Smart Structures with Multiple Functionalities

Abstract3D printing, and more recently 4D printing, has emerged as a transformative technology for fabricating structures with complex geometries and responsive properties. However, employing functional colloidal solutions as inks for printing remains unexplored. In this work, we present a novel and versatile 4D printing approach for fabricating functional and complex‐shaped objects using polymerizable liquid crystal (LC) emulsion droplets. Leveraging a digital light processing (DLP) 3D printing technique, we achieve rapid production of intricate 3D geometries with high resolution. The printed structures retain the LC ordering from the precursor droplets, imparting the final objects with shape memory properties, including shape fixation and recovery upon heating or light exposure. Light‐responsive behavior is introduced post‐printing by embedding an azo dye into the 3D structures. Additionally, we explore the potential to create intrinsically porous 3D structures by selectively removing non‐reactive components from the printed geometries, adding an extra level of functionality to the printed objects. Furthermore, we incorporate chiral nematic LCs into the emulsion droplets, producing 3D objects with tunable reflective properties. To our knowledge, this is the first example of DLP 3D printing with emulsions, offering an effective and versatile pathway for developing 4D‐printed materials with potential applications in optics, robotics, microfluidics, and biomedicine.

Exploring Robotic Nursing: A Comprehensive Systematic Review of Socially Assistive Robots within the Healthcare Professions

ABSTRACT Purpose The objective is to evaluate empirical literature on Socially Assistive Robots (SARs) in nursing, identifying strengths, weaknesses, and avenues for future research and practice. This article explores studies investigating robotic applications in healthcare, specifically nursing. Design The systematic review using PRISMA guidelines includes 19 relevant studies from Medline, PubMed, and Cochrane, presenting insights into the potential of SARs in addressing patients’ mental health and well-being. Methods The eligibility criteria for this review included publications from 2015 to 2024, full-text articles employing either qualitative or quantitative methodologies, articles written in English, and those published in peer-reviewed academic journals. Excluded were single-case studies, unpublished theses or dissertations, and studies not published in peer-reviewed journals. The search employed the terms “robotic nursing” and “future,” utilizing Medical Subject Headings (MeSH) terminology for precise retrieval. Findings The current literature has limitations in generalizability, breadth, and quantification of health-related outcomes. Areas of exploration, including diverse robot types, therapies, and geographical contexts, offer promising directions for future research. Conclusions The article concludes that although SARs show promise in healthcare, particularly in nursing, more comprehensive research is needed to establish their efficacy across a wider range of applications and settings. Clinical Evidence Current studies indicate that SARs may play a valuable role in supporting patients’ mental health and well-being, though further investigation is required to determine their broader impact and effectiveness.

Implementation of an FPGA-Based System to Process Images and Match Keypoints on High-Resolution Pictures

Processing scenery and finding points of interest is crucial for applications in robotics and aerospace missions. Those areas require efficient and reliable visual input processing. Here, field programmable gate arrays (FPGAs) offer essential advantages, like low power consumption compared to CPUs, performing a large number of calculations simultaneously, and having compact hardware. This paper presents an FPGA system that processes incoming camera data, finds points of interest, and matches them across different images on high-resolution images (2048 × 1088). It is a novel approach to implement the complete image processing pipeline on high-resolution images within the FPGA fabric without additional hardware. For keypoint detection and matching, our work uses a modified SIFT algorithm optimized for FPGA implementation processing and a nearest neighbor-based matching method. It was implemented on a Xilinx Kintex-7 FPGA and partially on a NanoXplore NG-Ultra to evaluate a radiation-hardened FPGA for space applications. On the Kintex-7, the keypoint detection achieves a speed of 33 ms per image, and its features are matched on up to 5 images per second. Judging by the resource utilization of one image processing module on the NG-Ultra, porting the entire system on a radiation-hardened FPGA appears feasible.

Future Prospects of Large Language Models: Enabling Natural Language Processing in Educational Robotics

Large language models (LLMs) have recently shown considerable promise in educational robotics by offering generic knowledge necessary in situations when prior programming is not possible. In general, mobile education robots cannot perform tasks like navigation or localization unless they have a working knowledge of maps. In this letter, we tackle the issue of making LLMs more applicable in the field of mobile education robots by helping them to understand Space Graph, a text-based map description. This study, which focuses on LLMs, is divided into several sections. It explores basic natural language processing (NLP) techniques and highlights how they can help create smooth education discussions. Examining the development of LLMs inside NLP systems, the paper explores the benefits and implementation issues of important models utilized in the education sector. Applications useful in educational discussions are described in depth, ranging from patient-focused tools like diagnosis and treatment recommendations to systems that support education providers. We provide thorough instructions and real-world examples for quick engineering, making LLM-based educational robotics solutions more accessible to novices. We demonstrate how LLM-guided upgrades can be easily included in education robotics applications using tutorial-level examples and structured prompt creation. This survey provides a thorough review and helpful advice for leveraging language models in automation development, acting as a road map for researchers navigating the rapidly changing field of LLM-driven educational robotics.

Cooperative dual-actor proximal policy optimization algorithm for multi-robot complex control task

This paper introduces a novel multi-agent Deep Reinforcement Learning (DRL) framework named the Cooperative Dual-Actor Proximal Policy Optimization (CDA-PPO) algorithm, designed to address complex humanoid robot cooperative learning control tasks. Effective cooperation among multiple humanoid robots, particularly in scenarios involving complex walking gait control and external disturbances in dynamic environments, is a critical challenge. This is especially pertinent for tasks requiring precise coordination and control, such as joint object transportation. In various real-life scenarios, humanoid robots might need to cooperate to carry large objects in many scenarios. This capability is crucial for logistics, manufacturing, intelligent transportation, and search-and-rescue missions applications. Humanoid robots have gained significant popularity, and their use in these cooperative tasks is becoming more common. To address this challenge, we propose CDA-PPO, which introduces a learning-based communication platform between agents and employs two distinct policy networks for each agent. This dual-policy approach enhances the robots’ ability to adapt to complex interactions and maintain stability while performing intricate tasks. We demonstrate the efficacy of CDA-PPO in a cooperative object-transportation scenario, where two humanoid robots collaborate to carry a table. The experimental results show that CDA-PPO significantly outperforms traditional methods, such as Independent PPO (IPPO), Multi-Agent PPO (MAPPO), and Multi-Agent Twin Delayed Deep Deterministic Policy Gradient (MATD3), in terms of training efficiency, stability, reward acquisition, and humanoid robot cooperative balance control with effective coordination between robots. The findings underscore the potential of CDA-PPO to advance the field of cooperative multi-agent control problems, proposing the way for future research in complex robotics applications.

Editorial: Artificial intelligence and robotic applications for smart monitoring and assistance in healthcare services

Editorial: Artificial intelligence and robotic applications for smart monitoring and assistance in healthcare services

Enhancing actuation control in monolithic liquid crystal elastomer films with dual heat and light responsiveness

This study presents a dual heat and light-responsive monolithic liquid crystal elastomers (LCEs) film designed to enhance actuation control. The LCE films were capable of various motion types, including curvature reversal, oscillation, and sustainable flipping. By incorporating an azobenzene compound, the films exhibited additional functionalities such as enhanced curvature reversal, accelerated oscillation, and the ability to lock continuous flipping motion upon light stimulation. Furthermore, by adjusting the aspect ratio (AR) of a single film, different thermal motion states were realized, demonstrating the flexibility of this approach. Observations using an NIR camera confirmed temperature fluctuations corresponding to thermal exchange, and the influence of UV light on motion regulation was quantitatively analyzed. The ability to regulate motion through dual stimuli paves the way for improved dynamic motion control and thermal management in advanced robotic applications.

Relative-kinematic formulation of geometrically exact beam dynamics based on Lie group variational integrators

Geometrically exact beam models can accurately describe the statics and dynamics of elastic, slender beams undergoing large deformations. This work introduces a variational integrator for such models based on a relative-kinematic formulation, in which positions and velocities of nodes in the discretized beam are expressed relative to the respective preceding nodes in the kinematic chain. The resulting model is especially suited for applications in robotics and control, since it has a minimum number of states and possesses the same structure as rigid mechanical systems, simplifying the combined modeling of rigid–flexible systems. Moreover, this approach allows to specifically select the modeled deformation modes, avoiding numerical issues associated with stiff, high-frequency modes and greatly increasing numerical efficiency. The proposed model is derived fully variationally in the discrete mechanics framework and under consistent consideration of the underlying Lie group structure, which translates into beneficial numerical properties. We provide a detailed treatment of the inclusion of dissipation and propose two solver strategies for time integration, including a linear-time solver based on recursive rigid-body dynamics algorithms. The model is validated and analyzed in detailed simulation studies underlining its efficiency for the simulation of stiff and slender beams, where the straightforward, but exact reduction to a Kirchhoff beam in the presented frame leads to a substantial speed-up of the simulations.

Heat source and internal temperature estimation of an integrated modular motor drive in robotic application using inverse heat conduction problem

Heat source and internal temperature estimation of an integrated modular motor drive in robotic application using inverse heat conduction problem

A Skin-Like Self-Powered Flexible Sensor for Wearable Monitoring and Robotic Tactile Application

A Skin-Like Self-Powered Flexible Sensor for Wearable Monitoring and Robotic Tactile Application

Ground Robots Bring Potential for Efficiency, Safety in FPSO Operations

_ This article, written by JPT Technology Editor Chris Carpenter, contains highlights of paper OTC 32872, “Evaluation of the Potential Impact of Ground Robots on FPSO Operations,” by Gustavo L.L. da Silva, Maurício M. Cordeiro Jr., and Maurício Galassi, Petrobras, et al. The paper has not been peer reviewed. Copyright 2024 Offshore Technology Conference. _ The objective of this paper is to present the operator’s learnings in evaluating the processes by which the asset crew of a floating production, storage, and offloading (FPSO) vessel identifies scenarios for the application of robotics in day-to-day offshore activities. The studies reveal a glimpse of the addressable market size of ground robots for routine offshore verification tasks. An initial analysis suggests that 30–50% of the theoretical equivalent of hours per year could be freed. Introduction In the complete paper, the hypothetical use of ground mobile robots to carry out operational activities is considered. For that goal, the capability of robotic platforms to move along an offshore facility (an FPSO, for the purposes of this paper) has been explored. This includes the ability to overcome obstacles, move up and down stairs or ramps, and walk on uneven floors or gratings while being piloted remotely or even doing so autonomously. Some of the considered equipment may have coupled robotic manipulators that also enable them to interact with the environment, allowing them to open or close doors, turn handles, and activate commands. These robotic platforms, in general, include actuator mechanisms and sensors that enable visual inspections, thermography, dimensional analysis, area mapping, gas measurements, noise and vibration analysis, and other operations requiring specific sensing. Operational Requirements A paramount requirement for a robot to be widely used in an FPSO is its ability to operate in hazardous areas. Robotic platforms for hazardous zones are not widely available. However, some companies are quickly advancing in the development and commercialization of these platforms. A Swiss company has already made available a quadruped robot with high mobilization capacity, including the ability to navigate stairs and carry out autonomous missions that have been preprogrammed. An Austrian company has marketed a caterpillar robot that can carry out inspections autonomously in classified areas. Every such activity will demand thorough analysis to properly define technical and process requirements. On FPSO platforms, the procedure for planning any service takes place at least a few days before its execution, a task already demanding many hours. Subsequently, a permit to work (PTW) is issued to perform the service. Sensors and Actuators for a Robotic System Some of the main data-acquisition or processing sensors used in robotic systems are detailed in the complete paper. In this context, “data” means everything that can be processed online or is capable of producing useful information in the future. Cameras for Acquisition of Images and Videos. These can be very useful in the visual inspection of systems or equipment, the visualization of the workspace, or the generation of input for image processing with the purpose of identifying patterns of interest, segmentation, classification, or other aspects related to computer vision.

A first principles study of BiSb monolayer: A novel gas sensor for robotic applications

This study, based on density functional theory (DFT) and non-equilibrium Green's functions, systematically analyzes the structural stability and adsorption behavior of gases (CO, CO2, NH3, Cl2, and CH4) on BiSb monolayers, aiming to provide a theoretical foundation for environmental sensors in post-earthquake disaster relief robots. The optimal structures, electron density difference (EDD), electron localization function (ELF), density of states (DOS), band gap, and other adsorption properties of the adsorption systems were examined to elucidate the interactions between gas molecules and the BiSb monolayer. Theoretical results indicate that the adsorption process is exothermic, characterized by negative adsorption energy. Furthermore, the analysis shows that BiSb monolayers exhibit high selectivity for gas adsorption, the adsorption strength follows the order: Cl2 > CO > NH3 > CO2 > CH4. Theoretically, BiSb monolayers hold promise for developing novel gas sensors and adsorbents, applicable to real-time monitoring, search, and rescue operations in post-earthquake scenarios for robotic applications.

Controlling the Deformation of the Antagonistic Shape Memory Alloy System by LSTM Deep Learning

The antagonistic system of two shape memory alloy wires is a great inspiration for the robotics field where it is applied as a linear actuator due to its shape memory effect. However, its control is still a challenge due to its hysteresis behavior. For that reason, a new controller is proposed in this paper for the displacement of the system’s effector. It is based on a Long Short-Term Memory neural network model. The aim is achieved by combining temperature-deformation data from an analytical model with voltage-temperature-deformation data from real experiments. Hence, these datasets are studied to overcome the nonlinearity obstacle of this system in order to be able to integrate it into robotic applications.

Activities of Daily Living Object Dataset: Advancing Assistive Robotic Manipulation with a Tailored Dataset

The increasing number of individuals with disabilities—over 61 million adults in the United States alone—underscores the urgent need for technologies that enhance autonomy and independence. Among these individuals, millions rely on wheelchairs and often require assistance from another person with activities of daily living (ADLs), such as eating, grooming, and dressing. Wheelchair-mounted assistive robotic arms offer a promising solution to enhance independence, but their complex control interfaces can be challenging for users. Automating control through deep learning-based object detection models presents a viable pathway to simplify operation, yet progress is impeded by the absence of specialized datasets tailored for ADL objects suitable for robotic manipulation in home environments. To bridge this gap, we present a novel ADL object dataset explicitly designed for training deep learning models in assistive robotic applications. We curated over 112,000 high-quality images from four major open-source datasets—COCO, Open Images, LVIS, and Roboflow Universe—focusing on objects pertinent to daily living tasks. Annotations were standardized to the YOLO Darknet format, and data quality was enhanced through a rigorous filtering process involving a pre-trained YOLOv5x model and manual validation. Our dataset provides a valuable resource that facilitates the development of more effective and user-friendly semi-autonomous control systems for assistive robots. By offering a focused collection of ADL-related objects, we aim to advance assistive technologies that empower individuals with mobility impairments, addressing a pressing societal need and laying the foundation for future innovations in human–robot interaction within home settings.

C2Fi-NeRF: Coarse to fine inversion NeRF for 6D pose estimation

Estimating the 6DoF pose of objects in complex scenarios is one of the core challenges in environmental perception for unmanned systems. Recently, mesh-free pose estimation methods based on “inverse” NeRF have achieved state-of-the-art (SOTA) accuracy under ideal data conditions compared to traditional methods. However, the overall performance of this strategy is suboptimal due to some overlooked details, such as NeRF’s sampling of pixel backpropagation, which can lead to local minima in high-resolution images. Random initialization of poses increases the difficulty of network convergence and estimation bias. Pose estimation neglects geometric consistency constraints, resulting in low robustness to occluded environments. To address these issues, this paper proposes a “coarse-to-fine” NeRF pose prediction framework (C2Fi-NeRF). During the training phase, an affinity-based full-pixel backpropagation strategy is proposed, abandoning the sparse sampling of traditional NeRF training. The complete gradient map is divided into affinity blocks, which are rendered and backpropagated in sequence. This not only achieves efficient full-pixel training for high-resolution images but also significantly improves the quality and consistency of rendered images, reducing noise and artifacts. The prediction phase is divided into two parts: the coarse phase optimizes reprojection errors through feature point matching to introduce precise initialization data, accelerating NeRF convergence and reducing bias potential. The fine estimation phase integrates multi-view geometry and color consistency constraints in the inverse NeRF iteration, enhancing pixel rendering robustness in complex occluded scenarios while also refining pose prediction. Experiments demonstrate that compared to existing NeRF-based and mainstream deep learning methods, C2Fi-NeRF is competitive in accuracy and efficiency on relevant datasets (NeRF-Synthetic, LLFF, Replica, YCB) and is more suitable for practical robotic applications.