Sensor Fusion Research Articles

Formation of New Technology in Automated Highway System in Peripheral Highway

There will be a dramatic shift in the transportation sector with the advent of autonomous highway systems, which might boost safety, efficiency, and sustainability. Modernizing India's transportation system may be as simple as installing state-of-the-art equipment along the Western Peripheral Highway. This abstract explores the potential impacts of autonomous highway systems on the Western Peripheral Highway, a vital piece of infrastructure. The development of autonomous highway systems is facilitated by a number of critical technologies, including artificial intelligence, sensor fusion, communication networks, and autonomous vehicles. These innovations enable cars to navigate themselves, exchange data with each other and roadside infrastructure, and make split-second decisions, all with the goal of enhancing traffic flow and roadway safety. By using high-definition mapping and precise localization systems, vehicle positioning and navigation are assured to be accurate, even in complex urban environments. The installation of Formation of new technology in Automated highway system in peripheral highway along the Western Peripheral Highway in India is widely anticipated as a potential solution to the country's dire transportation issues. Formation of new technology in Automated highway system in peripheral highway offer a realistic solution to increase mobility, decrease emissions, and alleviate congestion, all of which are contributing factors to the growing demand for efficient logistics networks brought about by rapid urbanization. Smart grid technology and renewable energy sources, when integrated into highway infrastructure, can make the transportation sector more resilient and eco-friendly. To make Formation of new technology in Automated highway system in peripheral highway a reality, many things and challenges must be taken into account. Make sure the communication protocols and car manufacturers are compatible for a smooth integration and operation. Urgent action is needed to address privacy and cybersecurity concerns in order to ensure the security of data and autonomous driving systems. The development of autonomous highway systems along India's Western Peripheral Highway finally presents a chance to drastically change transportation and urban mobility. It is possible for India to use cutting-edge technology and promote cooperation between the government, businesses, and universities to build highways that are safer, more efficient, and less harmful to the environment in the future. With sufficient investment, innovative thinking, and meticulous planning, Formation of new technology in Automated highway system in peripheral highway have the potential to transform urban landscapes and improve the quality of life for countless Americans.

Railway safety through predictive vertical displacement analysis using the PINN-EKF synergy

Scientific Machine Learning (SciML) finds extensive application in daily life, industry, and scientific research. Specifically, in railway data analysis, it utilizes tools such as time series analysis, classification, and data visualization. Among these, monitoring vertical displacement, or the movement of railway components relative to a fixed point, is vital. This indicates changes in the elevation of railway infrastructure, highlighting track settlement and structural shifts. However, relying solely on single sensor measurements for these displacement calculations can introduce inaccuracies. To overcome this, sensor fusion techniques are employed. These techniques employ advanced algorithms to combine data from multiple sensors, thereby enhancing accuracy. They consider the individual characteristics of each sensor, effectively mitigating the limitations of any single sensor. This study introduces a hybrid approach that combines the Extended Kalman Filter (EKF) with the Physics-Informed Neural Network (PINN) to refine predictive data analytics in dynamic railway environments. The experimental results underscore the efficacy of this innovative methodology.

In-situ process monitoring and adaptive quality enhancement in laser additive manufacturing: A critical review

Laser Additive Manufacturing (LAM) presents unparalleled opportunities for fabricating complex, high-performance structures and components with unique material properties. Despite these advancements, achieving consistent part quality and process repeatability remains challenging. This paper provides a comprehensive review of various state-of-the-art in-situ process monitoring techniques, including optical-based monitoring, acoustic-based sensing, laser line scanning, and operando X-ray monitoring. These techniques are evaluated for their capabilities and limitations in detecting defects within Laser Powder Bed Fusion (LPBF) and Laser Directed Energy Deposition (LDED) processes. Furthermore, the review discusses emerging multisensor monitoring and machine learning (ML)-assisted defect detection methods, benchmarking ML models tailored for in-situ defect detection. The paper also discusses in-situ adaptive defect remediation strategies that advance LAM towards zero-defect autonomous operations, focusing on real-time closed-loop feedback control and defect correction methods. Research gaps such as the need for standardization, improved reliability and sensitivity, and decision-making strategies beyond early stopping are highlighted. Future directions are proposed, with an emphasis on multimodal sensor fusion for multiscale defect prediction and fault diagnosis, ultimately enabling self-adaptation in LAM processes. This paper aims to equip researchers and industry professionals with a holistic understanding of the current capabilities, limitations, and future directions in in-situ process monitoring and adaptive quality enhancement in LAM.

From sensor fusion to knowledge distillation in collaborative LIBS and hyperspectral imaging for mineral identification

Multimodal spectral imaging offers a unique approach to the enhancement of the analytical capabilities of standalone spectroscopy techniques by combining information gathered from distinct sources. In this manuscript, we explore such opportunities by focusing on two well-known spectral imaging techniques, namely laser-induced breakdown spectroscopy, and hyperspectral imaging, and explore the opportunities of collaborative sensing for a case study involving mineral identification. In specific, the work builds upon two distinct approaches: a traditional sensor fusion, where we strive to increase the information gathered by including information from the two modalities; and a knowledge distillation approach, where the Laser Induced Breakdown spectroscopy is used as an autonomous supervisor for hyperspectral imaging. Our results show the potential of both approaches in enhancing the performance over a single modality sensing system, highlighting, in particular, the advantages of the knowledge distillation framework in maximizing the potential benefits of using multiple techniques to build more interpretable models and paving for industrial applications.

Personal Air-Quality Monitoring with Sensor-Based Wireless Internet-of-Things Electronics Embedded in Protective Face Masks

Personal Air-Quality Monitoring with Sensor-Based Wireless Internet-of-Things Electronics Embedded in Protective Face Masks

Robotics Perception and Control: Key Technologies and Applications.

The integration of advanced sensor technologies has significantly propelled the dynamic development of robotics, thus inaugurating a new era in automation and artificial intelligence. Given the rapid advancements in robotics technology, its core area-robot control technology-has attracted increasing attention. Notably, sensors and sensor fusion technologies, which are considered essential for enhancing robot control technologies, have been widely and successfully applied in the field of robotics. Therefore, the integration of sensors and sensor fusion techniques with robot control technologies, which enables adaptation to various tasks in new situations, is emerging as a promising approach. This review seeks to delineate how sensors and sensor fusion technologies are combined with robot control technologies. It presents nine types of sensors used in robot control, discusses representative control methods, and summarizes their applications across various domains. Finally, this survey discusses existing challenges and potential future directions.

Advancements in Deep Learning for Autonomous Driving in Indian Road Conditions

Recent advancements in deep learning techniques tailored for autonomous driving in Indian road conditions are crucial for revolutionizing transportation systems. Indian roads present unique challenges, including unpredictable traffic patterns, diverse road infrastructures, and challenging weather conditions. Deep learning is pivotal in addressing these challenges, focusing on perception, decision-making, and control. Various architectures, including Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), and Deep Reinforcement Learning (DRL), are analyzed for their efficacy in autonomous driving. Sensor fusion techniques enhance perception capabilities, such as lidar, radar, and camera data integration. Additionally, advancements in semantic segmentation and object detection algorithms improve scene understanding and obstacle recognition. Collaborative efforts between academia, industry, and government agencies are essential for accelerating the deployment of autonomous driving technology in Indian road conditions. In conclusion, leveraging cutting-edge deep learning methodologies enables safe and efficient navigation of autonomous vehicles, ushering in a transformative future in transportation systems.

Vehicle Detection in Adverse Weather: A Multi-Head Attention Approach with Multimodal Fusion

In the realm of autonomous vehicle technology, the multimodal vehicle detection network (MVDNet) represents a significant leap forward, particularly in the challenging context of weather conditions. This paper focuses on the enhancement of MVDNet through the integration of a multi-head attention layer, aimed at refining its performance. The integrated multi-head attention layer in the MVDNet model is a pivotal modification, advancing the network’s ability to process and fuse multimodal sensor information more efficiently. The paper validates the improved performance of MVDNet with multi-head attention through comprehensive testing, which includes a training dataset derived from the Oxford Radar RobotCar. The results clearly demonstrate that the multi-head MVDNet outperforms the other related conventional models, particularly in the average precision (AP) of estimation, under challenging environmental conditions. The proposed multi-head MVDNet not only contributes significantly to the field of autonomous vehicle detection but also underscores the potential of sophisticated sensor fusion techniques in overcoming environmental limitations.

A Compact Handheld Sensor Package with Sensor Fusion for Comprehensive and Robust 3D Mapping.

This paper introduces an innovative approach to 3D environmental mapping through the integration of a compact, handheld sensor package with a two-stage sensor fusion pipeline. The sensor package, incorporating LiDAR, IMU, RGB, and thermal cameras, enables comprehensive and robust 3D mapping of various environments. By leveraging Simultaneous Localization and Mapping (SLAM) and thermal imaging, our solution offers good performance in conditions where global positioning is unavailable and in visually degraded environments. The sensor package runs a real-time LiDAR-Inertial SLAM algorithm, generating a dense point cloud map that accurately reconstructs the geometric features of the environment. Following the acquisition of that point cloud, we post-process these data by fusing them with images from the RGB and thermal cameras and produce a detailed, color-enriched 3D map that is useful and adaptable to different mission requirements. We demonstrated our system in a variety of scenarios, from indoor to outdoor conditions, and the results showcased the effectiveness and applicability of our sensor package and fusion pipeline. This system can be applied in a wide range of applications, ranging from autonomous navigation to smart agriculture, and has the potential to make a substantial benefit across diverse fields.

Measurement of aero-engine feature-hierarchy fusion degradation trend based on parameter-adaptive VMD method and improved transformer model

The accumulation of operational time in aero-engines leads to irreversible mechanical wear and tear, necessitating accurate measurement of the health evolution trend for effective predictive maintenance, thus reducing the risk of accidents and ensuring personnel safety. In this paper, a parameter-adaptive variational mode decomposition (VMD) method and improved transformer model are proposed to forecast the degradation trend of aero-engine feature hierarchy fusion. Firstly, in order to quantitatively evaluate the engine health evolution process, the health state aggregate indicator (HSAI) is innovatively constructed by employing the deep blend auto-encoder and self-organizing map network, which facilitate the feature-hierarchy fusion of multi-source sensory data. Secondly, for the significant characteristics with nonlinearity and stochastic fluctuation of the HSAI sequence, the multiscale frequency features are extracted by the parameter-adaptive VMD method with the improved gray wolf optimizer, which analyzes the inherent degradation law. Finally, considering the problem of parameter sharing in the transformer model, a simplified mixture of experts routing algorithm is introduced to implement the switch transformer model to further measure the future aero-engine health trends. Extensive experiments on the multi-source dataset of aero-engine confirm that the proposed method accomplishes the more superior performance for health evolution measurement compared with other available methods.

Driving Towards Safety: The Role of ECUs and IMUs in Advanced Driver-Assistance Systems (ADAS)

This research paper explores the pivotal role of Electronic Control Units (ECUs) and Inertial Measurement Units (IMUs) in Advanced Driver-Assistance Systems (ADAS), focusing on their functionalities, applications, regulatory frameworks, emerging technologies, and real-world case studies. Through a comprehensive review of literature, this paper investigates the integration of ECUs and IMUs in ADAS and its implications for vehicle safety, mobility, and sustainability. Key topics addressed include the adoption challenges, societal impact, international regulatory landscape, standardization efforts, emerging technologies such as artificial intelligence and sensor fusion, and real case studies exemplified by Tesla's Autopilot system, Volvo's City Safety system, and Waymo's autonomous taxi service. The paper concludes by highlighting the transformative potential of ECUs and IMUs in shaping the future of automotive technology and advancing towards safer, more efficient, and more sustainable transportation systems.

Innovative Exploration of a Bio-Inspired Sensor Fusion Algorithm: Enhancing Micro Satellite Functionality through Touretsky's Decentralized Neural Networks

Insect-inspired sensor fusion algorithms have presented a promising avenue in the development of robust and efficient systems, owing to the insects' ability to process numerous streams of noisy sensory data. The ring attractor neural network architecture has been identified as a noteworthy model for the optimal integration of diverse insect sensors. Expanding on this, our research presents an innovative bio-inspired ring attractor neural network architecture designed to augment the performance of microsatellite attitude determination systems through the fusion of data from multiple gyroscopic sensors.Extensive simulations using a nonlinear model of the microsatellite, while incorporating specific navigational disturbances, have been conducted to ascertain the viability and effectiveness of this approach. The results obtained have been superior to those of alternative methodologies, thus highlighting the potential of our proposed bio-inspired fusion technique. The findings indicate that this approach could significantly improve the accuracy and robustness of microsatellite systems across a wide range of applications.

Advancing ADAS Perception: A Sensor-Parameterized Implementation of the GM-PHD Filter.

Modern vehicles equipped with Advanced Driver Assistance Systems (ADAS) rely heavily on sensor fusion to achieve a comprehensive understanding of their surrounding environment. Traditionally, the Kalman Filter (KF) has been a popular choice for this purpose, necessitating complex data association and track management to ensure accurate results. To address errors introduced by these processes, the application of the Gaussian Mixture Probability Hypothesis Density (GM-PHD) filter is a good choice. This alternative filter implicitly handles the association and appearance/disappearance of tracks. The approach presented here allows for the replacement of KF frameworks in many applications while achieving runtimes below 1 ms on the test system. The key innovations lie in the utilization of sensor-based parameter models to implicitly handle varying Fields of View (FoV) and sensing capabilities. These models represent sensor-specific properties such as detection probability and clutter density across the state space. Additionally, we introduce a method for propagating additional track properties such as classification with the GM-PHD filter, further contributing to its versatility and applicability. The proposed GM-PHD filter approach surpasses a KF approach on the KITTI dataset and another custom dataset. The mean OSPA(2) error could be reduced from 1.56 (KF approach) to 1.40 (GM-PHD approach), showcasing its potential in ADAS perception.

Customizable Presentation Attack Detection for Improved Resilience of Biometric Applications Using Near-Infrared Skin Detection.

Due to their user-friendliness and reliability, biometric systems have taken a central role in everyday digital identity management for all kinds of private, financial and governmental applications with increasing security requirements. A central security aspect of unsupervised biometric authentication systems is the presentation attack detection (PAD) mechanism, which defines the robustness to fake or altered biometric features. Artifacts like photos, artificial fingers, face masks and fake iris contact lenses are a general security threat for all biometric modalities. The Biometric Evaluation Center of the Institute of Safety and Security Research (ISF) at the University of Applied Sciences Bonn-Rhein-Sieg has specialized in the development of a near-infrared (NIR)-based contact-less detection technology that can distinguish between human skin and most artifact materials. This technology is highly adaptable and has already been successfully integrated into fingerprint scanners, face recognition devices and hand vein scanners. In this work, we introduce a cutting-edge, miniaturized near-infrared presentation attack detection (NIR-PAD) device. It includes an innovative signal processing chain and an integrated distance measurement feature to boost both reliability and resilience. We detail the device's modular configuration and conceptual decisions, highlighting its suitability as a versatile platform for sensor fusion and seamless integration into future biometric systems. This paper elucidates the technological foundations and conceptual framework of the NIR-PAD reference platform, alongside an exploration of its potential applications and prospective enhancements.

Art Works of Youth Aesthetic Psychology Education Based on the Integration of Environmental Perception and Sensing

Youth aesthetic psychology is mainly a branch of psychology that studies the psychological mechanism of people in painting, sculpture, photography, architecture and other art activities, and the psychological activities and laws of people in the creation or appreciation of these art works. Psychologists in the Soviet Union believed that the most basic problem of Youth aesthetic psychology was to study the psychological mechanism of the reaction to beauty when feeling art works. Therefore, we can also regard the appreciation of art works as an aesthetic activity. We can appreciate art works by studying the application and role of Youth aesthetic psychology, so that art appreciators can master aesthetic methods and improve aesthetic standards to a certain extent, and also can deeply resonate with the creator in spirit. This paper carries out the research of Youth aesthetic psychology art works with the perspective of environmental perception and sensor fusion, and combined with experiments to illustrate the effectiveness and superiority of this method.

Shaping the Future of Transportation with Automation

This study explores the advancements and challenges of AI-powered self-driving cars, specifically in the context of urban planning, traffic management, and transportation systems. It investigates the technological components of autonomous vehicles, including computer vision, machine learning algorithms, sensor fusion, and real-time decision-making systems. The research further delves into the training and learning procedures, focusing on the use of large datasets, deep neural networks, and reinforcement learning to continuously enhance driving capabilities through interaction with the environment. The goal is to assess the potential of AI to improve road safety, transit efficiency, and individual mobility, while acknowledging the obstacles that need to be overcome for widespread adoption and societal trust.

Application of Artificial Intelligence and Sensor Fusion for Soil Organic Matter Prediction.

Soil organic matter (SOM) is one of the best indicators to assess soil health and understand soil productivity and fertility. Therefore, measuring SOM content is a fundamental practice in soil science and agricultural research. The traditional approach (oven-dry) of measuring SOM is a costly, arduous, and time-consuming process. However, the integration of cutting-edge technology can significantly aid in the prediction of SOM, presenting a promising alternative to traditional methods. In this study, we tested the hypothesis that an accurate estimate of SOM might be obtained by combining the ground-based sensor-captured soil parameters and soil analysis data along with drone images of the farm. The data are gathered using three different methods: ground-based sensors detect soil parameters such as temperature, pH, humidity, nitrogen, phosphorous, and potassium of the soil; aerial photos taken by UAVs display the vegetative index (NDVI); and the Haney test of soil analysis reports measured in a lab from collected samples. Our datasets combined the soil parameters collected using ground-based sensors, soil analysis reports, and NDVI content of farms to perform the data analysis to predict SOM using different machine learning algorithms. We incorporated regression and ANOVA for analyzing the dataset and explored seven different machine learning algorithms, such as linear regression, Ridge regression, Lasso regression, random forest regression, Elastic Net regression, support vector machine, and Stochastic Gradient Descent regression to predict the soil organic matter content using other parameters as predictors.

A digital shadow approach for enhancing process monitoring in wire arc additive manufacturing using sensor fusion

With the development of Industry 4.0 and smart manufacturing, improving production automation, intelligence, and digitalization has become a research trend in the Wire Arc Additive Manufacturing (WAAM) field. This study introduces a digital shadow that aims to improve the adaptiveness and dimensionality of monitoring systems in WAAM. Three sensors are used in the digital shadow: a welding electric signal sensor, a camera, and a laser profilometer to collect welding current and voltage data, image data, and point cloud data. The collected multi-scaled data are time and spatially synchronized by sampling multiple points along the welding path. Three ML algorithms are used for decision-making: Multi-layer Perceptron (MLP) classifier and YOLOv5 are used for time and spatial-scale detection, respectively, and a Variational Autoencoder (VAE) is used for the decision-level fusion. The system performance is then tested to detect defects and geometric errors in practical experiments and the results show that the overall F1 score is 0.791, including detecting, classifying, and analyzing the cause of defects. Additionally, the total predicting time is within 0.5 s, which is suitable for an in-process monitoring system.

Autonomous mobile robots for outdoor tasks

This paper presents a low-cost hardware platform for outdoor robots, being suitable for education, industrial prototyping and private use. The choice of components isdiscussed, including platform, sensors and controller as well as GPS and image processing hardware. Furthermore, a software approach is proposed, allowing students and researchers to easily implement own algorithms for localization, navigation and the tasks to fulfill. Several robots can be integrated in a framework which connects various different hardware platforms, called the BOSPORUS network. Together with other components, they form an intelligent network for gathering sensor and image data, sensor data fusion, navigation and control of mobile platforms. The architecture of a reference platform on the campus of the Brandenburg University of Applied Sciences is presented and evaluated.

Integrated Sensor Fusion and Multi-Modal Hierarchical Neural Network for Activity Recognition in Lower Limb Prosthetics

Activity recognition plays pivotal role in enhancing functionality for prosthetic devices, ensuring seamless integration with users' movements. However, the complexity arises from the diverse data sources, including acceleration, angular velocity, joint angles, orientation, electromyography (EMG), and marker data, necessitating a robust approach to overcome challenges in information integration. The primary challenge lies in the effective utilization of multiple sensor modalities, each with unique characteristics and potential noise sources. The proposed solution addresses this by employing advanced sensor fusion techniques, such as Kalman filtering, during data collection. Synchronization and resampling ensure temporal consistency, while noise reduction techniques, such as low-pass filters, mitigate signal distortions. To further refine the process, a hybrid optimization-based feature selection Adaptive Step Size in Marine Predators Algorithm (ASSMPA) is introduced, focusing on marker data features. ASSMPA synergizes Marine Predators Algorithm (MPA) and Pathfinder Algorithm (PFA) for optimal feature selection in marine predator pathfinding tasks. The Feature Fusion step integrates attention mechanisms to dynamically weigh the significance of different sensor modalities during the fusion process. This strategic fusion enhances the overall performance of the Multi-Modal Hierarchical Neural Network (MMHNN). The proposed model is implemented using Python.