Residual Connections Research Articles

MFEFNet: A Multi-Scale Feature Information Extraction and Fusion Network for Multi-Scale Object Detection in UAV Aerial Images

Unmanned aerial vehicles (UAVs) are now widely used in many fields. Due to the randomness of UAV flight height and shooting angle, UAV images usually have the following characteristics: many small objects, large changes in object scale, and complex background. Therefore, object detection in UAV aerial images is a very challenging task. To address the challenges posed by these characteristics, this paper proposes a novel UAV image object detection method based on global feature aggregation and context feature extraction named the multi-scale feature information extraction and fusion network (MFEFNet). Specifically, first of all, to extract the feature information of objects more effectively from complex backgrounds, we propose an efficient spatial information extraction (SIEM) module, which combines residual connection to build long-distance feature dependencies and effectively extracts the most useful feature information by building contextual feature relations around objects. Secondly, to improve the feature fusion efficiency and reduce the burden brought by redundant feature fusion networks, we propose a global aggregation progressive feature fusion network (GAFN). This network adopts a three-level adaptive feature fusion method, which can adaptively fuse multi-scale features according to the importance of different feature layers and reduce unnecessary intermediate redundant features by utilizing the adaptive feature fusion module (AFFM). Furthermore, we use the MPDIoU loss function as the bounding-box regression loss function, which not only enhances model robustness to noise but also simplifies the calculation process and improves the final detection efficiency. Finally, the proposed MFEFNet was tested on VisDrone and UAVDT datasets, and the mAP0.5 value increased by 2.7% and 2.2%, respectively.

Innovative integration of multi-scale residual networks and MK-MMD for enhanced feature representation in fault diagnosis

This article proposes a method based on multi-scale expansion of residual neural networks (ResNets) to address challenges in the operation of rotating components, such as bearings and gears, under complex conditions where they are often affected by environmental noise. This interference leads to weaker fault characteristics, making feature selection difficult and increasing the presence of extraneous information features. To tackle this issue, the proposed method first employs a multi-scale feature ResNet to extract features from vibration signals of rotating machinery. The method decomposes the signal into multiple sub-signals of different scales, extracting local features at each scale. It then uses residual connections to combine these local features to obtain a global feature representation. Furthermore, the article introduces a construction of the maximum mean discrepancy (MMD) and minimization of entropy boundaries to adapt to the differences between two domains. The method utilizes multiple kernel functions to calculate distances between data at different scales and combines these distances to obtain a comprehensive measure. By employing the MMD and minimization of entropy boundary approach, the method can more accurately determine whether signals at different scales belong to the same category, thereby improving diagnostic accuracy and robustness. Experimental results demonstrate the effectiveness of the proposed method in unsupervised cross-domain fault diagnosis tasks. Future work will focus on further optimizing the architecture of ResNets, enhancing feature extraction capabilities, and exploring advanced data augmentation methods to further improve the model’s generalization performance.

Neural Technologies for Objects Classification with Mobile Applications

This paper is related to the study of the features of the neural technologies’ application, in particular, ResNet neural networks for the classification of objects in photographs. The work aims to increase the accuracy of recognition and classification of objects in photographs by using various models of the ResNet neural network. The paper analyzes the features of the application of the corresponding models in comparison with other architectures of deep neural networks and evaluates their efficiency and accuracy in the classification of objects in photographs. The process of data formation for training neural networks, their processing and sorting is described. A web application and a mobile application for recognizing and classifying objects in a photo were also developed. A system for classifying objects, in particular airplanes in photographs, was developed using neural network technologies. It gives a recognition and classification accuracy of about 95%. Research results of ResNet models are of great practical importance, as they can improve the classification accuracy of various images. Features of ResNet, such as the use of skip connections or residual connections, make it effective in the relevant tasks. The results of the study will help to implement ResNet in various fields, including medicine, automatic pattern recognition and other areas where the classification of objects in photographs is an important task.

DSTN: Dynamic Spatio-Temporal Network for Early Fault Warning in Chemical Processes

Multivariate time series prediction, especially in early fault warning for chemical processes, poses significant challenges. The advent of graph neural network (GNN) method has made breakthroughs in this domain by enabling the processing of topological data. However, the traditional methods suffer from the issue of over-smoothing and inability to capture intricate multi-scale spatio-temporal dependencies. Additionally, the existing graph structures fall short in describing the complex spatial relationships among multi-stage sensors, impeding their adaptability to dynamically evolving chain reaction scenarios. To alleviate these limitations, a novel Dynamic spatio-Temporal Network for early fault warning in chemical processes, named DSTN for short, is proposed in this paper. We extract the spatial and temporal features of the time series by the designed dynamic GNN and the improved Transformer network. Then, we integrate the spatio-temporal features through the residual network. DSTN has the following advantages: (1) A one-dimensional convolutional neural network is seamlessly incorporated into the Transformer architecture for bolstering its capacity to discern both global and local features within time series. (2) The continuous sliding window and mutual information methods are employed to construct a dynamic topology graph, and a K-order adjacency matrix is designed to rectify the inefficiencies in learning weights associated with convolution kernel parameters. (3) Multiple spatio-temporal modules interconnected via residual connection to adaptively fuse multi-scale features. Experimental results demonstrate that our proposed DSTN method outperforms existing methods in terms of both performance and interpretability in early fault warning of chemical processes.

Analysis of the influencing factors of students' vocational ability based on joint improvement of convolutional neural network and multimodal data

Students' professional ability includes innovation and entrepreneurship ability, independent ability, quality ability, professional ability and adaptability. The school's practical training teaching and professional setting, as well as the unique talent training model have a profound impact on training and development of students' professional ability. The continuous progress and development of society indicates that the competitiveness of occupational positions in the future will continue to increase. The talent market will also put forward newer and more difficult requirements for the quality of students. In study and life, cultivating students' good professional ability is the fundamental purpose of colleges and universities. Employers tend to pay more attention to overall quality of candidates when selecting employees. Whether students can enter the society smoothly after graduation has become an important task. It can be seen that it is very important to analyze the cultivation of students' professional ability and the influencing factors of professional ability. This work combines convolutional neural network (CNN) with the analysis of factors influencing students' vocational ability. First, this work proposes an improved residual block (IRB). It increases the width of the residual network by adding a residual connection channel to learn richer features. Second, this work proposes an improved attention module (IAM). It combines channel attention with spatial attention to improve model performance. Third, this work combines IRB and IAM to propose an SVAIFANet. The model can be applied to the analysis of factors influencing students' vocational ability. Fourth, this work conducts various experiments for proposed method, experimental data verify correctness for this method.

PRO-SSRGAN: stable super-resolution generative adversarial network based on parameter reconstructive optimization on Gaofen-5 remote-sensing images

ABSTRACT Advances in hardware capabilities and big data technologies over the past decade have enabled the application of deep learning techniques to address the challenge of super-resolution in remote-sensing images. Recently, while deep-learning-based methods have outperformed traditional methods, the abundance of information in remote-sensing images creates an imbalance between performance and computational resource consumption in current deep-learning-based methods. This paper introduces a stable super-resolution algorithm based on parameter reconstructive optimization to address these issues. First, based on the stable super-resolution generative adversarial network (SSRGAN), the algorithm employs a generator with networks using residual connections to reconstruct images with enhanced resolution. Next, it extracts content, adversarial, and regularization losses using the discriminator from a stable super-resolution generative adversarial network, which in turn guides the training of the network. Finally, upon completion of training, structural re-parameterization is conducted to optimize the multi-branch trained network into a plain inference network. This inference network can serve as an individual new generator. The results of qualitative and quantitative experimental comparisons with the models Bicubic, super-resolution convolutional neural network, very deep super-resolution convolutional network, deep recursive residual network, super-resolution generative adversarial network (SRGAN), enhanced SRGAN, and stable SRGAN on the Gaofen-5 AHSI satellite dataset suggest that this algorithm achieves improved evaluation indices with a 4× magnification ratio, reaching a peak signal-to-noise ratio of 30.7207 dB and structural similarity index measure of 0.8178. Compared with the trained but unconverted generator, which can also work independently, implementing re-parameterization results in approximately a 10% reduction in the number of parameters, indicating lower resource consumption, while the reconstruction effect is minimally influenced. Furthermore, the super-resolution results exhibit richer detail, increased contrast, and better scene adaptability.

Tool Wear Prediction Based on Residual Connection and Temporal Networks

Tool Wear Prediction Based on Residual Connection and Temporal Networks

Self-testing Algorithm of Metro One-button Switch Station Equipment Based on a Neural Network

According to the operation and management requirements of subway stations, equipment managed by the station, such as lighting, escalators, broadcasting, etc., must be operated with one-button switch according to a certain process every day. The first step in one-button switch station operation is to perform routine self-testing on these devices. Traditional self-testing operations mainly rely on manual handling by operators, which greatly affects their work efficiency. To optimize the operational processes, it is necessary to establish intelligent self-testing algorithms. An AC-CNN (Attention Causal Convolutional Neural Network) model to increase the self-testing efficiency in subway switching stations was established in this paper. AC-CNN model is a deep learning prediction network based on attention mechanism, which can capture the causal convolutional layer of the time before and after relationship as the basic network structure, optimize the convergence process through residual connections, and fuse global and local attention representations through matrix multiplication in the attention mechanism module to reduce useful information loss. The algorithm used the one-hot encoding and sliding window feature engineering operations to preprocess the historical self-testing operation data and completed the prediction of the self-testing information of metro one-button switch station equipment through the deep analysis of AC-CNN. The on-site application results indicated that AC-CNN had greater advantages in terms of accuracy and operation time compared to those of existing BP neural networks, GBDT, and LSTM algorithms, which can significantly improve the work efficiency of subway staff on one-button switch station.

A bearing fault diagnosis method based on M-SSCNN and M-LR attention mechanism

Bearing fault diagnosis is vital for mechanical maintenance and fault prediction. It ensures equipment safety, extends lifespan, reduces maintenance costs, and improves production efficiency. Nevertheless, it should be acknowledged that some existing diagnostic methods have achieved high accuracy rates in certain scenarios. However, the challenge lies in their limited generalization capabilities, which can lead to reduced accuracy when applied to diverse or unseen conditions. In this study, we proposed a new bearing fault diagnosis method to address the issue of low accuracy caused by the inadequate generalization of models in the process of rolling bearing fault diagnosis. The method is based on a multi-scale sliding convolution neural network and multi-level residual attention mechanism, the model exhibits high accuracy, strong generalization capability, and lightweight structure. Firstly, the time domain signal of the bearing vibration is converted into a two-dimensional time–frequency map, and the image is pixel-segmented using superpixel segmentation techniques. Next, a multi-scale parallel convolution approach is used to extract features to improve the adaptability and robustness of the model to objects of different sizes and scales. Sliding convolution is used instead of pooling to avoid the problem of feature loss caused by maximum pooling and average pooling. A multi-level attention mechanism is then introduced for all stacked channels to focus on the more important and critical information of the module, and residual connections are added to prevent degradation of the network performance. Finally, the proposed method is passed through the fully connected layer for classification using the Softmax classifier. Experimental verification using public datasets and experimental data of our research group shows that the proposed method has better performance than the existing diagnostic methods and diagnostic models. The proposed method offers an advanced and innovative solution in the domain of bearing fault diagnosis.

A Continuous Non-Invasive Blood Pressure Prediction Method Based on Deep Sparse Residual U-Net Combined with Improved Squeeze and Excitation Skip Connections.

Arterial blood pressure (ABP) serves as a pivotal clinical metric in cardiovascular health assessments, with the precise forecasting of continuous blood pressure assuming a critical role in both preventing and treating cardiovascular diseases. This study proposes a novel continuous non-invasive blood pressure prediction model, DSRUnet, based on deep sparse residual U-net combined with improved SE skip connections, which aim to enhance the accuracy of using photoplethysmography (PPG) signals for continuous blood pressure prediction. The model first introduces a sparse residual connection approach for path contraction and expansion, facilitating richer information fusion and feature expansion to better capture subtle variations in the original PPG signals, thereby enhancing the network's representational capacity and predictive performance and mitigating potential degradation in the network performance. Furthermore, an enhanced SE-GRU module was embedded in the skip connections to model and weight global information using an attention mechanism, capturing the temporal features of the PPG pulse signals through GRU layers to improve the quality of the transferred feature information and reduce redundant feature learning. Finally, a deep supervision mechanism was incorporated into the decoder module to guide the lower-level network to learn effective feature representations, alleviating the problem of gradient vanishing and facilitating effective training of the network. The proposed DSRUnet model was trained and tested on the publicly available UCI-BP dataset, with the average absolute errors for predicting systolic blood pressure (SBP), diastolic blood pressure (DBP), and mean blood pressure (MBP) being 3.36 ± 6.61 mmHg, 2.35 ± 4.54 mmHg, and 2.21 ± 4.36 mmHg, respectively, meeting the standards set by the Association for the Advancement of Medical Instrumentation (AAMI), and achieving Grade A according to the British Hypertension Society (BHS) Standard for SBP and DBP predictions. Through ablation experiments and comparisons with other state-of-the-art methods, the effectiveness of DSRUnet in blood pressure prediction tasks, particularly for SBP, which generally yields poor prediction results, was significantly higher. The experimental results demonstrate that the DSRUnet model can accurately utilize PPG signals for real-time continuous blood pressure prediction and obtain high-quality and high-precision blood pressure prediction waveforms. Due to its non-invasiveness, continuity, and clinical relevance, the model may have significant implications for clinical applications in hospitals and research on wearable devices in daily life.

Transfer Learning-Based Hyperspectral Image Classification Using Residual Dense Connection Networks.

The extraction of effective classification features from high-dimensional hyperspectral images, impeded by the scarcity of labeled samples and uneven sample distribution, represents a formidable challenge within hyperspectral image classification. Traditional few-shot learning methods confront the dual dilemma of limited annotated samples and the necessity for deeper, more effective features from complex hyperspectral data, often resulting in suboptimal outcomes. The prohibitive cost of sample annotation further exacerbates the challenge, making it difficult to rely on a scant number of annotated samples for effective feature extraction. Prevailing high-accuracy algorithms require abundant annotated samples and falter in deriving deep, discriminative features from limited data, compromising classification performance for complex substances. This paper advocates for an integration of advanced spectral-spatial feature extraction with meta-transfer learning to address the classification of hyperspectral signals amidst insufficient labeled samples. Initially trained on a source domain dataset with ample labels, the model undergoes transference to a target domain with minimal samples, utilizing dense connection blocks and tree-dimensional convolutional residual connections to enhance feature extraction and maximize spatial and spectral information retrieval. This approach, validated on three diverse hyperspectral datasets-IP, UP, and Salinas-significantly surpasses existing classification algorithms and small-sample techniques in accuracy, demonstrating its applicability to high-dimensional signal classification under label constraints.

A Super-Resolution Reconstruction Model for Remote Sensing Image Based on Generative Adversarial Networks

In current times, reconstruction of remote sensing images using super-resolution is a prominent topic of study. Remote sensing data have a complex spatial distribution. Compared with natural pictures, remote sensing pictures often contain subtler and more complicated information. Most super-resolution reconstruction algorithms cannot restore all the information contained in remote sensing images when reconstructing them. The content of some areas in the reconstructed images may be too smooth, and some areas may even have color changes, resulting in lower quality reconstructed images. In response to the problems presenting in current reconstruction algorithms about super-resolution, this article proposes the SRGAN-MSAM-DRC model (SRGAN model with multi-scale attention mechanism and dense residual connection). This model roots in generative adversarial networks and incorporates multi-scale attention mechanisms and dense residual connections into the generator. Furthermore, residual blocks are incorporated into the discriminator. We use some remote sensing image datasets of real-world data to evaluate this model, and the results indicate the SRGAN-MSAM-DRC model has shown enhancements in three evaluation metrics for reconstructed images about super-resolution. Compared to the basic SRGAN model, the SSIM (structural similarity), PSNR (peak signal-to-noise ratio), and IE (image entropy) increase by 5.0%, 4.0%, and 4.1%, respectively. From the results, we know the quality of the reconstructed images of remote sensing using the SRGAN-MSAM-DRC model is better than basic SRGAN model, and verifies that the model has good applicability and performance in reconstruction of remote sensing images using super-resolution.

Attention-based digital filter with anchor-free feature pyramid learning model for pedestrian detection

Ensuring real-time performance while leveraging pedestrian detection is a crucial prerequisite for intelligent driving technology. The development of lightweight models with good detection accuracy is also crucial. This work proposes a novel method, the Attention Digital Filter with Anchor-Free Feature Pyramid Learning Model (ADFAFPLM), to meet these needs. The suggested method consists of combining two networks: one is a digital filter based on an attention network that eliminates noise and other picture distortions. The attention-based residual network digital filters are chosen for their enhanced filtering performance, adaptability, efficient learning through residual connections, noise suppression, interpretability, and generalization capabilities. Next, from the input crowded and occluded photos, the pedestrian is identified using an anchor-free feature pyramid network. The Eurocity person dataset was used to train the model, and it was also tested on other datasets like CityPersons, INRIA, PennFudan, and Eurocity. The investigation was expanded to include images in hazy, noisy, and occlusion environments, among other environmental conditions. The image resolutions were also considered for analysis and it was observed that with increasing image resolution, the mAP increases. Based on the ablation study, the ADF-AFPLM adopted YOLOv8n with batch size 16, and image size 640 is considered for efficient result with different testing datasets. The model achieved a mean average precision (mAP) of approx. 87% and shows its efficacy over state-of-art models.

A lightweight feature activation guided multi-receptive field attention network for light compensation

Image enhancement techniques are commonly used to improve problems such as lack of brightness, high noise, and low contrast in low-light images. Notably, deep learning-based approaches have recently achieved substantial advancements in this domain. However, learning-based methods often require many parameters and multi-layer network structures to achieve high-quality enhancement effects, which limits their application in real-time image processing. To solve this problem, a lightweight Feature Activation Guided Multi-Receptive Field Attention Network (FAMANet) is designed in this paper. The Wavelet Feature Activation Block (WFAB) introduced in the network utilizes the discrete wavelet transform and residual connection to achieve selective activation of image features, thus reducing the redundant information in the feature map and improving the computational efficiency. In addition, the Multi-Receptive Field Attention (MRFA) introduced in this paper addresses the issue of inadequate pixel information and feature map loss stemming from a single input image by concentrating on the image structure, spanning from intricate details to the overall composition. By better-utilizing image information and distinguishing between global and local features, MRFA can improve the speed and efficiency of real-time image processing. After sufficient experimental validation, FAMANet significantly outperforms state-of-the-art methods in low-light image enhancement and exposure correction tasks.

An Intelligent Diagnostic Method for Wear Depth of Sliding Bearings Based on MGCNN

Sliding bearings are vital components in modern industry, exerting a crucial influence on equipment performance, with wear being one of their primary failure modes. In addressing the issue of wear diagnosis in sliding bearings, this paper proposes an intelligent diagnostic method based on a multiscale gated convolutional neural network (MGCNN). The proposed method allows for the quantitative inference of the maximum wear depth (MWD) of sliding bearings based on online vibration signals. The constructed model adopts a dual-path parallel structure in both the time and frequency domains to process bearing vibration signals, ensuring the integrity of information transmission through residual network connections. In particular, a multiscale gated convolution (MGC) module is constructed, which utilizes convolutional network layers to extract features from sample sequences. This module incorporates multiple scale channels, including long-term, medium-term, and short-term cycles, to fully extract information from vibration signals. Furthermore, gated units are employed to adaptively assign weights to feature vectors, enabling control of information flow direction. Experimental results demonstrate that the proposed method outperforms the traditional CNN model and shallow machine learning model, offering promising support for equipment condition monitoring and predictive maintenance.

RCEAU-Net: Cascade Multi-Scale Convolution and Attention-Mechanism-Based Network for Laser Beam Target Image Segmentation with Complex Background in Coal Mine.

Accurate and reliable pose estimation of boom-type roadheaders is the key to the forming quality of the tunneling face in coal mines, which is of great importance to improve tunneling efficiency and ensure the safety of coal mine production. The multi-laser-beam target-based visual localization method is an effective way to realize accurate and reliable pose estimation of a roadheader body. However, the complex background interference in coal mines brings great challenges to the stable and accurate segmentation and extraction of laser beam features, which has become the main problem faced by the long-distance visual positioning method of underground equipment. In this paper, a semantic segmentation network for underground laser beams in coal mines, RCEAU-Net, is proposed based on U-Net. The network introduces residual connections in the convolution of the encoder and decoder parts, which effectively fuses the underlying feature information and improves the gradient circulation performance of the network. At the same time, by introducing cascade multi-scale convolution in the skipping connection section, which compensates for the lack of contextual semantic information in U-Net and improves the segmentation effect of the network model on tiny laser beams at long distance. Finally, the introduction of an efficient multi-scale attention module with cross-spatial learning in the encoder enhances the feature extraction capability of the network. Furthermore, the laser beam target dataset (LBTD) is constructed based on laser beam target images collected from several coal mines, and the proposed RCEAU-Net model is then tested and verified. The experimental results show that, compared with the original U-Net, RCEAU-Net can ensure the real-time performance of laser beam segmentation while increasing the Accuracy by 0.19%, Precision by 2.53%, Recall by 22.01%, and Intersection and Union Ratio by 8.48%, which can meet the requirements of multi-laser-beam feature segmentation and extraction under complex backgrounds in coal mines, so as to further ensure the accuracy and stability of long-distance visual positioning for boom-type roadheaders and ensure the safe production in the working face.

Triple-modality interaction for deepfake detection on zero-shot identity

Recent advancements in generative AI technology have created more realistic fake data that are utilized in various fields, such as data augmentation. However, the misuse of deepfake technology has led to increased damage. Consequently, ongoing research aims to analyze modality characteristics and detect deepfakes through AI-based methods. Existing AI-based deepfake-detection techniques have limitations in detecting deepfakes in modalities and identities that are not included in the training data. This study proposes a baseline approach based on zero-shot identity and one-shot deepfake detection for detecting deepfakes in environments with limited data. Additionally, we propose a triple-modality interaction based on a multimodal transformer (TMI-Former) to consider the triple-modality aspects of deepfakes. TMI-Former comprises four stages: vision feature extraction, representation, residual connection, and late-level fusion. It operates in a two-stage manner, extracting visual features and reconstructing them using auditory and linguistic features, thereby allowing for triple-modality interactions. In environments with limited data, such as zero-shot identity and one-shot deepfake scenarios, TMI-Former demonstrated effectiveness, with an accuracy ranging from 18.75% to 19.5% and an f1-score ranging from 0.2238 to 0.3561, compared to unimodal AI. Furthermore, TMI-Former shows superior performance compared to the existing multi-modal AI, with an accuracy ranging from 1.44% to 19.75% and an f1-score ranging from 0.0146 to 0.4169.

Efficient shrinkage temporal convolutional network model for photovoltaic power prediction

Power stations operating on PhotoVoltaic (PV) power generation are challenged by demand forecasting as PV power generation is random and intermittent. This paper presents an Efficient Shrinkage Temporal Convolutional Network (ESTCN) model, which combines the Temporal Convolutional Network (TCN) and an improved Deep Residual Shrinkage Network (DRSN) to forecast PV power output. First, the attention sub-network of the DRSN is improved, the fully connected layer of the sub-network is canceled, and feature extraction is done directly on the model features following global average pooling using a one-dimensional convolution to obtain cross-channel interaction and increased model efficiency. Next, an improved attention mechanism and adaptive soft thresholding are introduced into TCN to automatically determine the noise threshold to address the issue of information weight dispersion caused by redundant information in the input samples. By incorporating dilated causal convolution, attention module, soft thresholding, and residual connection, the ESTCN model is formed and is shown to enhance PV power output prediction with only a minimal increase in the number of parameters. The power station in Ningxia, China is adopted as a validation example with data taken from the year 2020. The fitting and prediction results of the ESTCN model are compared against the Convolutional Neural Network, Long Short-Term Memory, and TCN models. The ESTCN model yielded the following values of the evaluation metrics: Root Mean Square Error (RMSE) of 1.47 kW, Mean Absolute Error (MAE) of 0.79 kW, and coefficient of determination of 0.999. Compared to the TCN model, the prediction errors based on RMSE and MAE improved by 0.39 kW and 0.18 kW, respectively. Applying the ESTCN model to predict PV power generation of power stations in two regions in China, Ningxia and Xinjiang, shows the ESTCN model to be superior, scalable, and universal over other deep learning models.

Temporal convolutional network for prediction of Li-ion batteries capacity fade knee

Lithium-ion batteries are widely used for electric vehicles for fast charging capabilities and driving range, but they are characterized by a deterioration dependent from their operational conditions. The process of battery degradation shows a first stage when the degradation proceeds at a slow pace, followed by a stage when the battery abruptly deteriorates. The transition between these two stages is known as capacity fade curve knee. Predicting the capacity fade curve knee can be used to improve the lifetime of the battery by modifying the charging strategies, planning the maintenance, deciding warranty conditions in more cost-effective way and is also important in second life (when the battery is used in a less-demanding application), by timely preventing an unreversible aging trend that could occur in the first life. The present study aims to develop a novel technique to predict the occurrence of the capacity fade curve knee, introducing an engineered state of health indicator and using a Temporal Convolutional Network (TNC) that combines dilations and residual connections with causal convolutions. The effect of the choice of different initial cycles on the prediction accuracy has been studied and a heuristic uncertainty quantification has been provided to obtain an approximate measure of the prediction quality. Moreover, the network has been trained using inputs with different sampling frequencies and results have been compared. The prediction metrics of the present method have been compared to other methods, showing the benefit of this method for the early forecast of the onset of the capacity fade curve knee.

Advancing Brain Tumor Segmentation in MRI Scans: Hybrid Attention-Residual UNET with Transformer Blocks

Accurate segmentation of brain tumors is vital for effective treatment planning, disease diagnosis, and monitoring treatment outcomes. Post-surgical monitoring, particularly for recurring tumors, relies on MRI scans, presenting challenges in segmenting small residual tumors due to surgical artifacts. This emphasizes the need for a robust model with superior feature extraction capabilities for precise segmentation in both pre- and post-operative scenarios. The study introduces the Hybrid Attention-Residual UNET with Transformer Blocks (HART-UNet), enhancing the U-Net architecture with a spatial self-attention module, deep residual connections, and RESNET50 weights. Trained on BRATS’20 and validated on Kaggle LGG and BTC_ postop datasets, HART-UNet outperforms established models (UNET, Attention UNET, UNET++, and RESNET 50), achieving Dice Coefficients of 0.96, 0.97, and 0.88, respectively. These results underscore the model’s superior segmentation performance, marking a significant advancement in brain tumor analysis across pre- and post-operative MRI scans.