Mainstream Models Research Articles

Analysis for integrated energy system: Benchmarking methods and implementation

AbstractThe selection of suitable models and solutions is a fundamental requirement for conducting energy flow analysis in integrated energy systems (IES). However, this task is challenging due to the vast number of existing models and solutions, making it difficult to comprehensively compare scholars' studies with current work. In this paper, we aim to address this issue by presenting a comprehensive overview of mainstream IES models and clarifying their relationships, thereby providing guidance for scholars in selecting appropriate models. Additionally, we introduce several widely used solvers for solving algebraic and differential equations, along with their detailed implementations in the energy flow analysis of IES. Furthermore, we conduct extensive testing and demonstration of these models and methods in various cases to establish benchmarking datasets. To facilitate reproducibility, verification and comparisons, we provide open‐source access to these datasets, including system data, analysis settings and implementations of the various solvers in the mainstream models. Scholars can utilise the provided datasets to reproduce the results, verify the findings and perform comparative analyses. Moreover, they have the flexibility to customise these settings according to their specific requirements.

A local enhanced mamba network for hyperspectral image classification

Deep learning has significantly advanced hyperspectral image (HSI) classification, primarily due to its robust nonlinear feature extraction capabilities. The vision transformer has achieved notable performance but is limited by the quadratic computational burden of its self-attention mechanism. Recently, a network based on state space model named Mamba, has attracted considerable attention for its linear complexity and commendable performance. Nevertheless, Mamba was originally designed for one-dimensional causal sequence modeling, and its effectiveness in inherent non-causal HSI classification remains to be fully validated. To address this issue, we propose a novel Local Enhanced Mamba (LE-Mamba) network for hyperspectral image classification, which mainly comprises a Local Enhanced Spatial SSM (LES-S6), a Central Region Spectral SSM (CRS-S6), and a Multi-Scale Convolutional Gated Unit (MSCGU). The LES-S6 improves non-causal local feature extraction by incorporating a multi-directional local spatial scanning mechanism. Additionally, the CRS-S6 employs a bidirectional scanning mechanism in the spectral dimension to capture fine spectral details and integrate them with spatial information. The MSCGU utilizes a convolutional gating mechanism to aggregate features from diverse scanning routes and extract high-level semantic information. The overall accuracies of LE-Mamba on Indian Pines, WHU-Hi-HanChuan, WHU-Hi-LongKou, and Pavia University datasets are 99.16 %, 98.16 %, 99.57 %, and 99.63 %, respectively. Extensive experimental results on these four public datasets demonstrate that the LE-Mamba outperforms eight mainstream deep learning models in classification performance.

Deep Learning Models for PV Power Forecasting: Review

Accurate forecasting of photovoltaic (PV) power is essential for grid scheduling and energy management. In recent years, deep learning technology has made significant progress in time-series forecasting, offering new solutions for PV power forecasting. This study provides a systematic review of deep learning models for PV power forecasting, concentrating on comparisons of the features, advantages, and limitations of different model architectures. First, we analyze the commonly used datasets for PV power forecasting. Additionally, we provide an overview of mainstream deep learning model architectures, including multilayer perceptron (MLP), recurrent neural networks (RNN), convolutional neural networks (CNN), and graph neural networks (GNN), and explain their fundamental principles and technical features. Moreover, we systematically organize the research progress of deep learning models based on different architectures for PV power forecasting. This study indicates that different deep learning model architectures have their own advantages in PV power forecasting. MLP models have strong nonlinear fitting capabilities, RNN models can capture long-term dependencies, CNN models can automatically extract local features, and GNN models have unique advantages for modeling spatiotemporal characteristics. This manuscript provides a comprehensive research survey for PV power forecasting using deep learning models, helping researchers and practitioners to gain a deeper understanding of the current applications, challenges, and opportunities of deep learning technology in this area.

Instance segmentation of pigs in infrared images based on INPC model

Conventional segmentation methods based on visible images in intensive pig farming face various challenges. Examples include color differences between pig breeds, background interference and lighting conditions. To overcome these issues, we designed the infrared pig cascade segmentation (INPC) model for the first time on infrared images. The model uses a cascade structure. Each stage utilizes higher resolution feature maps to better preserve fine details. It also solves the problem of poor segmentation of small objects due to low resolution of infrared images. At the same time, the model’s cross-guidance strategy enhances the interaction between bounding box regression and mask prediction. This reduces errors caused by interference like feces and urine. Additionally, a progressive mask branch refines mask prediction, improving segmentation in scenarios like imaging haze or pig adhesion. To facilitate model training and evaluation, we built the first large-scale standardized infrared pig dataset. Experimental results demonstrate that INPC outperforms mainstream segmentation models in terms of average precision (AP), except for AP0.5. Specifically, INPC achieves AP0.5, AP0.75, AP0.5:0.95, AP0.5:0.95s, and AP0.5:0.95l of 97.9%, 97.1%, 88.2%, 71.5%, and 90.1% respectively. Inference for a single image on a GPU takes only 0.197 s. Some datasets are available at https://github.com/HUBUwg96/INPC.

A novel prediction method for peak cutting force of curved picks considering lithological tolerances

This study presents a 3D pick-rock contact calculation method for conical picks, aiming to develop a predictive method with high accuracy and lithological tolerance for peak cutting force (PCF). The method is based on the projection profile method and D. L. Sikarskie stress distribution function. By integrating Griffith’s theory with rock damage constitutive model, the energy relationship between the rock fracturing process and crack propagation process is analyzed. Furthermore, in order to accurately correct the PCF, the energy correction function (C-Kf) is proposed to calculate the damage intensity index (Ke), which accounts for the relationship between rock brittleness and rock damage elastic–plastic energy. To validate the method, it is compared with full-scale cutting tests and three existing models, and statistical analysis confirms its high lithological tolerance and accuracy, the present model has the highest R2 of 0.90404, which is at least 12.5% higher relative to the mainstream models. Moreover, incorporating Ke into the method further enhances its predictive capability.

Diffusion mechanism of quick-setting slurry in water-rich fractured rock mass based on circle-outburst diffusion model

Grouting is the most commonly used methods in dealing with water inrush issue in mine and tunnel engineering. In order to better predict the grouting effect, research on slurry diffusion mechanism became a hotspot for scholars. At present, the mainstream theoretical model used to study the slurry diffusion mechanism are the circle diffusion model and the modified ones in plane plate fracture. However, these models cannot explain the “contradiction” between the rapid setting characteristics of quick-setting slurry and the continuous long-term injection of slurry in grouting engineering, which cannot accurately predict the grouting pressure or grouting diffusion range. Therefore, a “circle-outburst diffusion model” which can explain the above “contradiction” was proposed in this paper. Based on the new model, stepwise algorithms were developed to predict the grouting pressure and slurry diffusion range. By means of conducting fracture grouting simulation test and collecting grouting pressure data in an actual grouting project, the new model was verified and the slurry diffusion mechanism was studied. Comparison results indicate that the new model can reveal the intrinsic reason for the irregular diffusion phenomenon of the slurry and forecast the outburst moment accurately. The circle diffusion stage and outburst diffusion stage elaborated in the new “circle-outburst diffusion model” were consistent with the staged characteristics of the grouting process presented in the grouting simulating test. Differences between theoretical and experimental pressure value were within 10 %, indicating a high degree of consistency. The number and distribution of outburst diffusion points determine slurry diffusion form and significantly influence the diffusion range. The grouting pressure and the length of slurry flow path increase nonlinearly with time in each diffusion stage. It is hoped that the new model can provide a theoretical basis for the study of diffusion mechanism of quick-setting slurry.

Point cloud semantic segmentation of grotto scenes using the knowledge-guided deep learning method

ABSTRACT In recent years, the deep learning-based semantic segmentation for point clouds has demonstrated remarkable capabilities in processing 3D urban scenes for applications such as three-dimensional reconstruction, semantic modeling, and augmented reality. However, research on grottoes scenes is very limited. It is currently unclear how existing neural architectures for point cloud semantic segmentation perform in grotto scenes, and how to effectively incorporate the unique characteristics of grotto scenes to enhance the performance of deep neural networks. This study proposed a method for point cloud semantic segmentation of grotto scenes, combining knowledge with deep learning approaches. The method adopted knowledge to guide the creation of benchmark datasets, the design of a neural network called GSS-Net, and the correction of segmentation errors in the results of deep learning. The results show that the proposed method outperforms four existing mainstream models without the correction of segmentation results. Moreover, a set of ablation studies verified the effectiveness of each proposed module. This method not only improves the accuracy of point cloud semantic segmentation in grotto scenes but also enhances the interpretability of network designs. It provides new insights into the application of knowledge-guided deep learning models in grotto scenes.

Implementation of Lung Nodule Detection Model Based on Incremental Meta-Learning

In response to the issue that traditional lung nodule detection models cannot dynamically optimize and update with the increase of new data, a new lung nodule detection model-task incremental meta-learning model (TIMLM) is proposed. This model comprises of two loops: the inner loop imposes incremental learning regularization update constraints, while the outer loop employs a meta-update strategy to sample old and new knowledge and learn a set of generalized parameters that adapt to old and new data. Under the condition that the main structure of the model is not changed as much as possible, it preserves the old knowledge that was learned previously. Experimental verification on the publicly available lung dataset showed that, compared with traditional deep network models and mainstream incremental models, TIMLM has greatly improved in terms of accuracy, sensitivity, and other indicators, demonstrating good continuous learning and anti-forgetting capabilities.

FHS-adapter: fine-grained hierarchical semantic adapter for Chinese landscape paintings generation

How to migrate text-to-image models based on pre-trained diffusion models to adapt them to domain generation tasks is a common problem. In particular, the generation task for Chinese landscape paintings with unique characteristics suffers from a scarcity of fine-grained contextual details specific to such artwork. Moreover, the use of substantial amounts of non-landscape painting data during pre-training predisposes the model to be swayed by alternative visual styles, thereby leading to generated images that inadvertently lack the distinctive traits inherent to Chinese paintings. In this paper, we propose a Fine-grained Hierarchical Semantic Adapter for Chinese landscape paintings generation, namely FHS-adapter. The method orchestrates the diffusion process in a batch-wise manner, leveraging external fine-grained multi-perspective information to guide it. It gradually diminishes the influence of other style images embedded in the pre-trained diffusion model, ultimately preserving a greater number of landscape painting elements. The encoder was also replaced with the Taiyi-CLIP encoder, which is adapted for Chinese. We propose T2ICLP, a multimodal dataset containing 10,000 high-quality image-text pairs of Chinese landscape paintings. Unlike previous datasets, this dataset extracts fine-grained textual information from four perspectives, including Meta, Description, Sentiment, Poem. We compared the proposed model with the mainstream diffusion-based T2I models. Through an anonymous user study, our FHS-adapter method performs well in simulating various aspects such as brushwork, e.g.‘Gou, Cun, Dian, Ran’ means hooking, texturing, dotting, and dyeing, compositional space, elemental proportions, and color usage of different painting genres and artists. Our dataset is available at https://github.com/T2ICLP/t2iclp.

SWFormer: A scale-wise hybrid CNN-Transformer network for multi-classes weed segmentation

Weeds in rapeseed field are an important factor in crop yield reduction and economic loss. Thus, Precision Agriculture is an important task for sustainable agriculture and weed management. At present, deep learning techniques have shown great potential for image-based detection and classification in various crops and weeds. However, the inherent limitations of traditional convolutional neural networks pose significant challenges due to the locally similarity of weeds and crops in color, shape and texture. To address this issue, we introduce SWFormer, a scale-wise hybrid CNN-Transformer network. SWFormer leverages the distinct strengths of both convolutional and transformer architectures. Convolutional structures excel at extracting short-range dependency information among pixels, whereas transformer structures are adept at capturing global dependency relationships. Additionally, we propose two innovative modules. Firstly, the Scale-wise Cascade Convolution (SWCC) module is designed to capture multiscale features and expand the receptive field. Secondly, the Adaptive Semantic Aggregation (ASA) module facilitates adaptive and effective information fusion across two distinct feature maps. Our experiments were conducted on the publicly available cropandweed dataset and SB20 dataset. it yields improved performance over other mainstream segmentation models. Specifically, SWFormer with 52.33M/527.51GFLOPs achieves an mAP of 76.54% and an accuracy of 83.95% on the cropandweed dataset. For the SB20 dataset, it attains an mAP of 61.24% and an accuracy of 79.47%. Overall, the evaluation clearly demonstrates our proposed SWFormer is conducive to promoting further research in the area of Precision Agriculture.

Bidirectional long-short term memory predictor for material removal rate in computer-controlled optical surfacing

In Computer-Controlled Optical Surfacing technology, the precision of the removal function directly affects the accuracy of computer-aided processing software predictions, which in turn influences subsequent polishing machine processing. A key parameter for constructing the removal function is the material removal rate, which is often challenging to obtain accurately. Currently, the Preston equation is widely used to describe the principles of material removal. However, as a linear equation that omits many factors, it struggles to accurately model the removal function in complex machining scenarios. Therefore, this paper proposes a hybrid neural network model combining Convolutional Neural Networks and Bidirectional Long Short-Term Memory to predict the material removal rate. The model's parameters are optimized using an improved Grey Wolf Optimization algorithm, ultimately establishing a removal function closely consistent with an actual removal function. We first tested our method on the PHM2016 Data Challenge dataset, achieving a mean squared error of 6.19 and an R2 of 0.9949, outperforming other mainstream neural network prediction models developed in recent years. Additionally, we further validated the performance of the neural network using a small grinding head polishing dataset, achieving MSE and R2 values of 1.9035 and 0.99902, respectively. Finally, we applied this method to construct the removal function on an actual small grinding head production line. Compared to the traditional Preston equation-based removal function, the predicted residual surface's PV and RMS errors were reduced from 28.24 % to 35.58 %–4.563 % and 4.86 %, respectively. These validation results demonstrate that the proposed method not only facilitates easier acquisition of the removal function model but also significantly enhances the accuracy of computer-aided processing software predictions, thereby better guiding ultra-precision machining processes.

Utilizing Silhouette and Head Information for Improved Cloth-changing Person Re-Identification

In recent years, significant progress has been made in person re-identification (ReID). However, as the time span increases, the phenomenon of changing clothes often occur, and the performance of methods based on person re-identification may decrease in this case. In this article, we focus on solving the problem of cloth-changing person re-identification from a single RGB image, which is more challenging, and improving the accuracy and robustness of traditional methods for recognition. We propose a cloth-changing Feature Regularization learning framework by fusing Silhouette and Head information (SHFR), a two-stream framework which transfers the silhouette information and head information learned by auxiliary stream to the main stream and supplements features unrelated to clothing. Specifically, the main stream approach we adopt is the traditional cloth-changing person re-identification network. In the auxiliary stream, we use the DeepLabV3 semantic segmentation model to extract person silhouette features, and the FCHD fully convolutional head detection model to extract head information with advanced semantic information. We concatenate the head information and background information into the silhouette as input for BackBone to continue training the network. In order to utilize silhouette information and head information, we regularize the cloth-changing features on both main stream and auxiliary stream, allowing main stream model to pay more attention to features unrelated to clothing and improve the accuracy of model recognition. We conduct extensive experiments on our model on the PRCC dataset, and the results show that our method has highly competitive performance.

Improved Chinese Giant Salamander Parental Care Behavior Detection Based on YOLOv8.

Optimizing the breeding techniques and increasing the hatching rate of Andrias davidianus offspring necessitates a thorough understanding of its parental care behaviors. However, A. davidianus' nocturnal and cave-dwelling tendencies pose significant challenges for direct observation. To address this problem, this study constructed a dataset for the parental care behavior of A. davidianus, applied the target detection method to this behavior for the first time, and proposed a detection model for A. davidianus' parental care behavior based on the YOLOv8s algorithm. Firstly, a multi-scale feature fusion convolution (MSConv) is proposed and combined with a C2f module, which significantly enhances the feature extraction capability of the model. Secondly, the large separable kernel attention is introduced into the spatial pyramid pooling fast (SPPF) layer to effectively reduce the interference factors in the complex environment. Thirdly, to address the problem of low quality of captured images, Wise-IoU (WIoU) is used to replace CIoU in the original YOLOv8 to optimize the loss function and improve the model's robustness. The experimental results show that the model achieves 85.7% in the mAP50-95, surpassing the YOLOv8s model by 2.1%. Compared with other mainstream models, the overall performance of our model is much better and can effectively detect the parental care behavior of A. davidianus. Our research method not only offers a reference for the behavior recognition of A. davidianus and other amphibians but also provides a new strategy for the smart breeding of A. davidianus.

EA-DINO: Improved method for unmanned aerial vehicle detection in airspace based on DINO

In recent years, the increase in drone traffic and the potential for unauthorized surveillance has underscored the urgent need for technological advances in drone detection. Despite the rapid advancements in deep learning that have significantly improved object detection tasks, air-to-air unmanned aerial vehicle (UAV) detection continues to pose significant challenges. Challenges such as complex backgrounds, small size of UAVs in captured images, and variations in flight poses and angles pose significant difficulties for traditional deep learning approaches, mainly because of the inherent limitations of conventional convolutional neural network architectures in discriminating fine details against dynamically changing backdrops. To address these challenges, this study introduces EA-DINO, a new deep learning network based on enhanced aggregation (EA) and DINO. The network incorporates a series of improvements over DINO. First, the backbone is replaced with a Swin transformer, and agent attention is integrated. Second, an EA feature pyramid network is added to the network architecture. Experimental evaluations demonstrate that, in the context of air-to-air UAV detection complexities, the EA-DINO model achieves an mAP 50 of 96.6% on the Det-Fly dataset, representing an improvement of 8.3% over the baseline DINO model. This improvement is noteworthy compared with other mainstream models, illustrating the effectiveness of the proposed model in addressing the challenges of air-to-air UAV detection.

OMC-YOLO: A Lightweight Grading Detection Method for Oyster Mushrooms

In this paper, a lightweight model—OMC-YOLO, improved based on YOLOv8n—is proposed for the automated detection and grading of oyster mushrooms. Aiming at the problems of low efficiency, high costs, and the difficult quality assurance of manual operations in traditional oyster mushroom cultivation, OMC-YOLO was improved based on the YOLOv8n model. Specifically, the model introduces deeply separable convolution (DWConv) into the backbone network, integrates the large separated convolution kernel attention mechanism (LSKA) and Slim-Neck structure into the Neck part, and adopts the DIoU loss function for optimization. The experimental results show that on the oyster mushroom dataset, the OMC-YOLO model had a higher detection effect compared to mainstream target detection models such as Faster R-CNN, SSD, YOLOv3-tiny, YOLOv5n, YOLOv6, YOLOv7-tiny, YOLOv8n, YOLOv9-gelan, YOLOv10n, etc., and that the mAP50 value reached 94.95%, which is an improvement of 2.62%. The number of parameters and the computational amount were also reduced by 26%. The model provides technical support for the automatic detection of oyster mushroom grades, which helps in realizing quality control and reducing labor costs and has positive significance for the construction of smart agriculture.

UCSwin‐UNet model for medical image segmentation based on cardiac haemangioma

AbstractCardiac hemangioma is a rare benign tumour that presents diagnostic challenges due to its variable clinical symptoms, imaging features, and locations. This study proposes a novel segmentation method based on a Convolutional Neural Network (CNN) and Transformer integration, with Swin‐UNet as the core model. We incorporated a U‐shaped convolutional neural network block into the original jump connection of Swin‐UNet. The Binary Cross Entropy Loss (BCE Loss) algorithm was added, and the learning rate decay algorithm was modified to select the appropriate one by comparing loss values. This paper utilizes the publicly available cardiac angioma dataset in AI Studio, consisting of 215 images for training and testing. To evaluate the effectiveness of the proposed model, this paper demonstrates its optimality through ablation experiments and comparisons with other mainstream models. The comparison experiments show that this model improves Dice by approximately 12%, HD95 by approximately 4.7 mm, Accuracy by approximately 6.1%, and F1 score by 0.11 compared to models such as UNet, UNet++, and Deeplabv3+, etc. For the recently proposed SOTO models, such as TransUNet, Swin‐UNet, and MultiResUnet, the Dice score improved by about 1.2%, HD95 reduced by about 1mm, Accuracy improved by about 0.3%, and F1 score improved by 0.015.

Long-term prediction modeling of shallow rockburst with small dataset based on machine learning

Rockburst present substantial hazards in both deep underground construction and shallow depths, underscoring the critical need for accurate prediction methods. This study addressed this need by collecting and analyzing 69 real datasets of rockburst occurring within a 500 m burial depth, which posed challenges due to the dataset's multi-categorized, unbalanced, and small nature. Through a rigorous comparison and screening process involving 11 machine learning algorithms and optimization with KMeansSMOKE oversampling, the Random Forest algorithm emerged as the most optimal choice. Efficient adjustment of hyper parameter was achieved using the Optuna framework. The resulting KMSORF model, which integrates KMeansSMOKE, Optuna, and Random Forest, demonstrated superior performance compared to mainstream models such as Gradient Boosting (GB), Extreme Gradient Boosting (XBG), and Extra Trees (ET). Application of the model in a tungsten mine and tunnel project showcased its ability to accurately forecast rockburst levels, thereby providing valuable insights for risk management in underground construction. Overall, this study contributes to the advancement of safety measures in underground construction by offering an effective predictive model for rockburst occurrences.

Bi-directional context-aware network for the nested named entity recognition

The Span-based model can effectively capture the complex entity structure in the text, thus becoming the mainstream model for nested named entity recognition (Nested NER) tasks. However, traditional Span-based models decode each entity span independently. They do not consider the semantic connections between spans or the entities’ positional information, which limits their performance. To address these issues, we propose a Bi-Directional Context-Aware Network (Bi-DCAN) for the Nested NER. Specifically, we first design a new span-level semantic relation model. Then, the Bi-DCAN is implemented to capture this semantic relationship. Furthermore, we incorporate Rotary Position Embedding into the bi-affine mechanism to capture the relative positional information between the head and tail tokens, enabling the model to more accurately determine the position of each entity. Experimental results show that compared to the latest model Diffusion-NER, our model reduces 20M parameters and increases the F1 scores by 0.24 and 0.09 on the ACE2005 and GENIA datasets respectively, which proves that our model has an excellent ability to recognise nested entities.

Dependent Hidden Markov Model for pedestrian intention prediction: considering Multivariate Interaction Force

Accurately recognizing and predicting pedestrian intentions is crucial for autonomous vehicle safety. However, existing prediction models often fail to comprehensively consider interactions between various traffic elements, resulting in suboptimal accuracy and robustness, especially in complex environments. To address this, we propose a pedestrian intention prediction model combining the Multivariate Interaction Force (MIF) model and a Dependent Hidden Markov Model (DE-HMM) for unsignalized midblock crossings. The MIF model captures dynamic interactions among pedestrians, vehicles, and the environment, while DE-HMM uses MIF data and pedestrian head orientation for predictions. Our model achieves 91.5% accuracy in recognizing crossing intentions, and 88.7% and 85.1% accuracy for predictions 0.5s and 1s ahead, respectively, outperforming current mainstream models and demonstrating strong robustness in special scenarios.

Exploring for the Change in Change of Employment Status Over Time

The study seeks to explore for presence of dissimilar developmental paths in employment status of American individuals. The empirical longitudinal exercise is conducted with hybrid latent class growth model and latent class growth mixtures. For testing the hypothesis of heterogeneous subgroups within employment status data three mainstream modelling variants of growth modelling are tested and elaborated in terms of model performance. Progressive employment status based typology is found robust to alternative model specifications voting for presence of clustered growth patterns in experiencing employment status over time. The resulted employment status based typology describes three clusters of active, inactive and mediocre active participants in terms of moving between various stages of employment status for the age span of 18years to 35 years i.e., from adult to post adult prime working life years. The presented approach to understand and explore employment status is novel perspective compared to classic survey based employment status data.