Optimization Of Loss Function Research Articles

MDD-DETR: Lightweight Detection Algorithm for Printed Circuit Board Minor Defects

PCBs (printed circuit boards) are the core components of modern electronic devices, and inspecting them for defects will have a direct impact on the performance, reliability and cost of the product. However, the performance of current detection algorithms in identifying minor PCB defects (e.g., mouse bite and spur) still requires improvement. This paper presents the MDD-DETR algorithm for detecting minor defects in PCBs. The backbone network, MDDNet, is used to efficiently extract features while significantly reducing the number of parameters. Simultaneously, the HiLo attention mechanism captures both high- and low-frequency features, transmitting a broader range of gradient information to the neck. Additionally, the proposed SOEP neck network effectively fuses scale features, particularly those rich in small targets, while INM-IoU loss function optimization enables more effective distinction between defects and background, further improving detection accuracy. Experimental results on the PCB_DATASET show that MDD-DETR achieves a 99.3% mAP, outperforming RT-DETR by 2.0% and reducing parameters by 32.3%, thus effectively addressing the challenges of detecting minor PCB defects.

Deep-learning-based attenuation map generation in kidney single photon emission computed tomography

BackgroundAccurate attenuation correction (AC) is vital in nuclear medicine, particularly for quantitative single-photon emission computed tomography/computed tomography (SPECT/CT) imaging. This study aimed to establish a CT-free quantification technology in kidney SPECT imaging using deep learning to generate synthetic attenuation maps (μ-maps) from SPECT data, thereby reducing radiation exposure and eliminating the need for CT scans.ResultsA dataset of 1000 Tc-99m DTPA SPECT/CT scans was analyzed for training (n = 800), validation (n = 100), and testing (n = 100) using a modified 3D U-Net for deep learning. The study investigated the use of primary emission and scattering SPECT data, normalization methods, loss function optimization, and up-sampling techniques for optimal μ-map generation. The problem of checkerboard artifacts, unique to μ-map generation from SPECT signals, and the effects of iodine contrast media were evaluated. The addition of scattering SPECT to primary emission SPECT imaging, logarithmic maximum normalization, the combination of absolute difference loss (L1) and three times the absolute gradient difference loss (3 × LGDL), and the nearest-neighbor interpolation significantly enhanced AI performance in μ-map generation (p < 0.00001). Checkerboard artifacts were effectively eliminated using the nearest-neighbor interpolation technique. The developed AI algorithm produced μ-maps neutral to the presence of iodine contrast and showed negligible contrast effects on quantitative SPECT measurement, such as glomerular filtration rate (GFR). The potential reduction in radiation exposure by transitioning to AI-based CT-free SPECT imaging ranges from 45.3 to 78.8%.ConclusionThe study successfully developed and optimized a deep learning algorithm for generating synthetic μ-maps in kidney SPECT images, demonstrating the potential to transition from conventional SPECT/CT to CT-free SPECT imaging for GFR measurement. This advancement represents a significant step towards enhancing patient safety and efficiency in nuclear medicine.

A Lightweight Real-Time Recognition Algorithm for Tomato Leaf Disease Based on Improved YOLOv8

To address the real-time detection challenge of deploying deep learning-based tomato leaf disease detection algorithms on embedded devices, an improved tomato leaf disease detection algorithm based on YOLOv8n is proposed in this paper. It is able to achieve the efficient, real-time detection of tomato leaf diseases while maintaining model’s lightweight requirements. The algorithm incorporated the LMSM (lightweight multi-scale module) and ALSA (Attention Lightweight Subsampling Module) to improve the ability to extract lightweight and multi-scale semantic information for the specific characteristics of tomato leaf disease, which include irregular spot size and lush tomato leaves. The head network was redesigned utilizing partial and group convolution along with a parameter-sharing method. Scalable auxiliary bounding box and loss function optimization strategies were introduced to further enhance performance. After undergoing the pruning technique, computation decreased by 61.7%, the model size decreased by 55.6%, and the FPS increased by 44.8%, all while a high level of accuracy was maintained. A detection speed of 19.70FPS on the Jetson Nano was obtained after undergoing TensorRT quantization, showing a 64.85% improvement compared to the initial detection speed. This method met the high real-time performance and small model size requirements for embedded tomato leaf disease detection systems, indirectly reducing the energy consumption of online detection. It provided an effective solution for the online detection of tomato leaf disease.

SNW YOLOv8: improving the YOLOv8 network for real-time monitoring of lump coal

Abstract Due to the large size of the coal and the high mining output, lump coal is one of the hidden risks of mining conveyor damage. Typically, lump coal can cause jamming and even damage to the conveyor belt during the coal mining and transportation process. This study proposes a novel real-time detection method for lump coal on a conveyor belt. The Space-to-Depth Conv (SPD-Conv) module is introduced into the feature extraction network to extract the features of the mine's low-resolution lump coal. To enhance the feature extraction capability of the model, the Normalization-based Attention Module (NAM) is combined to adjust weight sparsity. After loss function optimization using the Wise-IoU v3 (WIoU v3) module, the SPD-Conv-NAM-WIoU v3 YOLOv8 (SNW YOLO v8) model is proposed. The experimental results show that the SNW YOLOv8 model outperforms the widely used model (YOLOv8) in terms of precision and recall by 15.82% and 11.71%, respectively. Significantly, the real-time detection speed of the SNW YOLOv8 model is increased to 192.93 f/s. Compared to normal models, the SNW YOLO v8 model overcomes the disadvantages of normal models, such as being overweight, and the parameters of SNW YOLO v8 are reduced to only 6.04 million with a small model volume of 12.3 MB. Meanwhile, the floating point of SNW YOLOv8 is significantly reduced. Consequently, it demonstrates excellent lump coal detection performance, which may open up a new window for coal mining optimization.

Leveraging Conditional Generative Adversarial Networks (cGANs) for enhanced artistic creation: Exploring quality improvement and content control through conditional inputs

Conditional Generative Adversarial Networks (cGANs) have revolutionized digital art by enabling the creation of high-quality, artistically coherent images guided by conditional inputs. This paper examines key factors influencing the performance of cGANs, including the quality of training data, network architecture improvements, and loss function optimization. We introduce a mathematical model to quantify training data quality, emphasizing dataset diversity, data augmentation, and cleaning. Network architectural enhancements such as residual connections, attention mechanisms, and progressive growing are explored for their impact on image quality. Additionally, we discuss the integration of conditional inputs, such as labels and textual descriptions, for precise content control. Challenges in balancing realism with artistic expression, managing mode collapse, and interpreting conditional inputs are also addressed. This study provides a comprehensive framework for enhancing cGAN-generated artworks, offering insights into applications in personalized art generation, art restoration, and collaborative art projects.

XGBoost-B-GHM: An Ensemble Model with Feature Selection and GHM Loss Function Optimization for Credit Scoring

Credit evaluation has always been an important part of the financial field. The existing credit evaluation methods have difficulty in solving the problems of redundant data features and imbalanced samples. In response to the above issues, an ensemble model combining an advanced feature selection algorithm and an optimized loss function is proposed, which can be applied in the field of credit evaluation and improve the risk management ability of financial institutions. Firstly, the Boruta algorithm is embedded for feature selection, which can effectively reduce the data dimension and noise and improve the model’s capacity for generalization by automatically identifying and screening out features that are highly correlated with target variables. Then, the GHM loss function is incorporated into the XGBoost model to tackle the issue of skewed sample distribution, which is common in classification, and further improve the classification and prediction performance of the model. The comparative experiments on four large datasets demonstrate that the proposed method is superior to the existing mainstream methods and can effectively extract features and handle the problem of imbalanced samples.

Recognition Method of Cabbage Heads at Harvest Stage under Complex Background Based on Improved YOLOv8n

To address the problems of low recognition accuracy and slow processing speed when identifying harvest-stage cabbage heads in complex environments, this study proposes a lightweight harvesting period cabbage head recognition algorithm that improves upon YOLOv8n. We propose a YOLOv8n-Cabbage model, integrating an enhanced backbone network, the DyHead (Dynamic Head) module insertion, loss function optimization, and model light-weighting. To assess the proposed method, a comparison with extant mainstream object detection models is conducted. The experimental results indicate that the improved cabbage head recognition model proposed in this study can adapt cabbage head recognition under different lighting conditions and complex backgrounds. With a compact size of 4.8 MB, this model achieves 91% precision, 87.2% recall, and a mAP@50 of 94.5%—the model volume has been reduced while the evaluation metrics have all been improved over the baseline model. The results demonstrate that this model can be applied to the real-time recognition of harvest-stage cabbage heads under complex field environments.

Monocular Depth Estimation Based on Dilated Convolutions and Feature Fusion

Depth estimation represents a prevalent research focus within the realm of computer vision. Existing depth estimation methodologies utilizing LiDAR (Light Detection and Ranging) technology typically obtain sparse depth data and are associated with elevated hardware expenses. Multi-view image-matching techniques necessitate prior knowledge of camera intrinsic parameters and frequently encounter challenges such as depth inconsistency, loss of details, and the blurring of edges. To tackle these challenges, the present study introduces a monocular depth estimation approach based on an end-to-end convolutional neural network. Specifically, a DNET backbone has been developed, incorporating dilated convolution and feature fusion mechanisms within the network architecture. By integrating semantic information from various receptive fields and levels, the model’s capacity for feature extraction is augmented, thereby enhancing its sensitivity to nuanced depth variations within the image. Furthermore, we introduce a loss function optimization algorithm specifically designed to address class imbalance, thereby enhancing the overall predictive accuracy of the model. Training and validation conducted on the NYU Depth-v2 (New York University Depth Dataset Version 2) and KITTI (Karlsruhe Institute of Technology and Toyota Technological Institute) datasets demonstrate that our approach outperforms other algorithms in terms of various evaluation metrics.

3D reconstruction of building structures incorporating neural radiation fields and geometric constraints

Neural Radiance Fields (NeRF) techniques demonstrate potential for reconstructing complex architectural scenes in three dimensions. However, applying NeRF poses challenges, such as prolonged training processes and limited detailed characterization. To address these issues, this paper introduces NeRFusion by integrating Mipmapped Neural Radiance Fields (Mip-NeRF) and Instant Neural Graphics Primitives (iNGP). NeRFusion enhances training efficiency, rendering quality, and reduces jaggedness through multisampling, weight reduction, and loss function optimization. Geometric constraints—normal consistency, plane fitting, and vertical/horizontal constraints—improve 3D reconstruction accuracy. Using the Manhattan World Model (MWM), NeRFusion accurately extracts primary building components and dimensions. Experimental results show NeRFusion achieved a Peak Signal-to-Noise Ratio (PSNR) of 36.23 dB and completed training in 50 min. Structural Similarity Index Measure (SSIM) improved by 13.41% over Mip-NeRF and 50.00% over iNGP, with PSNR increasing by 10.45% and 25.10%. NeRFusion significantly reduces training time by a factor of 15 compared to the original NeRF.

Enhancing Safety and Workover Efficiency Through Real-Time Scale-Adaptive Video Detection of Critical Objects at the Wellsite

Summary The wellsite serves as the fundamental unit in the development of oil and gas fields, functioning as a hub for the production activities, with workover operations being a critical means to ensure production continuity. In addition, it plays a crucial role in environmental protection, preventing oil and gas leakage and pollution. Various pieces of mechanical equipment deployed at the wellsite are essential for tasks such as oil and gas extraction and well repair operations, holding a pivotal position in oil- and gasfield development. Consequently, intelligent wellsite implementation necessitates a primary focus on monitoring mechanical equipment, with video emerging as a vital form of multisource information at the wellsite. While existing research on wellsite video monitoring predominantly addresses system and data transmission issues, it falls short in addressing the challenges of real-time assessment and early warning in intelligent wellsite operations. This study introduces a method for identifying critical targets at the wellsite based on a scale-adaptive network. The model employs a multiscale fusion network to extract different image features and semantic features at various scales, facilitating their fusion. The processing of wellsite video images occurs in multiple stages, outputting predicted box locations and category information, enabling the localization and recognition of critical objects at the wellsite. Unlike traditional deep convolutional object detection methods, this model incorporates a parameter-free attention mechanism, enhancing the accurate feature learning of small targets during the extraction process and addressing the issue of multiscale imbalance. The experimental results validate the robust performance of the method, surpassing the latest one-stage object detection models and mainstream loss function methods. Comparative experiments demonstrate a 9.22% improvement in mean average precision (mAP) compared with YOLOv8, establishing the proposed model as a top performer in loss function optimization experiments. Furthermore, we propose a video security detection model whose results, combined with the recognition model, are applicable for video detection in wellsite scenarios. The model exhibits strong integration capabilities for scene area division and behavior regulation monitoring. In addition, the model provides valuable insights for analyzing equipment operating status, aligning with the practical needs of oil fields.

Detection of the Pine Wilt Disease Using a Joint Deep Object Detection Model Based on Drone Remote Sensing Data

Disease and detection is crucial for the protection of forest growth, reproduction, and biodiversity. Traditional detection methods face challenges such as limited coverage, excessive time and resource consumption, and poor accuracy, diminishing the effectiveness of forest disease prevention and control. By addressing these challenges, this study leverages drone remote sensing data combined with deep object detection models, specifically employing the YOLO-v3 algorithm based on loss function optimization, for the efficient and accurate detection of tree diseases and pests. Utilizing drone-mounted cameras, the study captures insect pest image information in pine forest areas, followed by segmentation, merging, and feature extraction processing. The computing system of airborne embedded devices is designed to ensure detection efficiency and accuracy. The improved YOLO-v3 algorithm combined with the CIoU loss function was used to detect forest pests and diseases. Compared to the traditional IoU loss function, CIoU takes into account the overlap area, the distance between the center of the predicted frame and the actual frame, and the consistency of the aspect ratio. The experimental results demonstrate the proposed model’s capability to process pest and disease images at a slightly faster speed, with an average processing time of less than 0.5 s per image, while achieving an accuracy surpassing 95%. The model’s effectiveness in identifying tree pests and diseases with high accuracy and comprehensiveness offers significant potential for developing forest inspection protection and prevention plans. However, limitations exist in the model’s performance in complex forest environments, necessitating further research to improve model universality and adaptability across diverse forest regions. Future directions include exploring advanced deep object detection models to minimize computing resource demands and enhance practical application support for forest protection and pest control.

Non-Differentiable Loss Function Optimization and Interaction Effect Discovery in Insurance Pricing Using the Genetic Algorithm

Non-Differentiable Loss Function Optimization and Interaction Effect Discovery in Insurance Pricing Using the Genetic Algorithm

SLKIR: A framework for extracting key information from air traffic control instructions Using small sample learning

In air traffic control (ATC), Key Information Recognition (KIR) of ATC instructions plays a pivotal role in automation. The field's specialized nature has led to a scarcity of related research and a gap with the industry's cutting-edge developments. Addressing this, an innovative end-to-end deep learning framework, Small Sample Learning for Key Information Recognition (SLKIR), is introduced for enhancing KIR in ATC instructions. SLKIR incorporates a novel Multi-Head Local Lexical Association Attention (MHLA) mechanism, specifically designed to enhance accuracy in identifying boundary words of key information by capturing their latent representations. Furthermore, the framework includes a task focused on prompt, aiming to bolster the semantic comprehension of ATC instructions within the core network. To overcome the challenges posed by category imbalance in boundary word and prompt discrimination tasks, tailored loss function optimization strategies are implemented, effectively expediting the learning process and boosting recognition accuracy. The framework's efficacy and adaptability are demonstrated through experiments on two distinct ATC instruction datasets. Notably, SLKIR outperforms the leading baseline model, W2NER, achieving a 3.65% increase in F1 score on the commercial flight dataset and a 12.8% increase on the training flight dataset. This study is the first of its kind to apply small-sample learning in KIR for ATC and the source code of SLKIR will be available at: https://github.com/PANPANKK/ATC_KIR.

Robust hyperspectral image classification using generative adversarial networks

This paper introduces Sill-Rgan, a novel Generative Adversarial Network (GAN) designed to improve hyperspectral image (HSI) classification under varying lighting conditions. Sill-Rgan uniquely maps different light condition domains, enhancing sample classification robustness and generating new virtual samples. Addressing challenges like high spectral dimensionality and noise in HSI classification, our approach utilizes a deep proxy-based learning framework. It integrates and improves advanced GAN models and multitask networks for optimal training stability and loss function optimization. The model's mapping network is adept at generating domain-specific latent codes, enabling the transformation of original hyperspectral data into enhanced versions. Extensive experiments conducted on hyperspectral datasets of agricultural products under diverse indoor and outdoor lighting conditions confirm the effectiveness of Sill-Rgan. The results highlight the model's adaptability in both supervised and semi-supervised learning scenarios, yielding exceptional classification accuracy and enhanced data quality. The versatile potential of Sill-Rgan extends its applicability to a broad range of spectral data classifications, underlining its significant contribution to hyperspectral imaging. This advancement opens new avenues in machine vision systems, particularly in scenarios with dynamic lighting challenges.

An algorithm for power transmission line fault detection based on improved YOLOv4 model

In response to the escalating demand for real-time and accurate fault detection in power transmission lines, this paper undertook an optimization of the existing YOLOv4 network. This involved the substitution of the main feature extraction network within the original YOLOv4 model with a lighter EfficientNet network. Additionally, the inclusion of Grouped Convolution modules in the feature pyramid structure replaced conventional convolution operations. The resulting model not only reduced model parameters but also effectively ensured detection accuracy. Moreover, in enhancing the model's reliability, data augmentation techniques were employed to bolster the robustness of the power transmission line fault detection algorithm. This optimization further utilized the DIoU loss function to stabilize target box regression. Comparative experiments demonstrated the improved YOLOv4 model's superior performance in terms of loss function optimization while significantly enhancing detection speed under equivalent configurations. The parameter capacity was reduced by 81%, totaling merely 43.65 million, while the frame rate surged by 85% to achieve 24 frames per second. These experimental findings validate the effectiveness of the algorithm.

Real-time reliable semantic segmentation of thyroid nodules in ultrasound images

Objective. Low efficiency in medical image segmentation is a common issue that limits computer-aided diagnosis development. Due to the varying positions and sizes of nodules, it is not easy to accurately segment ultrasound images. This study aims to propose a segmentation model that maintains high efficiency while improving accuracy. Approach. We propose a novel layer that integrates the advantages of dense connectivity, dilated convolution, and factorized filters to maintain excellent efficiency while improving accuracy. Dense connectivity optimizes feature reuse, dilated convolution redesigns layers, and factorized convolution improves efficiency. Moreover, we propose a loss function optimization method from a pixel perspective to increase the network's accuracy further. Main results. Experiments on the Thyroid dataset show that our method achieves 81.70% intersection-over-union (IoU), 90.50% true positive rate (TPR), and 0.25% false positive rate (FPR). In terms of accuracy, our method outperforms the state-of-the-art methods, with twice faster inference and nearly 400 times fewer parameters. Meanwhile, in a test on an External Thyroid dataset, our method achieves 77.03% IoU, 82.10% TPR, and 0.16% FPR, demonstrating our proposed model's robustness. Significance. We propose a real-time semantic segmentation architecture for thyroid nodule segmentation in ultrasound images called fully convolution dense dilated network (FCDDN). Our method runs fast with a few parameters and is suitable for medical devices requiring real-time segmentation.

Study on Japan’s Cybersecurity Strategy and Regional Cybersecurity Construction in the Face of Global Competition

Abstract Cybersecurity has emerged as a crucial security concern for countries worldwide, and Japan has made significant strides in this area, providing other countries with valuable lessons from its experience. In the context of global competition, this paper presents Japan’s cybersecurity situation, examines the top-level design of the Japanese government’s cybersecurity strategy, and outlines a three-pronged approach to building regional cybersecurity. Aiming to address the shortcomings of the existing DAEDALUS cyber attack warning system, this paper proposes an unknown attack detection algorithm based on an open-set classification network, which improves the algorithm’s recognition accuracy in the face of unknown attacks through loss function optimization and classifier replacement on the basis of a convolutional neural network’s open-set classification architecture. The experimental results demonstrate that, under various openness conditions, this algorithm optimizes the average F1 value of the three recognition models to 78.47 and enhances the detection accuracy of OCN in unknown attacks across two datasets to 84.94% and 76.53%, respectively. This paper demonstrates the accuracy of the OCN algorithm in recognizing unknown attacks.

Financial Risk Prediction Model in the Context of Big Data - Corporate Financial Risk Control Based on LSTM Deep Neural Networks

Abstract This paper is based on the use of recurrent neural networks and LSTM deep neural networks to obtain the financial risk prediction feature sequence in the context of big data. The financial risk prediction feature sequence is used as the input value of the input gate of the LSTM deep neural network model after data filtering, normalization and loss function optimization, and then the financial risk prediction for the output gate of the LSTM deep neural network model. Considering the availability of data, small and medium-sized enterprises listed in A-share companies in the Wind database are selected as sample enterprises, and evaluation indexes are constructed and detected at the same time so as to complete the experimental design of enterprise financial risk prediction in the context of big data. The prediction of enterprise financial risk is empirically analyzed using simulation analysis and statistical analysis. The results show that in the model performance analysis, the average value of ten years of data, the highest value is still the result obtained by LSTM training, 0.761, compared with other models of LSTM deep neural network in static financial risk prediction in the overall best performance. In the case study of Yibai Pharmaceutical, the minimum value of the rate of return, return on total assets, and return on assets were -10.02%, 2.56%, -20.72%, which reflects the fact that the private enterprises still have large profitability space to be mined. This study helps investors or financial institutions such as funds to find out the possible financial risk crisis of listed companies as early as possible to avoid the parties from incurring large financial losses.

Application of 3D visual perception-driven design of velvet flowers in traditional dresses

Abstract This paper firstly analyzes the specific application of velvet flowers on women’s dresses from the perspective of fashion aesthetics and with the understanding of the background and development trend of dresses. Secondly, based on 3D visual perception, we propose the optimization of the normalization method and loss function optimization, which can improve the migration speed and generation quality of velvet flower design, and then seamlessly fit it to the dress base map by Poisson fusion to realize the intelligent design of velvet flower in dresses driven by 3D visual perception. Then, the color features and attributes of the floral in the dress are studied, and the HSV color space model is used to extract the high-frequency colors and attributes of the dress. Then, the floral design is digitized, and the dress design is driven by 3D visual perception is studied and analyzed. The results show that the loss value of the dress design style migration network trained based on AdaN is the smallest, and the loss value is reduced by 0.19 compared to the dress design style migration network using IN and 0.31 compared to BN. The velvet flower design on the dress design base map can be implemented based on the foundation provided by this study.

The predictive machine learning model of a hydrated inverse vulcanized copolymer for effective mercury sequestration from wastewater

Inverse vulcanized polysulfides (IVP) are promising sulfur-enriched copolymers with unconventional properties irresistible for diverse applications like Hg2+ remediation. Nevertheless, due to their inherent hydrophobic nature, these copolymers still offer low Hg2+ uptake capacity. Herein, we reported the synthesis of IVP by reacting molten sulfur with 4-vinyl benzyl chloride, followed by their functionalization using N-methyl D-glucamine (NMDG) to increase the hydration of the developed IVP. The chemical composition and structure of the functionalized IVP were proposed based on FTIR and XPS analysis. The functionalized IVP demonstrated a high mercury adsorption capacity of 608 mg/g (compared to <26 mg/g for common IVP) because of rich sulfur and hydrophilic regions. NMDG functionalized IVP removed 100 % Hg2+ from a low feed concentration (10–50 mg/l). A predictive machine learning model was also developed to predict the amount of mercury removed (%) using GPR, ANN, Decision Tree, and SVM algorithms. Hyperparameter and loss function optimization was also carried out to reduce the prediction error. The optimized GPR algorithm demonstrated high R2 (0.99 (training) and 0.98 (unseen)) and low RMSE (2.74 (training) and 2.53 (unseen)) values indicating its goodness in predicting the amount of mercury removed. The produced functionalized IVP can be regenerated and reused with constant Hg2+ uptake capacity. Sulfur is the waste of the petrochemical industry and is abundantly available, making the functionalized IVP a sustainable and cheap adsorbent that can be produced for high-volume Hg2+ remediation. Environmental implicationThis research effectively addresses the removal of the global top-priority neurotoxic pollutant mercury, which is toxic even at low concentrations. We attempted to remove the Hg2+ utilizing an inexpensive adsorbent developed by NMDG functionalized copolymer of molten sulfur and VBC. A predictive machine learning model was also formulated to predict the amount of mercury removal from wastewater with only a 0.05 % error which shows the goodness of the developed model. This work is critical in utilizing this low-cost adsorbent and demonstrates its potential for large-scale industrial application.