Loss Function Model Research Articles

LVD-YOLO: An efficient lightweight vehicle detection model for intelligent transportation systems

Vehicle detection is a fundamental component of intelligent transportation systems. However, current algorithms often encounter issues such as high computational complexity, long execution times, and significant resource demands, making them unsuitable for resource-limited environments. To overcome these challenges, we propose LVD-YOLO, a Lightweight Vehicle Detection Model based on YOLO. This model incorporates the EfficientNetv2 network structure as its backbone, which reduces parameters and enhances feature extraction capabilities. By utilizing a bidirectional feature pyramid structure along with a dual attention mechanism, we enable efficient information exchange across feature layers, thereby improving multiscale feature fusion. Additionally, we refine the model's loss function with SIoU loss to boost regression and prediction performance. Experimental results on the PASCAL VOC and MS COCO datasets show that LVD-YOLO outperforms YOLOv5s, achieving a 0.5% increase in accuracy while reducing FLOPs by 64.6% and parameters by 48.6%. These improvements highlight its effectiveness for use in resource-constrained environments.

Addressing bias in bagging and boosting regression models.

As artificial intelligence (AI) becomes widespread, there is increasing attention on investigating bias in machine learning (ML) models. Previous research concentrated on classification problems, with little emphasis on regression models. This paper presents an easy-to-apply and effective methodology for mitigating bias in bagging and boosting regression models, that is also applicable to any model trained through minimizing a differentiable loss function. Our methodology measures bias rigorously and extends the ML model's loss function with a regularization term to penalize high correlations between model errors and protected attributes. We applied our approach to three popular tree-based ensemble models: a random forest model (RF), a gradient-boosted model (GBT), and an extreme gradient boosting model (XGBoost). We implemented our methodology on a case study for predicting road-level traffic volume, where RF, GBT, and XGBoost models were shown to have high accuracy. Despite high accuracy, the ML models were shown to perform poorly on roads in minority-populated areas. Our bias mitigation approach reduced minority-related bias by over 50%.

A deep learning approach based on domain generalization for mooring tension prediction in floating structures

Generalization remains a significant challenge in the application of deep learning methods, particularly in predicting mooring line tension for moored floating structures. The dynamic and complex nature of marine environments makes accurate prediction of mooring line tension a formidable task. Existing deep learning models, constrained by the data distribution of their training sets, typically perform well within the scope of these datasets. However, their limited generalization capability becomes apparent when confronted with unknown and changing marine conditions, resulting in a decline in prediction accuracy. To address this issue, this paper proposes a Domain Generalization (DG) model approach, which incorporates a distribution matching regularization term to the model's loss function, aimed at reducing distributional disparities between data from different domains. The proposed method was compared with existing Deep Neural Network (DNN) model method through validation with engineering case studies. The results indicate that the DG model method significantly surpasses the DNN model in terms of generalization capabilities. The mooring line tension prediction model developed herein holds potential for constructing digital twins, offering near real-time data support for moored floating engineering projects. This facilitates timely and accurate decision-making in response to environmental changes.

基于改进YOLOv5的苹果幼果检测方法

The intelligent detection of young apple fruits based on deep learning faced various challenges such as varying scale sizes and colors similar to the background, which increased the risk of misdetection or missed detection. To effectively address these issues, a method for young apple fruit detection based on improved YOLOv5 was proposed in this paper. Firstly, a young apple fruits dataset was established. Subsequently, a prediction layer was added to the detection head of the model, and four layers of CA attention mechanism were integrated into the detection neck (Neck). Additionally, the GIOU function was introduced as the model's loss function to enhance its overall detection performance. The accuracy on the validation dataset reached 94.6%, with an average precision of 82.2%. Compared with YOLOv3, YOLOv4, and the original YOLOv5 detection methods, the accuracy increased by 0.4%, 1.3%, and 4.6% respectively, while the average precision increased by 0.9%, 1.6%, and 1.2% respectively. The experiments demonstrated that the algorithm effectively recognized young apple fruits in complex scenes while meeting real-time detection requirements, providing support for intelligent apple orchard management.

Brain Tumor Detection and Classification Using Deep Learning Models on MRI Scans

INTRODUCTION: The primary goal of artificial intelligence (AI) is to develop computers that exhibit human-like behavior and functionality. Computer-based activities employing artificial intelligence encompass a variety of extra features beyond only pattern detection, planning, and problem resolution. METHODOLOGY: Machines use a set of techniques collectively called "deep learning." Magnetic resonance imaging (MRI) is employed with the use of deep learning methods to develop models that can effectively identify and classify brain cancers. This technique facilitates the rapid and straightforward detection of brain cancers. Brain problems mainly arise from the abnormal multiplication of brain cells, leading to detrimental alterations in brain structure and finally culminating in the development of cancer in the brain, malignant. Early detection of brain tumors along with following effective intervention can reduce mortality rates. This paper proposes convolutional neural network (CNN) architecture to effectively detect brain cancers using magnetic resonance (MR) images. RESULTS: This research further examines several models, including ResNet-50, VGG16, and Inception V3, and compares the proposed architecture and these models. For the efficacy of the models, many measures were evaluated, including accuracy, recall, loss, and area under the curve (AUC). After analyzing several models and comparing them with the suggested model using the specified metrics, it was determined that the proposed model exhibited superior performance compared to the alternative models. Based on an analysis conducted on data from 3265 MR images. CONCLUSION: It was seen that the CNN model exhibited a classification precision of 93.3%. Additionally, the area under the receiver operating characteristic curve (AUC) was determined to be 98.43%, while the recall rate was 91.19%. Furthermore, the model's loss function yielded a value of 0.25. Based on a comparative analysis with other models, it can be inferred that the suggested model is highly reliable in detecting various types of brain cancers at an early stage.

Conditional Backdoor Attack via JPEG Compression

Deep neural network (DNN) models have been proven vulnerable to backdoor attacks. One trend of backdoor attacks is developing more invisible and dynamic triggers to make attacks stealthier. However, these invisible and dynamic triggers can be inadvertently mitigated by some widely used passive denoising operations, such as image compression, making the efforts under this trend questionable. Another trend is to exploit the full potential of backdoor attacks by proposing new triggering paradigms, such as hibernated or opportunistic backdoors. In line with these trends, our work investigates the first conditional backdoor attack, where the backdoor is activated by a specific condition rather than pre-defined triggers. Specifically, we take the JPEG compression as our condition and jointly optimize the compression operator and the target model's loss function, which can force the target model to accurately learn the JPEG compression behavior as the triggering condition. In this case, besides the conditional triggering feature, our attack is also stealthy and robust to denoising operations. Extensive experiments on the MNIST, GTSRB and CelebA verify our attack's effectiveness, stealthiness and resistance to existing backdoor defenses and denoising operations. As a new triggering paradigm, the conditional backdoor attack brings a new angle for assessing the vulnerability of DNN models, and conditioned over JPEG compression magnifies its threat due to the universal usage of JPEG.

The Challenges and Countermeasures of Ideological and Political Education Theory Course Teaching for Art Students in Universities in the New Media Era

Contemporary art students in universities are a generation that has grown up in the context of new media. With the increasingly close integration of art and new media, in order to enable art students to better shoulder the mission of spreading the excellent culture of the Chinese nation, ideological and political course teachers in universities should strengthen the reform and innovation of ideological and political theory courses for art students in teaching content, teaching methods, and the use of new media, Ensure that art students embody a positive energy of thought in their artistic creation. In this study, a crude oil price prediction model based on quantum leap radius and polynomial fitting is established by building a market atom model, fitting financial funds as "market atoms" with energy, and applying quantum leap theory to describe the leaping behavior of price. The LSTM neural network model is used to learn the price jump paths of financial instruments to improve the prediction effect. After 2000 rounds of iterative training, the RMSE of the model reaches 3.1136, and the correlation coefficient is 0.48084; the model's loss function decreases rapidly, indicating that the training effect is good. The study reveals the potential value of quantum theory in finance, preliminarily verifies the application of quantum leap and LSTM model in crude oil price prediction, and provides new ideas for the in-depth study of quantum finance theory.

Bony structure enhanced synthetic CT generation using Dixon sequences for pelvis MR-only radiotherapy.

MRI-only radiotherapy planning (MROP) is beneficial to patients by avoiding MRI/CT registration errors, simplifying the radiation treatment simulation workflow and reducing exposure to ionizing radiation. MRI is the primary imaging modality for soft tissue delineation. Treatment planning CTs (i.e., CT simulation scan) are redundant if a synthetic CT (sCT) can be generated from the MRI to provide the patient positioning and electron density information. Unsupervised deep learning (DL) models like CycleGAN are widely used in MR-to-sCT conversion, when paired patient CT and MR image datasets are not available for model training. However, compared to supervised DL models, they cannot guarantee anatomic consistency, especially around bone. The purpose of this work was to improve the sCT accuracy generated from MRI around bone for MROP. To generate more reliable bony structures on sCT images, we proposed to add bony structure constraints in the unsupervised CycleGAN model's loss function and leverage Dixon constructed fat and in-phase (IP) MR images. Dixon images provide better bone contrast than T2-weighted images as inputs to a modified multi-channel CycleGAN. A private dataset with a total of 31 prostate cancer patients were used for training (20) and testing (11). We compared model performance with and without bony structure constraints using single- and multi-channel inputs. Among all the models, multi-channel CycleGAN with bony structure constraints had the lowest mean absolute error, both inside the bone and whole body (50.7 and 145.2 HU). This approach also resulted in the highest Dice similarity coefficient (0.88) of all bony structures compared with the planning CT. Modified multi-channel CycleGAN with bony structure constraints, taking Dixon-constructed fat and IP images as inputs, can generate clinically suitable sCT images in both bone and soft tissue. The generated sCT images have the potential to be used for accurate dose calculation and patient positioning in MROP radiation therapy.

Edge Intelligence: Federated Learning-Based Privacy Protection Framework for Smart Healthcare Systems.

Federated learning methods offer secured monitor services and privacy-preserving paradigms to end-users and organisations in the Internet of Things networks such as smart healthcare systems. Federated learning has been coined to safeguard sensitive data, and its global aggregation is often based on a centralised server. This design is vulnerable to malicious attacks and could be breached by privacy attacks such as inference and free-riding, leading to inefficient training models. Besides, uploaded analysing parameters by patients can reveal private information and the threat of direct manipulation by the central server. To address these issues, we present a three-fold Federated Edge Aggregator, the so-called Edge Intelligence, a federated learning-based privacy protection framework for safeguarding Smart Healthcare Systems at the edge against such privacy attacks. We employ an iteration-based Conventional Neural Network (CNN) model and artificial noise functions to balance privacy protection and model performance. A theoretical convergence bound of Edge Intelligence on the trained federated learning model's loss function is also introduced here. We evaluate and compare the proposed framework with the recently established methods using model performance and privacy budget on popular and recent datasets: MNIST, CIFAR10, STL10, and COVID19 chest x-ray. Finally, the proposed framework achieves 90% accuracy and a high privacy rate demonstrating better performance than the baseline technique.

AutoGraph: Autonomous Graph-Based Clustering of Small-Molecule Conformations.

While accurately modeling the conformational ensemble is required for predicting properties of flexible molecules, the optimal method of obtaining the conformational ensemble appears as varied as their applications. Ensemble structures have been modeled by generation, refinement, and clustering of conformations with a sufficient number of samples. We present a conformational clustering algorithm intended to automate the conformational clustering step through the Louvain algorithm, which requires minimal hyperparameters and importantly no predefined number of clusters or threshold values. The conformational graphs produced by this method for O-succinyl-l-homoserine, oxidized nicotinamide adenine dinucleotide, and 200 representative metabolites each preserved the geometric/energetic correlation expected for points on the potential energy surface. Clustering based on these graphs provides partitions informed by the potential energy surface. Automating conformational clustering in a workflow with AutoGraph may mitigate human biases introduced by guess and check over hyperparameter selection while allowing flexibility to the result by not imposing predefined criteria other than optimizing the model's loss function. Associated codes are available at https://github.com/TanemuraKiyoto/AutoGraph.

On the equivalence of classic ROC analysis and the loss-function model to set cut points in sequential testing.

In an effort to reduce the cost of administration for objective structured clinical examinations (OSCEs), several authors have promoted the use of sequential testing in which all candidates take a short screening test and candidates who pass the screen are exempted from taking the full test. Traditionally, the determination of the optimally efficient cut point (passing score) for the screen has used ROC analysis to minimize false-positive and false-negative errors. Recently, Muijtjens et al. have questioned the appropriateness of the ROC method for these purposes and have promoted an alternative method that uses a "loss" formula. However, given certain theoretically derived conditions, it can be shown that the use of the loss formula is functionally identical to using ROC analysis, and the authors suggest that continued use of the ROC method is appropriate.