Data Augmentation Techniques Research Articles

English Grammar Auto-Correction Robot based on Grammatical Error Generation Model

The traditional English grammar error correction system has problems such as poor error recognition precision and error correction success rate to be improved. Therefore, in this study, data augmentation techniques were used to transform and process error correcting English texts, and a rule-based and shallow neural network-based English text grammar correction model was constructed. The experimental results showed that the grammar error generation (GEG), rule-based (RB), classification-based (CB), and recurrent neural network (RNN) models achieved accuracy rates of 93.92%, 82.17%, 79.41%, and 88.09% in correcting grammar errors on 1702641 test sentences in the One Billion word corpus, respectively. The experimental results showed that the English grammar error correction model designed in this study had a strong error correction ability, but the computational efficiency was low. The research results significantly improved the accuracy and generalization ability of English grammar correction, optimized learning costs, and brought positive impacts to educational applications, providing strong support for the development of intelligent English grammar correction.

A phenotypic drug discovery approach by latent interaction in deep learning

Contemporary drug discovery paradigms rely heavily on binding assays about the bio-physicochemical processes. However, this dominant approach suffers from overlooked higher-order interactions arising from the intricacies of molecular mechanisms, such as those involving cis -regulatory elements. It introduces potential impairments and restrains the potential development of computational methods. To address this limitation, I developed a deep learning model that leverages an end-to-end approach, relying exclusively on therapeutic information about drugs. By transforming textual representations of drug and virus genetic information into high-dimensional latent representations, this method evades the challenges arising from insufficient information about binding specificities. Its strengths lie in its ability to implicitly consider complexities such as epistasis and chemical–genetic interactions, and to handle the pervasive challenge of data scarcity. Through various modeling skills and data augmentation techniques, the proposed model demonstrates outstanding performance in out-of-sample validations, even in scenarios with unknown complex interactions. Furthermore, the study highlights the importance of chemical diversity for model training. While the method showcases the feasibility of deep learning in data-scarce scenarios, it reveals a promising alternative for drug discovery in situations where knowledge of underlying mechanisms is limited.

Tumor Detection in MRI Data using Deep Learning Techniques for Image Classification and Semantic Segmentation

This study aims to apply image classification and semantic segmentation methods using deep learning for accurate and efficient tumor detection in brain MRI data. It looks at ways to get over issues including interpretability of the model and a lack of annotated data. A pre-trained VGG19 model and a basic convolutional neural network (CNN) were trained using a public dataset of 273 brain MRI images for the purpose of image classification. Techniques for regularization, transfer learning, and data augmentation were used. A U-Net architecture was trained using manually created masks from the same dataset for semantic segmentation, with several training setups investigated. With a mean test accuracy of 77.19%, the pre-trained VGG19 model surpassed the basic CNN in picture categorization. The U-Net model performed better for semantic segmentation after training on the entire dataset for two epochs as opposed to training on a subset for ten epochs. The work acknowledges issues including data scarcity and the requirement for model interpretability and scalability, which call for additional research, but also underlines the potential of deep learning for brain tumor identification.

Radio Frequency-Enabled Cerebral Blood Flow Monitoring and Classification Using Data Augmentation and Machine Learning Techniques

Radio Frequency-Enabled Cerebral Blood Flow Monitoring and Classification Using Data Augmentation and Machine Learning Techniques

Multi-attribute balanced dataset generation framework AutoSyn and KinFace Channel-Spatial Feature Extractor for kinship recognition

In the field of kinship verification, facial recognition technology is becoming increasingly vital due to privacy concerns, ethical disputes, and the high costs associated with DNA testing. We have developed a novel method, the AutoSyn framework, to synthesize facial images and enhance kinship image datasets, effectively addressing the challenges of scale and quality in existing datasets. By employing a strategy that mixes ages and genders in the synthesized images, we minimize the impact of these factors on kinship recognition tasks. We have enhanced the original KinFaceW-I dataset by integrating ten distinct styles, including diverse combinations of gender, ethnicity, and age. This enrichment significantly improves both the quality and quantity of the images. Furthermore, this paper introduces an efficient feature extractor for kinship tasks, KinFace-CSFE, within a siamese neural network framework. This model not only utilizes meticulously designed channel feature extraction but also incorporates mixed kernel size spatial attention mechanisms to better focus on local features. We have also integrated YOCO data augmentation techniques to simulate complex imaging conditions, enhancing the model’s robustness and accuracy. The effectiveness of these innovations has been validated through experiments on the KinFaceW-I, KinFaceW-II, and synthesized Syn-KinFaceW-I datasets, achieving accuracy rates of 82.7%, 94.1%, and 83.2% respectively. These results significantly surpass both traditional models and current advanced models.

Experiment on Lung Disease Classification using YOLOv8

Lung diseases are a leading cause of illness and mortality worldwide. Accurate and timely diagnosis is crucial for improving patient outcomes, but manual interpretation of chest X-rays by radiologists may consume a significant amount of time and is susceptible to errors. This study leverages the state-of-the-art YOLOv8 deep learning model to develop an automated system for classifying lung diseases from chest X-ray images. The proposed approach utilizes a large, diverse dataset of 21,165 chest X-ray images categorized into four classes: COVID-19, viral pneumonia, lung opacity, and normal. The YOLOv8-cls model is fine-tuned using transfer learning and advanced data augmentation techniques. The system achieves a high accuracy of approximately 95% across all disease classes while maintaining real-time performance. Confusion matrix analysis demonstrates strong performance in correctly identifying each condition, with COVID-19, normal, viral pneumonia and lung opacity cases correctly identified 97%, 97%, 99% and 93% of the time respectively. The outcomes validate the adaptability and reliability of deep learning, specifically YOLOv8, for automated lung disease detection, offering the potential to improve clinical workflows and patient care by providing efficient screening tools for practitioners. The study addresses limitations of previous works by utilizing a large consolidated dataset, reporting comprehensive computational efficiency metrics, and extending classification complexity without substantially impacting accuracy or speed. Future research should focus on further optimizations and extending the curated image repositories to include under-represented patient groups to enhance the model's inclusiveness and robustness.

Detecting multiclass objects in remote sensing imagery: A deep learning approach

Abstract Object detection from remote sensing imagery is crucial in fields including monitoring agriculture, efficient urban planning, environmental conservation, and disaster response. It enables informed decision-making by identifying and tracking objects such as crops, infrastructure, and environmental changes, contributing to optimized re-source management and rapid response in various domains. Multiclass object detection benefits from the transformative power of deep learning, surpassing traditional methods in accuracy and efficiency. This research investigates the effects of data augmentation techniques and diverse hyperparameters on the training process of a single-stage YOLOv5 deep learning algorithm applied to the selected DIOR remote sensing dataset for multiclass object detection practices, resulting in 0.628 mAP score among the applied experiments.

Using Data Augmentation Techniques for Sentiment Analysis of Users’ Opinions on Reopening of Schools During the Covid-19 Epidemic

Using Data Augmentation Techniques for Sentiment Analysis of Users’ Opinions on Reopening of Schools During the Covid-19 Epidemic

MinoritySalMix and adaptive semantic weight compensation for long-tailed classification

In real-world datasets, the widespread presence of a long-tailed distribution often leads models to become overly biased towards majority class samples while ignoring minority class samples. We propose a strategy called MASW (MinoritySalMix and adaptive semantic weight) to improve this problem. First, we propose a data augmentation method called MinoritySalMix (minority-saliency-mixing), which uses significance detection techniques to select significant regions from minority class samples as cropping regions and paste them into the same regions of majority class samples to generate brand new samples, thereby amplifying images containing important regions of minority class samples. Second, in order to make the label value information of the newly generated samples more consistent with the image content of the newly generated samples, we propose an adaptive semantic compensation factor. This factor provides more label value compensation for minority samples based on the different cropping areas, thereby making the new label values closer to the content of the newly generated samples. Improve model performance by generating more accurate new label value information. Finally, considering that some current re-sampling strategies generally lack flexibility in handling class sampling weight allocation and frequently require manual adjustment. We designed an adaptive weight function and incorporated it into the re-sampling strategy to achieve better sampling. The experimental results on three long-tailed datasets show that our method can effectively improve the performance of the model and is superior to most advanced long-tailed methods. Furthermore, we extended MinoritySalMix’s strategy to three balanced datasets for experimentation, and the results indicated that our method surpassed several advanced data augmentation techniques.

Improving the training performance of generative adversarial networks with limited data: Application to the generation of geological models

In the past years, there is a growing interest in the applications of Generative Adversarial Networks (GANs) to generate geological models. Although GANs have proven to be an effective tool to learn and reproduce the complex data patterns present in some geological models, some challenges still remain open. Among others, a well-noticed problem is the need for a large number of samples to ensure high-quality training, which can be prohibitively expensive in some cases. As an attempt to offer a (possibly partial) solution to the aforementioned challenge, in this study, we investigate the feasibility and effectiveness of a zero-centered discriminator regularization technique for improving the performance of a GAN. Additionally, we evaluate an adaptive data augmentation technique to overcome the potential issue of limited training data, for the purpose of generating geologically feasible realizations of hydrocarbon reservoir models. Our findings demonstrate that a combination of the two techniques lead to notable performance improvements of a GAN. Particularly, it is observed that using the adaptive data augmentation technique in a GAN can yield similar results to those obtained by the GAN with a much larger dataset.

HQNet: A hybrid quantum network for multi-class MRI brain classification via quantum computing

The complex and nonlinear nature of brain tumor morphology and texture pose significant challenges for representative feature extraction from magnetic resonance imaging (MRI) images, ultimately leading to inaccurate diagnoses of brain tumors. To tackle this problem, we propose a novel approach termed the hybrid quantum–classical convolutional network (HQNet) for detecting MRI brain tumors. Firstly, we use data augmentation techniques to deal with the issues of class imbalance and the sample scarcity within brain tumor MRI images. Secondly, we integrate channel attention and self-attention mechanisms to capture both channel and spatial dependencies from MRI images. This integration enables us to effectively fuse these dependencies and mitigate the discrepancies between them. However, the varying dependence of brain tumors at different scales can result in a decline in classification performance. To address this issue, we extract brain tumor features at various scales and combine them to alleviate this effect. Thirdly, a new parameterized quantum circuit is designed based on the principles of quantum computing to maximize the potential advantages of quantum computing and improve feature extraction. Finally, we compress the features and pass them through the fully connected layer to generate the final classification result. The effectiveness of our model is demonstrated through its superior performance when evaluated using three benchmark datasets.

NASPrecision: Neural Architecture Search-Driven Multi-Stage Learning for surface roughness prediction in ultra-precision machining

Accurate surface roughness prediction is critical for ensuring high product quality, especially in sectors such as manufacturing, aerospace, and medical devices, where the smallest imperfections can compromise performance or safety. However, this is very challenging due to complex, non-linear interactions among variables, which is further exacerbated when working with limited and imbalanced datasets. Existing methods leveraging traditional machine learning algorithms require extensive domain knowledge for feature engineering and substantial human intervention for model selection. To address these issues, we propose a Neural Architecture Search (NAS)-Driven Multi-Stage Learning Framework, named NASPrecision. This innovative approach autonomously identifies the most suitable features and models for various surface roughness prediction tasks and significantly enhances the performance by multi-stage learning. Our framework operates in three stages: (1) architecture search stage, employing NAS to automatically identify the most effective model architecture; (2) initial training stage, where we train the neural network for initial predictions; (3) refinement stage, where a subsequent model is appended to refine and capture subtle variations overlooked by the initial training stage. In light of limited and imbalanced datasets, we adopt a generative data augmentation technique to balance and generate new data by learning the underlying data distribution. We perform extensive experiments on three distinct real-world datasets, each associated with a different machining technique, and compare with various machine learning algorithms. The experimental results underscore the superiority of our framework, which achieves an average improvement of 25.7%, 22.7%, and 39.1% in terms of Mean Absolute Error (MAE), Root Mean Square Error (RMSE), and Standard Deviation of Residuals (STDR), respectively. This significant performance enhancement not only confirms the robustness of our framework but also establishes it as a generic solution for accurate surface roughness prediction. The success of this approach can lead to improved production efficiency and product quality in critical industries while also reducing the need for extensive domain knowledge and human intervention.

Easy and effective! Data augmentation for knowledge-aware dialogue generation via multi-perspective sentences interaction

In recent years, knowledge-based dialogue generation has garnered significant attention due to its capacity to produce informative and coherent responses through the integration of external knowledge into models. However, obtaining high-quality knowledge that aligns with the dialogue content poses a considerable challenge, necessitating substantial time and resources. To tackle the issue of limited dialogue data, a majority of research endeavors concentrate on data augmentation to augment the volume of training data. Regrettably, these methods overlook knowledge augmentation, leading to a restricted diversity in input data and yielding enhancements solely in specific metrics. Real-world conversations exhibit a spectrum of characteristics, including repetitions, reversals, and interruptions, demanding a heightened level of data diversity. In this study, we introduce a straightforward yet effective data augmentation technique known as Multi-perspective Sentence Interaction to bolster the connections among sentences from varied viewpoints. Through an examination of target responses from multiple dialogue perspectives, we enhance our comprehension of the relationships between dialogue sentences, thereby facilitating the expansion of knowledge-based dialogue data. Through experiments conducted on various knowledge-based dialogue datasets and utilizing different models, our findings illustrate a notable enhancement in the quality of model generation facilitated by our method. Specifically, we observed a 3.5% enhancement in reply accuracy and a 0.1506 increase in diversity (DIST-2). Moreover, there was a substantial improvement in knowledge selection accuracy by 19.04% and a reduction in model perplexity by 31.48%.

COMPARATIVE ANALYSIS OF MULTILINGUAL QA MODELS AND THEIR ADAPTATION TO THE KAZAKH LANGUAGE

This paper presents a comparative analysis of large pretrained multilingual models for question-answering (QA) systems, with a specific focus on their adaptation to the Kazakh language. The study evaluates models including mBERT, XLM-R, mT5, AYA, and GPT, which were tested on QA tasks using the Kazakh sKQuAD dataset. To enhance model performance, fine-tuning strategies such as adapter modules, data augmentation techniques (back-translation, paraphrasing), and hyperparameter optimization were applied. Specific adjustments to learning rates, batch sizes, and training epochs were made to boost accuracy and stability. Among the models tested, mT5 achieved the highest F1 score of 75.72%, showcasing robust generalization across diverse QA tasks. GPT-4-turbo closely followed with an F1 score of 73.33%, effectively managing complex Kazakh QA scenarios. In contrast, native Kazakh models like Kaz-RoBERTa showed improvements through fine-tuning but continued to lag behind larger multilingual models, underlining the need for additional Kazakh-specific training data and further architectural enhancements. Kazakh’s agglutinative morphology and the scarcity of high-quality training data present significant challenges for model adaptation. Adapter modules helped mitigate computational costs, allowing efficient fine-tuning in resource-constrained environments without significant performance loss. Data augmentation techniques, such as back-translation and paraphrasing, were instrumental in enriching the dataset, thereby enhancing model adaptability and robustness. This study underscores the importance of advanced fine-tuning and data augmentation strategies for QA systems tailored to low-resource languages like Kazakh. By addressing these challenges, this research aims to make AI technologies more inclusive and accessible, offering practical insights for improving natural language processing (NLP) capabilities in underrepresented languages. Ultimately, these findings contribute to bridging the gap between high-resource and low-resource language models, fostering a more equitable distribution of AI solutions across diverse linguistic contexts.

Deep Learning-Based Classification of Powerlifting Movements Using Mediapipe

The analysis of sports movements is of great importance for optimizing sports performance, minimizing injury risks, and ensuring that athletes work with correct techniques. Powerlifting is a power sport consisting of fundamental movements such as bench press, deadlift, and squat. These movements are inherently complex and challenging to execute. Therefore, it is of great importance to perform these movements with the correct technique and safely. The aim of this study was to classify these movements using deep learning methods to ensure that the basic movements in powerlifting sports (bench press, deadlift, and squat) are applied with correct techniques and to minimize the risk of injury. In this study, feature extraction was performed on powerlifting movements using the deep learning-based SqueezeNet model, followed by classification using machine learning methods. The dataset was compiled from 876 images of bench press, deadlift, and squat movements sourced from various online platforms. Additionally, the dataset was expanded through data augmentation techniques, and key points of posture estimation were added to the images using the Mediapipe library. The obtained datasets were classified using Neural Network, Logistic Regression, Support Vector Machine and Random Forest algorithms and model performances were evaluated using various metrics. The findings revealed that the Neural Network model demonstrated superior performance, achieving the highest accuracy (0.989). Additionally, the integration of pose estimation and data augmentation techniques significantly enhanced classification accuracy and overall model performance. The findings of this study show that deep learning methods are powerful tools in sports movement analysis and can make significant contributions to the evaluation of athletes' performance.

Intelligent Classifier for Identifying and Managing Sheep and Goat Faces Using Deep Learning

Computer vision, particularly in artificial intelligence (AI), is increasingly being applied in various industries, including livestock farming. Identifying and managing livestock through machine learning is essential to improve efficiency and animal welfare. The aim of this work is to automatically identify individual sheep or goats based on their physical characteristics including muzzle pattern, coat pattern, or ear pattern. The proposed intelligent classifier was built on the Roboflow platform using the YOLOv8 model, trained with 35,204 images. Initially, a Convolutional Neural Network (CNN) model was developed, but its performance was not optimal. The pre-trained VGG16 model was then adapted, and additional fine-tuning was performed using data augmentation techniques. The dataset was split into training (88%), validation (8%), and test (4%) sets. The performance of the classifier was evaluated using precision, recall, and F1-Score metrics, with comparisons against other pre-trained models such as EfficientNet. The YOLOv8 classifier achieved 95.8% accuracy in distinguishing between goat and sheep images. Compared to the CNN and VGG16 models, the YOLOv8-based classifier showed superior performance in terms of both accuracy and computational efficiency. The results confirm that deep learning models, particularly YOLOv8, significantly enhance the accuracy and efficiency of livestock identification and management. Future research could extend this technology to other livestock species and explore real-time monitoring through IoT integration.

A novel approach for detecting Pomegranate leaf pathologies using deep learning

Pomegranate cultivation is essential for ensuring global food security, yet it faces significant threats from diseases. This has resulted in significant losses of yield. Integrated disease management strategies are therefore crucial for addressing this problem and include cultural practices, disease resistant varieties and timely application of fungicides. Artificial intelligence (AI), primarily deep learning, has recently made great strides that can help change the landscape on how agricultural diseases are diagnosed. In this study, therefore, we will develop a highly accurate and efficient system for early detection of diseases in pomegranate crops using deep learning algorithms. Using convolutional neural networks (CNNs) along with transfer learning coupled with data augmentation techniques such as rotation, flipping and scaling automate the identification and classification of disorders related to leaves growing on pomegranate plants. Rigorous experimentation and evaluation using performance metrics like accuracy, precision, recall, and F1 score demonstrate the efficacy of the CNN models. The underlying theory behind this is that AI technologies would be able to successfully detect all BLB diseases associated with pomegranates at an accuracy rate of 96.33 percent using Inception v3 CNN model. These results point out that AI technology changes everything about dealing with crop diseases in agriculture while also emphasizing its importance towards global food security efforts. This study not only presents a novel approach to disease detection but also provides practical solutions for farmers to mitigate crop losses and improve yield quality, promoting more sustainable and resilient farming.

Deep Learning-Based Classification of Fruit Diseases - A Comprehensive Approach to Automated Detection and Diagnosis

This study aims to develop a deep learning-based model for accurate fruit disease classification using advanced architectures like ResNet50 and VGG19. The dataset includes images of fruits such as grapes, mangoes, lemons, pomegranates, and guavas, with both healthy and diseased categories. Diseases like black rot in grapes and bacterial canker in mangoes are considered for classification. The objective is to build a model capable of accurately identifying these diseases to aid in early identification and control. The approach begins with pre-processing the photographs using standardisation, resizing, and data augmentation techniques including flipping, zooming, and rotation to strengthen the model. By enhancing picture contrast with Contrast Limited Adaptive Histogram Equalisation (CLAHE), important illness characteristics can be better highlighted. We train and evaluate deep learning models by dividing the dataset into three parts: training, validation, and test. The ratio of the parts is 80:10:10. According on the results, the ResNet50 model outperforms all other accuracy at 99.77%.

Emergency Vehicle Classification Using Combined Temporal and Spectral Audio Features with Machine Learning Algorithms

This study presents a novel approach to emergency vehicle classification that leverages a comprehensive set of informative audio features to distinguish between ambulance sirens, fire truck sirens, and traffic noise. A unique contribution lies in combining time domain features, including root mean square (RMS) and zero-crossing rate, to capture the temporal characteristics, like signal energy changes, with frequency domain features derived from short-time Fourier transform (STFT). These include spectral centroid, spectral bandwidth, and spectral roll-off, providing insights into the sound’s frequency content for differentiating siren patterns from traffic noise. Additionally, Mel-frequency cepstral coefficients (MFCCs) are incorporated to capture the human-like auditory perception of the spectral information. This combination captures both temporal and spectral characteristics of the audio signals, enhancing the model’s ability to discriminate between emergency vehicles and traffic noise compared to using features from a single domain. A significant contribution of this study is the integration of data augmentation techniques that replicate real-world conditions, including the Doppler effect and noise environment considerations. This study further investigates the effectiveness of different machine learning algorithms applied to the extracted features, performing a comparative analysis to determine the most effective classifier for this task. This analysis reveals that the support vector machine (SVM) achieves the highest accuracy of 99.5%, followed by random forest (RF) and k-nearest neighbors (KNNs) at 98.5%, while AdaBoost lags at 96.0% and long short-term memory (LSTM) has an accuracy of 93%. We also demonstrate the effectiveness of a stacked ensemble classifier, and utilizing these base learners achieves an accuracy of 99.5%. Furthermore, this study conducted leave-one-out cross-validation (LOOCV) to validate the results, with SVM and RF achieving accuracies of 98.5%, followed by KNN and AdaBoost, which are 97.0% and 90.5%. These findings indicate the superior performance of advanced ML techniques in emergency vehicle classification.

Improving Localization in Wireless Sensor Networks for the Internet of Things Using Data Replication-Based Deep Neural Networks.

Localization is one of the most challenging problems in wireless sensor networks (WSNs), primarily driven by the need to develop an accurate and cost-effective localization system for Internet of Things (IoT) applications. While machine learning (ML) algorithms have been widely applied in various WSN-based tasks, their effectiveness is often compromised by limited training data, leading to issues such as overfitting and reduced accuracy, especially when the number of sensor nodes is low. A key strategy to mitigate overfitting involves increasing both the quantity and diversity of the training data. To address the limitations posed by small datasets, this paper proposes an intelligent data augmentation strategy (DAS)-based deep neural network (DNN) that enhances the localization accuracy of WSNs. The proposed DAS replicates the estimated positions of unknown nodes generated by the Dv-hop algorithm and introduces Gaussian noise to these replicated positions, creating multiple modified datasets. By combining the modified datasets with the original training data, we significantly increase the dataset size, which leads to a substantial reduction in normalized root mean square error (NRMSE). The experimental results demonstrate that this data augmentation technique significantly improves the performance of DNNs compared to the traditional Dv-hop algorithm at a low number of nodes while maintaining an efficient computational cost for data augmentation. Therefore, the proposed method provides a scalable and effective solution for enhancing the localization accuracy of WSNs.