Transfer Learning Research Articles

Web-based diagnostic platform for microorganism-induced deterioration on paper-based cultural relics with iterative training from human feedback

PurposePaper-based artifacts hold significant cultural and social values. However, paper is intrinsically fragile to microorganisms, such as mold, due to its cellulose composition, which can serve as a microorganisms’ nutrient source. Mold not only can damage papers’ structural integrity and pose significant challenges to conservation works but also may subject individuals attending the contaminated artifacts to health risks. Current approaches for strain identification usually require extensive training, prolonged time for analysis, expensive operation costs, and higher risks of secondary damage due to sampling. Thus, in current conservation practices with mold-contaminated artifacts, little pre-screening or strain identification was performed before mold removal, and the cleaning techniques are usually broad-spectrum rather than strain-specific. With deep learning showing promising applications across various domains, this study investigated the feasibility of using a convolutional neural network (CNN) for fast in-situ recognition and classification of mold on paper.MethodsMolds were first non-invasively sampled from ancient Xuan Paper-based Chinese books from the Qing and Ming dynasties. Strains were identified using molecular biology methods and the four most prevalent strains were inoculated on Xuan paper to create mockups for image collection. Microscopic images of the molds as well as their stains situated on paper were collected using a compound microscope and commercial microscope lens for cell phone cameras, which were then used for training CNN models with a transfer learning scheme to perform the classification of mold. To enable involvement and contribution from the research community, a web interface that actuates the process while providing interactive features for users to learn about the information of the classified strain was constructed. Moreover, a feedback functionality in the web interface was embedded for catching potential classification errors, adding additional training images, or introducing new strains, all to refine the generalizability and robustness of the model.Results & ConclusionIn the study, we have constructed a suite of high-confidence classification CNN models for the diagnostic process for mold contamination in conservation. At the same time, a web interface was constructed that allows recurrently refining the model with human feedback through engaging the research community. Overall, the proposed framework opens new avenues for effective and timely identification of mold, thus enabling proactive and targeted mold remediation strategies in conservation.

Irrigation with Artificial Intelligence: Problems, Premises, Promises

AbstractProtagonists allege that artificial intelligence (AI) is revolutionising contemporaneous mindscapes. Here, we authoritatively review the status quo of AI and machine learning application in irrigated agriculture, evaluating the potential of, and challenges associated with, a wide range of existential AI approaches. We contend that aspiring developers of AI irrigation systems may benefit from human-centred AI, a nascent algorithm that captures diverse end-user views, behaviours and actions, potentially facilitating refinement of proposed systems through iterative stakeholder feedback. AI-guided human–machine collaboration can streamline integration of user needs, allowing customisation towards situational farm management adaptation. Presentation of big data in intuitive, legible and actionable forms for specialists and laypeople also urgently requires attention: here, AI-explainable interpretability may help harness human expertise, enabling end-users to contribute their experience within an AI pipeline for bespoke outputs. Transfer learning holds promise in contextualising place-based AI to agroecological regions, production systems or enterprise mixes, even with limited data inputs. We find that the rate of AI scientific and software development in recent times has outpaced the evolution of adequate legal and institutional regulations, and often social, moral and ethical license to operate, revealing consumer issues associated with data ownership, legitimacy and trust. We opine that AI has great potential to elicit sustainable outcomes in food security, social innovation and environmental stewardship, albeit such potential is more likely to be realised through concurrent development of appropriate ethical, moral and legal dimensions.

YOLO‐DFT: An object detection method based on cloud data fusion and transfer learning for power system equipment maintenance

YOLO‐DFT: An object detection method based on cloud data fusion and transfer learning for power system equipment maintenance

Enhancing facial geometry analysis by DeepFaceLandmark leveraging ResNet101 and transfer learning

Enhancing facial geometry analysis by DeepFaceLandmark leveraging ResNet101 and transfer learning

Music Information Retrieval using Deep Learning Techniques

Music Information Retrieval (MIR) is gaining attention due to the surge in digital music and the need for efficient search and recommendation systems. Traditional MIR methods rely on hand-crafted features and rule-based systems, limiting their adaptability. Deep Learning (DL) shows promise in automatically extracting complex patterns from raw data. This paper offers an extensive overview of MIR tasks like classification, genre recognition, similarity search, and recommendation, along with DL models like Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs), including LSTM and Transformer architectures, tailored for MIR. Challenges such as data scarcity, computational complexity, and interpretability persist, with proposed solutions like data augmentation, transfer learning, and attention mechanisms. Experimental results on benchmark datasets demonstrate DL's superiority in accuracy, scalability, and robustness over traditional methods. Practical examples highlight DL's potential to revolutionize music search, recommendation, and analysis. Emphasizing the importance of large annotated datasets for training high-quality DL models, strategies for data collection, labeling, and preprocessing are outlined. DL offers promising prospects for advancing MIR by addressing its inherent challenges and establishing new performance benchmarks. Further DL development is expected to drive innovation and enhance digital music consumption experiences through MIR systems. Keywords: Deep Learning, Convolution Neural Network (CNNs), Recurrent Neural Network (RNNs), Digital Music Consumption, Genre recognition.

Hybrid deep learning assisted multi classification: Grading of malignant thyroid nodules.

Thyroid nodules are commonly diagnosed with ultrasonography, which includes internal characteristics, varying looks, and hazy boundaries, making it challenging for a clinician to differentiate between malignant and benign forms based only on visual identification. The advancement of AI, particularly DL, provides significant breakthroughs in the domain of medical image identification. Yet, there are certain obstacles to achieving accuracy as well as efficacy in thyroid nodule detection. The thyroid nodules in this study are detected and classified using an inventive hybrid deep learning-assisted multi-classification method. The median blur method is applied in this work to eliminate the salt and pepper noise from the image. Then MPIU-Net-based segmentation is utilized to segment the image. The LGBPNP-based features are retrieved from the segmented image to obtain a single histogram sequence of the LGBP pattern in addition to other features like extraction of multi-texton and LTP-based features. After the feature extraction, the data augmentation process is applied and then the features are fed to the hybrid classification-based nodule classification model that comprises Deep Maxout and CNN, this hybrid classification trains the features and predicts the thyroid nodule. Additionally, the TIRADS score classification is used for the projected malignant thyroid nodule coupled with statistical features collected from the segmented. The DBNAAF with transfer learning model is employed to classify the grading of malignant thyroid nodules, where the weights of the model are learned with transfer learning. The MCC of the Hybrid Model is 0.9445, whereas the DCNN is 0.6858, YOLOV3-DMRF is 0.7229, CNN is 0.7780, DBN is 0.7601, Bi-GRU is 0.7038, Deep Maxout is 0.7528, and RNN is 0.8522, respectively.

Sentiment analysis of online reviews of energy-saving products based on transfer learning and LBBA model

With the exacerbation of global climate change and the growing environmental awareness among the general public, the concept of green consumption has gained significant attention across various sectors of society. As a representative example of green consumer products, energy-saving products play a crucial role in the timely realization of dual carbon goals. However, an analysis of online comments regarding energy-saving products reveals that the majority of these products still exhibit shortcomings in terms of efficacy, noise level, cost-effectiveness, and particularly, energy-saving appliances. This study focuses on the user-generated online comments data from the Taobao e-commerce platform for Grade 1 energy-saving refrigerators. By employing text mining techniques, the study aims to extract the essential information and sentiments expressed in the comments, in order to explore the consumption characteristics of Grade 1 energy-saving refrigerators. Moreover, the LBBA (LDA-Bert-BiLSTM-Attention) model is utilized to investigate the consumer topics of interest and emotional features. Initially, the LDA model is adopted to identify the attributes and weights of consumer concerns. Subsequently, the Bert model is pre-trained with the online comment data, and combined with the BiLSTM algorithm and Attention mechanism to predict sentiment categories. Finally, a transfer learning approach is utilized to determine the sentiment inclination of user-generated online comments and to identify the primary driving factors behind each sentiment category. This research employs sentiment analysis on online comments data regarding energy-saving products to uncover consumer sentiment attributes and emotional characteristics. It provides decision-makers with a comprehensive and systematic understanding of public consumption intentions, offering decision support for the efficient operation and management of the energy-saving product market.

Selecting subsets of source data for transfer learning with applications in metal additive manufacturing

Selecting subsets of source data for transfer learning with applications in metal additive manufacturing

Using Transfer Learning and XGBoost for Early Detection of Fires in Offshore Wind Turbine Units

To improve the power generation efficiency of offshore wind turbines and address the problem of high fire monitoring and warning costs, we propose a data-driven fire warning method based on transfer learning for wind turbines in this paper. This paper processes wind turbine operation data in a SCADA system. It uses an extreme gradient-boosting tree (XGBoost) algorithm to build an offshore wind turbine unit fire warning model with a multiparameter prediction function. This paper selects some parameters from the dataset as input variables for the model, with average cabin temperature, average outdoor temperature, average cabin humidity, and average atmospheric humidity as output variables. This paper analyzes the distribution information of input and output variables and their correlation, analyzes the predicted difference, and then provides an early warning for wind turbine fires. This paper uses this fire warning model to transfer learning to different models of offshore wind turbines in the same wind farm to achieve fire warning. The experimental results show that the prediction performance of the multiparameter is accurate, with an average MAPE of 0.016 and an average RMSE of 0.795. It is better than the average MAPE (0.051) and the average RMSE (2.020) of the prediction performance of a backpropagation (BP) neural network, as well as the average MAPE (0.030) and the average RMSE (1.301) of the prediction performance of random forest. The transfer learning model has good prediction performance, with an average MAPE of 0.022 and an average RMSE of 1.469.

Revealing Urban Deformation Patterns through InSAR Time Series Analysis with TCN and Transfer Learning

Abstract. Current multi-epoch InSAR techniques heavily rely on the assumption of linear deformation. This can sometimes overlook crucial deformation signals when using velocities for evaluation. The process of interpreting InSAR time series is not only time-consuming and labor-intensive but also requires a certain level of expertise. This study refines existing InSAR deformation categories, such as stable, linear, step, piecewise linear, power, and undefined, to define 'canonical deformation time series patterns.' We propose an innovative approach for InSAR post-processing using Temporal Convolutional Networks (TCN) and transfer learning. Due to the limited availability of real data, we use simulated data to train a pre-existing model. We then assess the effectiveness of our method in identifying urban deformation patterns. This research could significantly improve our understanding of large-scale InSAR time series deformation and reveal the underlying patterns.

FireXplainNet: Optimizing Convolution Block Architecture for Enhanced Wildfire Detection and Interpretability

The early detection of wildfires is a crucial challenge in environmental monitoring, pivotal for effective disaster management and ecological conservation. Traditional detection methods often fail to detect fires accurately and in a timely manner, resulting in significant adverse consequences. This paper presents FireXplainNet, a Convolutional Neural Network (CNN) base model, designed specifically to address these limitations through enhanced efficiency and precision in wildfire detection. We optimized data input via specialized preprocessing techniques, significantly improving detection accuracy on both the Wildfire Image and FLAME datasets. A distinctive feature of our approach is the integration of Local Interpretable Model-agnostic Explanations (LIME), which facilitates a deeper understanding of and trust in the model’s predictive capabilities. Additionally, we have delved into optimizing pretrained models through transfer learning, enriching our analysis and offering insights into the comparative effectiveness of FireXplainNet. The model achieved an accuracy of 87.32% on the FLAME dataset and 98.70% on the Wildfire Image dataset, with inference times of 0.221 and 0.168 milliseconds, respectively. These performance metrics are critical for the application of real-time fire detection systems, underscoring the potential of FireXplainNet in environmental monitoring and disaster management strategies.

Automated assessment of mental workload from PPG sensor data using cross-wavelet coherence and transfer learning

Automated assessment of mental workload from PPG sensor data using cross-wavelet coherence and transfer learning

A Beginner's Guide to Artificial Intelligence for Ophthalmologists.

The integration of artificial intelligence (AI) in ophthalmology has promoted the development of the discipline, offering opportunities for enhancing diagnostic accuracy, patient care, and treatment outcomes. This paper aims to provide a foundational understanding of AI applications in ophthalmology, with a focus on interpreting studies related to AI-driven diagnostics. The core of our discussion is to explore various AI methods, including deep learning (DL) frameworks for detecting and quantifying ophthalmic features in imaging data, as well as using transfer learning for effective model training in limited datasets. The paper highlights the importance of high-quality, diverse datasets for training AI models and the need for transparent reporting of methodologies to ensure reproducibility and reliability in AI studies. Furthermore, we address the clinical implications of AI diagnostics, emphasizing the balance between minimizing false negatives to avoid missed diagnoses and reducing false positives to prevent unnecessary interventions. The paper also discusses the ethical considerations and potential biases in AI models, underscoring the importance of continuous monitoring and improvement of AI systems in clinical settings. In conclusion, this paper serves as a primer for ophthalmologists seeking to understand the basics of AI in their field, guiding them through the critical aspects of interpreting AI studies and the practical considerations for integrating AI into clinical practice.

Afitness: Fitness Monitoring on Smart Devices via Acoustic Motion Images

Recently, as fitness has become a popular part of people’s lives, the intention to record fitness processes and assess the standards of fitness movements has grown increasingly keen. However, the existing approaches have some limitations, for example, wearable devices can hinder users’ fitness activities; computer vision–based solutions pose the risk of privacy breach, and so on. Fortunately, we observed that smartspeaker, acoustic-based sensing is a promising method of activity monitoring. In this article, we propose Afitness, an acoustic-based sensing system that enables non-intrusive, passive, and high-precision fitness detection. Afitness has the following three innovations. (i) We utilize pulse compression to generate high-precision motion distance images on commercial devices that can be visually recognized. (ii) We propose a data augmentation algorithm, which also incorporates transfer learning to greatly reduce the pressure of data collection. (iii) We exploit incremental learning techniques that allow Afitness to improve the portability of our system and recognize new actions. Overall, Afitness achieves acoustic signal interpretability and environmental reliability detection.

Multi Task Learning Based Shallow Parsing for Indian Languages

Shallow Parsing is an important step for many Natural Language Processing tasks. Although shallow parsing has a rich history for resource rich languages, it is not the case for most Indian languages. Shallow Parsing consists of POS Tagging and Chunking. Our study focuses on developing shallow parsers for Indian languages. As part of shallow parsing we included morph analysis as well. For the study, we first consolidated available shallow parsing corpora for 7 Indian Languages (Hindi, Kannada, Bangla, Malayalam, Marathi, Urdu, Telugu) for which treebanks are publicly available. We then trained models to achieve state of the art performance for shallow parsing in these languages for multiple domains. Since analyzing the performance of model predictions at sentence level is more realistic, we report the performance of these shallow parsers not only at the token level, but also at the sentence level. We also present machine learning techniques for multitask shallow parsing. Our experiments show that fine-tuned contextual embedding with multi-task learning improves the performance of multiple as well as individual shallow parsing tasks across different domains. We show the transfer learning capability of these models by creating shallow parsers (only with POS and Chunk) for Gujarati, Odia, and Punjabi for which no treebanks are available. As a part of this work, we will be releasing the Indian Languages Shallow Linguistic (ILSL) benchmarks for 10 Indian languages including both the major language families Indo-Aryan and Dravidian as common building blocks that can be used to evaluate and understand various linguistic phenomena found in Indian languages and how well newer approaches can tackle them.

TL‐GNN: Android Malware Detection Using Transfer Learning

ABSTRACTMalware growth has accelerated due to the widespread use of Android applications. Android smartphone attacks have increased due to the widespread use of these devices. While deep learning models offer high efficiency and accuracy, training them on large and complex datasets is computationally expensive. Hence, a method that effectively detects new malware variants at a low computational cost is required. A transfer learning method to detect Android malware is proposed in this research. Because of transferring known features from a source model that has been trained to a target model, the transfer learning approach reduces the need for new training data and minimizes the need for huge amounts of computational power. We performed many experiments on 1.2 million Android application samples for performance evaluation. In addition, we evaluated how well our framework performed in comparison with traditional deep learning and standard machine learning models. In comparison with state‐of‐the‐art Android malware detection methods, the proposed framework offers improved classification accuracy of 98.87%, a precision of 99.55%, recall of 97.30%, F1‐measure of 99.42%, and a quicker detection rate of 5.14 ms using the transfer learning strategy.

Transfer learning for servomotor bearing fault detection in the industrial robot

In consequence of their superior performance and durability, industrial robots have enjoyed widespread adoption across a variety of industries. However, despite their sturdy build, they are susceptible to malfunction. The servomotor is a fundamental component of industrial robots, and to ensure smooth and uninterrupted functioning, it is essential to detect any defects it may develop. Although research has addressed methods for detecting bearing failure, diagnosis of a servomotor bearing failure in the industrial robot remains difficult and requires intensive research. In this paper, a novel method for detecting servomotor bearing defects in the industrial robot is provided by integrating knowledge transfer via transfer learning. Initially, current signals of the servomotor are transformed to scalogram images. This processed data is utilized to build the model for fault detection. Applying transfer learning eliminates model training from scratch and streamlined operations. The purported approach shows an average accuracy of more than 99 %.

Dog Breed Identification Using Deep Learning

Deep learning has revolutionized computer vision tasks, including image classification. In this study, we propose a deep learning approach for the identification of dog breeds from images. Leveraging transfer learning with the ResNet50V2 model, our methodology involves preprocessing and augmenting a dataset of dog images to enhance model generalization. Through rigorous experimentation and training, our model achieves competitive accuracy rates in identifying over 60 unique dog breeds. Results indicate the efficacy of our approach in breed classification tasks, with potential applications in pet identification systems and animal welfare initiatives. Keywords: Deep learning, Dog breed identification, Transfer learning, Computer vision.

Data augmentation and transfer learning for cross-lingual Named Entity Recognition in the biomedical domain

AbstractGiven the increase in production of data for the biomedical field and the unstoppable growth of the internet, the need for Information Extraction (IE) techniques has skyrocketed. Named Entity Recognition (NER) is one of such IE tasks useful for professionals in different areas. There are several settings where biomedical NER is needed, for instance, extraction and analysis of biomedical literature, relation extraction, organisation of biomedical documents, and knowledge-base completion. However, the computational treatment of entities in the biomedical domain has faced a number of challenges including its high cost of annotation, ambiguity, and lack of biomedical NER datasets in languages other than English. These difficulties have hampered data development, affecting both the domain itself and its multilingual coverage. The purpose of this study is to overcome the scarcity of biomedical data for NER in Spanish, for which only two datasets exist, by developing a robust bilingual NER model. Inspired by back-translation, this paper leverages the progress in Neural Machine Translation (NMT) to create a synthetic version of the Colorado Richly Annotated Full-Text (CRAFT) dataset in Spanish. Additionally, a new CRAFT dataset is constructed by replacing 20% of the entities in the original dataset generating a new augmented dataset. We evaluate two training methods: concatenation of datasets and continuous training to assess the transfer learning capabilities of transformers using the newly obtained datasets. The best performing NER system in the development set achieved an F-1 score of 86.39%. The novel methodology proposed in this paper presents the first bilingual NER system and it has the potential to improve applications across under-resourced languages.

Deep Learning Model for COVID-19 Classification Using Fine Tuned ResNet50 on Chest X-Ray Images

Amid the COVID-19 pandemic, extensive research has focused on deep learning methodologies for accurately diagnosing the virus from chest X-ray images. Various models, including Convolutional Neural Networks (CNNs) and pre-trained models, have achieved accuracies ranging from 85.20% to 99.66%. However, the proposed Fine-Tuned ResNet50 model consistently outperforms others with an impressive accuracy of 98.20%. By leveraging on transfer learning and careful architectural design the proposed model demonstrates superior performance compared to previous studies using DarkNet, ResNet50, and pre-trained models. Graphical comparisons highlight its competitive edge, emphasizing its effectiveness in COVID-19 classification tasks. The ResNet50 architecture, known for its deep residual layers and skip connections, facilitates robust feature extraction and classification, especially in medical imaging. Data pre-processing techniques, like noise reduction and contrast enhancement, ensure input data quality and reliability, enhancing the model's predictive abilities. Training results reveal the model's steady accuracy improvement and loss reduction over 20 epochs, aligning closely with validation metrics. Evaluation on a test set of COVID-19 chest X-ray images confirms exceptional accuracy (98.20%), precision (99.00%), recall (98.82%), and F1-score (98.91%), highlighting its proficiency in identifying COVID-19 cases while minimizing false positives and negatives. Comparative analyses against prior studies further validate its superior performance, establishing the Fine-Tuned ResNet50 model as a reliable tool for COVID-19 diagnosis. Future research should focus on exploring ensemble learning techniques, interpretability methods, and stakeholder collaboration to ensure safe AI deployment in clinical settings. Moreover, larger and diverse datasets are crucial for validating model performance and improving generalization, ultimately enhancing patient care and public health outcomes in the mitigating COVID-19 and future pandemics.