Artificial Neural Network Classification Model Research Articles

Improved Artificial Neural Network Classification Model based Metaheuristic Optimization for Handwritten Character Recognition

This study addresses the concerns regarding the performance of Handwritten Character Recognition (HCR) systems, focusing on the classification stage. It is widely acknowledged that the development of the classification model significantly impacts the overall performance of HCR. The problems identified specifically pertain to the classification model, particularly in the context of the Artificial Neural Network (ANN) learning problem, leading to low accuracy in recognizing handwritten characters. The objective of this study is to improve and refine the ANN classification model to achieve better HCR. To achieve this goal, this study proposed a hybrid Flower Pollination Algorithm with Artificial Neural Network (FPA-ANN) classification model for HCR. The FPA is one of the metaheuristic approaches is utilized as an optimization technique to enhance the performance of ANN, particularly by optimizing the network training process of ANN. The experimentation phase involves using the National Institute of Standards and Technology (NIST) handwritten character database. Finally, the proposed FPA-ANN classification model is analysed based on generated confusion matrix and evaluated performance of the classification model in terms of precision, sensitivity, specificity, F-score and accuracy.

ANN-Based Intelligent Secure Routing Protocol in Vehicular Ad Hoc Networks (VANETs) Using Enhanced AODV

A vehicular ad hoc network (VANET) is a sophisticated wireless communication infrastructure incorporating centralized and decentralized control mechanisms, orchestrating seamless data exchange among vehicles. This intricate communication system relies on the advanced capabilities of 5G connectivity, employing specialized topological arrangements to enhance data packet transmission. These vehicles communicate amongst themselves and establish connections with roadside units (RSUs). In the dynamic landscape of vehicular communication, disruptions, especially in scenarios involving high-speed vehicles, pose challenges. A notable concern is the emergence of black hole attacks, where a vehicle acts maliciously, obstructing the forwarding of data packets to subsequent vehicles, thereby compromising the secure dissemination of content within the VANET. We present an intelligent cluster-based routing protocol to mitigate these challenges in VANET routing. The system operates through two pivotal phases: first, utilizing an artificial neural network (ANN) model to detect malicious nodes, and second, establishing clusters via enhanced clustering algorithms with appointed cluster heads (CH) for each cluster. Subsequently, an optimal path for data transmission is predicted, aiming to minimize packet transmission delays. Our approach integrates a modified ad hoc on-demand distance vector (AODV) protocol for on-demand route discovery and optimal path selection, enhancing request and reply (RREQ and RREP) protocols. Evaluation of routing performance involves the BHT dataset, leveraging the ANN classifier to compute accuracy, precision, recall, F1 score, and loss. The NS-2.33 simulator facilitates the assessment of end-to-end delay, network throughput, and hop count during the path prediction phase. Remarkably, our methodology achieves 98.97% accuracy in detecting black hole attacks through the ANN classification model, outperforming existing techniques across various network routing parameters.

Screening and identification of unknown chemical contaminants in food based on liquid chromatography–high-resolution mass spectrometry and machine learning

Unknown or unexpected chemical contaminants and/or their transformation products in food that may be harmful to humans need to be discovered for comprehensive safety evaluation. Liquid chromatography–high-resolution mass spectrometry (LC-HRMS) is a powerful tool for detecting chemical contaminants in food samples. However, identifying all of peaks in LC-HRMS is not possible, but if class information is known in advance, further identification will become easier. In this work, a novel MS2 spectra classification-driven screening strategy was constructed based on LC-HRMS and machine learning. First, the classification model was developed based on machine learning algorithm using class information and experimental MS2 data of chemical contaminants and other non-contaminants. By using the developed artificial neural network classification model, in total 32 classes of pesticides, veterinary drugs and mycotoxins were classified with good prediction accuracy and low false-positive rate. Based on the classification model, a screening procedure was developed in which the classes of unknown features in LC-HRMS were first predicted through the classification model, and then their structures were identified under the guidance of class information. Finally, the developed strategy was tentatively applied to the analysis of pork and aquatic products, and 8 chemical contaminants and 11 transformation products belonging to 8 classes were found. This strategy enables screening of unknown chemical contaminants and transformation products in complex food matrices.

Determination of moisture content and contaminated blank dried figs (Ficus carica L.) using dielectric property and artificial neural network

AbstractDried figs are a garden produce that must be graded after harvesting. Moisture levels and contaminated blank are two of the most critical effective elements on the marketability of dried figs, and they are highly related to fig quality. In the present research, an intelligent system was employed to classify dried figs based on moisture content levels and infected blank fruits. Capacitance characteristics, average diameter, and fruit area were all taken into account in this study. The dried fig dielectric constant was measured at six different frequency levels: 12, 22, 32, 42, 52, and 62 MHz. The best frequency was then chosen using the improved distance evaluation feature selection approach. Image processing was also used to determine the average diameter and area of the figures. Following that, the dielectric constant of the most effective frequency, the average diameter, and the area of the fruit were used as input parameters in the artificial neural network classification model to classify and describe the moisture and porosity level of the dried fig. The most essential dielectric constant information relating to moisture and porosity level was at frequencies of 22 and 52 MHz, respectively. Finally, classification accuracy of 95.7% for moisture and 91.3% for porosity level was attained. The results demonstrated the excellent performance and capabilities of the proposed approach for rating the internal quality of dried figs.

Assessing the color status and daylight chromaticity of road signs through machine learning approaches

The color of road signs is a critical aspect of road safety, as it helps drivers quickly and accurately identify and respond to these signs. Properly colored road signs improve visibility during the day and make it easier for drivers to make informed decisions while driving. In order to ensure the safety and efficiency of road traffic, it is essential to maintain the appropriate color level of road signs.The objective of this study was to analyze the color status and daylight chromaticity of in-use road signs using supervised machine learning models, and to explore the correlation between road sign's age and daylight chromaticity. Three algorithms were employed: Random Forest (RF), Support Vector Machine (SVM), and Artificial Neural Network (ANN). The data used in this study was collected from road signs that were in-use on roads in Sweden.The study employed classification models to assess the color status (accepted or rejected) of the road signs based on minimum acceptable color levels according to standards, and regression models to predict the daylight chromaticity values. The correlation between road sign's age and daylight chromaticity was explored through regression analysis. Daylight chromaticity describes the color quality of road signs in daylight, that is expressed in terms of X and Y chromaticity coordinates.The study revealed a linear relationship between the road sign's age and daylight chromaticity for blue, green, red, and white sheeting, but not for yellow. The lifespan of red signs was estimated to be around 12 years, much shorter than the estimated lifespans of yellow, green, blue, and white sheeting, which are 35, 42, 45, and 75 years, respectively.The supervised machine learning models successfully assessed the color status of the road signs and predicted the daylight chromaticity values using the three algorithms. The results of this study showed that the ANN classification and ANN regression models achieved high accuracy of 81% and R2 of 97%, respectively. The RF and SVM models also performed well, with accuracy values of 74% and 79% and R2 ranging from 59% to 92%. The findings demonstrate the potential of machine learning to effectively predict the status and daylight chromaticity of road signs and their impact on road safety in the Swedish context.

A data-driven approach to estimating post-discovery parameters of unexplored oilfields

Consider a typical situation where an investor is considering acquiring an unexplored oilfield. The oilfield has undergone a preliminary geological and geophysical study in which pre-discovery data such as lithology, depth, depositional system, diagenetic overprint, structural compartmentalization, and trap type are available. In this situation, investors usually estimate production rates using a volumetric approach. A more accurate estimation of production rates can be obtained using analytical methods, which require additional data such as net pay, porosity, oil formation volume factor, permeability, viscosity, and pressure. We call these data post-discovery parameters because they are only available after discovery through exploration drilling. A data-driven approach to estimating post-discovery parameters of an unexplored oilfield is developed based on its pre-discovery data by learning from proven reservoir data. Using the Gaussian mixture model, and a data-driven reservoir typology based on the joint probability distribution of post-discovery parameters is established. We came up with 12 reservoir types. Subsequently, an artificial neural network classification model with the resilient backpropagation algorithm is used to find relationships between pre-discovery data and reservoir types. Based on k-fold cross-validation with k = 10, the accuracy of the classification model is stable with an average of 87.9%. With our approach, an investor considering acquiring an unexplored oilfield can classify the oilfield's reservoir into a particular type and estimate its post-discovery parameters' joint probability distribution. The investor can incorporate this information into a valuation model to calculate the production rates more accurately, estimate the oilfield's value and risk, and make an informed acquisition decision accordingly.

Non-destructive discrimination of homochromatic foreign materials in cut tobacco based on VIS-NIR hyperspectral imaging.

The presence of foreign materials (FM) not only reduces the commercial value of tobacco and the quality of cigarette products, but also affects the aroma and flavor of cigarettes. Existing tobacco deblending equipment has received little study with respect to homochromatic FM. In the present study, visible-near infrared (VIS-NIR) hyperspectral imaging technique combined with chemometrics were used to identify and visualize the homochromatic FM on the surface of thining tobacco. A comparison with conventional vision method was made to analyze the feasibility of the method. The importance of detecting FM in cut tobacco was further demonstrated by first studying the volatile organic compounds produced in cigarette mixed FM smoke and their effects on human health before conducting hyperspectral experiments. The results indicated that solid-phase microextraction and gas chromatography mass spectrometry could detect volatile organic compounds in mainstream cigarette smoke that were not cigarette components and affected consumer health. Then, spectral features of the samples were extracted from hyperspectral images for building identification models to distinguish FM from cut tobacco. The visual RGB values of cut tobacco and FM were also used for the analysis of the recognition models. The results showed that the accuracy, precision and recall reached 100.00% using the back propagation artificial neural network classification model based on the principal component analysis raw wavelengths. The visualization results based on the optimal model produced clearer localization than conventional computer vision method. The present study revealed that the VIS-NIR hyperspectral imaging technology had advantage in the detection and localization of FM on the surface of thinning tobacco, which provided a foundation for improving the quality and safety of cut tobacco production. © 2023 Society of Chemical Industry.

Artificial Neural Networks, Support Vector Machine And Energy Detection For Spectrum Sensing Based On Real Signals

A Cognitive Radio (CR) is an intelligent wireless communication system, which is able to improve the utilization of the spectral environment. Spectrum sensing (SS) is one of the most important phases in the cognitive radio cycle, this operation consists in detecting signals presence in a particular frequency band. In order to detect primary user (PU) existence, this paper proposes a low cost and low power consumption spectrum sensing implementation. Our proposed platform is tested based on real world signals. Those signals are generated by a Raspberry Pi card and a 433 MHz Wireless transmitter (ASK (Amplitude-Shift Keying) and FSK (Frequency-Shift Keying) modulation type). RTL-SDR dongle is used as a reception interface. In this work, we compare the performance of three methods for SS operation: The energy detection technique, the Artificial neural network (ANN) and the support vector machine (SVM). So, the received data could be classified as a PU or not (noise) by the ED method, and by training and testing on a proposed ANN and SVM classification model. The proposed algorithms are implemented under MATLAB software. In order to determine the best architecture, in the case of ANN, two different training algorithms are compared. Furthermore, we have investigated the effect of several SVM functions. The main objective is to find out the best method for signal detection between the three methods. The performance evaluation of our proposed system are the probability of detection and the false alarm probability . This Comparative work has shown that the SS operation by SVM can be more accurate than ANN and ED.

Explainable artificial intelligence for building energy performance certificate labelling classification

The building energy performance certificates (EPC) are widely adopted for sustainable development and improvement in building energy efficiency. Different from the conventional direct measurement based approach of acquiring a building’s EPC label, this study proposes a novel and alternative approach to classify a building’s EPC label using artificial neural network (ANN) models. Given the extensive best building EPC practices in developed countries, historical building EPC data and experiences can expedite the development and improvement of this procedure in developing countries. This study first develops the ANN classification model to attain the building EPC label. The classification result shows that the building EPC classification can achieve a 99% precision with sufficient input data. With the assistance of explainable artificial intelligence (XAI) tools such as the Local Interpretable Model-Agnostic Explanation (LIME) and SHapley Additive exPlanation (SHAP), some less important input features for the ANN classification models can be removed without severely influencing the ANN model’s accuracy. In the case studies, the EPC best practices historical registry data from Lombardy, Italy are used in training the ANN model. The ANN models’ accuracy for the case study 1 is 93% with 14 input features where CO2 emissions and net surface area are the two most influential features. The most influential input feature for case study 2 is the winter AC non-renewable energy performance, and the accuracy of the case study 2 ANN model is 89% with 26 input features.

A SEMI AUTOMATED MODEL FOR IMPROVING VESSEL SYSTEM RELIBAILITY AND MAINETANANCE MANAGEMENT

The demanding nature of Naval operational requirements leads to rapid deterioration and decline in the reliability of ships systems and machineries. In most Navies ships built with design life of 25-30 years begin to significantly decline in performance around 7-8 years after joining service. Consequently, these leads to frequent and often prolonged downtime and huge maintenance cost. The Nigerian Navy like other navies is equally faced with this situation in a challenging manner due to the introduction of new platforms and to non-standardised data management. Therefore, a data management approach that is focused on the use of maintenance, repair, and overhaul (MRO) data is proposed. The proposed approach will build on the existing data collection and management practiced in the Nigerian Navy while identifying alternatives for both onboard and fleet level maintenance data collection and management. In this regard a platform for a predictive machinery condition monitoring approach based on failure mode and component criticality is proposed. In this research a methodology for data collection and fault labelling is presented. Diagnostic analysis using Feedforward Artificial Neural Network classification model was used for fault classification.

Use of Machine Learning and Routine Laboratory Tests for Diabetes Mellitus Screening.

Most patients with diabetes mellitus are asymptomatic, which leads to delayed and more complex treatment. At the same time, most individuals are routinely subjected to standard clinical laboratory examinations, which create large health datasets over a lifetime. Computer processing has been used to search for health anomalies and predict diseases using clinical examinations. This work studied machine learning models to support the screening of diabetes through routine laboratory tests using data from laboratory tests of 62,496 patients. The classification and regression models used were the K-nearest neighbor, support vector machines, Bayes naïve, random forest models, and artificial neural networks. Glycated hemoglobin, a test used for diabetes diagnosis, was used as the target. Regression models calculated glycated hemoglobin directly and were later classified. The performance of classification computer models has been studied under various subdataset partitions and combinations (e.g., healthy, prediabetic, and diabetes, as well as no healthy and no diabetes). The best single performance was achieved with the artificial neural network model when detecting prediabetes or diabetes. The artificial neural network classification model scored 78.1%, 78.7%, and 78.4% for sensitivity, precision, and F1 scores, respectively, when identifying no healthy group. Other models also had good results, depending on what is desired. Machine learning-based models can predict glycated hemoglobin values from routine laboratory tests and can be used as a screening tool to refer a patient for further testing.

Classification of Breast Cancer Patients Using Neural Network Technique

This work develops an Artificial Neural Network (ANN) model for performing Breast Cancer (BC) classification tasks. The design of the model considers studying different ANN architectures from the literature and chooses the one with the best performance. This ANN model aims to classify BC cases more systematically and more quickly. It provides facilities in the field of medicine to detect breast cancer among women. The ANN classification model is able to achieve an average accuracy of 98.88 % with an average run time of 0.182 seconds. Using this model, the classification of BC can be carried out much more faster than manual diagnosis and with good enough accuracy.

Classification of Breast Cancer Patients Using Neural Network Technique

This work develops an Artificial Neural Network (ANN) model for performing Breast Cancer (BC) classification tasks. The design of the model considers studying different ANN architectures from the literature and chooses the one with the best performance. This ANN model aims to classify BCcasesmore systematically and more quickly. It provides facilities in the field of medicine to detect breast cancer among women. TheANN classification model is able to achieve an average accuracy of 98.88 %with an average run time of0.182seconds.Using this model, the classification of BC can be carried out much more faster than manual diagnosisand with good enough accuracy

Predicting innovative firms using web mining and deep learning.

Evidence-based STI (science, technology, and innovation) policy making requires accurate indicators of innovation in order to promote economic growth. However, traditional indicators from patents and questionnaire-based surveys often lack coverage, granularity as well as timeliness and may involve high data collection costs, especially when conducted at a large scale. Consequently, they struggle to provide policy makers and scientists with the full picture of the current state of the innovation system. In this paper, we propose a first approach on generating web-based innovation indicators which may have the potential to overcome some of the shortcomings of traditional indicators. Specifically, we develop a method to identify product innovator firms at a large scale and very low costs. We use traditional firm-level indicators from a questionnaire-based innovation survey (German Community Innovation Survey) to train an artificial neural network classification model on labelled (product innovator/no product innovator) web texts of surveyed firms. Subsequently, we apply this classification model to the web texts of hundreds of thousands of firms in Germany to predict whether they are product innovators or not. We then compare these predictions to firm-level patent statistics, survey extrapolation benchmark data, and regional innovation indicators. The results show that our approach produces reliable predictions and has the potential to be a valuable and highly cost-efficient addition to the existing set of innovation indicators, especially due to its coverage and regional granularity.

Hybrid Firefly Algorithm with Artificial Neural Network (FA-ANN) Classification Model for Handwritten Character Recognition

This paper acknowledged the issues regarding HCR performances particularly in the classification stage. It is generally agreed that one of the main factors influencing performance in HCR is the development of classification model. As for the classification stage, the problems identified are related to classification model particularly in Artificial Neural Network (ANN) learning problem that results in low accuracy of handwritten character recognition. Thus, the aim of this study is to develop and enhance the ANN classification model in order to identify the handwritten character better. This paper proposed the hybrid Firefly Algorithm with Artificial Neural Network (FA-ANN) classification model for handwritten character. Firefly algorithm acts as optimisation approach in enhancing ANN particularly by optimize network training process of ANN. National Institute of Standards and Technology (NIST) handwritten character database was applied in the experiment.

Predicting 30-day hospital readmissions using artificial neural networks with medical code embedding.

Reducing unplanned readmissions is a major focus of current hospital quality efforts. In order to avoid unfair penalization, administrators and policymakers use prediction models to adjust for the performance of hospitals from healthcare claims data. Regression-based models are a commonly utilized method for such risk-standardization across hospitals; however, these models often suffer in accuracy. In this study we, compare four prediction models for unplanned patient readmission for patients hospitalized with acute myocardial infarction (AMI), congestive health failure (HF), and pneumonia (PNA) within the Nationwide Readmissions Database in 2014. We evaluated hierarchical logistic regression and compared its performance with gradient boosting and two models that utilize artificial neural networks. We show that unsupervised Global Vector for Word Representations embedding representations of administrative claims data combined with artificial neural network classification models improves prediction of 30-day readmission. Our best models increased the AUC for prediction of 30-day readmissions from 0.68 to 0.72 for AMI, 0.60 to 0.64 for HF, and 0.63 to 0.68 for PNA compared to hierarchical logistic regression. Furthermore, risk-standardized hospital readmission rates calculated from our artificial neural network model that employed embeddings led to reclassification of approximately 10% of hospitals across categories of hospital performance. This finding suggests that prediction models that incorporate new methods classify hospitals differently than traditional regression-based approaches and that their role in assessing hospital performance warrants further investigation.

Statistical Aspects of High-Dimensional Sparse Artificial Neural Network Models

An artificial neural network (ANN) is an automatic way of capturing linear and nonlinear correlations, spatial and other structural dependence among features. This machine performs well in many application areas such as classification and prediction from magnetic resonance imaging, spatial data and computer vision tasks. Most commonly used ANNs assume the availability of large training data compared to the dimension of feature vector. However, in modern applications, as mentioned above, the training sample sizes are often low, and may be even lower than the dimension of feature vector. In this paper, we consider a single layer ANN classification model that is suitable for analyzing high-dimensional low sample-size (HDLSS) data. We investigate the theoretical properties of the sparse group lasso regularized neural network and show that under mild conditions, the classification risk converges to the optimal Bayes classifier’s risk (universal consistency). Moreover, we proposed a variation on the regularization term. A few examples in popular research fields are also provided to illustrate the theory and methods.

Artificial Neural Networks, Support Vector Machine And Energy Detection For Spectrum Sensing Based On Real Signals

A Cognitive Radio (CR) is an intelligent wireless communication system, which is able to improve the utilization of the spectral environment. Spectrum sensing (SS) is one of the most important phases in the cognitive radio cycle, this operation consists in detecting signals presence in a particular frequency band. In order to detect primary user (PU) existence, this paper proposes a low cost and low power consumption spectrum sensing implementation. Our proposed platform is tested based on real world signals. Those signals are generated by a Raspberry Pi card and a 433 MHz Wireless transmitter (ASK (Amplitude-Shift Keying) and FSK (Frequency-Shift Keying) modulation type). RTL-SDR dongle is used as a reception interface. In this work, we compare the performance of three methods for SS operation: The energy detection technique, the Artificial neural network (ANN) and the support vector machine (SVM). So, the received data could be classified as a PU or not (noise) by the ED method, and by training and testing on a proposed ANN and SVM classification model. The proposed algorithms are implemented under MATLAB software. In order to determine the best architecture, in the case of ANN, two different training algorithms are compared. Furthermore, we have investigated the effect of several SVM functions. The main objective is to find out the best method for signal detection between the three methods. The performance evaluation of our proposed system are the probability of detection and the false alarm probability . This Comparative work has shown that the SS operation by SVM can be more accurate than ANN and ED.

Artificial Neural Network for in-Bed Posture Classification Using Bed-Sheet Pressure Sensors.

Pressure ulcer prevention is a vital procedure for patients undergoing long-term hospitalization. A human body lying posture (HBLP) monitoring system is essential to reschedule posture change for patients. Video surveillance, the conventional method of HBLP monitoring, suffers from various limitations, such as subject's privacy, and field-of-view obstruction. We propose an autonomous method for classifying the four state-of-the-art HBLPs in healthy adults subjects: supine, prone, left and right lateral, with no sensors or cables attached on the body and no constraints imposed on the subject. Experiments have been conducted on 12 healthy adults (age 27.35 ± 5.39 years) using a collection of textile pressure sensors embedded in a cover placed under the bed sheet. Histogram of oriented gradients and local binary patterns were extracted and fed to a supervised artificial neural network classification model. The model was trained based on the scaled conjugate gradient backpropagation. A nested cross validation with an exhaustive outer validation loop was performed to validate the classification's generalization performance. A high testing prediction accuracy of 97.9% with a Cohen's Kappa coefficient of 97.2% has been interestingly obtained. Prone and supine postures were successfully separated in the classification, in contrast to the majority of previous similar works. We found that using the information of body weight distribution along with the shape and edges contributes to a better classification performance and the ability to separate supine and prone postures. The results are satisfactorily promising toward unobtrusively monitoring posture for ulcer prevention. The method can be used in sleep studies, post-surgical procedures, or applications requiring HBLP identification.

Predicting Innovative Firms Using Web Mining and Deep Learning

Innovation is considered as a main driver of economic growth. Promoting the development of innovation through STI (science, technology and innovation) policies requires accurate indicators of innovation. Traditional indicators often lack coverage, granularity as well as timeliness and involve high data collection costs, especially when conducted at a large scale. In this paper, we propose a novel approach on how to create firm-level innovation indicators at the scale of millions of firms. We use traditional firm-level innovation indicators from the questionnaire-based Community Innovation Survey (CIS) survey to train an artificial neural network classification model on labelled (innovative/non-innovative) web texts of surveyed firms. Subsequently, we apply this classification model to the web texts of hundreds of thousands of firms in Germany to predict their innovation status. Our results show that this approach produces credible predictions and has the potential to be a valuable and highly cost-efficient addition to the existing set of innovation indicators, especially due to its coverage and regional granularity. The predicted firm-level probabilities can also directly be interpreted as a continuous measure of innovativeness, opening up additional advantages over traditional binary innovation indicators.