Multi-layer Deep Neural Network Research Articles

LEVERAGING MACHINE LEARNING FOR IMPROVED SPAM DETECTION IN ONLINE NETWORKS

This paper proposes an advanced methodology of spam detection by including N-gram tf.idf feature selection and a deep multi-layer perceptron neural network, with further improvement through the modified distribution-based balancing algorithm. Considering high-dimensional data and class imbalance problems, the proposed method proved to outperform the state-of-the-art methods on benchmark datasets, including Enron, SpamAssassin, SMS spam collection, and social networking data. It also makes up an important enhancement in the classification of spam, as it captures complex features that reduce false positives and false negatives. These results show that combining deep learning with improved feature extraction and balancing techniques provides a very robust approach for spam detection.

PSSM-Sumo: deep learning based intelligent model for prediction of sumoylation sites using discriminative features

Post-translational modifications (PTMs) are fundamental to essential biological processes, exerting significant influence over gene expression, protein localization, stability, and genome replication. Sumoylation, a PTM involving the covalent addition of a chemical group to a specific protein sequence, profoundly impacts the functional diversity of proteins. Notably, identifying sumoylation sites has garnered significant attention due to their crucial roles in proteomic functions and their implications in various diseases, including Parkinson’s and Alzheimer’s. Despite the proposal of several computational models for identifying sumoylation sites, their effectiveness could be improved by the limitations associated with conventional learning methodologies. In this study, we introduce pseudo-position-specific scoring matrix (PsePSSM), a robust computational model designed for accurately predicting sumoylation sites using an optimized deep learning algorithm and efficient feature extraction techniques. Moreover, to streamline computational processes and eliminate irrelevant and noisy features, sequential forward selection using a support vector machine (SFS-SVM) is implemented to identify optimal features. The multi-layer Deep Neural Network (DNN) is a robust classifier, facilitating precise sumoylation site prediction. We meticulously assess the performance of PSSM-Sumo through a tenfold cross-validation approach, employing various statistical metrics such as the Matthews Correlation Coefficient (MCC), accuracy, sensitivity, specificity, and the Area under the ROC Curve (AUC). Comparative analyses reveal that PSSM-Sumo achieves an exceptional average prediction accuracy of 98.71%, surpassing existing models. The robustness and accuracy of the proposed model position it as a promising tool for advancing drug discovery and the diagnosis of diverse diseases linked to sumoylation sites.

Deep Learning-Based Defects Detection in Keyhole TIG Welding with Enhanced Vision.

Keyhole tungsten inert gas (keyhole TIG) welding is renowned for its advanced efficiency, necessitating a real-time defect detection method that integrates deep learning and enhanced vision techniques. This study employs a multi-layer deep neural network trained on an extensive welding image dataset. Neural networks can capture complex nonlinear relationships through multi-layer transformations without manual feature selection. Conversely, the nonlinear modeling ability of support vector machines (SVM) is limited by manually selected kernel functions and parameters, resulting in poor performance for recognizing burn-through and good welds images. SVMs handle only lower-level features such as porosity and excel only in detecting simple edges and shapes. However, neural networks excel in processing deep feature maps of "molten pools" and can encode deep defects that are often confused in keyhole TIG. Applying a four-class classification task to weld pool images, the neural network adeptly distinguishes various weld states, including good welds, burn-through, partial penetration, and undercut. Experimental results demonstrate high accuracy and real-time performance. A comprehensive dataset, prepared through meticulous preprocessing and augmentation, ensures reliable results. This method provides an effective solution for quality control and defect prevention in keyhole TIG welding process.

A physics-informed, data-driven framework for estimation and optimization of two-phase pressure drop of refrigerants in mini- and macro channels

At present, there is no universally accepted approach for forecasting the flow boiling heat transfer in the scientific literature. The objective of this study is to predict and optimize the two-phase pressure drop (2ϕΔP) for different refrigerants in both mini and macro-sized channels under various operating conditions. The dataset is amassed from open literature and consists of 1954 points that include seven different refrigerants, including R12345yf, R1234ze, R134A, R410A, R22, R744, and R717 containing heat flux (Q) in the range 0–40 kW/m2, hydraulic diameters (Dh) in the range 0.509–14 mm, mass flux in the range 55 < G < 1800 kg/m2s, saturation temperature (Tsat) in the range -40 – 43 °C, and flow qualities (x) in the range 0.001–0959. The first step involves conducting feature engineering operations to select the most significant and impactful features for estimating the considered output. The interpretation by Pearson’s correlation highlighted that Dh, Tsat, x, Q, and G were the most impactful params. The Bayesian optimization incorporated with surrogacy was used to determine the required hyper-parameters, which were then deployed to form multi-layer deep neural network (DNN) for estimating 2ϕΔP. A metaheuristic algorithm known as differential evolution (GA) was used to estimate Dh, Tsat, x, Q, and G to minimize the pressure drop. The performance of the established model was determined to be highly accurate with an accuracy of 0.9985. Additionally, an appropriate 2ϕΔP value for each refrigerant was provided to obtain the optimized values of the different input features. The optimized ML (regression) models performed better than the existing semi-empirical pressure drop correlations. This approach can be beneficial for the development and improvement of various engineering systems, particularly those involving the 2ϕΔP of numerous refrigerants.

Perceptron Theory Can Predict the Accuracy of Neural Networks.

Multilayer neural networks set the current state of the art for many technical classification problems. But, these networks are still, essentially, black boxes in terms of analyzing them and predicting their performance. Here, we develop a statistical theory for the one-layer perceptron and show that it can predict performances of a surprisingly large variety of neural networks with different architectures. A general theory of classification with perceptrons is developed by generalizing an existing theory for analyzing reservoir computing models and connectionist models for symbolic reasoning known as vector symbolic architectures. Our statistical theory offers three formulas leveraging the signal statistics with increasing detail. The formulas are analytically intractable, but can be evaluated numerically. The description level that captures maximum details requires stochastic sampling methods. Depending on the network model, the simpler formulas already yield high prediction accuracy. The quality of the theory predictions is assessed in three experimental settings, a memorization task for echo state networks (ESNs) from reservoir computing literature, a collection of classification datasets for shallow randomly connected networks, and the ImageNet dataset for deep convolutional neural networks. We find that the second description level of the perceptron theory can predict the performance of types of ESNs, which could not be described previously. Furthermore, the theory can predict deep multilayer neural networks by being applied to their output layer. While other methods for prediction of neural networks performance commonly require to train an estimator model, the proposed theory requires only the first two moments of the distribution of the postsynaptic sums in the output neurons. Moreover, the perceptron theory compares favorably to other methods that do not rely on training an estimator model.

ACDMBI: A deep learning model based on community division and multi-source biological information fusion predicts essential proteins

Accurately identifying essential proteins is vital for drug research and disease diagnosis. Traditional centrality methods and machine learning approaches often face challenges in accurately discerning essential proteins, primarily relying on information derived from protein-protein interaction (PPI) networks. Despite attempts by some researchers to integrate biological data and PPI networks for predicting essential proteins, designing effective integration methods remains a challenge. In response to these challenges, this paper presents the ACDMBI model, specifically designed to overcome the aforementioned issues. ACDMBI is comprised of two key modules: feature extraction and classification. In terms of capturing relevant information, we draw insights from three distinct data sources. Initially, structural features of proteins are extracted from the PPI network through community division. Subsequently, these features are further optimized using Graph Convolutional Networks (GCN) and Graph Attention Networks (GAT). Moving forward, protein features are extracted from gene expression data utilizing Bidirectional Long Short-Term Memory networks (BiLSTM) and a multi-head self-attention mechanism. Finally, protein features are derived by mapping subcellular localization data to a one-dimensional vector and processing it through fully connected layers. In the classification phase, we integrate features extracted from three different data sources, crafting a multi-layer deep neural network (DNN) for protein classification prediction. Experimental results on brewing yeast data showcase the ACDMBI model’s superior performance, with AUC reaching 0.9533 and AUPR reaching 0.9153. Ablation experiments further reveal that the effective integration of features from diverse biological information significantly boosts the model’s performance.

Survival Analysis Based Qos Recommendation for Bus Transportation using Deep Learning

Public transportation play an important role in metropolitan cities.Bus services are an important part of public transportation systems, which are frequently chosen because they are convenient, economical, environmentally beneficial, and less taxing on the infrastructure. The temporal patterns of bus transportation incidents are examined in this study using survival analysis, with a focus on the amount of time until certain events like delays, malfunctions, or safe arrivals at destinations. High-dimensional data is being generated at an increasing rate due to technological advancements. As a result, it is quite difficult to analyze such a dataset adequately. Algorithms for machine learning (ML) have become popular tools for modeling complex and nonlinear interactions in a variety of real-world applications, including as the analysis of high-dimensional survival data. Multilayer Deep Neural Network (DNN) models have achieved impressive results recently. Thus, using Keras and TensorFlow, a Cox-based DNN prediction survival model (DNNSurv model) was created. Its findings, however, were limited to survival datasets with large sample sizes or high dimensionality. Using high dimensional survival data, the proposed work will evaluate the DNNSurv model's prediction ability and compare it to a well-known machine learning survival prediction model (random survival forest). The Proposed Work also offers the best settings for a number of hyperparameters, including tuning parameter selection, for this reason. The suggested approach showed through data analysis that, when compared to the ML model, the DNNSurv model performed better overall in terms of the two primary survival prediction evaluation measures (i.e., the concordance index and the time-dependent AUC).

Cryptocurrency returns prediction using candlestick patterns analysis and multi-layer deep LSTM neural networks

Cryptocurrency returns prediction using candlestick patterns analysis and multi-layer deep LSTM neural networks

An inter-modal attention-based deep learning framework using unified modality for multimodal fake news, hate speech and offensive language detection

Fake news, hate speech and offensive language are related evil triplets currently affecting modern societies. Text modality for the computational detection of these phenomena has been widely used. In recent times, multimodal studies in this direction are attracting a lot of interests because of the potentials offered by other modalities in contributing to the detection of these menaces. However, a major problem in multimodal content understanding is how to effectively model the complementarity of the different modalities due to their diverse characteristics and features. From a multimodal point of view, the three tasks have been studied mainly using image and text modalities. Improving the effectiveness of the diverse multimodal approaches is still an open research topic. In addition to the traditional text and image modalities, we consider image–texts which are rarely used in previous studies but which contain useful information for enhancing the effectiveness of a prediction model. In order to ease multimodal content understanding and enhance prediction, we leverage recent advances in computer vision and deep learning for these tasks. First, we unify the modalities by creating a text representation of the images and image–texts, in addition to the main text. Secondly, we propose a multi-layer deep neural network with inter-modal attention mechanism to model the complementarity among these modalities. We conduct extensive experiments involving three standard datasets covering the three tasks. Experimental results show that detection of fake news, hate speech and offensive language can benefit from this approach. Furthermore, we conduct robust ablation experiments to show the effectiveness of our approach. Our model predominantly outperforms prior works across the datasets.

Advancements in remote sensing: Harnessing the power of artificial intelligence for scene image classification

&lt;abstract&gt; &lt;p&gt;The Remote Sensing Scene Image Classification (RSSIC) procedure is involved in the categorization of the Remote Sensing Images (RSI) into sets of semantic classes depending upon the content and this procedure plays a vital role in extensive range of applications, like environment monitoring, urban planning, vegetation mapping, natural hazards' detection and geospatial object detection. The RSSIC procedure exploits Artificial Intelligence (AI) technology, mostly Machine Learning (ML) techniques, for automatic analysis and categorization of the content, present in these images. The purpose is to recognize and differentiate the land cover classes or features in the scene, namely crops, forests, buildings, water bodies, roads, and other natural and man-made structures. RSSIC, using Deep Learning (DL) techniques, has attracted a considerable attention and accomplished important breakthroughs, thanks to the great feature learning abilities of the Deep Neural Networks (DNNs). In this aspect, the current study presents the White Shark Optimizer with DL-driven RSSIC (WSODL-RSSIC) technique. The presented WSODL-RSSIC technique mainly focuses on detection and classification of the remote sensing images under various class labels. In the WSODL-RSSIC technique, the deep Convolutional Neural Network (CNN)-based ShuffleNet model is used to produce the feature vectors. Moreover, the Deep Multilayer Neural network (DMN) classifiers are utilized for recognition and classification of the remote sensing images. Furthermore, the WSO technique is used to optimally adjust the hyperparameters of the DMN classifier. The presented WSODL-RSSIC method was simulated for validation using the remote-sensing image databases. The experimental outcomes infer that the WSODL-RSSIC model achieved improved results in comparison with the current approaches under different evaluation metrics.&lt;/p&gt; &lt;/abstract&gt;

Lulu Filterized Lin’s correlative Theil-Sen regression-based fully connected deep multilayer perceptive neural network for eye gaze pattern recognition

Gaze estimation is process finding the point of gaze on observe axis of eye. Gaze tracking schemes are mainly employed in HCI and study of visual scanning samples. Traditional tracking schemes usually need accurate personal calibration procedure to evaluate the particular eye metrics. In order to improve the accurate gaze estimation, Lulu Filterized Lin?s Correlative Theil-Sen Regression-based Fully Connected Deep Multilayer Perceptive Neural Network (LFLCTR-FCDMPNN) is designed for accurate gaze pattern identification through lesser time consumption. Fully Connected Deep Multilayer Perceptive NN contains input layer, three hidden layers, output layer. In input layer, number of gaze images is collected. Then using Lulu nonlinear smoothing filtering method is applied in initial hidden layer for removing noise as well as enhancing image quality. In second hidden layer, Polar coordinate system-based eye-gaze point estimation is performed. Finally, the Gaze Pattern matching is carried out in third hidden layer using Lin?s Concordance Correlative Theil-Sen regression. The estimated gaze points are organized at gaze plane to identify gaze patterns. Then pattern matching performed by Lin?s Concordance Correlation. In this way, the eye gaze patterns are correctly recognized at the output layer. Experimental evaluation is conducted to demonstrate performance analysis of LFLCTR-FCDMPNN technique through different metrics like gaze pattern recognition accuracy, gaze pattern recognition time, and false-positive rate with different number of eye images. Explained result illustrates which LFLCTR-FCDMPNN method improves the accuracy of gaze pattern recognition and decreases the time consumption than the conventional prediction methods. Using the Synthes Eyes dataset, it turned out that the FPR of the suggested LFLCTR-FCDMPNN was 63% higher than existing.

Deep Multi-Layer Neural Network with Variable-Depth Output

In this study, a deep multi-layer neural network (DMLNN) with variable-depth output (VDO), called VDO-DMLNN, is proposed for classification. Unlike the traditional DMLNN, for which a user must define the network architecture in advance, VDO-DMLNN is produced from the top–down, layer by layer, until the classification error rate of VDO-DMLNN no longer decreases. The user thus does not need to define the depth of VDO-DMLNN in advance. The combination of the genetic algorithm (GA) and the self-organizing feature map (SOFM), called GA–SOFM, is proposed to automatically generate the weights and proper number of nodes for each layer in VDO-DMLNN. In addition, the output nodes can be at different levels in VDO-DMLNN rather than all being at the last layer, as in the traditional DMLNN. Thus, the average of computing time required for the recognition of an input sample in VDO-DMLNN is less than that in traditional DMLNN when they have the same classification error rate. Finally, VDO-DMLNN is compared with some state-of-the-art neural networks in the experiments.

Deep Multilayer Neural Network with Weights Optimization-Based Genetic Algorithm for Predicting Hypothyroid Disease

Deep Multilayer Neural Network with Weights Optimization-Based Genetic Algorithm for Predicting Hypothyroid Disease

Stochastic Gradient Deep Multilayer Neural Network based Linear Congruential Generative Cryptosystem for Secured Data Communication in Cloud

Cloud computing is a kind of distributed computing that use a vast network of interconnected resources accessible over the internet. Security is a crucial concern in cloud computing due to the fact that users save their data on the cloud for convenient access from any location and at any time. Consequently, many users are worried about safeguarding their sensitive data in an unsafe location. Therefore, cloud computing architecture requires an innovative cryptographic method that ensures the secrecy, authenticity, integrity, and non-repudiation of data transfer in the cloud. A new technique called SEMcrypt, which stands for Stochastic Gradient DEep Multilayer Neural Network based Linear Congruential Generative Cryptography, has been developed to enhance secure data transmission. SEMcrypt ensures higher data confidentiality and reduces the time required for communication between the cloud user (i.e., patient) and the server. The SEMcrypt approach has two distinct processes: categorization and secure data transport. Initially, the data is gathered from the patients and is used as input for the stochastic gradient regularised deep multilayer neural network. The deep neural network consists of one input layer, two hidden layers, and one output layer. At first, the information is gathered from the patients and sent to the input layer. Next, the patient data that has been gathered is examined in hidden layer 1 using the generalised Tikhonov regularisation function. The patient data that has been analysed is sent to hidden layer 2. The hyperbolic tangent activation function is used at that layer to classify the patient data. Subsequently, the categorised data undergoes encryption via the use of Linear Congruential Generative Goldwasser-Micali encryption, ensuring safe transfer of the data. Subsequently, the encrypted data is sent to the cloud server. The patient data is encrypted on the server side using the Linear Congruential Generative Goldwasser-Micali decryption technique to prevent unauthorised access or assaults. Consequently, the authorised recipient receives the unaltered information, which is then kept in the database for further analysis. Secured data transmission is achieved by ensuring better levels of data confidentiality and reducing the time required for the process. The experimental assessment focuses on criteria such as the time it takes to generate keys, the level of data confidentiality and integrity, the computing time, and the accuracy of categorization. The empirical findings demonstrate that our suggested SEMcrypt approach delivers efficient performance outcomes by attaining superior levels of data confidentiality and integrity within a minimal timeframe.

Attention-based generative adversarial networks improve prognostic outcome prediction of cancer from multimodal data.

The prediction of prognostic outcome is critical for the development of efficient cancer therapeutics and potential personalized medicine. However, due to the heterogeneity and diversity of multimodal data of cancer, data integration and feature selection remain a challenge for prognostic outcome prediction. We proposed a deep learning method with generative adversarial network based on sequential channel-spatial attention modules (CSAM-GAN), a multimodal data integration and feature selection approach, for accomplishing prognostic stratification tasks in cancer. Sequential channel-spatial attention modules equipped with an encoder-decoder are applied for the input features of multimodal data to accurately refine selected features. A discriminator network was proposed to make the generator and discriminator learning in an adversarial way to accurately describe the complex heterogeneous information of multiple modal data. We conducted extensive experiments with various feature selection and classification methods and confirmed that the CSAM-GAN via the multilayer deep neural network (DNN) classifier outperformed these baseline methods on two different multimodal data sets with miRNA expression, mRNA expression and histopathological image data: lower-grade glioma and kidney renal clear cell carcinoma. The CSAM-GAN via the multilayer DNN classifier bridges the gap between heterogenous multimodal data and prognostic outcome prediction.

Reliable adaptive edge-cloud collaborative DNN inference acceleration scheme combining computing and communication resources in optical networks

With the continuous development of the Artificial Intelligence of Things, deep neural network (DNN) models require a larger amount of computing capacity. The emerging edge-cloud collaboration architecture in optical networks is proposed as an effective solution, which combines edge computing with cloud computing to provide faster response and reduce the cloud load for compute-intensive tasks. The multi-layered DNN model can be divided into subtasks that are offloaded to edge and cloud servers for computation in this architecture. In addition, as bearer networks for computing capacity, once a server or link in optical networks fails, a large amount of data can be lost, so the robust reliability of the edge-cloud collaborative optical networks is very important. To solve the above problems, we design a reliable adaptive edge-cloud collaborative DNN inference acceleration scheme (RACAI) combining computing and communication resources. We formulate the RACAI into a mixed integer linear programming model and develop a multi-agent deep reinforcement learning algorithm (MADRL-RACIA) to jointly optimize DNN task partitioning, offloading, and protection. The simulation results show that compared with the benchmark schemes, the proposed MADRL-RACIA can provide a guarantee of reliability for more tasks under latency constraints and reduce the blocking probability.

Hybrid deep learning model for efficient state of charge estimation of Li-ion batteries in electric vehicles

State of charge (SoC) estimation is critical for the safe and efficient operation of electric vehicles (EVs). This work proposes a hybrid multi-layer deep neural network (HMDNN)-based approach for SoC estimation in EVs. This HMDNN uses Mountain Gazelle Optimizer (MGO) as a training algorithm for the deep neural network. Our method leverages the intrinsic relationship between the SoC and the voltage/current measurements of the EV battery to accurately estimate the SoC in real time. We evaluate our approach on a large dataset of real-world EV charging data and demonstrate its effectiveness in comparison to traditional SoC estimation methods. Four diverse Li-ion battery datasets of electric vehicles are employed which are the dynamic stress test (DST), Beijing dynamic stress test (BJDST), federal urban driving schedule (FUDS), and highway driving schedule (US06) with different temperatures of 0oC,25oC,45oC. The comparison is made with Mayfly Optimization Algorithm based DNN, Particle Swarm Optimization based DNN and Back-Propagation based DNN. The evaluation indices used are normalized mean square error (NMSE), root mean square error (RMSE), mean absolute error (MAE), and relative error (RE). The proposed algorithm achieves 0.1% NMSE and 0.3% RMSE on average on all datasets, which validates the effective performance of the proposed model. The results show that the proposed neural network-based approach can achieve higher accuracy and faster convergence than existing methods. This can enable more efficient EV operation and improved battery life.

Near Real-Time Flood Mapping with Weakly Supervised Machine Learning

Advances in deep learning and computer vision are making significant contributions to flood mapping, particularly when integrated with remotely sensed data. Although existing supervised methods, especially deep convolutional neural networks, have proved to be effective, they require intensive manual labeling of flooded pixels to train a multi-layer deep neural network that learns abstract semantic features of the input data. This research introduces a novel weakly supervised approach for pixel-wise flood mapping by leveraging multi-temporal remote sensing imagery and image processing techniques (e.g., Normalized Difference Water Index and edge detection) to create weakly labeled data. Using these weakly labeled data, a bi-temporal U-Net model is then proposed and trained for flood detection without the need for time-consuming and labor-intensive human annotations. Using floods from Hurricanes Florence and Harvey as case studies, we evaluated the performance of the proposed bi-temporal U-Net model and baseline models, such as decision tree, random forest, gradient boost, and adaptive boosting classifiers. To assess the effectiveness of our approach, we conducted a comprehensive assessment that (1) covered multiple test sites with varying degrees of urbanization, and (2) utilized both bi-temporal (i.e., pre- and post-flood) and uni-temporal (i.e., only post-flood) input. The experimental results showed that the proposed framework of weakly labeled data generation and the bi-temporal U-Net could produce near real-time urban flood maps with consistently high precision, recall, f1 score, IoU score, and overall accuracy compared with baseline machine learning algorithms.

Traffic congestion forecasting using multilayered deep neural network

ABSTRACT This study proposes a multilayered deep neural network (MLDNN) and a congestion index (CI) based on traffic density factor to forecast traffic congestion directly. Data were collected in Delhi city from a selected location using video cameras during peak hours of weekdays from Monday to Sunday to test the proposed model. Collected data were categorized in a matrix format in the intervals of five-minutes. The input matrix was divided into a number of intervals to train, validate, and test the MLDNN and baseline models, including support vector regression, multi-layer perceptron neural network, gated recurrent unit (GRU) neural network, long short-term memory (LSTM) neural network, convolutional neural network (CNN), CNN-GRU neural network, and CNN-LSTM neural network. Results of the study show that the MLDNN and proposed CI can be applied to predict traffic congestion successfully in heterogeneous traffic.

A novel discrete deep learning-based intelligent methodology for energy consumption classification

Energy consumption classification is one of the most widely-used approaches in the energy area that is applied in various applications such as household, commercial, urban, rural, industrial, etc. Energy consumption due to its substantial positive influence on the quality of made decisions, production and distribution management, and cost reduction, has considerable literature. In the classification literature, numerous statistical, intelligence, and hybrid methods have been developed and proposed in order to yield more accurate results. The common point of all these models is that whole of techniques follow a prevalent and repetitive procedure of learning process based on continuous distance-based cost function. While the objective function of classification is discrete. While the mismatch of the continuous cost function in classification problems with the discrete objective function causes them to be illogical or inefficient. Therefore, in this paper, a novel discrete learning process is offered to eliminate the inconsistency between the cost function and the classification objective function. The main difference between the proposed learning methodology rather than conventional versions is its cost function. In the proposed learning methodology, a mismatching function is considered as a cost function, which is dissimilar to previously developed ones, which are continuous functions based on distance, is a discrete function based on direction. In this way, in the proposed learning process, unknown parameters are discretely adjusted and at once jumped to the target. This is in contrast to conventional continuous learning algorithms in which the unknown parameters are continuously adjusted and step-by-step near the target. In this paper, deep multilayer neural networks (DMNs) have been exemplarily applied to implement the proposed learning algorithm. Although more consistency of goal and cost functions will logically has not a negative effect on the classification rate of classifiers. However, in this paper, to show the superiority of the proposed discrete deep multilayer neural network (DDMN) over conventional continuous-based classifiers, four energy consumption benchmark data sets have been employed. These data sets include the Tamilnadu Electricity Board Hourly Readings, Tetouan City Energy Consumption, Household Electric Power consumption, and steel industry Energy Consumption. Empirical results indicate that the proposed DDMN model, as pre-expected, can yield better performance in all cases than the DMN model. The DDMN model can achieve a 93.27% classification rate on average and upgrade its classic version approximately by 4.77%.