Attention-based Bidirectional Long Short-term Memory Research Articles

ERABiLNet: enhanced residual attention with bidirectional long short-term memory

Alzheimer’s Disease (AD) causes slow death in brain cells due to shrinkage of brain cells which is more prevalent in older people. In most cases, the symptoms of AD are mistaken as age-related stresses. The most widely utilized method to detect AD is Magnetic Resonance Imaging (MRI). Along with Artificial Intelligence (AI) techniques, the efficacy of identifying diseases related to the brain has become easier. But, the identical phenotype makes it challenging to identify the disease from the neuro-images. Hence, a deep learning method to detect AD at the beginning stage is suggested in this work. The newly implemented “Enhanced Residual Attention with Bi-directional Long Short-Term Memory (Bi-LSTM) (ERABi-LNet)” is used in the detection phase to identify the AD from the MRI images. This model is used for enhancing the performance of the Alzheimer’s detection in scale of 2–5%, minimizing the error rates, increasing the balance of the model, so that the multi-class problems are supported. At first, MRI images are given to “Residual Attention Network (RAN)”, which is specially developed with three convolutional layers, namely atrous, dilated and Depth-Wise Separable (DWS), to obtain the relevant attributes. The most appropriate attributes are determined by these layers, and subjected to target-based fusion. Then the fused attributes are fed into the “Attention-based Bi-LSTM”. The final outcome is obtained from this unit. The detection efficiency based on median is 26.37% and accuracy is 97.367% obtained by tuning the parameters in the ERABi-LNet with the help of Modified Search and Rescue Operations (MCDMR-SRO). The obtained results are compared with ROA-ERABi-LNet, EOO-ERABi-LNet, GTBO-ERABi-LNet and SRO-ERABi-LNet respectively. The ERABi_LNet thus provides enhanced accuracy and other performance metrics compared to such deep learning models. The proposed method has the better sensitivity, specificity, F1-Score and False Positive Rate compared with all the above mentioned competing models with values such as 97.49%.97.84%,97.74% and 2.616 respective;y. This ensures that the model has better learning capabilities and provides lesser false positives with balanced prediction.

Comparison of deep learning algorithms for site detection of false data injection attacks in smart grids

False Data Injection Attacks (FDIA) pose a significant threat to the stability of smart grids. Traditional Bad Data Detection (BDD) algorithms, deployed to remove low-quality data, can easily be bypassed by these attacks which require minimal knowledge about the parameters of the power bus systems. This makes it essential to develop defence approaches that are generic and scalable to all types of power systems. Deep learning algorithms provide state-of-the-art detection for FDIA while requiring no knowledge about system parameters. However, there are very few works in the literature that evaluate these models for FDIA detection at the level of an individual node in the power system. In this paper, we compare several recent deep learning-based model that proven their high performance and accuracy in detecting the exact location of the attack node, which are convolutional neural networks (CNN), Long Short-Term Memory (LSTM), attention-based bidirectional LSTM, and hybrid models. We, then, compare their performance with baseline multi-layer perceptron (MLP)., All the models are evaluated on IEEE-14 and IEEE-118 bus systems in terms of row accuracy (RACC), computational time, and memory space required for training the deep learning model. Each model was further investigated through a manual grid search to determine the optimal architecture of the deep learning model, including the number of layers and neurons in each layer. Based on the results, CNN model exhibited consistently high performance in very short training time. LSTM achieved the second highest accuracy; however, it had required an averagely higher training time. The attention-based LSTM model achieved a high accuracy of 94.53 during hyperparameter tuning, while the CNN model achieved a moderately lower accuracy with only one-fourth of the training time. Finally, the performance of each model was quantified on different variants of the dataset—which varied in their l2\\documentclass[12pt]{minimal} \\usepackage{amsmath} \\usepackage{wasysym} \\usepackage{amsfonts} \\usepackage{amssymb} \\usepackage{amsbsy} \\usepackage{mathrsfs} \\usepackage{upgreek} \\setlength{\\oddsidemargin}{-69pt} \\begin{document}$${\ ext{l}}_{2}$$\\end{document}-norm. Based on the results, LSTM, CNN obtained the highest accuracy followed by CNN-LSTM and lastly MLP.

Attention-Based BiGRU Model for Real-time Sign Language Translation Applications

Sign language applications provide an important key to solving communication problems for deaf community and normal hearing people. Current research problem usually focuses on improving communication access between deaf and hearing people. In this study, we consider real-time communication context from deaf to hearing people, and thus we propose an attention-based bidirectional gated recurrent unit (A-BiGRU) model which demonstrates on trading-off among an precision performance, and computational efficiency which includes training time, testing time, and system resources on extended the American Sign Language Gloss (E-ASLG-PC12) dataset. The results shown that our proposal has a significant performance improvement in term of training time, testing time, system resources, comparing to attentionbased bidirectional long-short term memory (A-BiLSTM), and the other moderns of sequence to sequence models. Moreover, precision performance of our proposal model achieve closer to that of the complex architecture, A-BiLSTM. Thus, we believe that our proposed model is a suitable and potential candidate for real-time translation applications as well as and lower computational devices when they solve the communication problems from deaf to normal hearing people direction. Keywords– computational efficiency (CE), attention-based bidirectional gated recurrent unit (A-BiGRU), sign language translation applications (SLTA).

Improving clinical abbreviation sense disambiguation using attention-based Bi-LSTM and hybrid balancing techniques in imbalanced datasets.

Clinical abbreviations pose a challenge for clinical decision support systems due to their ambiguity. Additionally, clinical datasets often suffer from class imbalance, hindering the classification of such data. This imbalance leads to classifiers with low accuracy and high error rates. Traditional feature-engineered models struggle with this task, and class imbalance is a known factor that reduces the performance of neural network techniques. This study proposes an attention-based bidirectional long short-term memory (Bi-LSTM) model to improve clinical abbreviation disambiguation in clinical documents. We aim to address the challenges of limited training data and class imbalance by employing data generation techniques like reverse substitution and data augmentation with synonym substitution. We utilise a Bi-LSTM classification model with an attention mechanism to disambiguate each abbreviation. The model's performance is evaluated based on accuracy for each abbreviation. To address the limitations of imbalanced data, we employ data generation techniques to create a more balanced dataset. The evaluation results demonstrate that our data balancing technique significantly improves the model's accuracy by 2.08%. Furthermore, the proposed attention-based Bi-LSTM model achieves an accuracy of 96.09% on the UMN dataset, outperforming state-of-the-art results. Deep neural network methods, particularly Bi-LSTM, offer promising alternatives to traditional feature-engineered models for clinical abbreviation disambiguation. By employing data generation techniques, we can address the challenges posed by limited-resource and imbalanced clinical datasets. This approach leads to a significant improvement in model accuracy for clinical abbreviation disambiguation tasks.

Unraveling the Potential of Attentive Bi-LSTM for Accurate Obesity Prognosis: Advancing Public Health towards Sustainable Cities.

The global prevalence of obesity presents a pressing challenge to public health and healthcare systems, necessitating accurate prediction and understanding for effective prevention and management strategies. This article addresses the need for improved obesity prediction models by conducting a comprehensive analysis of existing machine learning (ML) and deep learning (DL) approaches. This study introduces a novel hybrid model, Attention-based Bi-LSTM (ABi-LSTM), which integrates attention mechanisms with bidirectional Long Short-Term Memory (Bi-LSTM) networks to enhance interpretability and performance in obesity prediction. Our study fills a crucial gap by bridging healthcare and urban planning domains, offering insights into data-driven approaches to promote healthier living within urban environments. The proposed ABi-LSTM model demonstrates exceptional performance, achieving a remarkable accuracy of 96.5% in predicting obesity levels. Comparative analysis showcases its superiority over conventional approaches, with superior precision, recall, and overall classification balance. This study highlights significant advancements in predictive accuracy and positions the ABi-LSTM model as a pioneering solution for accurate obesity prognosis. The implications extend beyond healthcare, offering a precise tool to address the global obesity epidemic and foster sustainable development in smart cities.

Deep Neural Networks for Location Reference Identification From Bilingual Disaster-Related Tweets

Twitter is increasingly being used during disasters to communicate with authorities, ascertain the ground reality, and coordinate real-time rescue and recovery activities. Geographical location information about users and events is critical in these scenarios. Geotagged tweets are extremely infrequent, and other location fields, such as user location and place name, are unreliable. The extraction of geographical information from tweet text is limited by the fact that individuals frequently publish multilingual tweets that contain numerous grammatical and spelling errors, as well as nonstandard acronyms. As a result, determining the geographical location of the tweet is a challenging problem. This article presents a technique based on deep neural networks for extracting geographical references mentioned in bilingual tweets. Several deep learning-based models, including convolutional neural networks (CNNs), long short-term memory (LSTM), bidirectional LSTM (Bi-LSTM), and attention-based Bi-LSTM, are implemented on real-world English and Hindi language tweets to determine their suitability for extracting location references. The proposed CNN, along with a conditional random field at the last layer, is found to perform better than other models, with an <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$F_1$</tex-math> </inline-formula> -score of 0.858. The findings of this study can aid in early event detection, pinpointing the area of devastation and victims, real-time traffic management, and a number of other location-based applications. The suggested system’s code and trained model may be obtained at https://github.com/Abhinavkmr/Bi-lingual-location-reference-identification.git.

Privacy-Preserving Federated Learning for Value-Added Service Model in Advanced Metering Infrastructure

Advanced metering infrastructure (AMI) is the backbone of the next generation smart city and smart grid; it not only provides near real-time two-way communication between the consumers and the energy systems, but also enables the third parties (TPs) to provide relevant value-added services to the consumers to improve user satisfaction. However, the existing services are implemented in a centralized manner, which has potential and associated security and privacy risks also increased with Internet-of-Things (IoT) devices. To better balance the quality of the services and ensure users’ privacy, a TP AMI service model based on differentially private federated learning (FL) is proposed in this article. Instead of sending the private energy data to the cloud server, the proposed service model trains the neural network models locally, and only model parameters are shared with the central server. Moreover, the identity of individuals is eliminated by adding random Gaussian noise during the secure aggregation. Furthermore, an attention-based bidirectional long short-term memory (ATT-BLSTM) neural network model is adopted to solve the long-range dependency problem of conventional neural networks. In the case study, a residential short-term load forecasting (STLF) task is implemented to evaluate the performance of the proposed model. Compared with other state-of-the-art energy service models, the proposed one can achieve similar accuracy as the typical centralized model and balances the trade-off between privacy loss and prediction accuracy flexibly.

Hybrid Metaheuristics with Deep Learning Assisted Intrusion Detection on Cyber-Physical Smart Grid Environment

Smart grids (SGs) offer can ensure that users with a continuous power supply, decreased line losses, improved renewable output and storing, user participation in current electricity, and demand-side responsiveness. The development of cyberphysical SG (CPSG) systems has transformed the standard power grid by allowing bi-directional energy flow among utilities and users. But, because of increased data change among consumers, it is presented a major problem to the firewall systems for the transmission networks at either cyber or physical planes. Intrusion Detection Systems (IDSs) can role an essential play in maintaining SGs systems against cyber threats by generating a second wall of defense, complementing conventional preventive security procedures (for instance, authorization, encryption, and authentication). Therefore, this article concentrates on the design and development of Hybrid Metaheuristics with Deep Learning Assisted Intrusion Detection in a Cyber-Physical Smart Grid (HMDL-IDCPSG) infrastructure. The major objective of the HMDL-IDCPSG system provides the effectual recognition of the intrusions using feature selection and classification processes in the CPSG infrastructure. In the presented HMDL-IDCPSG method, a binary dragonfly algorithm with the hybrid directed differential operator (BDA‐DDO) algorithm could be implemented for the feature selection (FS) method. Besides, attention-based bi-directional long short-term memory (ABiLSTM) algorithm could be carried out for the recognition and classification of the intrusions. At last, the sparrow search algorithm (SSA) can be exploited for highest chosen the hyperparameter values of the ABiLSTM algorithm which supports in achieving a better solution. For demonstrating the greater outcome of the HMDL-IDCPSG technique, a comprehensive simulation value can be executed. The obtained results reported the supremacy of the HMDL-IDCPSG methodology with other existing approaches

Multi-sensor Data Fusion based Medical Data Classification Model using Gorilla Troops Optimization with Deep Learning

Wireless Body Sensor Network (BSN) comprises wearables with different sensing, processing, storing, and broadcast abilities. Once several devices acquire the data, multi-sensor fusion was needed for transforming erroneous sensor information into maximum quality fused data. Deep learning (DL) approaches are utilized in different application domains comprising e-health for applications like activity detection, and disease forecast. In recent times, it can be demonstrated that the accuracy of classification techniques is enhanced by the combination of feature selection (FS) approaches. This article develops a Multi-sensor Data Fusion based Medical Data Classification Model using Gorilla Troops Optimization with Deep Learning (MDFMDC-GTODL) algorithm. The proposed MDFMDC-GTODL method enables collection of various daily activity data using different sensors, which are then fused to produce high-quality activity data. In addition, the MDFMDC-GTODL technique applies optimal attention based bidirectional long short term memory (ABLSTM) for heart disease prediction. In this study, Gorilla Troops Optimization Algorithm based FS (GTOA-FS) technique is involved to improve the classification performance. The simulation outcome of the MDFMDC-GTODL technique are validated and the results are investigated in different prospects. A wide-ranging simulation analysis stated the better performance of the MDFMDC-GTODL method over other compared approaches.

Golden jackal optimization algorithm with deep learning assisted intrusion detection system for network security

Network security is essential to our daily communications and networks. Cybersecurity researchers initiate the significance of emerging proficient network intrusion detection systems (IDS) for providing secure networks. While attackers endure to progress novel kinds of attacks and the network sizes endure to develop, the necessity for effectual IDS becomes significant. Additionally, IDS aims to offer confidentiality, integrity, and availability for the data communicated in networked computers by avoiding illegal access to the network. Several studies executed machine learning (ML) systems for emerging effectual IDS; then, with the advent of deep learning (DL) systems and artificial neural networks (ANNs) that create features automatically without human interference, researchers started to depend on DL approaches. This study introduces a new Golden Jackal Optimization Algorithm with Deep Learning Assisted Intrusion Detection System for Network Security (GJOADL-IDSNS) technique. The major intention of the GJOADL-IDSNS system lies in the effectual recognition and classification of the intrusions, to achieve network security. Primarily, data normalization is performed to scale the input data into a useful format. In the presented GJOADL-IDSNS technique, the GJOA-based feature selection (GJOA-FS) approach can be employed to elect an optimum subset of features. Next, the GJOADL-IDSNS methodology applies the attention-based bi-directional long short-term memory (A-BiLSTM) model. For hyperparameter tuning of the A-BiLSTM model, the GJOADL-IDSNS technique uses the salp swarm algorithm (SSA). The simulation value of the GJOADL-IDSNS technique has been tested utilizing benchmark datasets. The comparative results stated that the GJOADL-IDSNS technique achieves better performance than other models.

Computational linguistics based text emotion analysis using enhanced beetle antenna search with deep learning during COVID-19 pandemic.

Computational intelligence and nature-inspired computing have changed the way biologically and linguistically driven computing paradigms are made. In the last few decades, they have been used more and more to solve optimisation problems in the real world. Computational linguistics has its roots in linguistics, but most of the studies being done today are led by computer scientists. Data-driven and machine-learning methods have become more popular than handwritten language rules, which shows this shift. This study uses a new method called Computational Linguistics-based mood Analysis using Enhanced Beetle Antenna Search with deep learning (CLSA-EBASDL) to tackle the important problem of mood analysis during the COVID-19 pandemic. We sought to determine how people felt about the COVID-19 pandemic by studying social media texts. The method is made up of three main steps. First, data pre-processing changes raw data into a shape that can be used. After that, word embedding is done using the 'bi-directional encoder representations of transformers (BERT) process. An attention-based bidirectional long short-term memory (ABiLSTM) network is at the heart of mood classification. The Enhanced Beetle Antenna Search (EBAS) method, in particular, fine-tunes hyperparameters so that the ABiLSTM model works at its best. Many tests show that the CLSA-EBASDL method works better than others. Comparative studies show that it works, making it the best method for analysing opinion during the COVID-19 pandemic.

Design of Network Intrusion Detection System Using Lion Optimization-Based Feature Selection with Deep Learning Model

In the domain of network security, intrusion detection systems (IDSs) play a vital role in data security. While the utilization of the internet amongst consumers is increasing on a daily basis, the significance of security and privacy preservation of system alerts, due to malicious actions, is also increasing. IDS is a widely executed system that protects computer networks from attacks. For the identification of unknown attacks and anomalies, several Machine Learning (ML) approaches such as Neural Networks (NNs) are explored. However, in real-world applications, the classification performances of these approaches are fluctuant with distinct databases. The major reason for this drawback is the presence of some ineffective or redundant features. So, the current study proposes the Network Intrusion Detection System using a Lion Optimization Feature Selection with a Deep Learning (NIDS-LOFSDL) approach to remedy the aforementioned issue. The NIDS-LOFSDL technique follows the concept of FS with a hyperparameter-tuned DL model for the recognition of intrusions. For the purpose of FS, the NIDS-LOFSDL method uses the LOFS technique, which helps in improving the classification results. Furthermore, the attention-based bi-directional long short-term memory (ABiLSTM) system is applied for intrusion detection. In order to enhance the intrusion detection performance of the ABiLSTM algorithm, the gorilla troops optimizer (GTO) is deployed so as to perform hyperparameter tuning. Since trial-and-error manual hyperparameter tuning is a tedious process, the GTO-based hyperparameter tuning process is performed, which demonstrates the novelty of the work. In order to validate the enhanced solution of the NIDS-LOFSDL system in terms of intrusion detection, a comprehensive range of experiments was performed. The simulation values confirm the promising results of the NIDS-LOFSDL system compared to existing DL methodologies, with a maximum accuracy of 96.88% and 96.92% on UNSW-NB15 and AWID datasets, respectively.

Attention-based Spatialized Word Embedding Bi-LSTM Model for Sentiment Analysis

Movie reviews provide a medium of communication for the movie fans community. Movie reviews not only help viewers and potential viewers to obtain a general opinion about a movie but also allow the fans to construct an opinion of the movie. In this work, an analysis of over 60,000 movie reviews has been implemented to find meaningful text representation via text embedding. We improved the text embedding by proposing an attention-based Bidirectional Long-Short Term Memory (Bi-LSTM) network by using over 60,000 movie review text data as the training set and over 20,000 movie review text data as the testing set. Based on the data features, we performed a probabilistic analysis of the information related to words and phrases, combined the analysis results with text embedding, spatialized the text embedding, and compared the performance of the proposed attention-based spatialized word embedding Bi-LSTM model with several traditional machine learning models. The attention-based spatialized word embedding Bi-LSTM model proposed in this paper achieves an F1 score of 0.91 on the movie review sentiment classification dataset, with a prediction accuracy of 91%, outperforming the results of the current state-of-the-art research. The model can effectively identify the sentimental tendencies of movie reviews and use the analyzed sentimental tendencies to guide consumers in their consumption and obtain feedback on movie content.

TB-MFCC multifuse feature for emergency vehicle sound classification using multistacked CNN – Attention BiLSTM

Vehicles equipped for emergencies like ambulances, fire engines, and police cruisers play a vital role in society by responding quickly to emergencies and helping to prevent loss of life and maintain order. Vehicle sound identification and classification are very important in the cities to identify emergency vehicles easily and to clear the traffic effectively. Convolutional Neural Network plays an important role in the accurate prediction of vehicles during an emergency. The main motive of this paper is to develop a suitable model and algorithms for data augmentation, feature extraction, and classification. The proposed TB-MFCC multifuse feature is comprised of data augmentation and feature extraction. First, in the proposed signal augmentation, each audio signal uses noise injection, stretching, shifting, and pitching separately and this process increases the number of instances in the dataset. The proposed augmentation reduces the overfitting problem in the network. Second, Triangular Bluestein Mel Frequency Cepstral Coefficients (TB-MFCC) are proposed and fused with Zero Crossing Rate (ZCR), Mel-frequency cepstral coefficients (MFCC), Root Mean Square (RMS), Chroma, and Tempogram to extract the exact feature which increases the accuracy and reduces the Mean Squared Error (MSE) of the model during classification. Finally, the proposed Multi-stacked Convolutional Neural Network (MCNN) with Attention-based Bidirectional Long Short Term Memory (A-BiLSTM) improves the nonlinear relationship among the features. The proposed Pooled Multifuse Feature Augmentation (PMFA) with MCNN & A-BiLSTM increases the accuracy (98.66 %), reduces the False Positive Rate (FPR) by 1.01 %, and loss (0 %). Thus the model predicts the sound without overfitting, underfitting, and vanishing gradient problems.

Robust DDoS Attack Detection Using Piecewise Harris Hawks Optimizer with Deep Learning for a Secure Internet of Things Environment

The Internet of Things (IoT) refers to the network of interconnected physical devices that are embedded with software, sensors, etc., allowing them to exchange and collect information. Although IoT devices have several advantages and can improve people’s efficacy, they also pose a security risk. The malicious actor frequently attempts to find a new way to utilize and exploit specific resources, and an IoT device is an ideal candidate for such exploitation owing to the massive number of active devices. Especially, Distributed Denial of Service (DDoS) attacks include the exploitation of a considerable number of devices like IoT devices, which act as bots and transfer fraudulent requests to the services, thereby obstructing them. There needs to be a robust system of detection based on satisfactory methods for detecting and identifying whether these attacks have occurred or not in a network. The most widely used technique for these purposes is artificial intelligence (AI), which includes the usage of Deep Learning (DL) and Machine Learning (ML) to find cyberattacks. The study presents a Piecewise Harris Hawks Optimizer with an Optimal Deep Learning Classifier (PHHO-ODLC) for a secure IoT environment. The fundamental goal of the PHHO-ODLC algorithm is to detect the existence of DDoS attacks in the IoT platform. The PHHO-ODLC method follows a three-stage process. At the initial stage, the PHHO algorithm can be employed to choose relevant features and thereby enhance the classification performance. Next, an attention-based bidirectional long short-term memory (ABiLSTM) network can be applied to the DDoS attack classification process. Finally, the hyperparameter selection of the ABiLSTM network is carried out by the use of a grey wolf optimizer (GWO). A widespread simulation analysis was performed to exhibit the improved detection accuracy of the PHHO-ODLC technique. The extensive outcomes demonstrated the significance of the PHHO-ODLC technique regarding the DDoS attack detection technique in the IoT platform.

Accurate water quality prediction with attention-based bidirectional LSTM and encoder–decoder

Accurate prediction of water quality indicators can effectively predict sudden water pollution events and reveal them to water users for reducing the impact of water quality pollution. Neural networks, e.g., Long Short-Term Memory (LSTM) and encoder–decoder, have been widely used to predict time series data. However, as the water quality data increases, it becomes unstable and highly nonlinear, and therefore, its accurate prediction becomes a big challenge. To solve it, this work proposes a hybrid prediction method called VBAED to predict the water quality time series. VBAED combines Variational mode decomposition (VMD), a Bidirectional input Attention mechanism, an Encoder with bidirectional LSTM (BiLSTM), and a Decoder with a bidirectional temporal attention mechanism and BiLSTM. The definition of VBAED is an Encoder–Decoder model that uses VMD as mode decomposition, combining BiLSTM with a bidirectional attention mechanism. Specifically, VBAED first adopts VMD to decompose historical data of a predicted factor, and its decomposed results are adopted as the input along with other features. Then, a bidirectional input attention mechanism is adopted to add weights to input features from both directions. VBAED adopts BiLSTM as an encoder to extract hidden features from input features. Finally, the predicted result is obtained by a BiLSTM decoder with a bidirectional temporal attention mechanism. Real-life data-based experiments demonstrate that VBAED obtains the best prediction results compared with other widely used methods.

Assessment of bidirectional transformer encoder model and attention based bidirectional LSTM language models for fake news detection

Fake news arouses to be untrue with the point of deceiving it openly which is now viewed as the greatest threat to society by cultivating the political division and doubts in government. Since this kind of news is disseminated in sheer volume through social media, driving the improvement of strategies for the recognizable proof of false news is necessary. Therefore, this study focuses on text analytics to derive the hidden properties of stylistic content to detect fake and real news. An erudite literature study of fake news detection diverted towards issues such as attention, context, and parallelization. In this same direction, the assessment evaluates the sequential memory-based deep learning model in comparison to the parallel memory-based deep learning model. For sequential, Long Short-Term Memory (LSTM), Bi-Directional LSTM, and Attention-based Bi-directional LSTM are taken into consideration. Besides, for parallel, the transformer-based BERT model is examined. To identify the efficacy of applied approaches, four datasets are taken from diverse domains such as political news, entertainment news, satire news, conspiracy news, and global pandemic news. The experimental analysis of real-world information demonstrates that the pre-trained transformer encoder-based BERT model outperforms with a quite significant margin of improvement. Also, as inspected Attention-based Bi-directional approach provides state-of-the-art results with good training accuracy.

Computer-aided diagnosis using white shark optimizer with attention-based deep learning for breast cancer classification

Breast cancer (BC) is categorized as the most widespread cancer among women throughout the world. The earlier analysis of BC assists to increase the survival rate of the disease. BC diagnosis on histopathology images (HIS) is a tedious process that includes recognizing cancerous regions within the microscopic image of breast tissue. There are various methods to discovering BC on HSI, namely deep learning (DL) based methods, classical image processing techniques, and machine learning (ML) based methods. The major problems in BC diagnosis on HSI are the larger size of images and the high degree of variability in the appearance of tumorous regions. With this motivation, this study develops a computer-aided diagnosis using a white shark optimizer with attention-based deep learning for the breast cancer classification (WSO-ABDLBCC) model. The presented WSO-ABDLBCC technique performs accurate classification the breast cancer using DL techniques. In the WSO-ABDLBCC technique, the Guided filtering (GF) based noise removal is applied to improve the image quality. Next, the Faster SqueezeNet model with WSO-based hyperparameter tuning performs the feature vector generation process. Finally, the classification of histopathological images takes place using attention-based bidirectional long short-term memory (ABiLSTM). A detailed experimental validation of the WSO-ABDLBCC occurs utilizing the benchmark Breakhis database. The proposed model achieved an accuracy of 95.2%. The experimental outcomes portrayed that the WSO-ABDLBCC technique accomplishes improved performance compared to other existing models.

An Attention-based Bidirectional LSTM Model for Continuous Cross-Subject Estimation of Knee Joint Angle during Running from sEMG Signals.

Accurate and robust estimation of joint kinematics via surface electromyogram (sEMG) signals provides a human-machine interaction (HMI)-based method that can be used to adequately control rehabilitation robots while performing complex movements, such as running, for motor function restoration in affected individuals. To this end, this paper proposes a deep learning-based model (AM-BiLSTM) that integrates a bidirectional long short-term memory (BiLSTM) network and an attention mechanism (AM) for robust estimation of joint kinematics. The proposed model was appraised using knee joint kinematic and sEMG signals collected from fourteen subjects who performed running at the speed of 2 m/s. The proposed model's generalizability was tested for both within- and cross-subject scenarios and compared with long short-term memory (LSTM) and multi-layer perceptron (MLP) networks in terms of normalized root-mean-square error and correlation coefficient metrics. Based on the statistical tests, the proposed AM-BiLSTM model significantly outperformed the LSTM and MLP methods in both within- and cross-subject scenarios (p<0.05) and achieved state-of-the-art performance.Clinical Relevance- The promising results of this study suggest that the AM-BiLSTM model has the potential for continuous cross-subject estimation of lower limb kinematics during running, which can be used to control sEMG-driven exoskeleton robots oriented towards rehabilitation training.

Pelican Optimization Algorithm with Deep Learning for Aspect based Sentiment Analysis on Asian Low Resource Languages

Recently, sentiment analysis (SA) has become more popular as it is crucial to moderate and examine the data from the internet. It contains several applications, such as social media monitoring, market research, and opinion mining. Aspect Based Sentiment Analysis (ABSA) is a domain of SA that manages sentiment at a better level. ABSA classifies sentiment in terms of all the aspects for obtaining superior insights as sentiment expressed. A major contribution has been developed in ABSA, and then this progress can be restricted only to some languages with suitable resources. One common method is to utilize machine learning (ML) approaches, namely Neural Networks (NN), Support Vector Machines (SVM), and Naive Bayes (NB), together with Asian and low language-specific resources. These resources offer data on the sentiment polarity (neutral, positive, or negative) of phrases and words that are generally utilized in low-resource languages. In this aspect, this study develops a new Pelican Optimization Algorithm with Deep Learning for ABSA (POADL-ABSA) on Asian and Low Resource Languages. The proposed POADL-ABSA technique focuses on the detection and classification of sentiments. To accomplish this, the POADL-ABSA technique encompasses various levels of operations such as pre-processed, feature vector conversion, and classification. In addition, the POADL-ABSA technique employs the BERT model for feature vector extraction. Besides, attention-based bi-directional long short-term memory (ABiLSTM) system was used for the recognition and classification of sentiments. Finally, the POA was utilized for optimum hyperparameter selection of the ABiLSTM model, and it helps in attaining enhanced sentiment classification results. To ensure the improvised performance of the IAOADL-ABSA technique, an extensive experimental outcome the IAOADL-ABSA technique surpassed other models with acc{u}_y , pre{c}_n , rec{a}_l , and {F}_{score} of 98.72%, 98.71%, 98.72%, and 98.71%, respectively. Therefore, the IAOADL-ABSA technique can be employed for accurate classification results.