Weightless Neural Network Research Articles

The Eye and Nose Identification Chip Controller-Based on Robot Vision Using Weightless Neural Network Method

Increasingly advanced image analysis in computer vision, allowing computers to interpret, identify, and analyze pictures with accuracy comparable to humans. The availability of data sources in decimal, hexadecimal, or binary forms enables researchers to take the initiative in applying their study findings. Decimal formats are typically used on traditional computers like desktops and minicomputers, whereas hexadecimal and binary formats were utilized on single-chip controllers. Weightless Neural Network is a method that can be implemented in a single chip controller. The aim of this research is to develop a facial recognition system, for eye and mouth identification, that works in a single chip controller or also called a microcontroller. The suggested method is a Weightless Neural Network with Immediate Scan approach for processing and identifying eye and nose patterns. The data will be handled in many memory locations that are specifically designed to handle massive volumes of data. The data is made up of primary face data sheets and face input data. The data sets utilized are (x,y) pixels, and frame sizes range from 90x90 pixels to 110x110 pixels. Each face shot will be processed by selecting the region of the eyes and nose and saving it as an image file. The eye and nose will identify the face frame. Next, the photos will be converted to binary format. A magazine matrix will be used to transmit binary data from a minicomputer to a microcontroller via serial connection. Based on a known pattern, the resultant similarity accuracy is 83,08% for the eye and 84,09% for the sternum. In contrast, the similarity percentage for an eye ranges from 70% to 85% for an undefined pattern.

A new system for underwater vehicle balancing control based on weightless neural network and fuzzy logic methods

<p>The utilization of humans to be in the water for short time, resulting in limited area underwater that can be explored, so the information obtained is very limited, plus the influence of irregular water movements, changes in waves, and changes in water pressure, indirectly also constitutes obstacle to this problem. One of the best solutions is to develop underwater vessel that can travel either autonomously or by giving control of movement and navigation systems. New system for underwater vehicle balance control through weightless neural network (WNN) and fuzzy logic methods was proposed in this study. The aim was to simplify complicated data source on stability system using WNN algorithm and determine depth level of autonomous underwater vehicle (AUV) through fuzzy logic method. Moreover, speed control of underwater vehicle was determined using fuzzy rule-based design and inference. The tests were conducted by showing convergence performance of system in the form of AUV simulator. The results showed that proposed system could produce real-time motion balance performance, faster execution time, and good level of accuracy. This study was expected to produce real-time motion balance system with better performance, faster execution time, and good level of accuracy which could be subsequently used to design simple, cheap, and efficient hardware prototype.</p>

Memory-efficient DRASiW Models

Weightless Neural Networks (WNN) are ideal for Federated Learning due to their robustness and computational efficiency. These scenarios require models with a small memory footprint and the ability to aggregate knowledge from multiple models. In this work, we demonstrate the effectiveness of using Bloom filter variations to implement DRASiW models—an adaptation of WNN that records both the presence and frequency of patterns—with minimized memory usage. Across various datasets, DRASiW models show competitive performance compared to models like Random Forest, k-Nearest Neighbors, Multi-layer Perceptron, and Support Vector Machines, with an acceptable space trade-off. Furthermore, our findings indicate that Bloom filter variations, such as Count Min Sketch, can reduce the memory footprint of DRASiW models by up to 27% while maintaining performance and enabling distributed and federated learning strategies.

Enhancing Tire Condition Monitoring through Weightless Neural Networks Using MEMS-Based Vibration Signals

Tire pressure monitoring system (TPMS) has a critical role in safeguarding vehicle safety by monitoring tire pressure levels. Keeping the accurate tire pressure is necessary for confirming comfortable driving and safety, and improving fuel consumption. Tire problems can result from various factors, such as road surface conditions, weather changes, and driving activities, emphasizing the importance of systematic tire checks. This study presents a novel method for tire condition monitoring using weightless neural networks (WNN), which mimic neural processes using random-access memory (RAM) components, supporting fast and precise training. Wilkes, Stonham, and Aleksander Recognition Device (WiSARD), a type of WNN, stands out for its capability in classification and pattern recognition, gaining from its ability to avoid repetitive training and residual formation. For vibration data acquisition from tires, cost-effective micro-electro-mechanical system (MEMS) sensors are employed, offering a more economical solution than piezoelectric sensors. This approach yields a variety of features, such as autoregressive moving average (ARMA), statistical and histogram features. The J48 decision tree algorithm plays a critical role in selecting essential features for classification, which are subsequently divided into training and testing sets, crucial for assessing the WiSARD classifier’s efficacy. Hyperparameter optimization of the WNN leads to improved classification accuracy and shorter computation times. In practical tests, the WiSARD classifier, when optimally configured, achieved an impressive 97.92% accuracy with histogram features in only 0.008 seconds, showcasing the capability of WNN to enhance tire technology and the accuracy and efficiency of tire monitoring and maintenance.

Monitoring the condition of nitrogen-filled tires using weightless neural networks

The novelty of this paper revolves around monitoring the condition of nitrogen-filled tires through the fusion of features and utilization of weightless neural networks. A tire pressure monitoring system (TPMS) plays a crucial role in ensuring vehicle safety and comfort. Reckless driving, poor road conditions, continual operation, higher road friction and excessive load are certain factors that can degrade the longevity of tires. Such conditions can result in instantaneous fault attacks in tires raising a concern for safety and comfort. To apply instantaneous and accurate fault diagnosis, the present study leverages machine learning techniques through the integration of an adaptive and robust algorithm, namely, the Wilkes, Stonham and Aleksander Recognition Device (WiSARD) classifier. The experiment uses three types of features namely, statistical, histogram and autoregressive moving average (ARMA) features. The J48 decision tree algorithm was used to pinpoint the key attributes crucial for classification. Following this, the identified attributes were segregated into training and testing datasets, facilitating the evaluation of the WiSARD classifier. Hyperparameter tuning was carried out to achieve optimal value for maximizing classification accuracy and minimizing computational time. Among the features considered, ARMA features delivered the best test set accuracy of about 96.18%.

Fault detection and identification in induction motor using weightless neural network.

This paper presents a novel multiclass, multiparameter real-valued weightless neural network-based classifier for fault detection and identification. In contrast to primitive variants of weightless neural nets, the proposed method is capable of multiclass identification with real-valued input features and has improved recognition and generalization capabilities. The major accomplishments of the proposed method include an improved input-to-address mapping strategy that is suitable for address assignment within discriminator units and an effective memory expansion scheme based on similarity metric-based membership value. The developed classifier is utilized for fault detection and identification in single-phase and three-phase induction motors. The sensitivity analysis of the method is investigated for design parameter variation and the fault diagnosis is performed for multiple faults of the motor. The proposed method achieves the highest accuracy of 99.6% and 89.25% for single-phase and three-phase induction motor fault identification, respectively.

Dijagnostika kvarova zasnovana na bestežinskoj neuronskoj mreži u sistemu vešanja

Vehicle suspension systems play a critical role in ensuring passenger comfort and safety. Detecting faults in these systems is vital for maintaining safety, performance, and cost-effectiveness. Traditional inspection methods have limitations, such as visual checks, bounce tests, and alignment assessments. This study explores Wilkie, Stonham, and Aleksander Recognition Device (WiSARD), a weightless neural network (WNN), for suspension fault diagnosis. A WNN model is employed to classify suspension system faults using sensor data. The dataset includes both normal and faulty conditions to train the model. The study assesses WiSARD under various fault conditions, including strut damage, mount failure, worn-out components, and low wheel pressure. Comparative evaluations demonstrate that the approach outperforms other classification techniques, achieving an impressive 95.63% accuracy with a rapid 0.05-second computation time for test data. This WNN-based method proves superior in detecting suspension faults and holds potential as a candidate for real-time vehicle fault diagnosis systems.

ULEEN: A Novel Architecture for Ultra-low-energy Edge Neural Networks

‘‘Extreme edge” 1 devices, such as smart sensors, are a uniquely challenging environment for the deployment of machine learning. The tiny energy budgets of these devices lie beyond what is feasible for conventional deep neural networks, particularly in high-throughput scenarios, requiring us to rethink how we approach edge inference. In this work, we propose ULEEN, a model and FPGA-based accelerator architecture based on weightless neural networks (WNNs). WNNs eliminate energy-intensive arithmetic operations, instead using table lookups to perform computation, which makes them theoretically well-suited for edge inference. However, WNNs have historically suffered from poor accuracy and excessive memory usage. ULEEN incorporates algorithmic improvements and a novel training strategy inspired by binary neural networks (BNNs) to make significant strides in addressing these issues. We compare ULEEN against BNNs in software and hardware using the four MLPerf Tiny datasets and MNIST. Our FPGA implementations of ULEEN accomplish classification at 4.0–14.3 million inferences per second, improving area-normalized throughput by an average of 3.6× and steady-state energy efficiency by an average of 7.1× compared to the FPGA-based Xilinx FINN BNN inference platform. While ULEEN is not a universally applicable machine learning model, we demonstrate that it can be an excellent choice for certain applications in energy- and latency-critical edge environments.

Weightless Neural Network-Based Detection and Diagnosis of Visual Faults in Photovoltaic Modules

The present study introduces a novel approach employing weightless neural networks (WNN) for the detection and diagnosis of visual faults in photovoltaic (PV) modules. WNN leverages random access memory (RAM) devices to simulate the functionality of neurons. The network is trained using a flexible and efficient algorithm designed to produce consistent and precise outputs. The primary advantage of adopting WNN lies in its capacity to obviate the need for network retraining and residual generation, making it highly promising in classification and pattern recognition domains. In this study, visible faults in PV modules were captured using an unmanned aerial vehicle (UAV) equipped with a digital camera capable of capturing RGB images. The collected images underwent preprocessing and resizing before being fed as input into a pre-trained deep learning network, specifically, DenseNet-201, which performed feature extraction. Subsequently, a decision tree algorithm (J48) was employed to select the most significant features for classification. The selected features were divided into training and testing datasets that were further utilized to determine the training, test and validation accuracies of the WNN (WiSARD classifier). Hyperparameter tuning enhances WNN’s performance by achieving optimal values, maximizing classification accuracy while minimizing computational time. The obtained results indicate that the WiSARD classifier achieved a classification accuracy of 100.00% within a testing time of 1.44 s, utilizing the optimal hyperparameter settings. This study underscores the potential of WNN in efficiently and accurately diagnosing visual faults in PV modules, with implications for enhancing the reliability and performance of photovoltaic systems.

A conditional branch predictor based on weightless neural networks

Conditional branch prediction allows the speculative fetching and execution of instructions before knowing the direction of conditional statements. As in other areas, machine learning techniques are a promising approach to building branch predictors, e.g., the Perceptron predictor. However, those traditional solutions demand large input sizes, which impose a considerable area overhead. We propose a conditional branch predictor based on the WiSARD (Wilkie, Stoneham, and Aleksander’s Recognition Device) weightless neural network model. The WiSARD-based predictor implements one-shot online training designed to address branch prediction as a binary classification problem. We compare the WiSARD-based predictor with two state-of-the-art predictors: TAGE-SC-L (TAgged GEometric-Statistical Corrector-Loop) and the Multiperspective Perceptron. Our experimental evaluation shows that our proposed predictor, with a smaller input size, outperforms the perceptron-based predictor by about 0.09% and achieves similar accuracy to that of TAGE-SC-L. In addition, we perform an experimental sensitivity analysis to find the best predictor for each dataset, and based on these results, we designed new specialized predictors using a particular parameter composition for each dataset. The results show that the specialized WiSARD-based predictor outperforms the state-of-the-art by more than 2.3% in the best case. Furthermore, through the implementation of specialized predictor classifiers, we discovered that utilizing 90% of the specialized predictor for a specific dataset yielded comparable performance to the corresponding specialized predictor.

Weightless Neural Networks Face Recognition Learning Process for Binary Facial Pattern

The facial recognition process is normally used to verify and identify individuals, especially during the process of analyzing facial biometrics. The face detection algorithm automatically determines the presence or absence of a face. It is, however, theoretically difficult to analyze the face of a system with limited resources due to the complex pattern of a face. This implies an embedded platform scheme which is a combination of several learning methods supporting each other is required. Therefore, this research proposed the combination of the Haar Cascade method for the face detection process and the WNNs method for the learning process. The WNNs face recognition Algorithm (WNNs-FRA) uses facial data at the binary level and for binary recognition. Moreover, the sample face data in the binary were compared with the primary face data obtained from a particular camera or image. The parameters tested in this research include detection distance, detection coordinates, detection degree, memory requirement analysis, and the learning process. It is also important to note that the RAM node has 300 addresses divided into three face positions while the RAM discriminator has three addresses with codes (00), (10), and (10). Meanwhile, the largest amount of facial ROI data was found to be 900 pixels while the lowest is 400 pixels. The total RAM requirements were in the range of 32 , 768 bytes and 128 bytes and the execution time for each face position was predicted to be 33.3% which is an optimization because it is 66.67% faster than the entire learning process

Weightless Neural Network and Neighborhood Rough Set for Parkinson's Detection on Gait Movement

Weightless Neural Network and Neighborhood Rough Set for Parkinson's Detection on Gait Movement

Novel Preprocessors for Convolution Neural Networks

Fooling neural networks is a main concern in the process of Artificial Intelligence optimization. Character perturbation make part of a text unnoticeable for some systems, even for human observers. This research focuses the probe on a novel input preprocessing technique, which applies with the Convolutional Neural Networks for character recognition applications. Using Hand-written, Font, and Arabic Alphabet datasets, we show the CNN competitive results in classification. Then, we apply random deformation by mean of reshaping and relocation on the three testing datasets. As a reaction to change, the CNN demonstrates a confused behavior. Therefore, we design a Weightless Neural Network preprocessor that optimizes the shapes of deformed characters. Finally, we compare the impact of corrected input in improving the CNN performance. To measure the success of our preprocessor, we have applied it on well-known CNNs to compare the results between defected and rectified test datasets. Using Keras, we reconstructed LeNet-5, AlexNet and ZFNet for testing. Then, we conduct the test on the three databases to show how the recognition capability of CNNs would decline, then improve after preprocessing.

A multisensor prediction-based heuristic for the internet of things

IoT devices usually produce large volume of data in low semantic levels. Also, they constantly communicate to the sink node. Since IoT devices are resource-constrained in terms of battery, memory and processing power, the usage of advanced machine learning techniques to support real-time decision making is unfeasible. So a challenge is to provide machine learning techniques tailored to the resource-constrained environment of IoT either by adapting existing techniques or developing new ones. In this paper, we propose an heuristic for adapting data prediction and data fusion techniques to preprocess data to avoid unnecessary communication between sensor devices and sink node. Also, in this work we compare (i) linear estimation; (ii) Weightless Neural Networks; and (iii) Moving Average Convergence Divergence in the aforementioned context. The main contribution is the proposal of an heuristics to mitigate unnecessary communications while avoiding data accuracy loss by combining data fusion and data prediction techniques. As implementation of the heuristics we present in this work, we introduce two algorithms: Dione and Delfos. Dione as a centralized approach and Delfos as a decentralized approach. We executed experiments to assess the performance of Dione and Delfos.

Real-Time Signature Recognition Using Neural Network

The human signature is an important biometric feature that is used to identify human identity. It is essential in preventing falsification of documents in numerous financial, legal, and other commercial settings. The computerized system enters many aspects of our life, security is one of them, continues developing in computer vision and artificial network leads researcher to develop computerized signature recognition. This paper proposed a real-time algorithm for signature recognition. It is based on client and server operation.in which, client agent captures a signature and sends it to the server through the network. The server receives data and performs processing on it. Processing algorithm is based on weightless neural network. It is chosen for its simplicity and few numbers of sample required for training. The algorithm is tested and evaluated and show the ability to process 4.7 images per second.

Experimental Review of Neural-Based Approaches for Network Intrusion Management

The use of Machine Learning (ML) techniques in Intrusion Detection Systems (IDS) has taken a prominent role in the network security management field, due to the substantial number of sophisticated attacks that often pass undetected through classic IDSs. These are typically aimed at recognising attacks based on a specific signature, or at detecting anomalous events. However, deterministic, rule-based methods often fail to differentiate particular (rarer) network conditions (as in peak traffic during specific network situations) from actual cyber attacks. In this paper we provide an experimental-based review of neural-based methods applied to intrusion detection issues. Specifically, we i) offer a complete view of the most prominent neural-based techniques relevant to intrusion detection, including deep-based approaches or weightless neural networks, which feature surprising outcomes; ii) evaluate novel datasets (updated w.r.t. the obsolete KDD99 set) through a designed-from-scratch Python-based routine; iii) perform experimental analyses including time complexity and performance (accuracy and F-measure), considering both single-class and multi-class problems, and identifying trade-offs between resource consumption and performance. Our evaluation quantifies the value of neural networks, particularly when state-of-the-art datasets are used to train the models. This leads to interesting guidelines for security managers and computer network practitioners who are looking at the incorporation of neural-based ML into IDS.

Weightless Neural Networks as Memory Segmented Bloom Filters

Weightless Neural Networks (WNNs) are Artificial Neural Networks based on RAM memory broadly explored as solution for pattern recognition applications. Memory-oriented solutions for pattern recognition are typically very simple, and can be easily implemented in hardware and software. Nonetheless, the straightforward implementation of a WNN requires a large amount of memory resources making its adoption impracticable on memory constrained systems. In this paper, we establish a foundational relationship between WNN and Bloom filters, presenting a novel unified framework which encompasses the two. In particular, we indicate that a WNN can be framed as a memory segmented Bloom filter. Leveraging such finding, we propose a new model of WNNs which utilizes Bloom filters to implement RAM nodes. Bloom filters reduce memory requirements, and allow false positives when determining if a given pattern was already seen in data. We experimentally found that for pattern recognition purposes such false positives can build robustness into the system. The experimental results show that our model using Bloom filters achieves competitive accuracy, training time and testing time, consuming up to 6 orders of magnitude less memory resources when compared against the standard Weightless Neural Network model.

Extending the weightless WiSARD classifier for regression

This paper explores two new weightless neural network models, Regression WiSARD and ClusRegression WiSARD, in the challenging task of predicting the total palm oil production of a set of 28 (twenty eight) differently located sites under different climate and soil profiles. Both models were derived from Kolcz and Allinson’s n-Tuple Regression weightless neural model and obtained mean absolute error (MAE) rates of 0.09097 and 0.09173, respectively. Such results are very competitive with the state-of-the-art (0.07983), whilst being four orders of magnitude faster during the training phase. Additionally the models have been tested on three classic regression datasets, also presenting competitive performance with respect to other models often used in this type of task.

Combined weightless neural network FPGA architecture for deforestation surveillance and visual navigation of UAVs

This work presents a combined weightless neural network architecture for deforestation surveillance and visual navigation of Unmanned Aerial Vehicles (UAVs). Binary images, which are required for position estimation and UAV navigation, are provided by the deforestation surveillance circuit. Learned models are evaluated in a real UAV flight over a green countryside area, while deforestation surveillance is assessed with an Amazon forest benchmarking image data. Small utilization percentage of Field Programmable Gate Arrays (FPGAs) allows for a higher degree of parallelization and block processing of larger regions of input images.

Design of Robust, High-Entropy Strong PUFs via Weightless Neural Network

Physically unclonable functions (PUFs) have been explored as lightweight hardware primitives for the purpose of realizing robust security via strong authentication or secure key/ID generation. PUF harness manufacturing process variations for the purpose of generating binary keys or binary functions. An ideal strong PUF is a binary function that maps an m-bit input challenge to an uniquen-bit output response, making it attractive for authentication applications. Unfortunately, real strong PUF implementations suffer from reliability issues where the same challenge may produce different responses in the presence of noise. To overcome this problem, strong PUF leverages the availability of exponential number of challenge-response pairs (CRPs). A successful authentication event requires acquiring multiple CRPs and applying a threshold. In contrast, weak PUFs produce limited keys and are required to be highly reliable. Multiple techniques have been developed to achieve the necessary reliability. An additional prerequisite for strong PUFs is resilience against model-building attacks (cloning) by an adversary, who has observed a few CRPs, to prevent successful prediction of future CRPs. In this work, we first illustrate a strong PUF design that re-purposes a weightless neural network (WNN). Second, we showcase the robustness of WNN-based strong PUFs with respect to machine learning attacks, while providing desirable uniqueness and reliability metrics. Finally, we employ an initial entropy source of highly reliable weak PUF bits mapped to weightless neural networks (WNNs) for the purpose of creating a near-ideal strong PUF in terms of reliability. Our results show that it is possible to create highly reliable WNN–based strong PUFs with < 65 % ML accuracy by using as few as 32 initial reliable weak PUF bits.