Implementation Of Artificial Neural Networks Research Articles

Нейронные сети в системах управления преобразователями электрического подвижного состава

Objective: To improve the performance and accuracy of the system of voltage and frequency control for asynchronous traction motor (ATD) of rolling stock. Methods: To estimate the influence of artificial neural networks (INS) implementation to ATD control systems on the control indexes the comparison method was used. Results: The paper examines the possibility of INS implementation within the systems of direct control of traction electric motor moment. It also suggests a method of INS implementation as a ATD flow monitor. It provides the options of implementation and indicates the features of monitor structure design. Practical importance: Integration of the method of direct moment control and using of neural network technologies allows to improve the structure of converters and to improve the accuracy and the performance of output parameters, that, in its turn, decreases the power consumption, as well as losses in traction converters.

Hardware design and implementation of a novel ANN-based chaotic generator in FPGA

This paper presents a novel hardware implementation of Artificial Neural Networks (ANNs) for modeling of the Pehlivan–Uyaroglu Chaotic System (PUCS) on Field Programmable Gate Array (FPGA). There are two main parts in the proposed work. In the first part, a 3-8-3 Feed Forward Neural Network (FFNN) has been created using Matlab R2015a. The training results show that FFNN trained with back propagation algorithm exhibits satisfactory precision for the direct implementation. In the second part, the hardware implementation of the trained network has been carried out. The designed architecture is presented using Very High Speed Integrated Circuits Hardware Description Language (VHDL) and is implemented on a Xilinx Virtex 6 (XC6VCX240T) chip. All related parameters are defined with IEEE 754 single precision floating point number format. For the approximation of Log-Sigmoid transfer function, Xilinx's COordinate Rotation DIgital Computer (CORDIC) design has been employed. The design can be used with a clock frequency up to 266.429MHz. Finally, chip statistics of FPGA and analysis results have been presented. The proposed work have showed that chaotic systems can be successfully modeled using ANNs on FPGA. In future, chaos-based engineering applications can be performed using ANN-based chaotic oscillators on FPGA.

Reaction–diffusion chemistry implementation of associative memory neural network

Unconventional computing paradigms are typically very difficult to program. By implementing efficient parallel control architectures such as artificial neural networks, we show that it is possible to program unconventional paradigms with relative ease. The work presented implements correlation matrix memories (a form of artificial neural network based on associative memory) in reaction–diffusion chemistry, and shows that implementations of such artificial neural networks can be trained and act in a similar way to conventional implementations.

Improving quantitative structure-activity relationship models using Artificial Neural Networks trained with dropout.

Dropout is an Artificial Neural Network (ANN) training technique that has been shown to improve ANN performance across canonical machine learning (ML) datasets. Quantitative Structure Activity Relationship (QSAR) datasets used to relate chemical structure to biological activity in Ligand-Based Computer-Aided Drug Discovery pose unique challenges for ML techniques, such as heavily biased dataset composition, and relatively large number of descriptors relative to the number of actives. To test the hypothesis that dropout also improves QSAR ANNs, we conduct a benchmark on nine large QSAR datasets. Use of dropout improved both enrichment false positive rate and log-scaled area under the receiver-operating characteristic curve (logAUC) by 22-46% over conventional ANN implementations. Optimal dropout rates are found to be a function of the signal-to-noise ratio of the descriptor set, and relatively independent of the dataset. Dropout ANNs with 2D and 3D autocorrelation descriptors outperform conventional ANNs as well as optimized fingerprint similarity search methods.

Software Design Challenges in Time Series Prediction Systems Using Parallel Implementation of Artificial Neural Networks.

Software development life cycle has been characterized by destructive disconnects between activities like planning, analysis, design, and programming. Particularly software developed with prediction based results is always a big challenge for designers. Time series data forecasting like currency exchange, stock prices, and weather report are some of the areas where an extensive research is going on for the last three decades. In the initial days, the problems with financial analysis and prediction were solved by statistical models and methods. For the last two decades, a large number of Artificial Neural Networks based learning models have been proposed to solve the problems of financial data and get accurate results in prediction of the future trends and prices. This paper addressed some architectural design related issues for performance improvement through vectorising the strengths of multivariate econometric time series models and Artificial Neural Networks. It provides an adaptive approach for predicting exchange rates and it can be called hybrid methodology for predicting exchange rates. This framework is tested for finding the accuracy and performance of parallel algorithms used.

Investigating camera calibration for eye tracking of the physically challenged

This paper tries to address a problem faced by a proportion of community - the paralysed people, and investigates a solution in calibrating a camera used for the purpose of eye detection. The eye tracking is later used to read characters from a partner-assisted keyboard. As such, this keyboard solves the problem of immobility. In order to calibrate camera for the purpose of eye detection, two approaches are implemented-Artificial Neural Networks and Support Vector Machines in context of paralysed people, and are discussed in detail in this paper. The results of both approaches are compared in order to select the best approach to be used in keyboard that operates on eye tracking.

Implementation of artificial neural-networks to model the performance parameters of Stirling engine

The Stirling engine is defined as a simple form of external-combustion engine which employs a compressible working fluid. From a theoretical point of view the Stirling engine can be very effective at Carnot efficiency to convert heat into mechanical work. It is an environmental friendly heat engine which could reduce CO2 emission through combustion process. Performance of Stirling engine changes via changing several variables and the aforementioned variables should be optimized to accomplish maximum performance of Stirling engine. Among all the variables representing the performance of Stirling engine, output power and shaft torque are most common for illustrating the performance of Stirling engines. In this research predicting two aforementioned variables with high accuracy and flexibility is investigated. To gain this goal, a predictive and easy-to-use tool is developed based on the concept of the artificial neural network (ANN) to predict output power and shaft torque of the Stirling engine. Furthermore, precise data samples from previous researches are employed to construct this easy-to-use model. Based on the outputs obtained from an easy-to-use model developed in this research, ANN model could help experts in designing of Stirling engine with low degree of uncertainty.

FPGA-Based Stochastic Echo State Networks for Time-Series Forecasting.

Hardware implementation of artificial neural networks (ANNs) allows exploiting the inherent parallelism of these systems. Nevertheless, they require a large amount of resources in terms of area and power dissipation. Recently, Reservoir Computing (RC) has arisen as a strategic technique to design recurrent neural networks (RNNs) with simple learning capabilities. In this work, we show a new approach to implement RC systems with digital gates. The proposed method is based on the use of probabilistic computing concepts to reduce the hardware required to implement different arithmetic operations. The result is the development of a highly functional system with low hardware resources. The presented methodology is applied to chaotic time-series forecasting.

Neural Network Reinforcement Learning for Walking Control of a 3-Link Biped Robot

In recent years, researches on adaptive control have focused on bio-inspired learning techniques to deal with real-life applications. Reinforcement Learning (RL) is one of these major techniques, which has been widely used in robot control approaches. The implementation of artificial neural networks in RL algorithms enables more efficient optimal control strategies. This article proposes a field application of neural network reinforcement learning (NNRL) for walking control of an active simulated 3-link biped robot. The adaptive control agent consists of two neural network units, known as actor and critic for learning prediction and learning control tasks. Results of the presented control method reveal its efficiency in stable walking control of the biped robot model as a nonlinear complex dynamic task.

Predicting the moment capacity of RC beams exposed to fire using ANNs

This research investigates the implementation of artificial neural networks (ANNs) to estimate the moment capacity (Mr) of reinforced concrete (RC) beams under rising temperatures due to fire. 280 data were obtained for ANN model. Input layer in ANN model consisted of eight input parameters; the beam width (bw), the beam depth (d), the ratio of (bw/d), distance from the beam edge to the center of the rebar (d′), the ratio of (d′/d), fire time (texposure), the reinforcement area (Ast), and concrete compressive strength (fc). It is shown that the ANN model can be used to predict the Mr of RC beams exposed to fire with high accuracy. The predicted Mr by ANN are consistent with the results obtained using Mr equation. It was observed from the results the ANN model reduces the computational complexity problem in determining Mr. Consequently, the ANN model was used to examine the effects of the inputs parameters on Mr.

Automatic generation of LUTs for Hardware Neural Networks

One very important component of Hardware implementations of Artificial Neural Networks (HNN) is the activation function. A common solution for activation function design in HNN is the Look-Up Table (LUT) representation that has acceptable area constraints and usually achieves acceptable execution time. Tools and techniques for automatic generation of LUTs have been developed but have some problems as high complexity, high dependency of external tools or languages and the optimization techniques that are not efficient enough for critical applications. In order to solve some of the presented problems this paper describes a method for automatic LUT generation that overcomes some deficiencies of existing methods using a simple approach. This method was evaluated initially considering the xor function and the sine function for evaluation purposes. After these initial tests, two other ANN based robotic systems were tested. These robotic systems will be implemented in hardware in the near future and they demonstrate a different behavior using different domains of the same activation function. Proposed method achieved good results that are directly related to how neural networks define the activation function domain.

A preliminary study on the role of acoustic emission on inferring Cerchar abrasivity index of rocks using artificial neural network

The wear rate of working tools during the cutting and drilling of rocks is closely related to the abrasiveness of those rocks. As the contact area of the tools increases, due to wear, the specific cutting energy will also increase, and that directly affects the overall consumption of excavation tools. A new artificial intelligence (AI) based model has been developed. It utilizes acoustic emission (AE) and rock properties as main indicators of rock abrasivity, estimated by Cerchar Abrasivity Index (CAI). AE sensors are attached to both the Cerchar testing apparatus and the rock in question while conducting scratch tests using hardened steel pins of 42 and 56 HRC. Prior to the implementation of Artificial Neural Network (ANN) modeling, the selection of independent variables was carried out via Gamma test and V-ratio analyses. As a result, AE parameters, such as total number of events and root mean square of signal, in addition to testing parameters (i.e. uniaxial compressive strength, Young׳s Modulus, quartz content and pin hardness) are found to be the optimum model input combination needed to accurately predict CAI.

Digital Artificial Neural Network Implementation on a FPGA for data classification

This paper presents the implementation of a Digital Artificial Neural Network (ANN) of type Multilayer Perceptron trained for data classification corresponding to the output characteristic of a transistor MOSFET. The ANN digital was build and training with an adequate number of neurons and samples for achieve an approximate of 90% correct data classification of the transistor MOSFET.

MCDM Tools Application for Selection of Suppliers in Manufacturing Industries Using AHP, Fuzzy Logic and ANN

In manufacturing industry selection of right supplier (s) is one of the challenging activities. Supplier selection is the method of determining the appropriate suppliers to provide the right quality of products, at the right quantities, at the right price in the right time. During the last ten years based on the changes in the business sector, Multi-Criteria Decision Making (MCDM) has been one of the fastest growing areas. By choosing the best supplier, the companies can increase their productivity and also competitive advantage. In the earlier period, several methods have been proposed to solve the supplier selection problem, such as the linear weighting methods, the analytic network process, total cost approaches and mathematical programming techniques. Although the linear programming methods are simple, they are not accurate and more variations exist. So the latest multi-criteria decision making tools such as Analytical Hierarchy Process (AHP), Fuzzy Logic (FL) and Artificial Neural Network (ANN) are deeply studied. While selecting the best supplier, many criteria are involved. The criteria may be different for different approach. The decision makers always express their preferences on alternatives or on the attributes of supplier which can be used to help rank the supplier and choose the enviable one. In this article, application of fuzzy logic and AHP are discussed with case-studies and also presented the discussion about implementation of ANN for supplier selection.

Modular implementation of artificial neural network in predicting in-flight particle characteristics of an atmospheric plasma spray process

This paper presents a modular implementation of an artificial neural network to model the atmospheric plasma spray process in predicting the in-flight particle characteristics from the input processing parameters. The in-flight particle characteristics influence the structure and properties of the thermal spray coating and, thus, are considered important parameters to comprehend, simulate and predict the manufacturing process. The modular implementation allows simplification of the optimized model structure with enhanced ability to generalise the network. As well, the underlying relationship between each of the output in-flight characteristics with respect to the input processing parameters is explored. Smaller networks are constructed that achieves better, or in some cases, similar results. The training process is found to be more robust and stable along with fewer fluctuations in the values of the network parameters. The networks also respond to the variations of the number of hidden layer neurons with some definite trend. The predictable trend enhances reliability of the application of the artificial neural network in modelling the atmospheric plasma spray process and overcomes the variability and non-linearity associated with the process.

Time-order error and scalar variance in a computational model of human timing: simulations and predictions

This work introduces a computational model of human temporal discrimination mechanism – the Clock-Counter Timing Network. It is an artificial neural network implementation of a timing mechanism based on the informational architecture of the popular Scalar Timing Model. The model has been simulated in a virtual environment enabling computational experiments which imitate a temporal discrimination task – the two-alternative forced choice task. The influence of key parameters of the model (including the internal pacemaker speed and the variability of memory translation) on the network accuracy and the time-order error phenomenon has been evaluated. The results of simulations reveal how activities of different modules contribute to the overall performance of the model. While the number of significant effects is quite large, the article focuses on the relevant observations concerning the influence of the pacemaker speed and the scalar source of variance on the measured indicators of network performance. The results of performed experiments demonstrate consequences of the fundamental assumptions of the clock-counter model for the results in a temporal discrimination task. The results can be compared and verified in empirical experiments with human participants, especially when the modes of activity of the internal timing mechanism are changed because of some external conditions, or are impaired due to some kind of a neural degradation process.

Implementation of ANN on CCHP system to predict trigeneration performance with consideration of various operative factors

A detailed investigation was aimed based on numerical thermodynamic survey and artificial neural network (ANN) modeling of the trigeneration system. The results are presented in two pivotal frameworks namely the sensitivity analysis and ANN prediction capability of proposed modeling. The underlying operative parameters were chosen as input parameters from different cycles and components, while the exergy efficiency, exergy loss, coefficient of performance, heating load exergy, lambda, gas turbine power, exergy destruction, actual outlet air compressor temperature, and heat recovery gas steam generator (HRSG) outlet temperature were taken as objective output parameters for the modeling purpose. Up to now, no significant step was taken to investigate the compound power plant with thermodynamic analyses and network predictability hybrid in such a detailed oriented approach. It follows that multilayer perceptron neural network with back propagation algorithm deployed with 10–8–9 configuration results in the modeling reliability ranged within R2=0.995–0.999. When dataset treated with trainlm learning algorithm and diversified neurons, the mean square error (MSE) is obtained equal to 0.2175. This denotes a powerful modeling achievement in both scientific and industrial scale to save considerable computational cost on combined cooling, heating, and power system in accomplishment of boosting the energy efficiency and system maintenance.

RAM-Based Neural Network Parallel Implementation on a Reconfigurable Platform and Its Application for Handwritten Digits Recognition

Artificial neural networks (ANNs) are widely used in different areas of nowadays applications. Many challenges are imposed on the practical implementation of ANNs. Some of them are: the number of samples required to train the network; the number of adders, multipliers, nonlinear transfer functions, storage elements; and the speed of calculations in either training phase or recall phase. In this paper, the RAM-based neural network is investigated. No weights, adders, multipliers, transfer functions are required to implement it neither in hardware nor in software, but at a cost of large RAM utilization. In addition, a small number of samples are required for training. However, in hardware implementation, a large size of memory is required to train it.The network is implemented on the FPGA platform. The Stratix IV GX FPGA development board, which is provided on large on board RAM, is used. A considerable speedup of 237is achievedin either training or recalling phases. A comparable error rate of 7.6 is achieved when MNIST (Mixed National Institute of Standards and Technology) database are used to train the network on handwritten digit recognition.

Application of artificial neural networks as an alternative to volumetric water balance in drip irrigation management in watermelon crop

Precision irrigation seeks to establish strategies which achieve an efficient ratio between the volume of water used (reduction in input) and the productivity obtained (increase in production). There are several studies in the literature on strategies for achieving this efficiency, such as those dealing with the method of volumetric water balance (VWB). However, it is also of great practical and economic interest to set up versatile implementations of irrigation strategies that: (i) maintain the performance obtained with other implementations, (ii) rely on few computational resources, (iii) adapt well to field conditions, and (iv) allow easy modification of the irrigation strategy. In this study, such characteristics are achieved when using an Artificial Neural Network (ANN) to determine the period of irrigation for a watermelon crop in the Irrigation Perimeter of the Lower Acaraú, in the state of Ceará, Brazil. The Volumetric Water Balance was taken as the standard for comparing the management carried out with the proposed implementation of ANN. The statistical analysis demonstrates the effectiveness of the proposed management, which is able to replace VWB as a strategy in automation.

Hardware Implementation of Artificial Neural Networks

Hardware Implementation of Artificial Neural Networks