Cellular Neural Network Templates Research Articles

Biomimetic adaptive memristive cellular neural network for image enhancement

Cellular neural networks (CNN) have a simple local interconnect structure and high-speed parallel processing capability. As the basic model for a constructing artificial retina, CNNs can be applied to image enhancement in the machine vision field. However, existing image enhancement methods based on CNNs face several challenges. For example, when using common fixed templates, it is difficult to obtain ideal results when handling complex images in real-world applications. In addition, the lack of bionic considerations can cause failures when simulating the powerful global and local adaptive adjustment characteristics of human vision. Therefore, this paper proposes a biomimetic adaptive memristive CNN (BAM-CNN) that combines CNNs, human visual adaptive tri-Gaussian theory and memristor, and nano information devices. The proposed CNN can be used for image enhancement. Specifically, the memristive CNN is constructed based on emerging memristors that are programmable, non-volatile, and synapse-plastic. Merged with the tri-Gaussian model for the receptive field of neurons, an adaptive CNN template design algorithm for biomimetic image enhancement is proposed using the image processing features of the Gaussian kernel function and CNNs. In this paper, gray-scale and color images are taken as target examples in image enhancement experiments. The experimental results demonstrate that the proposed BAM-CNN significantly improves the global brightness, local contrast, and sharpness of the image. This paper provides a novel design and implementation scheme for adaptive templates of CNNs, which can improve CNNs biomimetic characteristics and hardware implementation feasibility. The proposed BAM-CNN can be used to develop innovative techniques for intelligent image processing besides image enhancement.

Building cellular neural network templates with a hardware friendly learning algorithm

Abstract A general solution for the construction of Cellular Neural Network (CNN) weights (cloning template) with Random Weight Change (RWC) algorithm is proposed. A target image for each input image is prepared via a sketch or any other kind of image processing technique for learning of Cellular Neural Network templates. A vector of randomly generated small values is added to the original weights and tested upon the input-target image pair. As a result, if the learning error decreases, the weight is taken for learning in the next iteration and updated using the same vector of random values. Otherwise, a new random vector for updating the weights is regenerated. One of the strong benefits of the proposed weight learning method is the simplicity of its learning algorithm and hence a simpler hardware architecture. Moreover the proposed method provides a unified solution to the problem of learning CNN templates without having to modify the original CNN structure and is applicable for all types of CNNs and input images. Successful learning of templates for various image processing tasks using different CNN structures are also demonstrated in this paper.

Real-time raindrop detection based on cellular neural networks for ADAS

A core aspect of advanced driver assistance systems (ADAS) is to support the driver with information about the current environmental situation of the vehicle. Bad weather conditions such as rain might occlude regions of the windshield or a camera lens and therefore affect the visual perception. Hence, the automated detection of raindrops has a significant importance for video-based ADAS. The detection of raindrops is highly time critical since video pre-processing stages are required to improve the image quality and to provide their results in real-time. This paper presents an approach for real-time raindrops detection which is based on cellular neural networks (CNN) and support vector machines (SVM). The major idea is to prove the possibility of transforming the support vectors into CNN templates. The advantage of CNN is its ultra fast precessing on embedded platforms such as FPGAs and GPUs. The proposed approach is capable to detect raindrops that might negatively affect the vision of the driver. Different classification features were extracted to evaluate and compare the performance between the proposed approach and other approaches.

A universal concept based on cellular neural networks for ultrafast and flexible solving of differential equations.

This paper develops and validates a comprehensive and universally applicable computational concept for solving nonlinear differential equations (NDEs) through a neurocomputing concept based on cellular neural networks (CNNs). High-precision, stability, convergence, and lowest-possible memory requirements are ensured by the CNN processor architecture. A significant challenge solved in this paper is that all these cited computing features are ensured in all system-states (regular or chaotic ones) and in all bifurcation conditions that may be experienced by NDEs.One particular quintessence of this paper is to develop and demonstrate a solver concept that shows and ensures that CNN processors (realized either in hardware or in software) are universal solvers of NDE models. The solving logic or algorithm of given NDEs (possible examples are: Duffing, Mathieu, Van der Pol, Jerk, Chua, Rössler, Lorenz, Burgers, and the transport equations) through a CNN processor system is provided by a set of templates that are computed by our comprehensive templates calculation technique that we call nonlinear adaptive optimization. This paper is therefore a significant contribution and represents a cutting-edge real-time computational engineering approach, especially while considering the various scientific and engineering applications of this ultrafast, energy-and-memory-efficient, and high-precise NDE solver concept. For illustration purposes, three NDE models are demonstratively solved, and related CNN templates are derived and used: the periodically excited Duffing equation, the Mathieu equation, and the transport equation.

Edge detection of infrared image with CNN_DGA algorithm

In this paper, infrared image edge detection algorithm based on the combination of the cellular neural networks (CNN) and distributed genetic algorithm (DGA) is proposed. The CNN template is used to train the network with distributed genetic algorithm (CNN_DGA). The experimental results show: the edge of the infrared image was extracted accurately with CNN_DGA edge detection algorithm; furthermore, the noise of the infrared image was reduced greatly. Compared with the edge detection algorithms based on cellular neural networks with template trained by particle swarm optimization, parameters’ search range and convergence speed are greatly improved.

A Novel General and Robust Method Based on NAOP for Solving Nonlinear Ordinary Differential Equations and Partial Differential Equations by Cellular Neural Networks

This paper develops and validates through a series of presentable examples, a comprehensive high-precision, and ultrafast computing concept for solving nonlinear ordinary differential equations (ODEs) and partial differential equations (PDEs) with cellular neural networks (CNN). The core of this concept is a straightforward scheme that we call "nonlinear adaptive optimization (NAOP),” which is used for a precise template calculation for solving nonlinear ODEs and PDEs through CNN processors. One of the key contributions of this work is to demonstrate the possibility of transforming different types of nonlinearities displayed by various classical and well-known nonlinear equations (e.g., van der Pol-, Rayleigh-, Duffing-, Rössler-, Lorenz-, and Jerk-equations, just to name a few) unto first-order CNN elementary cells, and thereby enabling the easy derivation of corresponding CNN templates. Furthermore, in the case of PDE solving, the same concept also allows a mapping unto first-order CNN cells while considering one or even more nonlinear terms of the Taylor's series expansion generally used in the transformation of a PDE in a set of coupled nonlinear ODEs. Therefore, the concept of this paper does significantly contribute to the consolidation of CNN as a universal and ultrafast solver of nonlinear ODEs and/or PDEs. This clearly enables a CNN-based, real-time, ultraprecise, and low-cost computational engineering. As proof of concept, two examples of well-known ODEs are considered namely a second-order linear ODE and a second order nonlinear ODE of the van der Pol type. For each of these ODEs, the corresponding precise CNN templates are derived and are used to deduce the expected solutions. An implementation of the concept developed is possible even on embedded digital platforms (e.g., field programmable gate array (FPGA), digital signal processor (DSP), graphics processing unit (GPU), etc.). This opens a broad range of applications. Ongoing works (as outlook) are using NAOP for deriving precise templates for a selected set of practically interesting ODEs and PDEs equation models such as Lorenz-, Rössler-, Navier Stokes-, Schrödinger-, Maxwell-, etc.

Fast texture synthesis with cellular neural network‐based patch stitching

ABSTRACTThe presented paper introduces a novel approach to patch‐based texture synthesis. The proposed method utilizes Cellular Neural Networks (CNNs) for patch stitching, the most important operation of the synthesis procedure, expected to transform a patchwork made up of pieces of some small texture sample into a seamless, large texture. To fill in between‐patch gaps, spontaneous pattern formation capabilities of CNNs are used. By using autoregressive filtering framework, we show that CNNs can be designed to generate complex stochastic fields that approximate stochastic and near‐stochastic textures. The proposed texture‐synthesis procedure is the following. After creating a patchwork from randomly drawn pieces of a small target texture, we fix boundary CNN conditions to edge pixels of all patches subject to stitching and execute an appropriately derived texture‐approximating template. Finally, brightness of the resulting patterns is locally adjusted by executing a diffusion CNN template. As both processing steps involve pure CNN dynamics, the proposed patch‐stitching method can be extremely fast if implemented in existing hardware (at the order of milliseconds for synthesizing several megapixel images). Copyright © 2012 John Wiley & Sons, Ltd.

Cellular Neural Network Based on Hybrid Linear Matrix Inequality and Particle Swarm Optimization for Noise Removal of Color Image

This paper presents a color image noise removal technique that employs a cellular neural network (CNN) based on hybrid linear matrix inequality (LMI) and particle swarm optimization (PSO). For designing templates of CNN, the Lyapunov stability theorem is applied to derive the criterion for the uniqueness and global asymptotic stability of the CNN’s equilibrium point. The template design is characterized as a standard LMI problem, and the parameters of templates are optimized by PSO. The input templates are obtained by employing the CNN’s property of saturation nonlinearity, which can be used to eliminate noise from arbitrary corrupted images. The demonstrated examples are compared favorably with other available methods, which illustrate the better performance of the proposed LMI-PSO-CNN methodology.

A Novel Cloning Template Designing Method by Using an Artificial Bee Colony Algorithm for Edge Detection of CNN Based Imaging Sensors

Cellular Neural Networks (CNNs) have been widely used recently in applications such as edge detection, noise reduction and object detection, which are among the main computer imaging processes. They can also be realized as hardware based imaging sensors. The fact that hardware CNN models produce robust and effective results has attracted the attention of researchers using these structures within image sensors. Realization of desired CNN behavior such as edge detection can be achieved by correctly setting a cloning template without changing the structure of the CNN. To achieve different behaviors effectively, designing a cloning template is one of the most important research topics in this field. In this study, the edge detecting process that is used as a preliminary process for segmentation, identification and coding applications is conducted by using CNN structures. In order to design the cloning template of goal-oriented CNN architecture, an Artificial Bee Colony (ABC) algorithm which is inspired from the foraging behavior of honeybees is used and the performance analysis of ABC for this application is examined with multiple runs. The CNN template generated by the ABC algorithm is tested by using artificial and real test images. The results are subjectively and quantitatively compared with well-known classical edge detection methods, and other CNN based edge detector cloning templates available in the imaging literature. The results show that the proposed method is more successful than other methods.

On-chip template training system and image processing applications using iterative annealing on ACE16k chip

Cellular neural networks proved to be a useful parallel computing system for image processing applications. Cellular neural networks (CNNs) constitute a class of recurrent and locally coupled arrays of identical cells. The connectivity among the cells is determined by a set of parameters called templates. CNN templates are the key parameters to perform a desired task. One of the challenging problems in designing templates is to find the optimal template that functions appropriately for the solution of the intended problem. In this paper, we have implemented the Iterative Annealing Optimization Method on the analog CNN chip to find an optimum template by training a randomly selected initial template. We have been able to show that the proposed system is efficient to find the suitable template for some specific image processing applications.

Cellular Neural Networks for Gray Image Noise Cancellation Based on a Hybrid Linear Matrix Inequality and Particle Swarm Optimization Approach

This paper describes a technique for gray image noise cancellation. This method employs linear matrix inequality (LMI) and particle swarm optimization (PSO) based on cellular neural networks (CNN).We use two images that one is desired image and the other is corrupted to find the CNN template. The Lyapunov stability theorem is employed to derive the criterion for uniqueness and global asymptotic stability of the CNN equilibrium point. The current study characterizes the template design problem as a standard LMI problem and the optimization parameters of the templates are carried out by PSO. Finally, the examples are given to illustrate the effectiveness of the proposed method.

HYBRID APPROACH FOR BRAIN TUMOR SEGMENTATION IN MAGNETIC RESONANCE IMAGES USING CELLULAR NEURAL NETWORKS AND OPTIMIZATION TECHNIQUES

Tumor segmentation from brain magnetic resonance image data is an important but time consuming task performed manually by medical experts. Automating this process is challenging due to the high diversity in appearance of tumor tissue among different patients and in many cases, similarity between tumor and normal tissue. This paper deals with an efficient segmentation algorithm for extracting brain tumors in magnetic resonance images using Cellular Neural Networks (CNN). Learning CNN templates values are formulated as an optimization problem. The template coefficients (weights) of an CNN which will give a desired performance, can be derived by learning genetic algorithm and simulated annealing optimization techniques. The objective of this work is to compare the performance of genetic algorithm (GA) and simulated annealing (SA) for finding the optimum template values in the CNN which is used for segmenting the tumor region in the abnormal MR images. The method is applied on real data of MRI images of thirty patients with four different types of tumors. The results are compared with radiologist labeled ground truth. Quantitative analysis between ground truth and segmented tumor is presented in terms of segmentation efficiency. From the analysis and performance measures like segmentation accuracy, it is inferred that the brain tumor segmentation is best done using CNN with genetic algorithm template optimization than CNN with simulated annealing template optimization. An average accuracy rate of above 95% was obtained using this segmentation algorithm.

Implementation of on-chip training system for cellular neural networks using iterative annealing optimisation method

Cellular neural networks proved to be a useful parallel computing system for image processing applications. Cellular neural networks (CNNs) constitute a class of recurrent and locally coupled arrays of identical cells. The connectivity among the cells is determined by a set of parameters called templates. CNN templates are the key parameters to perform a desired task. One of the challenging problems in designing templates is to find the optimal template that functions appropriately for the solution of the intended problem. In this paper, we implement the iterative annealing optimisation method (IAOM) on the analogue CNN chip to find an optimum template by training a randomly selected initial template. We have been able to show that the proposed system is efficient to find the suitable template for some specific image processing applications.

Noise Reduction in CMOS Image Sensor Using Cellular Neural Networks with a Genetic Algorithm

In this paper, Cellular Neural Networks using genetic algorithm (GA-CNNs) are designed for CMOS image noise reduction. Cellular Neural Networks (CNNs) could be an efficient way to apply to the image processing technique, since CNNs have high-speed parallel signal processing characteristics. Adaptive CNNs structure is designed for the reduction of Photon Shot Noise (PSN) changed according to the average number of photons, and the design of templates for adaptive CNNs is based on the genetic algorithm using real numbers. These templates are optimized to suppress PSN in corrupted images. The simulation results show that the adaptive GA-CNNs more efficiently reduce PSN than do the other noise reduction methods and can be used as a high-quality and low-cost noise reduction filter for PSN. The proposed method is designed for real-time implementation. Therefore, it can be used as a noise reduction filter for many commercial applications. The simulation results also show the feasibility to design the CNNs template for a variety of problems based on the statistical image model.

Cellular Neural Networks-Based Genetic Algorithm for Optimizing the Behavior of an Unstructured Robot

A new learning algorithm for advanced robot locomotion is presented in this paper. This method involves both Cellular Neural Networks (CNN) technology and an evolutionary process based on genetic algorithm (GA) for a learning process. Learning is formulated as an optimization problem. CNN Templates are derived by GA after an optimization process. Through these templates the CNN computation platform generates a specific wave leading to the best motion of a walker robot. It is demonstrated that due to the new method presented in this paper an irregular and even a disjointed walker robot can successfully move with the highest performance.

A NEW METHOD FOR THE RE-IMPLEMENTATION OF THRESHOLD LOGIC FUNCTIONS WITH CELLULAR NEURAL NETWORKS

A new strategy is presented for the implementation of threshold logic functions with binary-output Cellular Neural Networks (CNNs). The objective is to optimize the CNNs weights to develop a robust implementation. Hence, the concept of generative set is introduced as a convenient representation of any linearly separable Boolean function. Our analysis of threshold logic functions leads to a complete algorithm that automatically provides an optimized generative set. New weights are deduced and a more robust CNN template assuming the same function can thus be implemented. The strategy is illustrated by a detailed example.

ADVANCED IMAGE PROCESSING CELLULAR NEURAL NETWORKS

Many useful and well-known image processing templates for cellular neural networks (CNN's) can be derived from neural field models, thereby providing a neural basis for the CNN paradigm. The potential ability of multitasking image processing is investigated by using these templates. Many visual illusions are simulated via CNN image processing. The ability of the CNN to mimic such high-level brain functions suggests possible applications of the CNN in cognitive engineering. Furthermore, two kinds of painting-like image processings, namely, texture generation and illustration style transformation are investigated.

New object-oriented segmentation algorithm based on the CNN paradigm

This paper illustrates a new object-oriented segmentation algorithm based on the cellular neural network (CNN) paradigm. The approach, which exploits rigorous model of the image contours, presents two remarkable features: 1) it provides more accurate segmented objects than the ones obtained by other CNN-based techniques; 2) it makes use of CNN templates that take into account the hardware characteristics imposed by the CNNUM. Results carried out for benchmark video sequences highlight the capabilities of the proposed technique.

New horizon for CNN: with fuzzy paradigms for multimedia

The cellular neural network (CNN) is a powerful technique to mimic the local function of biological neural circuits for real-time image and video processing. Recently, it is widely accepted that using a set of CNNs in parallel can achieve higher-level information processing and reasoning functions either from application or biology points of views. The authors introduce a novel framework for constructing a multiple-CNN integrated neural system called recurrent fuzzy CNN (RFCNN). This system can automatically learn its proper network structure and parameters simultaneously. In the RFCNN, each learned fuzzy rule corresponds to a CNN. Hence, each CNN takes care of a fuzzily separated problem region, and the functions of all CNNs are integrated through the fuzzy inference mechanism. Some online clustering algorithms are introduced for the structure learning, and the ordered-derivative calculus is applied to derive the recurrent learning rules of CNN templates in the parameter-learning phase. RFCNN provides a solution to the current dilemma on the decision of templates and/or fuzzy rules in the existing integrated (fuzzy) CNN systems. The capability of the RFCNN is demonstrated on the real-world vision-based defect inspection and image descreening problems proving that the RFCNN scheme is effective and promising.

SEGMENTATION OF OVARIAN ULTRASOUND IMAGES USING CELLULAR NEURAL NETWORKS

Segmentation of ovarian ultrasound images using cellular neural networks (CNNs) is studied in this paper. The segmentation method consists of five successive steps where the first four uses CNNs. In the first step, only rough position of follicles is determined. In the second step, the results are improved by expansion of detected follicles. In the third step, previously undetected inexpressive follicles are determined, while the fourth step detects the position of ovary. All results are joined in the fifth step. The templates for CNNs were obtained by applying genetic algorithm. The segmentation method has been tested on 50 ovarian ultrasound images. The recognition rate of follicles was around 60% and misidentification rate was around 30%.