Reservoir Computing with Sensitivity Analysis Input Scaling Regulation and Redundant Unit Pruning for Modeling Fed-Batch Bioprocesses

Abstract

Although reservoir computing (RC) is an effective approach to designing and training recurrent neural networks, the optimization of neural network systems involves a number of manual, tweaking or brute-force searching parameters, such as network size, input scaling parameters, and spectral radius. To create an optimal echo state network (ESN), we propose a modified RC that combines sensitivity analysis input scaling regulation (SAISR) and redundant unit pruning algorithm (RUPA). SAISR is first employed to obtain the optimal input scaling parameters. In SAISR, an ESN without tuning is established, and then its input scaling parameters are tuned based on the Sobol’ sensitivity analysis. Second, RUPA is employed to prune out the redundant readout connections. A fed-batch penicillin cultivation process is chosen to demonstrate the applicability of the modified RC. The results show that the input scaling parameter has a more important influence than other parameters in ESN, and SAISR-ESN outperforms ESN withou...