Abstract
Echo state network (ESN) has emerged as an effective alternative to conventional recurrent neural networks due to its simple training process and good modelling ability for solving a variety of problems, especially time-series modelling tasks. To improve modelling capability and to decrease the reservoir topology complexity, a new attention mechanism based ESN optimised by covariance matrix adaption evolutionary strategy (CMA-ES) is proposed in this paper. CMA-ES is a stochastic and derivative-free algorithm for solving non-linear optimization problems. Attention mechanism is incorporated to guide ESN to focus on regions of interest relevant to the modelling task. The proposed optimised ESN with attention mechanism is used to model a fed-batch penicillin fermentation process and the results are better than those from the standard ESN and ESN with attention mechanism.
Sign-in/Register to access full text options 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a callDisclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.
