A Model Transfer Method among Spectrometers Based on Improved Deep Autoencoder for Concentration Determination of Heavy Metal Ions by UV-Vis Spectra

Abstract

Ultraviolet Visible (UV-Vis) spectroscopy detection technology has been widely used in quantitative analysis for its advantages of rapid and non-destructive determination. However, the difference of optical hardware severely restricts the development of spectral technology. Model transfer is one of the effective methods to establish models on different instruments. Due to the high dimension and nonlinearity of spectral data, the existing methods cannot effectively extract the hidden differences in spectra of different spectrometers. Thus, based on the necessity of spectral calibration model transfer between the traditional large spectrometer and the micro-spectrometer, a novel model transfer method based on improved deep autoencoder is proposed to realize spectral reconstruction between different spectrometers. Firstly, two autoencoders are used to train the spectral data of the master and slave instrument, respectively. Then, the hidden variable constraint is added to enhance the feature representation of the autoencoder, which makes the two hidden variables equal. Combined with a Bayesian optimization algorithm for the objective function, the transfer accuracy coefficient is proposed to characterize the model transfer performance. The experimental results show that after model transfer, the spectrum of the slave spectrometer is basically coincident with the master spectrometer and the wavelength shift is eliminated. Compared with the two commonly used direct standardization (DS) and piecewise direct standardization (PDS) algorithms, the average transfer accuracy coefficient of the proposed method is improved by 45.11% and 22.38%, respectively, when there are nonlinear differences between different spectrometers.