A direct way to reduce scan time for chemical exchange saturation transfer (CEST)-magnetic resonance imaging (MRI) is to reduce the number of CEST images acquired in experiments. In some scenarios, a sufficient number of CEST images acquired in experiments was needed to estimate parameters for quantitative analysis, and this prolonged the scan time. For that, we aim to develop a general deep-learning framework to reconstruct dense CEST Z-spectra from experimentally acquired images at sparse frequency offsets so as to reduce the number of experimentally acquired CEST images and achieve scan time reduction. The main innovation works are outlined as follows: (1) a general sequence-to-sequence (seq2seq) framework is proposed to reconstruct dense CEST Z-spectra from experimentally acquired images at sparse frequency offsets; (2) we create a training set from wide-ranging simulated Z-spectra instead of experimentally acquired CEST data, overcoming the limitation of the time and labor consumption in manual annotation; (3) a new seq2seq network that is capable of utilizing information from both short-range and long-range is developed to improve reconstruction ability. One of our intentions is to establish a simple and efficient framework, i.e., traditional seq2seq can solve the reconstruction task and obtain satisfactory results. In addition, we propose a new seq2seq network that includes the short- and long-range ability to boost dense CEST Z-spectra reconstruction. The experimental results demonstrate that the considered seq2seq models can accurately reconstruct dense CEST images from experimentally acquired images at 11 frequency offsets so as to reduce the scan time by at least 2/3, and our new seq2seq network contributes to competitive advantage.