Spectral analysis is one of the most important methods of physico-technical research for solving many scientific and practical problems. The key parameter of a spectral instrument is its resolving power. Instruments based on diffraction gratings face a fundamental limitation: their resolving power is limited to operation in the first two orders of diffraction. The limitation is due to the fact that the intensity of diffraction maxima drops sharply with increasing diffraction order. As a result, such devices are unable to distinguish closely spaced spectral lines. Increasing the resolving power of spectral priors is an important and urgent task for spectroscopy. The aim of the research was to develop an optical scheme of a spectral instrument based on a high-resolution prism for the detection of nearby spectral lines with minimal influence of aberrations. The optical scheme of the diffraction prism spectral instrument was developed. The possibility of detecting nearby spectral lines is shown. Also a comprehensive study of the influence of aberrations and the development of methods of their minimisation to achieve the optimum quality of the spectral instrument and accuracy of measurements is carried out. The obtained results confirm the possibility of increasing the resolving power of the spectral instrument for the detection of closely spaced spectral lines. Taking into account the influence of aberrations in the diffraction prism spectral instrument will improve the quality of its work and measurement accuracy. The obtained results open new possibilities for studying complex spectra with high detail.