The tunnel portal section is often in extremely weak and fragmented strata, and the deformation of the portal side and slope will affect the stability of the surrounding rock and the tunnel-supporting structure. However, the deformation characteristics and displacement development patterns of slopes in the tunnel portal section are not clear. In this paper, the multifractal characteristics and displacement prediction of the deformation sequence of the tunnel portal slope at of a weak and water-rich shallow buried tunnel adjacent to an important structure are studied in depth. Combined with the deformation characteristics of the tunnel portal slope, a suitable slope monitoring and measurement scheme is designed to analyze the deformation pattern of the tunnel portal slope. Based on the multifractal detrended fluctuation analysis (MF-DFA) method, the multifractal characteristics of the deformation monitoring sequences at each monitoring point of the tunnel portal slope are analyzed. The multifractal characteristics of displacement sequences at different monitoring points of the tunnel portal slope are consistent with the actual monitoring results. Furthermore, the Long Short-Term Memory (LSTM) model is optimized using the Particle Swarm Optimization (PSO) algorithm to predict the deformation of the tunnel portal slope. The results show that the maximum mean square error (MSE) of the horizontal displacement test set prediction results is 0.142, and the coefficient of determination (R2) is higher than 91%. The maximum value of MSE for vertical displacement test set prediction is 0.069, and the R2 are higher than 91%. The study shows that the performance of the PSO-LSTM prediction model can meet the requirements for predicting the displacement of the tunnel portal slope. Based on the MF-DFA method and PSO-LSTM prediction model, the fluctuation characteristics of the displacement value of the tunnel portal section can be accurately identified and the displacement development pattern can be effectively predicted. The conclusions of the study are of great practical significance for the safe construction of the tunnel portal section.