Differential evolution (DE) is highly competitive in single-objective real parameter optimization. However, there are still some problems with differential evolutionary variants in optimizing complex multimode functions, such as poor solution accuracy and slow convergence. To address these problems, an optimization framework of integrated DE variants based on adaptive relay mode (fDE-ARM) is proposed. In this framework, different DE variants are integrated through two adaptive relay mechanisms to give full play to the advantages of the algorithms, thereby improving the performance of the whole algorithm. For the first adaptive relay mode, when the currently executed algorithm is judged to have converged, the population is updated by Gaussian random walk, and then the optimization is continued through the relay algorithm. For the second adaptive relay mode, the relay condition is determined by the average fitness improvement rate. If the condition is met, the relay algorithm takes over the optimization. At the same time, if the diversity is lower than the threshold, to improve the exploration, the roulette wheel method is used to select some individuals to perform the Gaussian random walk. In addition, a feedback mechanism is introduced in the relay process to avoid false switching. To verify the performance of the proposed algorithm, extensive simulations are performed on CEC2005, CEC2014, CEC2017, and CEC2021 benchmark functions. In addition, three engineering problems are used to test the performance. Compared with some newly proposed optimization algorithms, fDE-ARM is statistically superior to the comparison algorithms in terms of solution accuracy, convergence speed, and stability.