In order to solve the problem of decreasing the accuracy of quantitative prediction of damage of fruits resulting in the size difference of fruits, the spectral correction method based on the size difference of fruits was adopted. To provide richer theoretical knowledge for the quality detection of fruits and the design of damage reduction programs in reality. First, the undamaged spectra of the group of apples with better performance of the model were selected as the reference spectra by analyzing and comparing the modeling results of the prediction models of mechanical parameters with the single fruit diameter groups. The spectral correction coefficient was calculated with the formulas, and the damage spectra of three groups of apples were size-corrected by this coefficient to build the mechanical parameter models. Finally, the corrected spectra were screened for characteristic wavelengths by competitive adaptive reweighting and uninformative variable elimination algorithms. The results of study showed that the correlation coefficients of the prediction set of the models were improved by 2.1%-13% and the root mean square errors were reduced by 16%-51% with the spectrally corrected models compared with the precorrection models. Therefore, the size correction method can be used to eliminate the effect of size difference on the mechanical parameter models to improve the applicability of the quantitative damage prediction models, and it can provide the theoretical guidance to design the loss-reducing protective measures and the agricultural mechanized operation process.