This study aims to address the challenges of achieving a high harvesting rate and low flower bud damage rate during the harvesting of camellia fruits. To this end, a dynamic model of the camellia osmantha tree and a self-developed shaker-type harvesting machine were used as research subjects. The first 24 natural frequencies and mode shapes of the camellia tree were solved using the finite element method, and the effects of vibration frequency, excitation position, and vibration duration on the harvesting rate and flower bud damage rate were quantitatively analyzed through an orthogonal experiment. The numerical analysis results indicate that the camellia tree exhibits good response characteristics at vibration frequencies of 10–15.5 Hz and 38.5 Hz. The three-factors orthogonal experiment figured out that the optimal operational parameters for shaker-type harvesting were determined to be a vibration duration of 30 s, a motor output frequency of 12.5 Hz, and a gripping position height of 50 to 60 cm above the ground. Meanwhile, under these operational parameters, the harvesting efficiency reached 96.97%, while the flower bud damage rate was only 6%.