Vibratory harvesting is to dislodge fruits by applying excitation force to fruit trees, so the vibration response characteristics of fruit trees are of great significance for vibratory forest and fruit harvesting machinery to realize efficient harvesting. The effects of different clamping points and vibration frequencies on vibration responsiveness and energy transfer in Broussonetia papyrifera branches are investigated in this study. The results show that the effects of different clamping point positions and vibration frequencies on the branch vibration response are mutual. The ideal distance between the clamping point position and the base of the main branch should be between 48% and 73% of the branch length, and the distance between the clamping point position and the base of the main branch increased with the increase of vibration frequency. This is because, when the clamping point is close to the base of the main branch, a higher excitation frequency increases the energy consumption at the base of the main branch, and the amount of ineffective vibration energy transferred to the base of the main branch also increases. Therefore, when the location of the clamping point is close to the base of the main branch, the suppression of high-frequency vibration at the base of the main branch is stronger than the suppression of low-frequency vibration. When the clamping point is located in the center of the branch, the overall response of the branch to vibration is better.