Wood-boring pests are one of the most destructive forest pests. However, the early detection of wood-boring pests is extremely difficult because their larvae live in tree trunks and have high invisibility. Borehole listening technology is a new and effective method to detect the larvae of insect pests. It identifies infested trees by analyzing wood-boring vibration signals. However, the collected wood-boring vibration signals are often disturbed by various noises existing in the field environment, which reduces the accuracy of pest detection. Therefore, it is necessary to filter out the noise and enhance the wood-boring vibration signals to facilitate the subsequent identification of pests. The current signal enhancement models are all designed based on deep learning models, which have complex scales, a large number of parameters, high demands for storage resources, large computational complexity, and high time costs. They often run on resource-rich computers or servers, and they are difficult to deploy to resource-limited field environments to realize the real-time monitoring of pests; as well, they have low practicability. Therefore, this study designs and implements two model lightweight optimization algorithms, one is a pre-training pruning algorithm based on masks, and the other is a knowledge distillation algorithm based on the separate transfer of vibration signal knowledge and noise signal knowledge. We apply the two lightweight optimization algorithms to the signal enhancement model T-CENV with good performance outcomes and conduct a series of ablation experiments. The experimental results show that the proposed methods effectively reduce the volume of the T-CENV model, which make them useful for the deployment of signal enhancement models on embedded devices, improve the usability of the model, and help to realize the real-time monitoring of wood-boring pest larvae.