In contemporary security detection systems, the utilization of millimeter-wave radar has assumed a central role owing to its non-contact and innocuous nature. This study addresses the challenging issues of detecting low-resolution and small targets in active millimeter wave (AMMW) images concealed detection. We identify a prevalent drawback in existing detectors, specifically the adoption of strided convolution or pooling layers, leading to a loss of crucial details that adversely impacts the detection rate. To overcome this limitation, we introduce a novel convolutional structure, termed Wavelet-Conv, which maintains information integrity while segregating features from high and low frequency bands, effectively replacing the unfavorable design. Furthermore, we harness the wavelet transform to enhance channel and spatial attention mechanisms, enabling more effective utilization of frequency band features and ensuring interpretability in the computational process. In this pursuit, we integrate the proposed Wavelet-Conv and Wavelet-Attention modules into the YOLOv8 framework, culminating in a unified model, termed Wavelet-YOLO. Through rigorous experimental validation on two AMMW datasets, our approach exhibits superior performance by significantly enhancing the recall and mean average precision (mAP) of small targets in AMMW images, while maintaining competitive inference speed. Extensive experiments demonstrate the outperformance of our proposed method over existing state-of-the-art approaches.