Monitoring the particle size distribution (PSD) is crucial for controlling product quality during fluidized bed granulation. This paper proposed a rapid analytical method that quantifies the D10, D50, and D90 values using a Convolutional Block Attention Module-Convolutional Neural Network (CBAM-CNN) framework tailored for deep learning with near-infrared (NIR) spectroscopy. This innovative framework, which fuses CBAM with CNN, excels at extracting intricate features while prioritizing crucial ones, thereby facilitating the creation of a robust multi-output regression model. To expand the training dataset, we incorporated the C-Mixup algorithm, ensuring that the deep learning model was trained comprehensively. Additionally, the Bayesian optimization algorithm was introduced to optimize the hyperparameters, improving the prediction performance of the deep learning model. Compared with the commonly used Partial Least Squares (PLS), Support Vector Machine (SVM), and Artificial Neural Network (ANN) models, the CBAM-CNN model yielded higher prediction accuracy. Furthermore, the CBAM-CNN model avoided spectral preprocessing, preserved the spectral information to the maximum extent, and returned multiple predicted values at one time without degrading the prediction accuracy. Therefore, the CBAM-CNN model showed better prediction performance and modeling convenience for analyzing PSD values in fluidized bed granulation.