Belt conveyors in mining are crucial, with downtime leading to significant losses and safety hazards. Unplanned shutdowns often result from idler failures. To address this, an online monitoring system for continuous idler health assessment is proposed. Considering the large number and dense spatial distribution of idlers over long distances, this work presents a system that utilizes a quasi-distributed optical fiber accelerometer array. This array incorporates phase-sensitive optical time domain reflectometry (Phase-OTDR) interrogation technology and ultra-weak fiber Bragg gratings (UWFBGs) to effectively capture idler vibrations. The designed array achieves high-sensitivity vibration sensing with a sensitivity of 2.4 rad/g and a resolution of 1.7 mg/Hz. After collecting the vibrations of idlers by the designed accelerometer array, an automatic fault classification algorithm based on self-supervised learning (SSL) is introduced, which requires only a small number of labeled samples. By leveraging large amount of unlabeled data in the pretext task, the algorithm efficiently extracts latent features from the quasi-distributed accelerometer array. A diagnosis accuracy of 95.37 % can be achieved on a seven-class classification task with only 3.6 % labeled data (16 samples/class). This system offers a promising solution for idler monitoring, combining high sensitivity, distributed measurement capabilities, enhanced security, and superior fault detection accuracy.