Psoriatic arthritis (PsA) is characterized by enthesitis. As persistent inflammation around joints results in bone and cartilage destruction and physical impairment, a detailed assessment of inflammation is essential. We previously reported the difference between clinical assessment (tenderness) and ultrasound (US) assessment (inflammation) of entheses. Herein, we investigated whether clinical or US assessment of joints and entheses can predict the progression of joint destruction in Japanese patients with PsA. Thirty joints and 14 entheses in 47 patients were assessed using US and clinical examination. The US greyscale (GS) and power Doppler (PD) scores at the ultrasonographic synovitis, the US active enthesitis count, and the clinical tender joint/entheses count were assessed. Additionally, the yearly radiographic progression of the Sharp-van der Heijde scoring method for PsA was assessed. Their correlations were investigated. About half of the patients with PsA experienced joint destruction during a follow-up period of 20.4 months. Progression of joint destruction in patients with PsA only correlated with joint GS and PD scores, reflecting the severity of ultrasonographic synovitis, not with the tender joint/entheses count. US examinations are essential for preventing joint destruction and physical impairment in patients with PsA.