Health-related quality of life (HRQoL) captures different aspects of the fibrotic interstitial lung disease (FILD) evaluation from the patient's perspective. However, little is known about how HRQoL changes in patients with non-idiopathic pulmonary fibrosis (IPF) FILD, especially in those with progressive pulmonary fibrosis (PPF). The aim of this study is to clarify whether HRQoL deteriorates in patients with non-IPF FILD and to evaluate the differences in the changes in HRQoL between those with and without PPF. We collected data from consecutive patients with non-IPF FILD and compared annual changes in HRQoL over 2 years between patients with PPF and those without. The St George's respiratory questionnaire (SGRQ) and COPD assessment test (CAT) were used to assess HRQoL. Changes in the SGRQ and CAT scores for 24 months from baseline were evaluated with a mixed-effect model for repeated measures. A total of 396 patients with non-IPF FILD were reviewed. The median age was 65 years and 202 were male (51.0%). The median SGRQ and CAT scores were 29.6 and 11, respectively. Eighty-six (21.7%) showed PPF. Both SGRQ and CAT scores were significantly deteriorated in patients with PPF compared to those without PPF (p < 0.01 for both). Clinically important deterioration in the SGRQ and CAT scores were observed in 40.0 and 35.7% of patients with PPF and 11.7 and 16.7% of those without, respectively. PPF was significantly associated with clinically important deterioration in the SGRQ score (odds ratio 5.04; 95%CI, 2.61-9.76, p < 0.01) and CAT score (odds ratio 2.78; 95%CI, 1.27-6.06, p = 0.02). The SGRQ and CAT scores were significantly deteriorated in patients with non-IPF FILD and PPF. Considering an evaluation of HRQoL would be needed when assessing PPF.