Objective The quality of referrals is often criticized, and the effectiveness of improvement efforts remains uncertain. We assessed the impact of a rheumatologist triaging patients in primary care on the appropriateness of referrals to secondary care, healthcare utilization, and patient experience and outcomes. Method A cluster randomized controlled trial was conducted with patients experiencing musculoskeletal complaints. Intervention practices deployed an experienced rheumatologist triaging patients through in-person review. Usual care was performed in control practices, where practitioners referred patients based on their own judgement. The primary outcome was the proportion of inflammatory rheumatic diseases (IRDs) diagnosed by rheumatologists in referred patients. Healthcare utilization (iMTA Medical Consumption Questionnaire), quality of life (EuroQol 5 Dimensions), and experience of care (Consumer Quality Index) were determined after 3 months of follow-up. Data were analysed according to the intention-to-treat principle. Results In total, 544 participants were included [mean age 51.4 (range 18–87) years; 24% were men]. Of all referred patients, 51% had an IRD in the intervention group versus 21% in the control group (p = 0.035). After 3 months of follow-up, patients from the triage intervention showed lower healthcare utilization (p = 0.006) and higher quality of life (p = 0.011), without a decline in experienced quality of care (p = 0.712), compared to controls. Conclusion Triage by a rheumatologist in primary care provides appropriate care and adequate experience of care, leading to a higher quality of life. Long-term evidence is needed to assess the value on cost-effectiveness before implementing this strategy nationwide.