Working in a healthcare setting is associated with high levels of stress and burnout syndrome. Work-related quality of life (WRQoL) remains insufficiently evaluated among physicians. The aim of this study is to assess the WRQoL among physicians of interventional, non-interventional, and diagnostic specialties in Poland. Standardized and anonymous WRQoL questionnaires have been filled in by 257 physicians working in Silesia, Poland. After the removal of missing data, 246 individuals were stratified in terms of specialties into the appropriate categories, including interventional, non-interventional, and diagnostics. These categories were compared using the following subscales: general well-being (GWB), home-work interface (HWI), job and career satisfaction (JCS), control at work (CAW), working conditions (WCS), and stress at work (SAW). Out of 246 individuals, 132 were women (53.7%) and 112 (45.5%) were men. There were no differences in terms of WRQoL scores (p = 0.220) and subscales GWB (p = 0.148), HWI (p = 0.368), JCS (p = 0.117), CAW (p = 0.224), WCS (p = 0.609), SAW (p = 0.472) between interventional, non-interventional, and diagnostic specialties. The group of young doctors (age ≤ 30 years) had higher JCS scores than the older ones (mean score [SD], 22.7 [3.98] vs. 21 [4.6]; p = 0.013). Physicians who were not working in hospital had higher WRQoL score than respondents working in hospital (p = 0.061), with significant differences in terms of GWB (mean score [SD], 20.3 [4.93] vs. 22.8 [3.2], p = 0.014), HWI (mean score [SD], 9.1 [=2.65] vs. 10.6 [2.73], p = 0.011), and WCS (mean score [SD], 9.5 [2.61] vs. 10.8 [2.54], p = 0.035). There were no differences considering overall WRQoL between analyzed groups stratified according to specialty. However, we disclosed a significant association between the respondent's WRQoL and age as well as place of work.