Profiling medical specialties and informing aspiring physicians: a data-driven approach.

Abstract

A detailed, unbiased perspective of the inter-relations among medical fields could help students make informed decisions on their future career plans. Using a data-driven approach, the inter-relations among different medical fields were decomposed and clustered based on the similarity of their working environments.Publicly available, aggregate databases were merged into a single rich dataset containing demographic, working environment and remuneration information for physicians across Canada. These data were collected from the Canadian Institute for Health Information, the Canadian Medical Association, and the Institute for Clinical Evaluative Sciences, primarily from 2018 to 2019. The merged dataset includes 25 unique medical specialties, each with 36 indicator variables. Latent Profile Analysis (LPA) was used to group specialties into distinct clusters based on relatedness.The 25 medical specialties were decomposed into seven clusters (latent variables) that were chosen based on the Bayesian Information Criterion. The Kruskal-Wallis test identified eight indicator variables that significantly differed between the seven profiles. These variables included income, work settings and payment styles. Variables that did not significantly vary between profiles included demographics, professional satisfaction, and work-life balance satisfaction.The 25 analyzed medical specialties were grouped in an unsupervised manner into seven profiles via LPA. These profiles correspond to expected and meaningful groups of specialties that share a common theme and set of indicator variables (e.g. procedurally-focused, clinic-based practice). These profiles can help aspiring physicians narrow down and guide specialty choice.