PurposeGiven the psychosocial burdens patients in advanced stages of cancer face, innovative care concepts are needed. At the same time, such vulnerable patient groups are difficult to reach for participation in intervention studies and randomized patient inclusion may not be feasible. This article aims to identify systematic biases respectively selection effects occurring during the recruitment phase and to discuss their potential causes based on a non-randomized, multicenter intervention study with patients in advanced stages of cancer.MethodsPatients diagnosed with at least one of 16 predefined cancers were recruited at four hospitals in three German cities. The effect of social care nurses’ continuous involvement in acute oncology wards was measured by health-related quality of life (EORTC QLQ-C30), information and participation preferences, decisional conflicts, doctor-patient communication, health literacy and symptom perception. Absolute standardized mean difference was calculated as a standardized effect size to test baseline characteristics balance between the intervention and control groups.ResultsThe study enrolled 362 patients, 150 in the intervention and 212 in the control group. Except for gender, both groups differed in relevant socio-demographic characteristics, e.g. regarding age and educational background. With respect to the distribution of diagnoses, the intervention group showed a higher symptom burden than the control group. Moreover, the control group reported better quality of life at baseline compared to the intervention group (52.6 points (SD 21.7); 47.8 points (SD 22.0), ASMD = 0.218, p = 0.044).ConclusionOverall, the intervention group showed more social and health vulnerability than the control group. Among other factors, the wide range of diagnoses included and structural variation between the recruiting clinics increased the risk for bias. We recommend a close, continuous monitoring of relevant social and health-related characteristics during the recruitment phase as well as the use of appropriate statistical analysis strategies for adjustment, such as propensity score methods.Trial registration: German Clinical Trials Register (DRKS-ID: DRKS00013640); registered on 29th December 2017.