A Systematic Review of the Methodological Rigor of Studies Evaluating Cultural Competence Training of Health Professionals

Abstract

To systematically examine the methodological rigor of studies using cultural competence training as a strategy to improve minority health care quality. To the authors' knowledge, no prior studies of this type have been conducted. As part of a systematic review, the authors appraised the methodological rigor of studies published in English from 1980 to 2003 that evaluate cultural competence training, and determined whether selected study characteristics were associated with better study quality as defined by five domains (representativeness, intervention description, bias and confounding, outcome assessment, and analytic approach). Among 64 eligible articles, most studies (no. = 59) were published recently (1990-2003) in education (no. = 26) and nursing (no. = 14) journals. Targeted learners were mostly nurses (no. = 32) and physicians (no. = 19). Study designs included randomized or concurrent controlled trials (no. = 10), pretest/posttest (no. = 22), posttest only (no. = 27), and qualitative evaluation (no. = 5). Curricular content, teaching strategies, and evaluation methods varied. Most studies reported provider outcomes. Twenty-one articles adequately described provider representativeness, 21 completely described curricular interventions, eight had adequate comparison groups, 27 used objective evaluations, three blinded outcome assessors, 14 reported the number or reason for noninclusion of data, and 15 reported magnitude differences and variability indexes. Studies targeted at physicians more often described providers and interventions. Most trials completely described targeted providers, had adequate comparison groups, and reported objective evaluations. Study quality did not differ over time, by journal type, or by the presence or absence of reported funding. Lack of methodological rigor limits the evidence for the impact of cultural competence training on minority health care quality. More attention should be paid to the proper design, evaluation, and reporting of these training programs.