Subjective assessment of frequency distribution histograms and consequences on reference interval accuracy for small sample sizes: A computer‐simulated study

Abstract

Inaccuracy in estimating reference intervals (RIs) is a problem with small sample sizes. This study aimed to identify the most accurate statistical methods to estimate RIs based on sample size and population distribution shape. We also studied the accuracy of sample frequency distribution histograms to retrieve the original population distribution and compared strategies based on the histogram and goodness-of-fit test. The statistical methods that best enhanced accuracy were determined for various sample sizes (n=20-60) and population distributions (Gaussian, log-normal, and left-skewed) were determined by repeated-measures ANOVA and posthoc analyses. Frequency distribution histograms were built from 900 samples of five different sizes randomly extracted from six simulated populations. Three reviewers classified the population distributions from visual assessments of a sample histogram, and the classification error rate was calculated. RI accuracy was compared among the strategies based on the histograms and goodness-of-fit tests. The parametric, nonparametric, and robust methods enhanced lower reference limit estimation accuracy for Gaussian, log-normal, and left-skewed distributions, respectively. The parametric, nonparametric bootstrap, and nonparametric methods enhanced the upper limit estimation accuracy for Gaussian, log-normal, and left-skewed distributions, respectively. Regardless of sample size, sample histogram assessments properly classified the original population distribution 71% to 93.9% of the time, depending on the reviewers. In this study, the strategy based on histograms assessed by the statistician was significantly more precise and accurate than the strategy based on the goodness-of-fit test (P<0.001). A strategy based on histograms might enhance the accuracy of RI estimations. However, relevant inter-reviewer variations in histogram interpretation were detected. Factors affecting inter-reviewer variations should be further explored.