Results of a human observer performance study using a new ultrasound contrast-detail (CD) phantom are reported. The new phantom allows estimates of the fundamental statistical uncertainties involved in CD analysis. Results of these experiments show that observers generally considered to be "trained" require experience at the specific task of low-contrast target detection under signal known exactly (SKE) conditions, and that observers require an orientation period at the beginning of each observation session to obtain stable responses. The results obtained in this study can be used to estimate the number of independent images, observers, and repeat observation sessions required for a desired uncertainty in CD curves, and show that 10% fractional standard deviations are obtainable with modest observer effort.