Multilevel probit regression for 3-alternative forced choice audibility testing

Abstract

A recent psychoacoustic test at NASA Langley generated a dataset of 3-alternative forced-choice responses for 40 subjects that measured the audibility of a tone complex in a shaped broadband masker. The task was completed by four subjects at a time in a small theatre-like environment using predetermined stimuli levels. These data were subject to 4 forms of probit regression: a “complete pooling” analysis in which all data from the test was fit with one curve, two forms of “no pooling” analyses in which subjects’ data were treated individually (using both packaged and custom software), and a “partial pooling” analysis in which multilevel-regression software fit both individual curves as well as population-level parameters at the same time. The results of the analyses are compared in terms of both individual- and population-level parameters. Partial pooling appears to give the most consistent results at both levels, as well provide the most robustness among the packaged approaches (albeit with added complexity over single-level regression). These results mirror those contained in a recent NASA technical memorandum entitled “Comparisons of Analysis Methods Applied to Alternative Forced Choice Audibility Data.”