An interpretable neural network-based non-proportional odds model for ordinal regression

Abstract

This study proposes an interpretable neural network-based non-proportional odds model (N3POM) for ordinal regression. N3POM is different from conventional approaches to ordinal regression with non-proportional models in several ways: (1) N3POM is defined for both continuous and discrete responses, whereas standard methods typically treat the continuous variables as if they were discrete, (2) instead of estimating response-dependent finite-dimensional coefficients of linear models from discrete responses as is done in conventional approaches, we train a non-linear neural network to serve as a coefficient function. Thanks to the neural network, N3POM offers flexibility while preserving the interpretability of conventional ordinal regression. We establish a sufficient condition under which the predicted conditional cumulative probability locally satisfies the monotonicity constraint over a user-specified region in the covariate space. Additionally, we provide a monotonicity-preserving stochastic (MPS) algorithm for effectively training the neural network. We apply N3POM to several real-world datasets.