On a black hole effect in bilinear curve resolution based on least squares

Abstract

AbstractLeast squares‐based estimations lay behind most chemometric methodologies. Their properties, though, have been extensively studied mainly in the domain of regression, in relation to which the effect of well‐known deleterious factors (like object leverage or data distributions deviating from ideal conditions) on the accuracy of the prediction of an external response variable has been thoroughly assessed. Conversely, much less attention has been paid to what these factors might yield in alternative scenarios, where least squares approaches are still utilised, yet the objectives of data modelling may be very different. As an example, one can think of multivariate curve resolution (MCR) problems which are usually addressed by means of multivariate curve resolution‐alternating least squares (MCR‐ALS). In this respect, this article wants to offer a perspective on the basic principles of MCR‐ALS from the regression point of view. In particular, the following critical aspects will be highlighted: (i) in the presence of minor components, if the number of analysed data points is too large, the leverage of those that may be essential for a MCR‐ALS resolution might become too low for guaranteeing its correctness, and (ii) in order to overcome this black hole effect and improve the accuracy of the MCR‐ALS output, data pruning can be exploited. More in detail, this communication will provide a practical illustration of such aspects in the field of hyperspectral imaging where even single experimental runs may lead to the generation of massive amounts of spectral recordings.