Multiple-instance CNN Improved by S3TA for Colon Cancer Classification with Unannotated Histopathological Images

Abstract

In this paper, we propose a new method for colon cancer classification from histopathological images, which can automatically analyze a given whole slide image (WSI). We usually classify cancer classification by referring a WSI, which is typically 20000 × 20000 pixels. The cost of obtaining WSIs with annotating cancer regions is very high. Multiple-instance learning (MIL) is a variant of supervised learning in which the instances in a bag share a single class label. That is, MIL only needs unannotated WSI. In recent years, MIL has developed a hard attention mechanism which has achieved good performance. However, this hard attention mechanism cannot notice the interior of each patch, i.e., it lacks soft attention mechanism. In this paper, a soft, sequential, spatial, top-down attention mechanism (which we abbreviate as S3TA) is used to make up for the lack of MIL attention mechanism. Finally, our experiments show that by varying the number of attention steps in S3TA, we achieved a better accuracy of 93.6% than the old model.