Brain tumor classification for MR images using transfer learning and fine-tuning

Abstract

Accurate and precise brain tumor MR images classification plays important role in clinical diagnosis and decision making for patient treatment. The key challenge in MR images classification is the semantic gap between the low-level visual information captured by the MRI machine and the high-level information perceived by the human evaluator. The traditional machine learning techniques for classification focus only on low-level or high-level features, use some handcrafted features to reduce this gap and require good feature extraction and classification methods. Recent development on deep learning has shown great progress and deep convolution neural networks (CNNs) have succeeded in the images classification task. Deep learning is very powerful for feature representation that can depict low-level and high-level information completely and embed the phase of feature extraction and classification into self-learning but require large training dataset in general. For most of the medical imaging scenario, the training datasets are small, therefore, it is a challenging task to apply the deep learning and train CNN from scratch on the small dataset. Aiming this problem, we use pre-trained deep CNN model and propose a block-wise fine-tuning strategy based on transfer learning. The proposed method is evaluated on T1-weighted contrast-enhanced magnetic resonance images (CE-MRI) benchmark dataset. Our method is more generic as it does not use any handcrafted features, requires minimal preprocessing and can achieve average accuracy of 94.82% under five-fold cross-validation. We compare our results not only with the traditional machine learning but also with deep learning methods using CNNs. Experimental results show that our proposed method outperforms state-of-the-art classification on the CE-MRI dataset.