Medical image classification technology, preferably which is based on the deep learning, is not only a key auxiliary diagnosis and treatment method in clinical medicine but also an important direction of scientific research. With the intensification of social aging, the incidence of viral elderly pneumonia has been on the rise and needs dedication from the research community. Doctors rely on personal theories and experience to use traditional methods to check the computed tomography (CT) images of the lungs of elderly patients one by one, which is likely to cause diagnosis errors. The accuracy of the traditional method certainly meets the clinical needs, but it has higher requirements on the theory and experience of medical staff, and the classification efficiency is low. Constructing an accurate and fast auxiliary system can effectively save medical resources. In response to the above problems, we have proposed a viral pneumonia diagnosis method for lung CT images, which is based on the convolutional neural networks. The main research work is carried out around the following aspects: First, in the lung CT image classification task, the traditional methods are inefficient and effective for doctors. The basic quality requirements of the model are high, or, in the model training, the effective training data are small, and so forth, causing problems such as model overfitting. A lung CT classification model based on the improved Inception-ResNet is proposed. In this model, first the overall architecture of the network model is designed, and then the Contrast-Limited Adaptive Histogram Equalization (CLAHE) algorithm is used to perform the same image enhancement processing on the dataset and data needed in this article, and then the pictures pass through three different network models. A binary classification study was carried out on viral pneumonia and normal lung images, and finally the accuracy, sensitivity, and specificity of the three models were compared. The experimental results show that the accuracy of the three models for the judgment of viral pneumonia is more than 95%. Among these, the model proposed in this article has better classification effect and fit, the highest accuracy rate, and less parameters and can be used for rapid screening of viral senile pneumonia. Objective. To complete the classification of lung CT images of the elderly with viral pneumonia based on the improved Inception-ResNet network architecture. Methods. (1) Find and study domestic and foreign medical literature, understand the diagnosis and treatment methods of viral pneumonia, and study lung CT imaging; compare the pattern classifications of deep learning in lung imaging at home and abroad, and further study the application of convolutional neural networks in the medical field application. (2) Study various models and technologies of convolutional neural networks, summarize them separately, and have in-depth understanding of convolutional neural networks, including architecture, methods, and related system frameworks, experimental environments, and so forth. Results. This paper proposes an optimized Inception-ResNet network architecture for image classification. The control experimental model uses two network models, GoogLeNet and ResNet, and selects the viral pneumonia dataset for training and testing. The experimental results are as follows: the sensitivity and specificity are superior to those in the other two models, which can be used for actual medical screening and diagnosis. Conclusion. The improved Inception-ResNet network model method in this paper performs better in terms of accuracy, sensitivity, and specificity. Every metric is higher than those in the ResNet model and the GoogLeNet model, improving the classification effect. In addition, it can be seen from the experimental results that the model used in this paper has a very good classification effect in the classification of new coronary pneumonia CT image data.