Since deep learning models have been successfully used in many fields, they have been used to identify sick and healthy people in X-ray or Computed Tomography (CT) chest radiology images. In this study, Covid-19 and pneumonia classification is performed on both X-ray and CT images using the robust Convolutional Neural Network (CNN). BGR, HSV, and CIE LAB color space transformations are applied to X-ray and CT images to show that the model performs a successful classification independent of dataset characteristics. The binary classification accuracy rates of Covid-19 and pneumonia for X-ray images and CT images are 98.7% and 98.4%, 97.6% and 99.4%, respectively. Precision, Recall, Specificity, F1 score, and Mean Squared Error metrics are calculated for each X-ray and CT dataset. In addition, 5-fold cross-validation proved accuracy of the model. Although X-ray and CT chest radiology images are transformed into different color spaces, the proposed model performed a successful classification. Thus, even if the image characteristics of the radiology device brands change, the computer-based system will be able to make successful disease diagnoses at low cost where expert personnel are insufficient.