In the medical image analysis field, brain tumors (BTs) classification is a complicated process. For effortlessly detecting the tumor devoid of any surgical interference, the radiologists are aided with automated along with computerized technology. Currently, in the field of medical image processing along with analysis, admirable progress has been made by deep learning (DL) methodologies. In medical fields, for resolving several issues, huge attention was paid to DL techniques. For automation of several performed by radiologists like (1) lesion detection, (2) segmentation, (3) classification, (4) monitoring, along with (5) also prediction of treatment response that is not achievable without software, DL might be wielded. Nevertheless, classifying BTs by utilizing magnetic resonance imaging (MRI) has various complications like the difficulty of brain structure along with the intertwining of tissues in it; additionally, the brain’s higher density nature also makes the BT Classification (BTC) process quite complex. Therefore, by utilizing novel systems, MRI-centric Automatic segmentation together with classifications of BT and swelling have been proposed to overcome the aforementioned issues. The proposed methodology underwent various operations to detect BTs effectively. Initially, by utilizing the Range-centric Otsu’s Thresholding (ROT) algorithm, the skull stripping (SS) is conducted. After that, by performing contrast enhancement (CE) along with noise removal, the skull-stripped images are pre-processed. Next, by employing the Rectilinear Watershed Segmentation (RWS) algorithm, the tumor or swelling areas are segmented. Afterward, to obtain the precise tumor or swelling region, the morphological operations are executed on the segmented areas; subsequently, the desired along with relevant features are extracted. Lastly, the features being extracted are inputted to the classifier termed Uniform Convolution neural network (UCNN). The tumor tissues along with the swelling tissues are classified precisely in the classification phase. Here, the openly accessible BT Image Segmentation Benchmark (BRATS) datasets are utilized. Then, the outcomes obtained are analogized with prevailing methodologies. The experiential outcomes displayed that the BTC is performed by the proposed model with a higher accuracy rate; thus, outshined the other prevailing models.