• Solves the overfitting issue in the Convolution Neural Networks . • The proposed fully connected dilation unit enhances small and low-level features. • Accurate cancerous cell Detection using dilated model. • The proposed model solves the issue of desegregation. • Efficiently removal of redundant and similar features through proposed model. Breast cancer is the most significant cause of mortality among women. When detected and treated early, it saves lives. Breast cancer detection is becoming more accessible and accurate thanks to machine learning and deep learning models. This research aims to enhance medical science and technology by employing a deep learning model to detect small cancer cells with pinpoint accuracy. The proposed model uses datasets from the Breast Cancer Histopathological Image Classification (BreakHis) and Breast Cancer Histopathological Annotation and Diagnosis (BreCaHAD). Next, the image processing procedure employs strain normalization to rectify color divergence caused by using different slide scanners, staining processes, and biopsy materials. The data augmentation with nineteen parameters such as scaling, rotation, flip, resize, and gamma value tackles the overfitting problems. The augmented images are then processed using the dilated residual (DR) model; the DR model combines the proposed dilated spatial convolution unit, fully connected dilation unit, and dilated channel convolution. The first unit is the dilated spatial convolution, which handles all channels equally and amplifies the valuable aspects. The second unit is a fully connected dilation unit; it displays low-level properties such as edges, contours, and color. The third unit is dilated channel convolution, which detects tiny objects and thin boundaries without adding complexity. The proposed dilated residual grooming kernel (DRGK) model is a 14-layer deep learning model that stretches the receptive field while retaining feature information, using the proposed DR unit and ghost model, as well as convolution, pooling, downsampling, and dilated convolution. Dilated convolutions are extensively used in the proposed model to extract features. Accuracy, the area under the curve, average precision score, precision, sensitivity, and f1 score all improve with a learning rate of 0.001. With 96.33% and 93.35% marks, the proposed approach surpasses several state-of-the-art methods.