Detection of a fish's eye, tail and body is the initial process in the vision system for determining the freshness and species of fish, as well as calculating the number of fish automatically in the fishing industry. Classification performance of a system is affected by its ability to detect the intact body of a fish or its body parts. The You Only Look Once version 4 tiny (Yolov4-tiny) is a lightweight object detector that can detect body parts of a fish with fairly good detection accuracy. However, massive siltation of convolution layer in the Yolov4-tiny backbone leads to low feature diversity. This research proposes a modification of the Yolov4-tiny architecture to improve detection accuracy by enhancing and balancing feature diversity and attaching an extra-branch detector to detect small-sized objects. In addition, we propose the use of bottleneck and expansion convolution to reduce computational resources usage. Our contributions are enhancing feature diversity using a wing convolution layer (WCL), balancing feature diversity using tiny spatial pyramid pooling (Tiny-SPP), reducing computational resources of feature pyramid network (FPN) connections using bottleneck and expansion convolution (BEC), and detecting small objects using an extra-branch as a third-scale detector. Our experimental results show that the proposed model outperforms the original model and other modified Yolov4-tiny models with Precision, Recall, AP, and mAP of 97.48%, 93.3%, 94.07%, and 92.38% respectively. The proposed model is smaller in size and more efficient in the use of computing resources.