Over the years, research in the field of cultural heritage preservation and document analysis has exponentially grown. In this study, we propose an advanced approach for non-destructive estimation of paper fibers using macro images. Expanding on studies that implemented EfficientNet-B0, we explore the effectiveness of six other deep learning networks, including DenseNet-201, DarkNet-53, Inception-v3, Xception, Inception-ResNet-v2, and NASNet-Large, in conjunction with enlarged patch sizes. We experimentally classified three types of paper fibers, namely, kozo, mitsumata, and gampi. During the experiments, patch sizes of 500, 750, and 1000 pixels were evaluated and their impact on classification accuracy was analyzed. The experiments demonstrated that Inception-ResNet-v2 with 1000-pixel patches achieved the highest patch classification accuracy of 82.7%, whereas Xception with 750-pixel patches exhibited the best macro-image-based fiber estimation performance at 84.9%. Additionally, we assessed the efficacy of the method for images containing text, observing consistent improvements in the case of larger patch sizes. However, limitations exist in background patch availability for text-heavy images. This comprehensive evaluation of network architectures and patch sizes can significantly advance the field of non-destructive paper analysis, offering valuable insights into future developments in historical document examination and conservation science.