Because of the crucial role of collagen fibers on soft tissue mechanics, there is great interest in techniques to incorporate them in computational models. Recently we introduced a direct fiber modeling approach for sclera based on representing the long-interwoven fibers. Our method differs from the conventional continuum approach to modeling sclera that homogenizes the fibers and describes them as statistical distributions for each element. At large scale our method captured gross collagen fiber bundle architecture from histology and experimental intraocular pressure-induced deformations. At small scale, a direct fiber model of a sclera sample reproduced equi-biaxial experimental behavior from the literature. In this study our goal was a much more challenging task for the direct fiber modeling: to capture specimen-specific 3D fiber architecture and anisotropic mechanics of four sclera samples tested under equibiaxial and four non-equibiaxial loadings. Samples of sclera from three eyes were isolated and tested in five biaxial loadings following an approach previously reported. Using microstructural architecture from polarized light microscopy we then created specimen-specific direct fiber models. Model fiber orientations agreed well with the histological information (adjusted R2's>0.89). Through an inverse-fitting process we determined model characteristics, including specimen-specific fiber mechanical properties to match equibiaxial loading. Interestingly, the equibiaxial properties also reproduced all the non-equibiaxial behaviors. These results indicate that the direct fiber modeling method naturally accounted for tissue anisotropy within its fiber structure. Direct fiber modeling is therefore a promising approach to understand how macroscopic behavior arises from microstructure.