Size is the most important and valuable quality of the cultured black-lip pearl, Pinctada margaritifera. As this pearl aquaculture is carried out at numerous grow-out sites, this study analyzes the environmental influence on pearl size parameters (nacre weight and thickness) in relation to the recipient oyster biometric parameters (shell thickness, height, width, and oyster weight) at harvest time. Toward this end, an experimental graft was designed by using a homogeneous donor oyster phenotype. The recipient oysters were randomly and equally transferred and reared in five commercial and contrasting grow-out locations. Overall inter-site comparisons revealed that the cultured pearl size (N = 2168) and the biometric parameters of the recipient oysters were highest for sites with warmer temperatures with low seasonal variation in comparison to the southern latitude sites. These results were supported by positive correlations between pearl nacre thickness and recipient oyster shell thickness, height, and width. In parallel, the biomineralization potential of the mantle graft was screened through four genes encoding aragonite (Pif 177, MSI60) and calcite (shematrin 9, aspein). As the gene expression levels were the same among all the donor oysters, this finding demonstrates that: 1) the pearl sac that originated from the mantle graft was not isolated from environmental variations during the culture period and 2) the phenotypic expressions of the two biomineralizing tissues in the recipient oyster were consistent (shell and pearl). In the near future, this knowledge will be helpful at the production sites of genetically selected donor oyster lines for growth produced in hatchery systems.