Recent studies have revealed intriguing similarities between the contribution of wormholes to the gravitational path integral and the phenomenon of replica symmetry breaking observed in spin glasses and other disordered systems. Interestingly, these configurations may also be important for the explanation of the information paradox of quantum black holes. Motivated by these developments, we investigate the thermodynamic properties of a $PT$-symmetric system composed of two random non-Hermitian Hamiltonians with no explicit coupling between them. After performing ensemble averaging, we identify numerically and analytically a robust first-order phase transition in the free energy of two models with quantum chaotic dynamics: the elliptic Ginibre ensemble of random matrices and a non-Hermitian Sachdev-Ye-Kitaev (SYK) model. The free energy of the Ginibre model is temperature independent in the low-temperature phase. The SYK model has similar behavior for sufficiently low temperature, and then it experiences a possible continuous phase transition to a phase with a temperature-dependent free energy before the first-order transition takes place at a higher temperature. We identify the order parameter of the first-order phase transition and obtain analytical expressions for the critical temperature. The mechanism behind the transition is the existence of replica symmetry breaking configurations coupling left and right replicas that control the low-temperature limit of the partition function. We speculate that quantum chaos may be necessary for the observed dominance of off-diagonal replica symmetry breaking configurations in the low-temperature limit.