Calcium oxalate kidney stones, the most prevalent type of kidney stones, undergo a multi-step process of crystal nucleation, growth, aggregation, and secondary transition. The secondary transition has been rather overlooked, and thus, the effects on the disease and the underlying mechanism remain unclear. Here, we show, by periodic micro-CT images of human kidney stones in an ex vivo incubation experiment, that the growth of porous aggregates of calcium oxalate dihydrate (COD) crystals triggers the hardening of the kidney stones that causes difficulty in lithotripsy of kidney stone disease in the secondary transition. This hardening was caused by the internal nucleation and growth of precise calcium oxalate monohydrate (COM) crystals from isolated urine in which the calcium oxalate concentrations decreased by the growth of COD in closed grain boundaries of COD aggregate kidney stones. Reducing the calcium oxalate concentrations in urine is regarded as a typical approach for avoiding the recurrence. However, our results revealed that the decrease of the concentrations in closed microenvironments conversely promotes the transition of the COD aggregates into hard COM aggregates. We anticipate that the suppression of the secondary transition has the potential to manage the deterioration of kidney stone disease.