The large amount of construction waste produced by the construction industry brings severe natural resource consumption and environmental pollution, elevating the awareness of sustainable development. Recycled aggregate concrete, crushed from construction waste, is recognized as an eco-friendly material and the current optimal solution for the environmental problem. The interface shear failure between substrate recycled coarse aggregate concrete (RAC) and overlay natural aggregate concrete becomes vital for structural safety. In order to study the direct shear performance, a total of 19 specimens were designed to carry out the direct shear test with different replacement ratios, interface types and curing ages. The whole process and failure mode were recorded. The relationships between the shear capacity and deformation, ductility, damage evolution, and energy dissipation were evaluated and discussed. The results demonstrate that the RAC component in the interface was the weak line in the shear plane, accelerating the damage evolution. In the early curing stage, the replacement ratio had a slight influence on the shear properties. Increasing the recycled aggregate replacement ratio from 0 to 100% improved the normalized strength ratio by 8.94% and 14.62%, respectively, for curing ages of 3 days and 7 days. A regression equation was proposed to predict the shear strength, accounting for the curing ages. With the increase in the replacement ratio, the ductility and energy dissipation gradually enhanced.