This study developed an advanced three-dimensional spatial model to examine the behavior of Recycled Aggregate Concrete (RAC) frame structures using sophisticated nonlinear beam-column fiber elements. It thoroughly investigates the dynamic properties such as natural frequency, vibration modes, and stiffness of RAC structures and conducts a detailed nonlinear dynamic analysis focusing on acceleration, displacement, drift, and hysteresis curves. The seismic resilience of RAC structures, especially inter-story drift under various seismic intensities, was evaluated and compared with Natural Aggregate Concrete (NAC) structures by adjusting the concrete material model parameters in the finite element framework. The accuracy of the numerical model was validated against shaking table tests, showing that RAC and NAC structures comply with structural damage criteria across seismic phases from 0.066 g to 1.170 g. The findings suggest RAC structures are as seismically resilient as NAC ones, making them suitable for earthquake-prone areas.