Digital twin (DT) is capable of managing, simulating, and future performance prediction of existing infrastructures by integrating three-dimensional (3D) geometric model and finite element (FE) model. This study aims to automatically generate geometric DT of existing RC members using point clouds and incorporate damages detected from images into FE models. An edge-based modeling method was proposed to extract sharp features for geometry reconstruction with incomplete point clouds, and an automated procedure was established for registering images to point clouds, mapping cracks detected in images to FE models, and assigning reduced material properties. Four RC beams were tested in a laboratory to validate the proposed method. Existing cracks were found to have a significant effect on structural capacity and failure mode. The results also showed that the developed FE model produced a good agreement between experimental and predicted failure loads while providing a more efficient and time-saving assessment protocol.