This study aims to investigate the seismic behavior of thin-walled rectangular hollow reinforced concrete (RC) bridge piers through quasi-static cyclic tests. For this purpose, two identical 1:12 scale specimens were designed and tested under different loading protocols. One specimen was subjected to displacement-controlled cyclic lateral loading with a constant axial load, and the other to the same lateral loading history, but with a variable axial load. The behavior of both specimens was evaluated in terms of the damage progression and failure mode, concrete crack width, hysteretic response, backbone curve, and residual displacement. The results revealed that both specimens experienced a mixed flexure-shear damage progression from the first crack through collapse. Flexural cracks were first observed in the flange surfaces, followed by the development of shear diagonal cracks in both web surfaces. Meanwhile, both specimens exhibited stable hysteretic behavior. Then, concrete spalling and longitudinal bar buckling were concentrated at the corners of the flanges due to the shear lag effect. Eventually, both specimens collapsed as a result of the flange local compression buckling. In addition, the specimen under a variable axial load collapsed much severer than the one under a constant axial load. Ultimate drifts of the specimens under a constant or variable axial load were 2.25% and 2%, respectively. This experiment provides valuable dataset for validating advanced numerical modeling techniques for thin-walled rectangular hollow RC piers, especially the data points in the collapse stage.