To promote the application of special-shaped concrete-filled rectangular steel tubular (SCFRT) columns in high-rise residential buildings, this paper proposed innovative SCFRT column frame-buckling restrained steel plate shear wall structure. Three sets of 1:2 scale structural model specimens with a single span and two stories were designed and tested under the quasi-static load. The connection form between the frame and the shear wall includes four-side connection, four-corner connection, and groove connection. The hysteretic performance of the specimens was evaluated, and the mechanical properties were analyzed. The parametric analysis was carried out by the verified finite element model. The results revealed that the SCFRT columns frame-buckling restrained steel plate shear wall structure has favorable seismic performance, and the connection form significantly affects the mechanical properties of the structure. The bearing capacity and stiffness of the four-side connection form are relatively prominent, while the groove connection and four-corner connection have better ductility. The results can guide the engineering application to choose the proper connection form between the frame and the shear wall.