The structural response of a building on soft or loose soil differs from that on hard and rocky soil. Investigating the behaviour of buildings with shear walls on such soft soil is essential. This study considers four structural models of the nine-storied building with and without infill walls. The modelled buildings represent the existing buildings in the Patna, India region. The frame was analysed in four different conditions: (1) Fixed base bare frame building, (2) Flexible base bare frame building, (3) Fixed base building with shear walls (4) Flexible base building with shear walls. Twenty-four pairs of scaled ground motion from the PEER Ground Motion Database were selected, and a nonlinear time history analysis was performed in SAP2000v20.0. Understanding that soil-structure interaction is paramount for building on soft soil, the study quantified the seismic response for the building in the Patna region, a region of high seismicity.Moreover, in current scenarios, multistorey buildings with an open ground storey and shear walls are prevalently found owing to their advantage for parking and enhancing the seismic capacity. The result shows that base flexibility significantly increases the peak floor displacement, total floor acceleration, inter-storey drift and displacement ductility for bare frame structures. At the same time, consideration of shear and infill walls only affects the flexible base structures. While shear and infill walls significantly affect the seismic behaviour of the fixed base structure. It was also found that the shear and infill walls increase the structure’s stiffness and thus reduce the fundamental vibration period of the structure. The study’s significant findings are (1) the shear and infill wall significantly reduces the seismic responses of the building, (2) base flexibility (SSI) increases the seismic vulnerability of the buildings, (3) the displacement ductility significantly depends on the aspect ratio (height/width) of the building, and (4) the inter-storey drift is relatively higher in the lower and mid storey of buildings.