Local scour and wave loading are two key factors that affect the safety of seawalls under tsunami attacks. In this study, the scouring process at the toe of and wave impact force on a vertical seawall under consecutive solitary wave attacks are simulated using a quasi-three-phase (air, water, and sediment) flow model, which models the air and water as a fluid mixture phase and sediment as a solid phase. The air and water interface is modeled by a VOF method and the sediment–fluid interaction is modeled using the Eulerian two-phase flow method. A comparison between the beach profiles with and without the seawall shows that, with a seawall, a deeper scour hole is generated at the toe of the seawall. Besides, the presence of the seawall causes the eroded sediment to be deposited further offshore. The numerical results are then analyzed in detail regarding the flow field and sediment transport process to reveal the mechanisms of the above eroding/depositing patterns. The wave impact force on the seawall is also analyzed to understand the effect of scouring on the wave loading. It is shown that the wave impact force, despite being stochastic for a specific wave, increases in general with the deepening of the scour hole because the latter increases the exposure of the seawall to wave slamming.