Degradation in the energy spread of accelerated protons due to the transverse instability induced transparency is one of the critical issues in the laser-driven radiation pressure acceleration (RPA) scheme. This issue is more severe for linearly polarized lasers due to enhanced heating of electrons. Therefore, in spite of being experimentally challenging, most of the numerical studies are performed with circularly polarized lasers. In this work, through particle-in-cell simulations, we demonstrate a significant improvement in the energy spread of the accelerated protons when a multilayered target is irradiated by a linearly polarized laser. This multilayered target consists of a near-critical-density (NCD) layer, sandwiched between a thick metallic foil and a thin RPA target. The role of the NCD target is to suppress the laser transparency to increase the coupling of laser momentum to the RPA protons. On the other hand, the metallic foil utilizes the kinetic energy of the escaping fast electrons to form an electrostatic sheath to filter the low-energy RPA protons. This results in significant improvement in the accelerated proton spectrum, even with a linearly polarized laser.