Incompressible dipping substrata are commonly encountered in engineering practice. Compared to horizontal underlying strata, the inclined underlying stratum increase the risk of collapse of embankments reinforced with columns because it weakens the restraint of the column base. The objective of this study is to investigate the effectiveness of geosynthetics on improving the embankment stability when the underlying stratum is inclined. The influence of geosynthetic tensile stiffness on the ultimate surcharge and failure mechanism is studied. A deep-seated failure with column tilting occurs when the geosynthetic tensile stiffness is low, whereas a lateral sliding occurs when the geosynthetic tensile stiffness is high. To illustrate the contribution of geosynthetics, the distribution of the lateral pressures acting on the columns is analyzed.