Data assimilation can reduce the model-form errors of RANS simulations. A spatially distributed corrective parameter field can be introduced into the closure model, whose optimal values can be efficiently found by an adjoint method and gradient-based optimization. When assimilating experimental data, which in most cases are sparsely distributed or based on a low-resolution grid, the inverse problem is highly underdetermined and thus ambiguous. Therefore, to reduce the ambiguity, regularization is required. Established regularization approaches such as total variation and Sobolev gradient methods can produce smooth and physically meaningful velocity fields in many cases. However, if the measurements are located close to walls, spiky and unphysical wall shear stress profiles can occur. A new regularization strategy based on a piecewise linear approximation of the corrective field is proposed. This method is shown to lead to a very accurate free stream velocity field and smooth wall shear stress profiles. The resulting skin friction drag error for the case of flow over periodic hills was around 1.38% which is seven times lower than the error obtained with the Sobolev gradient and two orders of magnitude lower than that obtained with the other two methods.