We introduce a background gauge akin to the Landau-DeWitt gauge but deformed by the presence of a gauge parameter for the quantization of Euclidean Yang-Mills theories. In the limit where the background field vanishes, standard linear covariant gauges are recovered. This gauge allows for an explicit investigation of the effects of infinitesimal Gribov copies and their impact to background and gauge parameter dependence of physical correlators. Similarly to linear covariant gauges, the introduction of gauge-invariant dressed fields is essential to restore the Becchi-Rouet-Stora-Tyutin (BRST) symmetry. Hence, we construct a BRST symmetric action in linear covariant background gauges which eliminates regular infinitesimal Gribov copies in analogy to the recently introduced BRST invariant (refined) Gribov-Zwanziger action. The issue of background dependence and its relation to gauge parameter dependence is discussed in the light of nonperturbative effects driven by the elimination of Gribov copies.