Turbulence modifications over a rough wall with spanwise-varying roughness are investigated at a moderate Reynolds number Reτ ≈ 2000 (or Reθ ≈ 6400), using particle image velocimetry (PIV) and hotwire anemometry. The rough wall is comprised of spanwise-alternating longitudinal sandpaper strips of two different roughness heights. The ratio of high- and low-roughness heights is 8, and the ratio of high- and low-roughness strip width is 0.5. PIV measurements are conducted in a wall-parallel plane located in the logarithmic region, while hotwire measurements are made throughout the entire boundary layer in a cross-stream plane. In a time-average sense, large-scale counter-rotating roll-modes are observed in the cross-stream plane over the rough wall, with downwash and upwash common-flows displayed over the high- and low-roughness strips, respectively. Meanwhile, elevated and reduced streamwise velocities occur over the high- and low-roughness strips, respectively. Significant modifications in the distributions of mean vorticities and Reynolds stresses are observed, exhibiting features of spatial preference. Furthermore, spatial correlations and conditional average analyses are performed to examine the alterations of turbulence structures over the rough wall, revealing that the time-invariant structures observed are resultant from the time-average process of instantaneous turbulent events that occur mostly and preferentially in space.