A compact and high-rejection ultra-wideband (UWB) microstrip band-pass filter is proposed by using the multi-mode resonator (MMR) technique. The proposed MMR structure is realized by three open stubs-loaded and two short stubs-loaded and a high impedance microstrip line. Five modes, including two odd modes and three even modes could be designed within the UWB band. By resizing the dimensions of the stubs, the resonant modes of the MMR structure are arranged wider bandpass which the passband selectivity with this configuration significantly improved. By this configuration, the even modes can be flexibly controlled, while the odd modes remain the same. The proposed filter has a passband covers 4.1–10.6 GHz and its measured 3 dB fractional bandwidth is about 89%. In order to validate the performance of the proposed technique, the designed UWB band-pass filter is fabricated and the experimental verification is provided. A good agreement has been found between simulation and measurement’s results. To our knowledge, the size of the proposed UWB filter is small in comparison with known similar filters.