Strong magnetoelectric effects in single-phase two-dimensional (2D) materials are extremely rare in nature. Here by first-principles calculations, we find a strong magnetoelectric coupling in polar stacking bilayer Hf2S that allows the reversal of net magnetic moments with the reversal of electric dipoles. Further analysis shows that such strong magnetoelectric effects benefit from the Stoner instability of surface Hf atoms triggered by polar stacking. Moreover, an unexpectedly large out-of-plane electric polarization (which is at least two times larger than that of bilayer BN) survives in the material, despite its metallicity. The large electric polarization is ascribed to the delocalized interlayer electrons which generally present in layered electride materials. It is quite interesting that large electric polarization, metallicity and magnetism coexist in one single-phase material. Our findings reveal rich physical phenomena to be explored in 2D stacking multiferroics and suggest an alternative way of searching for strong magnetoelectric materials with ultrathin thickness.