A lot of Reversible Data Hiding (RDH) methods aim to generate a stego image infinitely approaches the original image while the quality of the original image is leaved out of consideration. Juxtaposed with a plain image, a contrast enhanced version always improves the user experience significantly. Reversible Data Hiding with Contrast Enhancement (RDHCE) enhances the stego image contrast combined with its payloads and enables the cover image to be regained accurately after the payloads have been extracted. This study presents a novel RDHCE method using histogram expansion. First, a new local histogram selecting strategy is proposed to improve the contrast of the whole image. Meanwhile, the global average brightness is used as a reference to determine the shifting direction of the local histogram to prevent the image from being over-enhanced. Moreover, the contrast can be improved adaptively when a reasonable number of data is embedded at the selected embedding points. Experimental results show that, with a given payload, the proposed method achieves better contrast and maintains good visual quality compared with state-of-the-arts.