Groundwater sources have been exploited excessively for numerous purposes worldwide, leading to increasingly severe depletion. However, the replenishment of groundwater sources has not usually been a focus in economically and socially underdeveloped countries and regions. In coastal provinces of the Vietnamese Mekong Delta (VMD), rural areas are facing difficulties in accessing fresh water due to shortages from the water supply plant and excessive use of groundwater, highlighting an urgent need for sustainable development solutions. Our study first conducted interviews with 200 households in Ca Mau Province of the VMD to identify the current situation and the challenges and obstacles of rainwater harvesting and to find sustainable and proactive solutions. We then analyzed daily rainfall data from 10 meteorological stations to construct four scenarios of the water balance method: (i) potential rainwater harvesting based on existing roof area; (ii) optimal scale of storage tank and catchments for different levels of water usage; (iii) tank scale utilizing rainwater entirely during the rainy season and basic needs during the dry season; and (iv) integrated water supply between rain and groundwater. The results showed that using rainwater entirely for domestic water supply requires large storage tank capacities, making these scenarios difficult to achieve in the near future. Our research introduces a novel integrated water supply approach to storing rain and groundwater that has demonstrated high effectiveness and sustainability. With existing tank capacities (0.8 m3 per person), rainwater could only meet over 48% (14 m3 per year) of the water demand while requiring 14.8 m3 of additional groundwater extraction. With a tank capacity of 2.4 m3 per person, ensuring rainwater harvesting meets basic demand, harvested rainwater could satisfy 64% of the demand, with artificial groundwater supplementation exceeding 1.79 times the required extraction, while excess rainwater discharge into the environment would be minimal. Our research results not only provide potential solutions for rainwater and groundwater collection to supplement sustainable domestic water sources for Ca Mau but also serve as an example for similar regions globally.