There are a substantial number of residential buildings situated in summer hot and winter cold climate zone of China, with tremendous energy consumption. In this work, we proposed a novel passive double-heating and double-cooling system, and integrated it into the residential buildings within this climate zone, aiming at improvement of the building energy efficiency. The proposed passive system includes a passive double-heating system (i.e., solar heating and water-to-air heating) and a passive double-cooling system (i.e., vegetation transpiration cooling and water-to-air cooling). Furthermore, a stand-alone residential building was selected as the study building, to evaluate its energy efficiency by applying the proposed passive system. Due to the passive system with double-heating and double-cooling functions, the indoor thermal comfort in the study building can be improved more significantly, in comparison with the base case. Moreover, a novel hydraulic-driven ventilation device was designed as an air-driven apparatus for the proposed passive system. Through air movement driven by the solar chimney and the hydraulic-driven ventilation device, the proposed passive system can be run without energy supply, under both the clear and rainy weather conditions. According to the numerical modeling, a total annual energy saving of 5523.42 kWh (i.e., energy saving rate of 39%) was achieved in the novel building, compared to the base case. This work focused on the passive double-heating and double-cooling system is expected to fill the knowledge gap in the building energy saving field.