Sky radiative cooling is a kind of passive cooling technology that uses the “atmospheric window” to emit the object’s own heat to the low temperature of outer space; this technology has low energy consumption, no pollution, and other useful characteristics, so in recent years it has attracted widespread attention. The cooling effect of the sky radiative cooler is mainly affected by the constantly changing outdoor ambient temperature. In addition, the structure of the radiative cooler itself also means that its radiative cooling power undergoes obvious changes. Here, we utilized COMSOL simulation software to establish a numerical heat transfer model for radiative cooling, aimed at investigating the influencing factors on the sky radiative cooler and methods to enhance the structure of the radiative cooling. This study discusses outdoor ambient wind speed, the inlet flow rate of the cooler, installation angle of the cooler, and different cooler structures. Based on simulation results, it is observed that, for varying wind speeds, when the ambient radiation temperature is higher than the surface temperature of the cooler, a larger ambient wind speed leads to a poorer refrigeration effect. The maximum temperature difference in surface temperature at wind speeds of 0 m/s and 4 m/s is 0.59 °C. When the ambient temperature is lower than the surface temperature of the cooler, a smaller wind speed results in a greater net refrigeration power. The maximum temperature difference in this scenario is 0.32 °C. The net refrigeration power of the radiative cooler increases with an increase in water flow rate. As the water flow rate increases from 0 L/min to 5 L/min, the net refrigeration power increases from 25 W/m2 to 200 W/m2 and gradually stabilizes. Considering the radiative impact of the cooler on the surrounding environment, as the installation angle increases from 0° to 90°, the surface temperature of the cooler first increases and then decreases, reaching its highest temperature of 29.26 °C at 45°. The surface temperature of the cooler varies with the thickness of the air sandwich, increasing from 1 cm to 12 cm, and then decreasing. The lowest temperature of 23.4 °C is achieved at a thickness of 8 cm. The increase in the fin structure on the surface of the radiative cooler leads to a decrease in its refrigeration performance, and the difference between the inlet and outlet temperatures of the radiative cooler with a flat plate structure is always greater than that of the finned plate, and the difference in the average radiance is 23.52 W/m2. Finally, the energy-saving effect of the sky radiative cooling composite system is analyzed. Taking a typical small office building as an example, an energy consumption analysis model is set up, and the energy consumption of the composite system is simulated in four cities with different climates, using EnergyPlus software (version 8.6); the system’s power consumption is the largest in hot and humid climates. Compared with the traditional vapor-compression refrigeration system, the composite system reduces air conditioning power consumption by 25.7%, 32.5%, 37.1%, and 44.8% in Guangzhou, Shanghai, Jinan, and Shenyang, respectively. The main innovations of this paper include analyzing and studying the influence of the tilt angle change of the radiative plate on the refrigeration performance of the cooler and the relationship between the surrounding buildings, adding air sandwiches and ribs to the radiative cooler to analyze the influence of convective heat transfer on the refrigeration effect, which plays a guiding role in the design and research of the sky radiative cooler.