The early design parameters exert a considerable influence on the cooling energy demand of a granary building in operation. In order to investigate the impact of various parameters on energy use, a grain warehouse energy model was constructed using the Ladybug + Honeybee tools on the Grasshopper platform. Three global energy sensitivity methods were used to analyze the model, and the sizes of the influential parameters were determined and ranked. The study uncovered that the cooling energy demand of the grain warehouse was primarily influenced by factors such as the cooling set-point temperature, roof solar absorptance, roof and exterior wall insulation thickness, window type, and orientation. On this basis, a local sensitivity analysis was conducted for the highly sensitive parameters to identify their influence trend and optimal design range. The results showed that the cooling energy demand of the grain warehouse increases faster as the cooling set-point temperature decreases, with the highest growth rate occurring at a temperature below 18 °C. Lower solar absorptance of the roof is conducive to reducing the cooling energy demand of the grain warehouse. When the thickness of the roof thermal insulation is less than 120 mm and the thickness of the external wall thermal insulation is less than 60 mm, energy use decreases more quickly with greater insulation thickness. It is advisable to use traditional or new windows with thermal insulation and shuttered windows. Furthermore, the optimal position of the long side of the granary was between 10° west and 10° east of north. This research could provide guidance for the energy-saving design and renovation of granary buildings in cold regions of China.