As temperature changes, red clay is prone to shrink and generate cracks, which weaken the structure and the stability of soil mass, leading to various engineering problems, such as damage and instability in engineering structures. To study the effect of environmental temperature on the crack evolution of red clay, Guilin Red Clay was taken as the research object, and the saturated mud samples were dried at 23, 40, and 60 °C respectively. During the drying process of the samples, the change of moisture content and the evolution process of surface cracks were monitored by high-definition automatic photographing and a weighing device, which were also improved. We used PCAS software to process the crack image, extract various geometric elements, observe, and analyze the change rule of the cracks during the drying process of red clay at different temperatures. The test results show that the cracking evolution of red clay at different temperatures is mainly divided into three stages: (i) the initiation of micro cracks; (ii) crack progress; and (iii) crack stability. With the increase of environmental temperature, stage (i) took less time. Meanwhile, the growth rate of the crack area increased. The number of final crack blocks of soil is significantly reduced. Moreover, the final crack rate is obviously increased. When the temperature is either 23 °C or 40 °C, the initial cracks almost happen at the same time in the samples with different diameters. While the temperature is higher than 60 °C, the cracking time will delay with the increase of the diameter. In addition, the decrease in water content leads to a decrease in the curvature radius of soil particles. Under the joint action of the surface tension and the matrix suction, the distance between red clay particles becomes shorter, so the time for red clay to start to generate cracks will be shorter, and the final crack rate will increase with the increase in temperature.