Crosslinker (polyvinylsilicone oil, C gum) and curing agent (2, 5-bis (tert-butyl peroxy)-2, 5-dimethyl hexane, DBPMH) were used to change the crosslink density of the thermal conductivity of silicone rubber filled with Al2O3. The results show that the thermal conductivity of silicone rubber changed with its degree of crosslinking. When the Al2O3 loading was 5 vol. % and a completely continuous conducting network had not formed, the thermal conductivity of the vulcanizates decreased with increasing crosslink density. The thermal conductivity of the vulcanizate with a suitable amount of C gum increased to 53%, and the tensile strength increased by 0.8 MPa compared to the vulcanizate without C gum. When the Al2O3 loading was 30 vol. % and a completely continuous conducting network had formed, the crosslink density of vulcanizates changed as the amount of DBPMH changed. The thermal conductivity of vulcanizates first decreased and then increased with increasing crosslink density. There was a valley value in the thermal conductivity–crosslink density curve.