The failure modes and mechanisms of single and polycrystalline aluminum under different stress states are very different. Therefore, molecular dynamics methods were used to study the tension-compression asymmetry and Bauschinger effect of single and polycrystalline aluminum under different loads. We found both single and polycrystalline aluminum exhibit work hardening under tensile and compressive loads. The difference in this hardening phenomenon is manifested in that the characteristics of single and polycrystalline aluminum are brittle fracture and ductile fracture, respectively. Furthermore, we found that the tension-compression asymmetry of polycrystalline aluminum is more obvious than that of single crystal aluminum, and it manifested as a reverse tension-compression asymmetry. The Bauschinger effect is caused by the defects introduced by preloading, and the asymmetry of the Bauschinger effect is caused by different microscopic defects. Dislocations introduced by the pre-stretching of single crystal aluminum degrade its performance under reverse loading. Polycrystalline aluminum has more twinned regions under compressive load, which hinder the movement of dislocations and grain boundaries during reverse stretching, showing the reverse Bauschinger effect. This study has important theoretical guiding significance for a comprehensive and in-depth understanding of the mechanical properties and microstructural evolution mechanism of single and polycrystalline aluminum.