This paper deals with a modified anisotropic stress-state-dependent plastic-damage continuum model incorporating combined hardening and softening rules to predict the plastic, damage, and fracture behavior of ductile metals under monotonic and reverse loading conditions. In the experimental part, a newly designed biaxially loaded cruciform flat HC-specimen of aluminum alloy EN AW 6082-T6 was subjected to biaxial non-proportional loading to generate a wide range of stress triaxialities during experiments. Thus, it is enabled to perform shear monotonic and reverse loading superimposed by various preloads without unloading processes. The experimental data reveal the Bauschinger effect, the strength-differential (SD) effect, and the change in the hardening ratio after shear reverse loading. This is captured by a Drucker–Prager-type yield criterion with an extended Voce isotropic hardening and modified Chaboche’s kinematic hardening rule. In addition, the damage surface is assumed to be translated in the direction of the rate of the damage strain. The numerically predicted global force–displacement curves and local strain fields are verified in terms of the digital image correlation (DIC) technique. Moreover, the scanning electron microscopy (SEM) is used to examine the fracture surfaces and to validate the proposed damage constitutive model.