This paper extends the reduced Yld2004 (rYld2004) function to present the anisotropic hardening behavior for body-centered cubic and face-centered cubic metals under the proportional loading conditions based on neural network. The parameters of the rYld2004 anisotropic hardening model (AH_rYld2004) are determined by the uniaxial tensile yield stresses along 0°, 15°, 30°, 45°, 60°, 75° and 90° from the rolling direction as well as equibiaxial tension. The evolution of anisotropic parameters are described by the back propagation neural network optimized by ant colony optimization algorithm. The predicted data by AH_rYld2004 and some common anisotropic models are compared with the experimental results to verify the precision of the AH_rYld2004 in characterizing anisotropic hardening. The comparison proves that the AH_rYld2004 precisely characterize the anisotropic evolution with increasing plastic deformation for AA 3003-O and QP980. Simultaneously, the AH_rYld2004 function based on neural network is used to accurately simulate of circular cup deep drawing for AA 3003-O and uniaxial tension for QP980. The results indicate that the AH_rYld2004 model is capable to accurately represent the plastic anisotropic evolution for uniaxial tension along seven loading directions and equibiaxial tension.