AbstractBy using kinematic state information obtained through vehicle‐to‐vehicle communications, connected autonomous vehicles (CAVs) can drive cooperatively to alleviate shockwave propagation associated with traffic disturbances. However, during the transition to full autonomy, CAVs and human‐driven vehicles (HDVs) will coexist on the road, creating mixed‐flow traffic. The inherent heterogeneity and randomness in human driving behavior can generate additional disturbances in the traffic flow. Further, HDVs without communication functionality (unconnected HDVs) can cause the control performance of CAVs to degrade by negatively impacting platoon formation. To proactively mitigate the negative impacts of HDVs in mixed‐flow traffic, this study proposes a cooperative control strategy with three components for platoons consisting of CAVs and unconnected HDVs: (i) a number estimator for estimating the number of HDVs between two CAVs, (ii) a kinematic state predictor for predicting the kinematic states of HDVs, and (iii) a multi‐anticipative car‐following controller (i.e., control strategy using kinematic state information of multiple preceding vehicles) for CAVs to maintain string stability and desired time headway. To initialize the proposed strategy, the number estimator is developed using a deep neural network (DNN). Then, a DNN‐based kinematic state predictor predicts the kinematic states of HDVs for CAVs to enable multi‐anticipative car‐following control. The multi‐anticipative car‐following controller is implemented using an extended intelligent driver model‐guided deep deterministic policy gradient algorithm, which ensures safety, string stability, and traffic efficiency. The effectiveness of the proposed control strategy is validated through numerical experiments using NGSIM data. Results indicate that the proposed strategy can produce accurate estimations of the number and the kinematic states of HDVs between CAVs. Further, it can achieve string stability while maintaining smaller time headways, compared to car‐following models used for training guidance under different market penetration rates of CAVs, which significantly improves traffic smoothness and mobility.