A double-layer Q-learning driven memetic algorithm for integrated scheduling of procurement, production and maintenance with distributed resources

Abstract

The existing research on integrated production scheduling typically focuses on activities related to both production and post-production (e.g., operation and maintenance), with limited consideration for simultaneously integrating pre-production activities (e.g., raw material procurement). However, achieving the equilibrium between the manufacturer and the demander for intelligent manufacturing systems requires the optimal scheduling solution that integrates both pre-production and post-production activities. Inspired by this, we investigate a novel integrated scheduling problem that concurrently considers raw material procurement, production scheduling and equipment maintenance (abbreviated as SIPPM). A mixed-integer linear programming model is developed to simultaneously minimize the total costs for the manufacturer and the demander. Furthermore, a double-layer Q-learning driven memetic algorithm (DQMA) is proposed to solve the SIPPM. In DQMA, a well-tailored three-layer hybrid encoding method is presented for chromosome representation. The global search of DQMA employs three crossover and three mutation operators. Moreover, a knowledge-based local search operator with six methods, guided by an effective double-layer Q-learning structure, is devised to enhance local exploitation capabilities. The superiority of DQMA is verified through comparison with three popular multi-objective optimization algorithms on 108 newly established benchmark instances. The proposed integrated scheduling mode is proven to be more effective than two separated scheduling modes without considering raw material procurement.