DRL-SFCP: Adaptive Service Function Chains Placement with Deep Reinforcement Learning

Abstract

Network function virtualization (NFV) is a promising paradigm that network functions can be deployed on commodity servers instead of dedicated servers to enhance the resource utilization and reduce the management difficulty. Based on the NFV technology, a complex network service can be composed of a series of ordered virtual network functions, known as service function chain (SFC). In this context, how to efficiently place SFCs in acceptable running time to improve resource utilization and service quality while meeting the constraints of the physical network is a critical issue for infrastructure providers. In this paper, we propose a deep reinforcement learning-based approach called DRL-SFCP for adaptive SFC placement. DRL-SFCP maximizes the long-term average revenue by combining both the graph convolution network which extracts the features of the physical network and sequence-to-sequence model which captures the ordered information of the SFC request to generate placement strategies. It learns to make SFC placement decisions via observations of the corresponding performance of past decisions rather than a hypothetical environment. Extensive experimental results show that our DRL-SFCP can achieve 11.6% and 9.6% improvement in terms of the acceptance ratio and the long-term average revenue, compared with existing benchmarks.