In order to respond to the increasing diversification of requirements, studies on software-defined access networks to enhance the flexibility of network systems continues. For fully software-defined access networks to efficiently accommodate various passive optical networks (PONs), other interfaces, and services, the softwarization of physical-layer processing has been studied. However, current techniques do not achieve enough performance for practical applications, and the total latency of upstream processing and downstream processing is 39.0 ms. The load imposed by conventional inter-ruption-based implementation makes it difficult to reduce buffer size. This article proposes an accelerator-based polling implementation method, which has lower load than the conventional interrupt approach, and thus has superior latency. We evaluate the latency performance in real time when implementing the 10G-EPON functions. Our implementation realizes graphic processing unit (CPU) polling by adding a flag to the received data and repeatedly checking the flag on a dedicated core. Demonstration results show that a prototype system successfully implemented our polling method on CPUs with low latency of 0.586 ms.