Dynamic Distributed Multi-Path Aided Load Balancing for Optical Data Center Networks

Abstract

Benefiting from dense connections in data center networks (DCNs), load balancing algorithms are capable of steering traffic into multiple paths for the sake of preventing traffic congestion. However, given each path’s time-varying and asymmetrical traffic state, this may also lead to worse congestion when some paths are overutilised. Especially in the two-tier hybrid optical/electrical DCNs (Hoe-DCNs), the port contentions and large-grained optical packets of the fast optical switch (FOS) require the top-of-rack (TOR) switch to have microsecond-level load balancing capability for microburst traffic. This paper establishes a leaf-spine Hoe-DCN model to illustrate the principal characteristic of dynamic load balancing in TOR switches for the first time. Moreover, we propose the dynamic distributed multi-path (DDMP) load balancing algorithm that relies on dynamic hashing computing for network flow distribution in DCNs, which dynamically adjusts traffic flow distribution at microsecond level according to the inverse ratio of the buffer occupancy. The simulation results show that our proposed algorithm reduces the TOR-to-TOR latency by 15.88% and decreases the packet loss by 22.06% compared to conventional algorithms under regular load conditions, which effectively improves the overall performance of the Hoe-DCNs. Moreover, our proposed algorithm prevents more than 90% packet loss under low load conditions.