Optimal flow control in queueing networks is a challenging problem occurring in many contexts, such as data centers, cloud computing, healthcare, revenue management, and distributed networks, etc. The traditional approach has been to adopt heuristic solutions or consider infinite-horizon fluid or diffusion approximations. Motivated by emerging techniques in Robust Optimization, we propose a framework, termed Pipeline Queues, which tracks the dynamics of a queue simultaneously in terms of its queue length and waiting time. We begin by showing that the dynamics of a traditional queueing system can be equivalently modeled using this approach. Our key contribution is the uncovering of the hidden convexity resulting from our modeling approach. This leads us to tractable optimization formulations for generic flow control problems of obtaining performance guarantees on average and quantiles of waiting time, under arbitrary arrival and service distributions with non-zero initial conditions. Our model is flexible enough to capture partial observability and uncertainty of the initial state, as well as various constraints on the control policy. We apply our approach to multiple examples from the literature and numerically illustrate their application. Finally, we implemented our model on a real dataset at a major hospital in India. Our proposed policies are near optimal and perform significantly better than present heuristics.
Read full abstract