Online control of discrete-event systems: A survey

Abstract

In control theory, as in other areas of engineering research, there is an inherent tension between the breadth of a technique’s applicability and its mathematical tractability. For the area of discrete-event systems (DES), this manifested itself in a theory of supervisory control that originally provided correct-by-construction guarantees for offline solutions to a restricted kind of deterministic process. Follow-on work extended the reach of these techniques to a number of new settings, notably the development of online control without sacrificing any of the original DES performance guarantees. The ability to enact online control opened the door to applying DES techniques to the adaptive control processes presented by modern technologies: processes with dynamic and time-varying natures, whose characteristics may be understood poorly or not at all. Although many works have built on the seminal work of online control in DES, we believe that these ideas have not reached their full potential due to the difficulty in translating them to adjacent fields. In this survey, we look back at 30 years of research concerning the online control of DES and closely related limited lookahead policies with an eye to making the works accessible to practitioners in the broader control theory and artificial intelligence communities. We conclude with some thoughts on future research directions for the further development and application of online DES control techniques to problems requiring intelligent control in our modern world.