Solution Of Optimal Control Problem Research Articles

Nonlinear optimal control for triangular tethered multi-satellite formations

Triangular satellite constellations are created by three satellites which are linked through tethers. Such formations serve distributed observation space missions or the creation of high-density satellite communication networks over high-frequency bands. In a tethered multi-satellite system consisting of three-satellites in triangular formation the associated dynamic model exhibits strong nonlinearities. Stabilization and precise positioning of the multi-satellite constellation is a nontrivial task and the solution of the associated nonlinear control problem is an elaborated procedure. In this article a novel nonlinear optimal control method is applied to the above-noted model the tethered multi-satellite system in triangular formation. First, the state-space model of the triangular tethered multi-satellite formation undergoes approximate linearization around a temporary operating point that is recomputed at each time-step of the control method. The linearization relies on Taylor series expansion and on the associated Jacobian matrices. For the linearized state-space model of the tethered satellites a stabilizing optimal (H-infinity) feedback controller is designed. This controller stands for the solution of the nonlinear optimal control problem under model uncertainty and external perturbations. To compute the controller’s feedback gains an algebraic Riccati equation is repetitively solved at each iteration of the control algorithm. The stability properties of the control method are proven through Lyapunov analysis. The proposed nonlinear optimal control approach achieves fast and accurate tracking of setpoints under moderate variations of the control inputs and a minimum dispersion of energy when changing the position of the satellites in their triangular tethered formation.

Optimal control for a variable-order diffusion-wave equation with a reaction term; A numerical study

In this paper, optimal control for a variable-order diffusion-wave equation with a reaction term is numerically studied, where the variable-order operator is defined in the sense of Caputo proportional constant. Necessary optimality conditions for the control problem are derived. Existence and uniqueness for the solutions of fractional optimal control problem are derived. The nonstandard weighted average finite difference method and the nonstandard leap-frog method are developed to study numerically the proposed problem. Moreover, the stability analysis of the methods is proved. Finally, in order to characterise the memory property of the proposed model, three test examples are given. It is found that the nonstandard weighted average finite difference method can be applied to study such variable-order fractional optimal control problems simply and effectively.

Bi-Basis Function Second Derivative Block Method for the Solution of Optimal Control Problems

This paper determines the state trajectory of a dynamic system over a period to optimize a given performance index. A one-step second derivative hybrid method based on the combination of Lucas and first Boubaker polynomials as basis functions is formulated for the solution of optimal control problems via the forward-backward sweep method. The technique is used to generate a set of hybrid schemes at selected grid and off-grid points with implementation in block form. The stability and convergence of the new method is discussed and the accuracy of the method is tested on some numerical examples. The results obtained correspond to a large extent with the results obtained by the exact solution. Bi-bases function, Block method, First Boubaker polynomials, Lucas polynomial, Optimal control problem

A direct transcription method for solving distributed-order fractional optimal control problems

This paper considers the numerical solution of distributed-order Fractional Optimal Control Problems (FOCPs). The common approaches for solving these problems involve approximating the problem with a multi-term FOCP and subsequently discretizing the resulting multi-term problem using either a direct or indirect method. However, this paper bypasses the need for approximation with a multi-term FOCP by introducing innovative approximation formulas for distributed-order fractional derivatives. These approximation formulas are directly derived from the conventional Grünwald–Letnikov, L1, and trapezoidal formulas. Building upon these formulas, we develop the relevant fractional-order distributed-order operational matrices. Utilizing the operational matrix, we easily discretize the distributed-order FOCP to a Non-Linear Programming (NLP), which can be solved by a suitable NLP-solver. Additionally, to enhance the efficiency of solving the resulting NLP, we determine the closed-forms of both the Jacobian of constraints and the gradient of the objective function. The presented method is characterized by its speed, simplicity, and ease of implementation. Moreover, it can be used to solve a wide range of distributed-order FOCPs, such as those involving nonlinear dynamics, free final times, free terminal conditions, and path constraints. By means of ample numerical tests, the accuracy and efficiency of the proposed method are assessed.

Pointwise Error Estimates of Numerical Solutions to Linear Quadratic Optimal Control Problems

An auxiliary optimal control problem is formulated that provides with its unique solution, a continuous representation of the global error of a numerical approximation to the solution of a linear quadratic optimal control problem. The resulting error functions are characterized as the unique solutions to an optimality system that is reformulated as a boundary value problem. With this formulation, reliable pointwise error estimates can be generated utilizing well-established techniques of defect control. A novel algorithm based on defect correction and defect control is presented that generates pointwise approximations to the global error of numerical optimal control solutions on a uniform grid. It is proven and numerically validated that this algorithm can generate pointwise estimates that approximate the true global error with a prescribed accuracy.

A Convergent Legendre Spectral Collocation Method for the Variable-Order Fractional-Functional Optimal Control Problems

In this paper, a numerical method is applied to approximate the solution of variable-order fractional-functional optimal control problems. The variable-order fractional derivative is described in the type III Caputo sense. The technique of approximating the optimal solution of the problem using Lagrange interpolating polynomials is employed by utilizing the shifted Legendre–Gauss–Lobatto collocation points. To obtain the coefficients of these interpolating polynomials, the problem is transformed into a nonlinear programming problem. The proposed method offers a significant advantage in that it does not require the approximation of singular integral. In addition, the matrix differentiation is calculated accurately and efficiently, overcoming the difficulties posed by variable-order fractional derivatives. The convergence of the proposed method is investigated, and to validate the effectiveness of our proposed method, some examples are presented. We achieved an excellent agreement between numerical and exact solutions for different variable orders, indicating our method’s good performance.

Non-Overlapping Domain Decomposition for 1D Optimal Control Problems Governed by Time-Fractional Diffusion Equations on Coupled Domains: Optimality System and Virtual Controls

We consider a non-overlapping domain decomposition method for optimal control problems of the tracking type governed by time-fractional diffusion equations in one space dimension, where the fractional time derivative is considered in the Caputo sense. We concentrate on a transmission problem defined on two adjacent intervals, where at the interface we introduce an iterative non-overlapping domain decomposition in the spirit of P.L. Lions for the corresponding first-order optimality system, such that the optimality system corresponding to the optimal control problem on the entire domain is iteratively decomposed into two systems on the respective sub-domains; this approach can be framed as first optimize, then decompose. We show that the iteration involving the states and adjoint states converges in the appropriate spaces. Moreover, we show that the decomposed systems on the sub-domain can in turn be interpreted as optimality systems of so-called virtual control problems on the sub-domains. Using this property, we are able to solve the original optimal control problem by an iterative solution of optimal control problems on the sub-domains. This approach can be framed as first decompose, then optimize. We provide a mathematical analysis of the problems as well as a numerical finite difference discretization using the L1-method with respect to the Caputo derivative, along with two examples in order to verify the method.

Accurate solutions of interval linear quadratic regulator optimal control problems with fractional-order derivative

Accurate solutions of interval linear quadratic regulator optimal control problems with fractional-order derivative

Approximate Solution of Optimal Pulse Control Problem Associated with the Heat Conduction Process

Abstract We consider the approximate solution of the control problem with minimum energy for an object described by the heat equation, with the process described by the linear equation of parabolic type and the system controlled by impulsive external influences. Our optimal control problem deals with finding a control parameter belonging to the class of admissible controls that provides the desired temperature distribution in a finite time with minimal energy consumption (energy consumption is described by the quadratic functional). Previous works dedicated to optimal impulse control problems have mostly used the Pontryagin’s maximum principle. However, from a practical point of view, this approach does not lead to satisfactory results. This is due to the fact that the corresponding boundary value problems in this case have no solution in a traditional class of absolutely continuous trajectories. In this work, we propose a method based on the moment relations. We seek for the approximate solution of the corresponding boundary value problem in the form of finite Fourier sum and state our optimal control problem in a finite-dimensional phase space. As a result, we obtain an optimal impulse control problem in a finite-dimensional function space. Taking into account the given condition for a finite time, we reduce the obtained problem to the L-problem of moments. Thus, the problem of finding a control parameter is reduced to the solution of the system of Fredholm integral equations of the first kind, with the norm of the sought solution not exceeding a given number. By Levi’s theorem, every element of Hilbert space can be represented by the sum of the elements of two orthogonal subspaces. This assertion makes it possible to find control parameters in analytical form. We also establish the convergence of the chosen approximation.

Optimal Fast Charging of Lithium Ion Batteries: Between Model-Based and Data-Driven Methods

Delivering lithium ion batteries capable of fast charging without suffering from accelerated degradation is an important milestone for transport electrification. Recently, there has been growing interest in applying data-driven methods for optimising fast charging protocols to avoid accelerated battery degradation. However, such data-driven approaches suffer from a lack of robustness, explainability and generalisability, which has hindered their wide-spread use in practice. To address this issue, this paper proposes a method to interpret the fast charging protocols of data-driven algorithms as the solutions of a model-based optimal control problem. This hybrid approach combines the power of data-driven methods for predicting battery degradation with the flexibility and optimality guarantees of the model-based approach. The results highlight the potential of the proposed hybrid approach for generating fast charging protocols. In particular, for fast charging to 80% state-of-charge in 10 min, the proposed approach was predicted to increase the cycle life from 912 to 1078 cycles when compared against a purely data-driven approach.

Dynamic programming principle for backward doubly stochastic recursive optimal control problem and sobolev weak solution of the stochastic Hamilton-Jacobi-Bellman equation

In this paper, we investigate a backward doubly stochastic recursive optimal control problem wherein the cost function is expressed as the solution to a backward doubly stochastic differential equation. We present the dynamical programming principle for this type of optimal control problem and establish that the value function is the unique Sobolev weak solution to the associated stochastic Hamilton-Jacobi-Bellman equation.

Numerical solution of the initial-boundary value problem describing separation processes in a distillation column

A modification of the numerical method of characteristics is developed to solve the initial-boundary value problem that arises when modeling the rectification process in the column. The process is described by a system of first-order hyperbolic equations. A specific peculiarity of the model is in the boundary conditions of a special type. At each of the boundaries, boundary conditions are determined from a system of ordinary differential equations, which also includes unknown values of functions on another boundary. A characteristic difference grid is constructed on the base of a linear transformation of a classical rectangular grid. Implicit second-order difference schemes are used, taking into account the features of the problem at the boundaries. The advantage of this approach is in consideration of the specifics of the propagation of perturbations in hyperbolic equations. Numerical implementation of the method was carried out. An illustrative example shows the effectiveness of the proposed modification of the characterization method. This method is a base for further solution of optimal control problems of flows in columns.

Co-simulation-based optimal reactive power control in smart distribution network

The increasing integration of distributed energy resources such as photovoltaic (PV) systems into distribution networks introduces intermittent and variable power, leading to high voltage fluctuations. High PV integration can also result in increased terminal voltage of the network during periods of high PV generation and low load consumption. These problems can be solved by optimal utilization of the reactive power capability of a smart inverter. However, solving the optimization problem using a detailed mathematical model of the distribution network may be time-consuming. Due to this, the optimization process may not be fast enough to incorporate this rapid fluctuation when implemented in real-time optimization. To address these issues, this paper proposes a co-simulation-based optimization approach for optimal reactive power control in smart inverters. By utilizing co-simulation, the need for detailed mathematical modeling of the power flow equation of the distribution network in the optimization model is eliminated, thereby enabling faster optimization. This paper compares three optimization algorithms (improved harmony search, simplicial homology global optimization, and differential evolution) using models developed in OpenDSS and DigSilent PowerFactory. The results demonstrate the suitability of the proposed co-simulation-based optimization for obtaining optimal setpoints for reactive power control, minimizing total power loss in distribution networks with high PV integration. This research paper contributes to efficient and practical solutions for modeling optimal control problems in future distribution networks.

Convergence analysis and optimization of a Robin Schwarz waveform relaxation method for time-periodic parabolic optimal control problems

This paper is concerned with a novel convergence analysis of the optimized Schwarz waveform relaxation method (OSWRM) for the solution of optimal control problems governed by periodic parabolic partial differential equations (PDEs). The new analysis is based on a Fourier-type technique applied to a semidiscrete-in-time form of the optimality condition. This leads to a precise characterization of the convergence factor of the method at the semidiscrete level. Using this characterization, the optimal transmission condition parameter is obtained at the semidiscrete level and its asymptotic behavior as the time discretization converges to zero is analyzed in detail.

Automatic scenario generation for efficient solution of robust optimal control problems

AbstractExisting methods for nonlinear robust control often use scenario‐based approaches to formulate the control problem as large nonlinear optimization problems. The optimization problems are challenging to solve due to their size, especially if the control problems include time‐varying uncertainty. This paper draws from local reduction methods used in semi‐infinite optimization to solve robust optimal control problems with parametric and time‐varying uncertainty. By iteratively adding interim worst‐case scenarios to the problem, methods based on local reduction provide a way to manage the total number of scenarios. We show that the local reduction method for optimal control problems consists of solving a series of simplified optimal control problems to find worst‐case constraint violations. In particular, we present examples where local reduction methods find worst‐case scenarios that are not on the boundary of the uncertainty set. We also provide bounds on the error if local solvers are used. The proposed approach is illustrated with two case studies with parametric and additive time‐varying uncertainty. In the first case study, the number of scenarios obtained from local reduction is 101, smaller than in the case when all extreme scenarios are considered. In the second case study, the number of scenarios obtained from the local reduction is two compared to 512 extreme scenarios. Our approach was able to satisfy the constraints both for parametric uncertainty and time‐varying disturbances, whereas approaches from literature either violated the constraints or became computationally expensive.

Modified dynamic programming algorithms for GLOSA systems with stochastic signal switching times

A discrete-time stochastic optimal control problem was recently proposed to address the GLOSA (Green Light Optimal Speed Advisory) problem in cases where the next signal switching time is decided in real time and is therefore uncertain in advance. The corresponding numerical solution via SDP (Stochastic Dynamic Programming) calls for substantial computation time, which excludes problem solution in the vehicle’s on-board computer in real time. In this context, the present paper concentrates on the challenge of developing numerical algorithms to solve efficiently the stochastic GLOSA problem. As a first attempt to overcome the computation time bottleneck, a modified version of Dynamic Programming, known as Discrete Differential Dynamic Programming (DDDP) was recently employed for the numerical solution of the stochastic optimal control problem and was demonstrated to achieve results equivalent to those obtained with the ordinary SDP algorithm, albeit with significantly reduced computation times. After an outline of the DDDP approach, the present work considers a second modified version of Dynamic Programming, known as Differential Dynamic Programming (DDP). For the stochastic GLOSA problem, it is demonstrated that DDP achieves quasi-instantaneous (extremely fast) solutions in terms of CPU times, which allows for the proposed approach to be readily executable online, in an MPC (Model Predictive Control) framework, in the vehicle’s on-board computer. The novel numerical approach is tested and demonstrated by use of realistic examples and is compared to the SDP and DDDP solutions. It should be noted that DDP does not require discretization of variables, hence the obtained solutions may be slightly superior to the standard SDP solutions.

Refinements the solutions of fuzzy optimal control problems

Refinements the solutions of fuzzy optimal control problems

Approximate Solution for Some Continuous Optimal Control Problems Using Veita-Pell Polynomials

In this paper, Veita-Pell polynomials (VPPs) are first presented with some interesting properties. These properties are utilized to construct a general explicit formula of their operational matrix of derivative. Then an appropriate direct technique is suggested for solving quadratic optimal control problems based on VPPs and the idea of state parameterization algorithm. The resulting performance index optimal value shows the proposed method is able to provide a good treatment with fast convergence. The effectiveness of the presented method is illustrated by solving three numerical examples. The obtained results show that as the number of basis functions VPPs increase the error in the solution by the present method will be decreased and it may exactly close with the analytical one. This is the main modification of the algorithm and this contribution in the using special basis functions in obtaining an approximate solution with minimum number of VPPs and satisfactory accuracy.

Atangana-Baleanu Fractional Dynamics of Predictive Whooping Cough Model with Optimal Control Analysis

Whooping cough, or pertussis, is an infectious disease that causes serious threats to people of all ages, specifically to infant and young children, all over the world. Due to the severe impact on health, it is necessary to construct a mathematical model that can be used to predict future dynamics of the disease, as well as to suggest strategies to eliminate the disease in an optimal way. For this, we constructed a new Atangana–Baleanu fractional model for whooping cough disease to predict the future dynamics of the disease, as well as to suggest strategies to eliminate the disease in an optimal way. We prove that the proposed model has a unique solution that is positive and bounded. To measure the contagiousness of the disease, we determined the reproduction number R0 and used it to examine the local and global stability at equilibrium points that have symmetry. Through sensitivity analysis, we determined parameters of the model that are most sensitive to R0. The ultimate aim of this research was to analyze different disease prevention approaches in order to find the most suitable one. For this, we included the vaccination and quarantine compartments in the proposed model and formulated an optimal control problem to assess the effect of vaccination and quarantine rates on disease control in three distinct scenarios. Firstly, we study the impact of vaccination strategy and conclude the findings with a graphical presentation of the results. Secondly, we examine the impact of quarantine strategy on whooping cough infection and its possible elimination from society. Lastly, we implement vaccination and quarantine strategies together to visualize their combined effect on infection control. In addition to the study of the optimal control problem, we examine the effect of the fractional order on disease dynamics, as well as the impact of constant vaccination and quarantine rates on disease transmission and control. The numerical results reveal that the optimal control strategy with vaccination and quarantine together would be more effective in reducing the spread of whooping cough infection. The implementation of the Toufik–Atangana-type numerical scheme for the solution of the fractional optimal control problem is another contribution of this article.

An optimal control problem for resource utilisation by microorganisms

Decomposition of organic matter controls the flow of carbon and nutrients in terrestrial and aquatic ecosystems. Several kinetic laws have been proposed to describe decomposition rates, but they neglect adaptation of the microbial decomposer to environmental conditions. Here we formalise decomposition as an optimal control problem by assuming that microorganisms regulate the uptake rate of a substrate to maximise their growth over the period of decomposition. The result is an optimal control problem consisting of two differential equations and auxiliary conditions that determine the optimal value of the control variable (the uptake rate), the remaining substrate at any given time, and the optimal completion time. This problem serves as a case study to illustrate the solution of differential equations and optimal control problems for students in undergraduate courses. The mathematical analysis of the problem requires rewriting the differential equations in reverse time along with the solution of a nonhomogeneous linear first order differential equation. We then return to modelling with some biologically motivated questions about how the parameters of the model representing environmental conditions and microbial functional traits affect the outcome. Finally, we discuss alternative ways to use the material with students.