Output saturation, mainly caused by the power amplifier, is a critical issue influencing the performance and stability of an adaptive system, such as in active noise control. In this paper, a quadratically constrained quadratic program (QCQP) is defined to achieve optimal control under the averaging-output-power constraint, which ensures the output of the system operates linearly and hence, avoids the output saturation. To solve this QCQP problem recursively in practice, this paper utilizes one of the leaky-based filtered-x least mean square algorithm with an optimal leak factor. However, this method only can be applied when the statistical feature of the control signal with maximum output-power is known, which is difficult to obtain in practice. Hence, by incorporating the adaptive inverse modeling technique, we can derive a practical estimation of the optimal leaky factor, which is applicable to different noise types. Furthermore, as the optimal output-constraint control forces the output to operate linearly, the nonlinear amplifier model is not required for the leak factor estimate. The simulation of the proposed algorithm is carried out on measured nonlinear paths to validate its efficacy.