The three-phase Y-connected bridgeless rectifier is essentially a nonlinear system, and it is difficult to obtain superior dynamic performance under the action of traditional linear controller. Under the condition of unbalanced power grids, this paper has established a mathematical model based on Euler–Lagrange (EL) equations with line voltage and line current as state variables. Furthermore, it then designed a passivity-based controller in inner current loop based on the mathematical model. The hybrid nonlinear control strategy consisting of active disturbance rejection controller (ADRC) in the outer voltage loop and passivity-based controller (PBC) in the inner current loop is adopted to control the system, which does not need to consider the positive and negative sequence components. The control structure is simple and can improve the steady-state accuracy, dynamic performance and anti-interference ability. The feasibility of the proposed control strategy is verified by computer simulation, which has a guiding significance for the application of three-phase bridgeless rectifier in practical engineering.