In this study, a battery energy management system for electric vehicle (EV) applications is proposed with a standalone photovoltaic (PV) source and controlled based on the availability of grid, PV source, load consumption, and energy stored in the battery. This paper proposes a single-ended primary-inductance converter (SEPIC) DC-DC converter for charging the battery through the utility and PV source that provides good load regulation. The bidirectional nature of the proposed DC-DC converter provides the charging and discharging of the EV battery in the succeeding modes of operation, i) grid-tied charging, ii) PV-tied charging, iii) discharging to the load in the absence of utility and PV source, and iv) regenerative braking. An improved perturb and observe-based maximum power point tracking (MPPT) algorithm is proposed to track the maximum power from the PV source. In addition, to handle the four modes of operation, a dedicated controller is also proposed. Firstly, the proposed system is validated using MATLAB/Simulink software by considering different operating conditions, and the performance is compared with the traditional MPPT algorithms. Finally, the effectiveness of the suggested system is validated through an experimental prototype. The result proved the superiority of the converter and controller over the traditional systems.<div align="center"> </div>