An adaptive front light system (AFS) is put forward by the Society of Automotive Engineers and Economic Commission for Europe as a means of enhancing vehicular lighting. Traditionally, AFS can be divided into three parts: (1) a leveling subsystem to make lighting parallel to the road surface; (2) a swiveling subsystem to change light distribution along with the angle of the steering wheel; (3) a dimming subsystem to reduce or intensify the lighting. In this paper, a new hybrid multi-sensor fusion framework combining Kalman Filter with neural network is proposed to adjust two stepper motors controlling the vehicles headlights pitch and yaw. Kalman Filter as the frontend is used to deal with redundant sensor signals that are collected from sensors in the different places. Fuzzy Neutral Network as the backend is used to generate adjustment of leveling and swiveling angle through the integration of different type signals. An adaptive parameter adjustment is accomplished by the proposed fusion framework with the varying filter coefficients. The simulation and experiment of leveling angle are conducted using the predefined experimental data. The evaluation results of leveling angle prove that the proposed algorithm can effectively filter out high-frequency perturbations and provide reliable outputs for stepper motor. The same results can be obtained for a swiveling subsystem. Consequently, the hybrid fusion framework is a feasible approach for AFS design to accomplish data processing and nonlinear mapping.