The ultra-low-altitude penetration with complex three-dimensional terrain environment usually requires the path planning algorithm to be computationally efficient to generate feasible optimized flight paths in a limited period of time. This paper investigates an improved bidirectional rapidly-exploring random tree* (RRT*) path planning algorithm with adaptive search strategy assignment mechanism to accelerate the exploration speed. The greedy optimization method and the three-dimensional Dubins method are utilized to reduce redundant nodes and optimize the flight path to satisfy the kinematic constraints of the fixed-wing aircraft. The model predictive control method is then employed to design the path-following controller, in which multiple types of constraints can be addressed. To demonstrate the superior planning efficiency of the proposed adaptive-alternating-exploration RRT* method, the existing widely-used path planning algorithms are used as benchmarks in the simulation studies. Simulation results show that the path planning time can be significantly reduced by up to 90% with the proposed adaptive-alternating-exploration RRT* method, simultaneously with optimized path length. Moreover, the designed model predictive path-following controller succeeds to track the planned collision-free path with maximum tracking errors of less than 2 meters. The effectiveness of the path planning algorithm and the designed controller is thoroughly demonstrated.