During the design phase of sailboats, naval architects typically employ hydrodynamic and aerodynamic models of the sailboat, utilizing a Velocity Prediction Program (VPP) to solve the equations of motion, thus determining the sailboat's speed and performance. Traditional methods for solving sailboat motion equations often employ simplified empirical formulas or costly experimental procedures, which yield less accurate results. This study presents the RANSE-based CFD software STAR-CCM + to comprehensively model the sailboat's hull-sail-rudder assembly. By implementing overset grid technology and the Volume of Fluid (VOF) model, the paper aims to couple the solution of aerodynamic and hydrodynamic forces under wind influence and introduces PID rudder control technology to maintain a balance of forces and convergence of motion state. This approach enables the prediction of the sailboat's speed and performance, such as yaw angle, heel, and rudder angle. Results demonstrate minimal variations in sailboat speed (<0.05 m/s) and heading (<0.1°) in upwind, downwind and reaching sailing conditions, underscoring the method's feasibility and advocating for further research into self-sailing performance.