This research presents the optimum performance model for predicting the shallow foundation ultimate bearing capacity (UBC). Twenty-one models are employed, trained, tested, and compared to find the best architecture computational model. Thirteen performance metrics, including three new index metrics, are used to calculate and analyze the model's performance. Five kernels, linear, polynomial, gaussian, laplacian, and exponential, have been implemented in RVM (mentioned by SRVM). These RVM models have been optimized by each particle swarm optimization (PSO) and genetic (GA) algorithm. Moreover, the kernel function of the higher-performance SRVM model has been used as kernel 1 to develop dual (parallel) kernel function-based RVM (mentioned by HRVM) models. Thus, four combinations have developed four HRVM models optimized by each GA and PSO algorithm. The Adam, root mean square propagation, and stochastic gradient descent with momentum algorithms have optimized long short-term memory (LSTM) models. The analysis of performance metrics reveals that (i) the GA-optimized laplacian SRVM model UBC3 has performed better than the PSO-optimized exponential SRVM model UBC10, (ii) PSO-optimized dual kernel-based HRVM model UBC18 has attained higher performance than GA-optimized dual kernel-based HRVM model UBC14, i.e., 0.9985. Adam-optimized model UBC19 based on the LSTM approach has gained higher performance (R = 0.9999) and the least residuals (RMSE = 5.9132 kPa, MAE = 3.7037 kPa, MAPE = 2.5314 kPa, and WMAPE = 0.0118 kPa). Also, model UBC19 has outperformed models UBC3, UBC10, UBC14, and UBC18 and published models available in the literature with higher index metrics. This study reveals that the HRVM models are less affected by multicollinearity.