Predictive monitoring supports the a priori scheduling of critical component maintenance and contributes significantly in attaining a safe yet economic operation and management of complex energy systems by mitigating the risk of accidents and minimizing the number of operational pauses. The current work studies the learning ability of probabilistic kernel machines, and more particularly of Gaussian Processes (GP) equipped with various kernels for the estimation of weld residual stress profiles of stainless steel pipe welds. The GP models are tested on experimentally-obtained data of axial and hoop residual stresses in two different stainless-steel pipes. The results exhibit the ability of GP to accurately predict the weld residual stress profile in the axial and hoop direction by providing a predictive distribution, i.e., mean and variance values. Furthermore, performance of GP is compared to a non-probabilistic kernel machine, such as support vector regression (SVR) equipped with the same kernels, and to multivariate linear regression (MLR). Comparison results exhibit the robustness of GP over SVR and MLR with respect to prediction accuracy of weld residual stress in terms of root mean square error. With respect to a second metric, namely, correlation coefficient between measured and predicted values, GP is superior to SVR and MLR in the majority of the cases.