Agriculture is closely associated with food and water. Agriculture is the first source of food but the biggest consumer of freshwater. The population is constantly increasing. Smart agriculture is one of the means of achieving food and water security. Smart agriculture can help improve water management and increase agricultural production, thus counteracting rapid population growth requirements. Soil moisture estimation is a critical step in agricultural water management. Soil moisture measurement techniques in situ are point measurements, labor-intensive, time-consuming, tedious, and expensive. We propose, in this research, a new approach to predict soil moisture over vegetation-covered areas from Sentinel-2 images based on a convolutional neural network (CNN). CNN architecture (3) consisting of six convolutional layers, one pooling layer, and two fully connected layers has achieved the highest prediction accuracy. Three well-known criteria including coefficient of determination (R2), mean absolute error (MAE), and root mean square error (RMSE) are utilized to measure the accuracy of the proposed algorithm. The Red Edge 3, NIR, and SWIR 1 are the most appropriate Sentinel-2 bands for retrieving soil moisture in vegetation-covered areas. Normalized Difference Water Index (NDWI) and Normalized Difference Vegetation Index (NDVI) are the best indicators. The use of the indicator is more proper than the use of the single Sentinel-2 band as input data for the proposed CNN architecture for predicting soil moisture. However, using combinations “that consist of some number of Sentinel-2 bands” as input data for CNN architecture is better than using each indicator separately or all of them as a group. The best values of the performance metrics were achieved using the sixth combination (R2=0.7094, MAE=0.0277, RMSE=0.0418) composed of the Red, Red Edge 1, Red Edge 2, Red Edge 3, NIR, and Red Edge 4 bands as input data to the CNN architecture (3), as well as by using the fifth combination (R2=0.7015, MAE=0.0287, RMSE=0.0424) composed of the Red Edge 3, NIR, Red Edge 4, and SWIR 1 bands.