Context. Rising interest in radio astronomy and upcoming projects in the field is expected to produce petabytes of data per day, questioning the applicability of traditional radio astronomy data analysis approaches under the new large-scale conditions. This requires new, intelligent, fast, and efficient methods that potentially involve less input from the domain expert. Aims. In our work, we examine, for the first time, the possibility of fast and efficient source localization directly from the uv-observations, omitting the recovering of the dirty or clean images. Methods. We propose a deep neural network-based framework that takes as its input a low-dimensional vector of sampled uv-data and outputs source positions on the sky. We investigated a representation of the complex-valued input uv-data via the real and imaginary and the magnitude and phase components. We provided a comparison of the efficiency of the proposed framework with the traditional source localization pipeline based on the state-of-the-art Python Blob Detection and Source Finder (PyBDSF) method. The investigation was performed on a data set of 9164 sky models simulated using the Common Astronomy Software Applications (CASA) tool for the Atacama Large Millimeter Array (ALMA) Cycle 5.3 antenna configuration. Results. We investigated two scenarios: (i) noise-free as an ideal case and (ii) sky simulations including noise representative of typical extra-galactic millimeter observations. In the noise-free case, the proposed localization framework demonstrates the same high performance as the state-of-the-art PyBDSF method. For noisy data, however, our new method demonstrates significantly better performance, achieving a completeness level that is three times higher for sources with uniform signal-to-noise ratios (S/N) between 1 and 10, and a high increase in completeness in the low S/N regime. Furthermore, the execution time of the proposed framework is significantly reduced (by factors ~30) as compared to traditional methods that include image reconstructions from the uv-plane and subsequent source detections. Conclusions. The proposed framework for obtaining fast and efficient source localization directly from uv-plane observations shows very encouraging results, which could open new horizons for interferometric imaging with existing and future facilities.