Hybrid beamforming (BF), which divides BF operation into radio frequency (RF) and baseband (BB) domains, will play a critical role in MIMO communication at millimeter-wave (mmW) frequencies. In principle, we can obtain unconstrained (optimum) beamformers of a transceiver, which approach the maximum achievable data rates, through its singular value decomposition (SVD). Due to the use of finite-precision phase shifters, combined with power constraints, additional challenges are imposed on the problem of designing hybrid beamformers. Motivated by the recent success of machine learning (ML) techniques, particularly in areas such as computer vision and speech recognition, we explore if ML techniques can be effectively used for SVD and hybrid BF. To this end, we first present a data-driven approach to compute the SVD. We propose three deep neural network (DNN) architectures to approximate the SVD, with varying levels of complexity. The methodology for training these DNN architectures is inspired by the fundamental property of SVD, i.e., it can be used to obtain low-rank approximations. We next explicitly take the constraints of hybrid BF into account (such as quantized phase shifters, power constraints), and propose a novel DNN based approach for the design of hybrid BF systems. To validate the DNN based approach, we present simulation results for both approximating the SVD as well as for hybrid BF. Our results show that DNNs can be an attractive and efficient solution for estimating SVD in a data-driven manner. For the simulations of hybrid BF, we first consider the geometric channel model. We show that the DNN based hybrid BF improves rates by up to 50 - 70% compared to conventional hybrid BF algorithms and achieves 10 - 30% gain in rates compared with the state-of-art ML-aided hybrid BF algorithms. We also discuss the impact of the choice of hyperparameters, such as the number of hidden layers, mini-batch size, and training iterations on the accuracy of DNNs. Furthermore, we provide time complexity and memory requirement analyses for the proposed approach and state-of-the-art approaches.