This study presents a deep learning-based method for the quantity take-off in the construction industry. In this context, the brick wall quantity calculation was performed automatically over two-dimensional (2D) pictures by the U-Net method. 280 photos were first taken in the field at different distances and angles. 1960 images were, then, obtained by augmentation to increase the training accuracy. Pixel calculation of the automatically masked area in the images was made for wall estimation. The wall area was calculated by comparing this pixel value with that of the reference brick surface area. The method was tested on four sample photos including different wall images. A parametric study was carried out to reduce the errors. In the study, it has been shown that the proposed method is suitable for brick quantity calculation. In addition, it was concluded that the photo should be taken as close as possible, and more than one brick should be taken as a reference in close-up photos to increase the accuracy.