Resolving building physics damages is of great importance in terms of the healthy functioning of the building and its sustainability. The first thing to be done in this direction, the correct determination of the damages, is the most important step in order to solve the problems. It directly adds to the smooth progress of the repair work and the cost of the repair. Trying to detect building physics problems with the naked eye involves subjective judgments, and destructive methods damage the structure. In this study, it is aimed to detect moisture damage/deterioration in buildings in a non-destructive and objective way by using digital image processing method, which is one of the artificial intelligence applications. 3.600 image data of damaged states taken from the surfaces of different structures were subjected to machine learning using convolutional neural network architecture and the test data were classified and the application results were obtained. As a result of the validity test, it was observed that the method was effective on moisture damage and deterioration, and achieved a high accuracy rate. With this study, it is revealed that artificial intelligence applications used in various fields today can be used to detect moisture damage and deterioration, which is one of the building physics problems.