Abstract. Rapid access to the operating status of Photovoltaic (PV) panels and troubleshooting can save management and maintenance costs for the development of PV power plants, which is important for PV power plant management and power generation capacity assurance. The use of remote sensing technology to identify the faults of photovoltaic panels has developed rapidly, however, current research usually relies only on a single optical data source to identify and count the area of PV panels in a PV electric field, although there are literature on PV panel fault detection, only the surface fault identification of PV panels is tested, while the internal faults (such as panel bad points or bad lines) cannot be identified because of the limitations of optical remote sensing. In this paper, a photovoltaic panel fault monitoring technology based on multi-source remote sensing is proposed. The optical and thermal infrared hybrid data combined with deep learning technology are used to achieve rapid and accurate fault identification and localization of PV panel arrays. It can not only automatically identify PV panels that are obscured by dust and foreign objects, but also locate PV panels that have bad dots or bad lines, which greatly improves the ability and effectiveness of remote sensing PV panel fault monitoring. The high-resolution unmanned air vehicle (UAV) optical image and thermal infrared image are applied in this experiment. The Mask RCNN algorithm is used to accurately locate and number the photovoltaic panel of the optical image. Then, the fault scene classification model is established for the multi-type fault characteristics of the optical image and thermal infrared image within the panel range, so as to identify five types of faults, such as dust cover, branch cover, bird droppings cover, internal bad points and bad lines of PV panel, which effectively solves the problem that the single optical remote sensing image cannot identify the internal component faults of the photovoltaic panel under normal conditions.