Abstract
Abstract. Thermal cameras are increasingly used in many photogrammetric and computer vision tasks. Nowadays it is possible to detect and recognize objects in infrared images, to solve such tasks as pedestrian detection (Huckridge et al., 2016), security applications, and autonomous driving (Wenbin, Li et al., 2017). Nevertheless, some tasks that are easily solved in the visible range data are still challenging to achieve in the infrared range. Reconstruction of a 3D object model from infrared images is challenging due to the low contrast of the original infrared image, noise of the sensor, and the absence of feature points on the image. Nevertheless, thermal cameras have their advantages, which make them popular for solving practical problems. Firstly, thermal cameras can be used in degraded environments (smoke, fog, precipitation, low light conditions). Secondly, infrared images can be fused with color images (Gao et al., 2013) to increases the system’s performance.This paper is focused on the evaluation of accuracy of 3D object reconstruction from thermal images. The evaluation of the accuracy is threefold. Firstly, we train four stereo matching methods (CAE, LF-Net, SURF, and SIFT) on the MVSIR dataset (Knyaz et al., 2017) and our new ThermalPatches dataset. We used two RTX 2080 Ti GPUs and the PyTorch library for the training. Secondly, we evaluate the matching score for the selected methods. Finally, we perform 3D object reconstruction using the SfM (Remondino et al., 2014) approach and matches for each method. We compare the object space accuracy of the resulting surfaces to the ground-truth 3D models generated with a structured light 3D scanner.
Highlights
Thermal cameras are increasingly used in many photogrammetric and computer vision tasks
Experimental results demonstrate that such approach outperforms the state-of-the-art methods on visible range,but there are no evaluations for infrared images
We present the results of the evaluation and demonstrate the quality of 3D object reconstruction from different image datasets.We reconstructed the ground truth 3D models of each object in visible range
Summary
Thermal cameras are increasingly used in many photogrammetric and computer vision tasks. While many large datasets of images captured in the visible range can be found in the public domain (Lin et al, 2014, Everingham et al, 2015), nowadays only a few small thermal images datasets are available. Such datasets are limited in terms of object classes and imaging conditions. 3D reconstruction of objects from thermal images is required in such applications as thermal texturing of 3D models and reconstruction of hot air streams.
Sign-in/Register to view highlights & summary Sign-in/Register to access full text options 
Free) 
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have
Schedule a call
