Direct method for rotation estimation from spherical images using 3D mesh surfaces with SPHARM representation

Abstract

Since a large field of view obviously bears important advantages, the use of spherical images is becoming increasingly important in various computer vision and image processing applications. This paper presents a novel rotation estimation approach for spherical images based on 3D mesh representation of gray level intensity. Once the 3D meshes of the underlying spherical images are obtained, the 3D rotation can be estimated directly and efficiently, without feature extraction and matching process. Subsequently, we propose a direct method for 3D object rotation estimation using spherical harmonics representation with SVD decomposition and ICP algorithm for estimation refinement. Experimental results validate our approach and prove its suitability and robustness for rotation estimation. Moreover, it performs well against noisy images, brightness changes, image compression and occlusions. A comparative study of our proposed approach with four similar methods for 3D rotation estimation between spherical images, is realized to prove its effectiveness.