This paper proposes a partition of unity method (PUM) based on KDFCM (KDFcmPUM) that can be implemented to solve the dense matrix problem that occurs when the radial basis function (RBF) interpolation method deals with a large amount of scattered data. This method introduces a kernel fuzzy clustering algorithm to improve clustering accuracy and achieve the partition of unity. The local compact support RBF is used to construct the weight function, and local expression is obtained from the interpolation of the global RBF. Finally, the global expression is constructed by the weight function and local expression. In this paper, the method is applied to the orthogonally splitting imaging pose sensor to establish the mathematical model and the calibration and test experiments are carried out. The calibration and test accuracy both reached ±0.1 mm, and the number of operations was reduced by 4% at least. The experimental results show that KDFcmPUM is effective.