In order to improve the accuracy of the photogrammetric joint roughness coefficient (JRC) value, the present study proposed a novel method combining an autonomous shooting parameter selection algorithm with a composite error model. Firstly, according to the depth map-based photogrammetric theory, the estimation of JRC from a three-dimensional (3D) digital surface model of rock discontinuities was presented. Secondly, an automatic shooting parameter selection algorithm was novelly proposed to establish the 3D model dataset of rock discontinuities with varying shooting parameters and target sizes. Meanwhile, the photogrammetric tests were performed with custom-built equipment capable of adjusting baseline lengths, and a total of 36 sets of JRC data was gathered via a combination of laboratory and field tests. Then, by combining the theory of point cloud coordinate computation error with the equation of JRC calculation, a composite error model controlled by the shooting parameters was proposed. This newly proposed model was validated via the 3D model dataset, demonstrating the capability to correct initially obtained JRC values solely based on shooting parameters. Furthermore, the implementation of this correction can significantly reduce errors in JRC values obtained via photographic measurement. Subsequently, our proposed error model was integrated into the shooting parameter selection algorithm, thus improving the rationality and convenience of selecting suitable shooting parameter combinations when dealing with target rock masses with different sizes. Moreover, the optimal combination of three shooting parameters was offered. JRC values resulting from various combinations of shooting parameters were verified by comparing them with 3D laser scan data. Finally, the application scope and limitations of the newly proposed approach were further addressed.