Accuracy of 3-dimensional stereophotogrammetry: Comparison of the 3dMD and Bellus3D facial scanning systems with one another and with direct anthropometry

Abstract

The objective of this study was to compare the accuracy of 3-dimensional (3D) digital facial photographs taken by the Bellus3D Face Camera Pro (Bellus3D) (Bellus3D Inc, Los Gatos, Calif) and the 3dMDface system (3dMD) (3dMD Inc, Atlanta, Ga) with one another and with direct anthropometry (DA). A mannequin head was selected as the research object. Twenty facial landmarks were labeled on the basis of the 8 interlandmark distances and 5 angles that were defined. A 150-mm digital Vernier caliper (Mitutoyo Inc, Tokyo, Japan) with an accuracy of 0.02mm was applied to directly measure the interlandmark distances, and the angles were calculated according to the law of cosines. All the measurements were conducted 3 times by each operator under identical conditions. Then, each scanner was used to acquire 3D photographs 5 times, generating 10 digital stereophotographs. Linear distances and angles were measured on the 3D facial photographs reconstructed with open-source MeshLab software (ISTI [Italian National Research Council], Rome, Italy). Each linear distance and angle were measured 3 times by 1 operator, and 3 examiners conducted the measurements independently. To obtain the trueness, equivalence tests were applied to compare the measurements of the 2 scanners and DA. In addition, the average absolute deviations were calculated to directly compare the trueness of 3 methods (Bellus3D vs 3dMD vs DA). Finally, the intraclass correlation coefficient was used to assess the interobserver agreement and the precision of 2 scanners. As for the trueness, 7 out of 8 of the linear distance measurements (N-Pn, Sn-Pog, ORE-IRE, OLE-ILE, RLC-RMC, LLC-LMC, and CR-CL) and 3 out of 5 of the angular measurements (MLA, NFA, and INI) obtained by 3dMD were equivalent to those obtained by DA. Five out of 8 measurements (N-Pn, Sn-Pog, RLC-RMC, LLC-LMC, and CR-CL) and 1 out of 5 of the angular measurements (MLA) obtained by Bellus3D were equivalent to the measurements obtained with DA. All but 3 of the measurements (ORE-IRE, NFA, and INI) obtained with Bellus3D were equivalent to 3dMD. The mean absolute difference between 3dMD and DA was 0.36±0.20mm and 0.45°±0.56°; the deviation between Bellus3D and DA was 0.61±0.47mm and 0.99°±0.61°; and the deviation between Bellus3D and 3dMD was 0.38±0.37mm and 0.62°±0.39°. Regarding the precision of the 2 scanners, the intraclass correlation coefficient value of 3dMD was approximately 1.00, and that of Bellus3D was 0.99. The interobserver agreement for each linear and angular measurement was 0.99. The trueness of each scanner was clinically acceptable for diagnosis and treatment planning. The precision of 3D photographs obtained by 3dMD and Bellus3D showed good scanning repeatability. The interobserver agreement between the 3 operators was rated as excellent (0.99).