Reconstruction of the spine structure with bi-planar x-ray images using the generative adversarial network

Abstract

In this study, a new computer-aided system was proposed to automatically reconstruct the spine model. The bi-planar EOS X-ray imaging was adopted as the scanning technology, which is capable of a simultaneous capture of bi-planar X-ray images by slot scanning of the whole body using ultra-low radiation doses. High quality and high contrast anteroposterior (AP) and lateral (LAT) X-ray images will be acquired during scanning period and these two radiographs enable a precise three-dimensional reconstruction of vertebrae, pelvis and other parts of the skeletal system. To overcome the timeconsuming issue of spine reconstruction using EOS system, a generative adversarial network (GAN) was applied to reconstruct the entire spine model, which is consist of generator and discriminator and training by unsupervised learning approach. Nowadays, GAN model has already been adopted in the transformation from 2D image to 3D scenes. Therefore, our approach represents a potential alternative for EOS reconstruction while still maintaining a clinically acceptable diagnostic accuracy.