Chapter 3 - Image Fusion and Visualization

Abstract

We provide an overview of the basics of image registration and medical imaging display technologies for the novice engineer in the field of image-guided interventions. Image fusion and visualization relate the surgeon to the patient by bringing together multiple data sets, such as images and interventional tools, into a common coordinate system defined by the surgical field. We discuss image coordinate systems, image registration methods, and image fusion across modalities, focusing on their utility for image-guided procedures. Standard image visualization methods such as orthogonal views and volume and surface renderings are presented with consideration of their utility for surgical procedures. Software and hardware requirements for several visualization methods are reviewed, with attention on design and human factors issues. These include display using large screens, head-mounted glasses, projection of images onto screens or the patient, and possible future display technologies. Clinical examples are used to illustrate the important concepts in image fusion and visualization, with particular attention on how the visualization has been designed for the image-guided procedure.