Non-rigid Registration Scheme Research Articles

Multimodal image registration with joint structure tensor and local entropy.

Nonrigid registration of multimodal medical images remains a challenge in image-guided interventions. A common approach is to use mutual information (MI), which is robust to the intensity variations across modalities. However, primarily based on intensity distribution, MI does not take into account of underlying spatial and structural information of the images, which might lead to local optimization. To address such a challenge, this paper proposes a two-stage multimodal nonrigid registration scheme with joint structural information and local entropy. In our two-stage multimodal nonrigid registration scheme, both the reference image and floating image are firstly converted to a common space. A unified representation in the common space for the images is constructed by fusing the structure tensor (ST) trace with the local entropy (LE). Through the representation that reflects its geometry uniformly across modalities, the complicated deformation field is estimated using L(1) or L(2) distance. We compared our approach to four other methods: (1) the method using LE, (2) the method using ST, (3) the method using spatially weighted LE and (4) the conventional MI-based method. Quantitative evaluations on 80 multimodal image pairs of different organs including 50 pairs of MR images with artificial deformations, 20 pairs of medical brain MR images and 10 pairs of breast images showed that our proposed method outperformed the comparison methods. Student's t test demonstrated that our method achieved statistically significant improvement on registration accuracy. The two-stage registration with joint ST and LE outperformed the conventional MI-based method for multimodal images. Both the ST and the LE contributed to the improved registration accuracy.

Non-rigid registration using gradient of self-similarity response

Locally affine transformation with globally elastic interpolation is a common strategy for non-rigid registration. Current techniques improve the registration accuracy by only processing the sub-images that contain well-defined structures quantified by Moran's spatial correlation. As an indicator, Moran's metric successfully excludes noisy structures that result in misleading global optimum in terms of similarity. However, some well-defined structures with intensity only varying in one direction may also cause mis-registration. In this paper, we propose a new metric based on the response of a similarity function to quantify the ability of being correctly registered for each sub-image. Using receiver operating characteristic analysis, we show that the proposed metric more accurately reflects such ability than Moran's metric. Incorporating the proposed metric into a hierarchical non-rigid registration scheme, we show that registration accuracy is improved relative to Moran's metric.

Nonrigid image registration using similarity measure based on spatially weighted global probability distribution function

In nonrigid image registration, similarity measures including spatial information have been shown to perform better than those measures without spatial information. In this work, we provide new insight to the relationships among regional mutual information, regional probability distribution functions (PDFs) and global PDFs, and propose a novel nonrigid registration scheme with spatially weighted global probability distribution function (SWGPDF). Similarity measures based on SWGPDF (SWGPDFSM) are constructed. Three different spatial sub-region division methods are compared: the equally spaced sub-region (ESSR), the local binary pattern sub-region (LBPSR) and the gradient sub-region (GSR). The registration scheme applies B-spline based free form deformations (FFDs) as the transformation model. A Parzen window and linear interpolation are used to construct histograms. The SWGPDFSM registration scheme with ESSR space division is compared with the traditional global mutual information (gMI), the traditional global normalized mutual information (gNMI), regional mutual information and the SWGPDFSM with LBPSR or GSR space division. The test results show that SWGPDFSM scheme with ESSR space division outperforms the other schemes for elastically aligning images in the presence of big geometrical transformations, bias fields and illumination changes.

Unsupervised content classification based nonrigid registration of differently stained histology images

Registration of histopathology images of consecutive tissue sections stained with different histochemical or immunohistochemical stains is an important step in a number of application areas, such as the investigation of the pathology of a disease, validation of MRI sequences against tissue images, multiscale physical modeling, etc. In each case, information from each stain needs to be spatially aligned and combined to ascertain physical or functional properties of the tissue. However, in addition to the gigabyte-size images and nonrigid distortions present in the tissue, a major challenge for registering differently stained histology image pairs is the dissimilar structural appearance due to different stains highlighting different substances in tissues. In this paper, we address this challenge by developing an unsupervised content classification method that generates multichannel probability images from a roughly aligned image pair. Each channel corresponds to one automatically identified content class. The probability images enhance the structural similarity between image pairs. By integrating the classification method into a multiresolution-block-matching-based nonrigid registration scheme (N. Roberts, D. Magee, Y. Song, K. Brabazon, M. Shires, D. Crellin, N. Orsi, P. Quirke, and D. Treanor, "Toward routine use of 3D histopathology as a research tool," Amer. J. Pathology, vol. 180, no. 5, 2012.), we improve the performance of registering multistained histology images. Evaluation was conducted on 77 histological image pairs taken from three liver specimens and one intervertebral disc specimen. In total, six types of histochemical stains were tested. We evaluated our method against the same registration method implemented without applying the classification algorithm (intensity-based registration) and the state-of-the-art mutual information based registration. Superior results are obtained with the proposed method.

Explicit shape descriptors: novel morphologic features for histopathology classification.

Object morphology, defined as shape and size characteristics, observed on medical imagery is often an important marker for disease presence and/or aggressiveness. In the context of prostate cancer histopathology, gland morphology is an integral component of the Gleason grading system which enables discrimination between low and high grade disease. However, clinicians are often unable to distinguish between subtle differences in object morphology, as evidenced by high inter-observer variability in Gleason grading. Boundary-based morphologic descriptors, such as the variance in the distance from points on the boundary of an object to its center, may not have the requisite discriminability to separate objects with subtle shape differences. In this paper, we present a set of novel explicit shape descriptors (ESDs) which are capable of distinguishing subtle shape differences between prostate glands of intermediate Gleason grades (grades 3 and 4) on prostate cancer histopathology. Calculation of ESDs involves: (1) representing object morphology using an explicit shape model (e.g. medial axis); (2) aligning the shape models via a non-rigid registration scheme with a diffeomorphic constraint and quantifying shape model dissimilarity; and (3) applying a non-linear dimensionality reduction scheme (e.g. Graph Embedding) to learn a low dimensional projection encoding the shape differences between objects. ESDs are hence the principal eigenvectors in the reduced embedding space. In this work we demonstrate that ESDs in conjunction with a Support Vector Machine classifier are able to correctly distinguish between 888 prostate glands corresponding to different Gleason grades (benign, grade 3, or grade 4) of prostate cancer from 58 needle biopsy specimens with a maximum accuracy of 0.89 and corresponding area under the receiver operating characteristic curve of 0.78.

Pulmonary nodule registration: Rigid or nonrigid?

The primary aim of this study is to investigate the performance difference of rigid and nonrigid registration schemes in matching corresponding pulmonary nodules depicted on sequential chest computed tomography (CT) examinations. A gradient descent based rigid registration algorithm with scaling was developed and it handled the involved geometric transformations (i.e., translation, rescaling, shearing, and rotation) separately instead of optimizing them in a single pass. Given two lung CT examinations, the scaling and translation parameters were simply estimated from the lung volume dimensions (e.g., size and mass center), while the rotation parameters were optimized progressively using gradient descent. To investigate the performance difference of rigid and nonrigid schemes in pulmonary nodule registration, the well-known nonrigid Demons algorithm was implemented and tested along with the developed schemes against 60 diverse low-dose clinical lung CT examinations with average 2-yr follow-up scans. A verified cancer and its correspondence in the follow-up scan as well as their spatial locations (mass center) were identified in each examination. In addition to the computational efficiency, the accuracy of these registration procedures was assessed by computing the Euclidean distances between the corresponding nodules after the registration. To demonstrate the advantage of the developed algorithm, the authors also implemented a fast iterative closest point (ICP) based rigid algorithm and compared their performance. Our experiments on the collected chest CT examinations showed that the nodule registration errors in 3D Euclidean distance for the developed rigid affine approach, the traditional ICP algorithm, and the refining nonrigid Demons algorithm were 9.6, 9.8, and 10.0 mm, respectively, and the corresponding computational costs in time were 5, 300, and 55 s, respectively. A rigid solution may be preferred in practice for the pulmonary nodule registration in longitudinal studies because of its relatively high efficiency and sufficient accuracy for the clinical need.

Fully Automatic Subpixel Image Registration of Multiangle CHRIS/Proba Data

Subpixel image registration is the key to successful image fusion and superresolution enhancement of multiangle satellite data. Multiangle image registration poses two main challenges: 1) Images captured at large view angles are susceptible to resolution change and blurring, and 2) local geometric distortion caused by topographic effects and/or platform instability may be important. In this paper, we propose a two-step nonrigid automatic registration scheme for multiangle satellite images. In the first step, control points (CPs) are selected in a preregistration process based on the scale-invariant feature transform (SIFT). However, the number of CPs obtained in this first step may be too few and/or CPs may be unevenly distributed. To remediate these problems, in a second step, the preliminary registered image is subdivided into chips of 64 × 64 pixels, and each chip is matched with a corresponding chip in the reference image using normalized cross correlation (NCC). By doing so, more CPs with better spatial distribution are obtained. Two criteria are applied during the generation of CPs to identify outliers. Selected SIFT and NCC CPs are used for defining a nonrigid thin-plate-spline model. The proposed registration scheme has been tested using data from the Compact High Resolution Imaging Spectrometer (CHRIS) onboard the Project for On-Board Autonomy (Proba) satellite. Experimental results demonstrate that the proposed method works well in areas with little variation in topography. Application in areas with more pronounced relief would require the use of orthorectified image data in order to achieve subpixel registration accuracy.

Thoracic non-rigid registration combining self-organizing maps and radial basis functions

An automatic three-dimensional non-rigid registration scheme is proposed in this paper and applied to thoracic computed tomography (CT) data of patients with stage III non-small cell lung cancer (NSCLC). According to the registration scheme, initially anatomical set of points such as the vertebral spine, the ribs, and shoulder blades are automatically segmented slice by slice from the two CT scans of the same patient in order to serve as interpolant points. Based on these extracted features, a rigid-body transformation is then applied to provide a pre-registration of the data. To establish correspondence between the feature points, the novel application of the self-organizing maps (SOMs) is adopted. In particular, the automatic correspondence of the interpolant points is based on the initialization of the Kohonen neural network model capable to identify 500 corresponding pairs of points approximately in the two CT sets. Then, radial basis functions (RBFs) using the shifted log function is subsequently employed for elastic warping of the image volume, using the correspondence between the interpolant points, as obtained in the previous phase. Quantitative and qualitative results are also presented to validate the performance of the proposed elastic registration scheme resulting in an alignment error of 6 mm, on average, over 15 CT paired datasets. Finally, changes of the tumor volume in respect to each reference dataset are estimated for all patients, which indicate inspiration and/or movement of the patient during acquisition of the data. Thus, the practical implementation of this scheme could provide estimations of lung tumor volumes during radiotherapy treatment planning.

Intensity-based Image Registration with a Guaranteed One-to-one Point Match

In this paper, we propose a novel registration technique, which combines the concepts of landmark and automatic, non-rigid intensity-based approaches. A general framework, which might be used for many different registration problems is presented. The novel approach enables the incorporation of different distance measures as well as different smoothers. The proposed scheme minimizes a regularized distance measure subject to some interpolation constraints. The desired deformation is computed iteratively using an Euler-scheme for the first variation of the chosen objective functional. A fast and robust numerical scheme for the computation of the wanted minimizer is developed, implemented, and applied to various registration tasks. This includes the registration of pre- and post-intervention images of the human eye. A novel framework for a parameter-free, non-rigid registration scheme which allows for the additional incorporation of user-defined landmarks is proposed. It enhances the reliability of conventional approaches considerably and thereby their acceptability by practitioners in a clinical environment.