Image Registration Methodology Research Articles

AI-driven generalized polynomial transformation models for unsupervised fundus image registration.

We introduce a novel AI-driven approach to unsupervised fundus image registration utilizing our Generalized Polynomial Transformation (GPT) model. Through the GPT, we establish a foundational model capable of simulating diverse polynomial transformations, trained on a large synthetic dataset to encompass a broad range of transformation scenarios. Additionally, our hybrid pre-processing strategy aims to streamline the learning process by offering model-focused input. We evaluated our model's effectiveness on the publicly available AREDS dataset by using standard metrics such as image-level and parameter-level analyzes. Linear regression analysis reveals an average Pearson correlation coefficient (R) of 0.9876 across all quadratic transformation parameters. Image-level evaluation, comprising qualitative and quantitative analyzes, showcases significant improvements in Structural Similarity Index (SSIM) and Normalized Cross Correlation (NCC) scores, indicating its robust performance. Notably, precise matching of the optic disc and vessel locations with minimal global distortion are observed. These findings underscore the potential of GPT-based approaches in image registration methodologies, promising advancements in diagnosis, treatment planning, and disease monitoring in ophthalmology and beyond.

Cluster-Based Memetic Approach of Image Alignment

The paper presents a new memetic, cluster-based methodology for image registration in case of geometric perturbation model involving translation, rotation and scaling. The methodology consists of two stages. First, using the sets of the object pixels belonging to the target image and to the sensed image respectively, the boundaries of the search space are computed. Next, the registration mechanism residing in a hybridization between a version of firefly population-based search procedure and the two membered evolutionary strategy computed on clustered data is applied. In addition, a procedure designed to deal with the premature convergence problem is embedded. The fitness to be maximized by the memetic algorithm is defined by the Dice coefficient, a function implemented to evaluate the similarity between pairs of binary images. The proposed methodology is applied on both binary and monochrome images. In case of monochrome images, a preprocessing step aiming the binarization of the inputs is considered before the registration. The quality of the proposed approach is measured in terms of accuracy and efficiency. The success rate based on Dice coefficient, normalized mutual information measures, and signal-to-noise ratio are used to establish the accuracy of the obtained algorithm, while the efficiency is evaluated by the run time function.

Remote Sensing Image Registration Methodology: Review and Discussion

Abstract Image registration is the process of overlaying two or more multi sensor or multi temporal or multi resolution images of the same scene. Image registration is very crucial preprocessing step in any remote sensing image processing application. This paper presents a brief review of evolution of different image registration methodologies with challenges involved in it. Image registration basically aligns the two images (reference and sensed image) geometrically. In the first part of this paper, classical methods will be discussed which are mainly based on area based (Intensity based) approach and feature based approach. Ample amount of work has already been done in both methods in manual and automatic manner. In the second part all recent approaches will be discussed and compared with results, on the basis of registration accuracy, number of correct correspondence. In recent studies Convolutional Neural Network with deep learning algorithms are used in combination with traditional methods to boost the overall performance.

In Vivo Detection of Chronic Kidney Disease Using Tissue Deformation Fields From Dynamic MR Imaging.

Chronic kidney disease (CKD) is a serious medical condition characterized by gradual loss of kidney function. Early detection and diagnosis is mandatory for adequate therapy and prognostic improvement. Hence, in the current pilot study we explore the use of image registration methods for detecting renal morphologic changes in patients with CKD. Ten healthy volunteers and nine patients with presumed CKD underwent dynamic T1 weighted imaging without contrast agent. From real and simulated dynamic time series, kidney deformation fields were estimated using a poroelastic deformation model. From the deformation fields several quantitative parameters reflecting pressure gradients, and volumetric and shear deformations were computed. Eight of the patients also underwent a kidney biopsy as a gold standard. We found that the absolute deformation, normalized volume changes, as well as pressure gradients correlated significantly with arteriosclerosis from biopsy assessments. Furthermore, our results indicate that current image registration methodologies are lacking sensitivity to recover mild changes in tissue stiffness. Image registration applied to dynamic time series correlated with structural renal changes and should be further explored as a tool for invasive measurements of arteriosclerosis. Under the assumption that the proposed framework can be further developed in terms of sensitivity and specificity, it can provide clinicians with a non-invasive tool of high spatial coverage available for characterization of arteriosclerosis and potentially other pathological changes observed in chronic kidney disease.

3D-2D silhouette-based image registration for comparative radiography-based forensic identification

Comparative radiography is a forensic identification technique traditionally involving the manual comparison of ante-mortem and post-mortem radiographs, thus being time consuming and error prone. The main objective is to propose and validate a computer-aided comparative radiography paradigm based on the 3D bone scan-2D radiograph superimposition process of any bone or cavity. The proposal follows an image registration methodology to automatically search for the ante-mortem radiograph acquisition parameters from the forensic object’s silhouette considering occlusions. The underlying optimization problem is complex since a close initialization cannot be assumed and the image intensities are not reliable or not captured. Several experiments were performed to validate the method. First, we study its accuracy and robustness with synthetic images of clavicles, patellae and frontal sinuses. Second, we study how optimization performance and both variability and differences in the segmentation performed by human operators affect the identification using synthetic and real images of frontal sinuses.

7T MRI subthalamic nucleus atlas for use with 3T MRI

Deep brain stimulation (DBS) of the subthalamic nucleus (STN) reduces motor symptoms in most patients with Parkinson disease (PD), yet may produce untoward effects. Investigation of DBS effects requires accurate localization of the STN, which can be difficult to identify on magnetic resonance images collected with clinically available 3T scanners. The goal of this study is to develop a high-quality STN atlas that can be applied to standard 3T images. We created a high-definition STN atlas derived from seven older participants imaged at 7T. This atlas was nonlinearly registered to a standard template representing 56 patients with PD imaged at 3T. This process required development of methodology for nonlinear multimodal image registration. We demonstrate mm-scale STN localization accuracy by comparison of our 3T atlas with a publicly available 7T atlas. We also demonstrate less agreement with an earlier histological atlas. STN localization error in the 56 patients imaged at 3T was less than 1mm on average. Our methodology enables accurate STN localization in individuals imaged at 3T. The STN atlas and underlying 3T average template in MNI space are freely available to the research community. The image registration methodology developed in the course of this work may be generally applicable to other datasets.

Multimodal image registration for the identification of dominant intraprostatic lesion in high-precision radiotherapy treatments.

The integration of CT and multiparametric MRI (mpMRI) is a challenging task in high-precision radiotherapy for prostate cancer. A simple methodology for multimodal deformable image registration (DIR) of prostate cancer patients is presented. CT and mpMRI of 10 patients were considered. Organs at risk and prostate were contoured on both scans. The dominant intraprostatic lesion was additionally delineated on MRI. After a preliminary rigid image registration, the voxel intensity of all the segmented structures in both scans except the prostate was increased by a specific amount (a constant additional value, A), in order to enhance the contrast of the main organs influencing its position and shape. 70 couples of scans were obtained by varying A from 0 to 800 and they were subsequently non-rigidly registered. Quantities derived from image analysis and contour statistics were considered for the tuning of the best performing A. A = 200 resulted the minimum enhancement value required to obtain statistically significant superior registration results. Mean centre of mass distance between corresponding structures decreases from 7.4 mm in rigid registration to 5.3 mm in DIR without enhancement (DIR-0) and to 2.7 mm in DIR with A = 200 (DIR-200). Mean contour distance was 2.5, 1.9 and 0.67 mm in rigid registration, DIR-0 and DIR-200, respectively. In DIR-200 mean contours overlap increases of +13 and +24% with respect to DIR-0 and rigid registration, respectively. Contour propagation according to the vector field resulting from DIR-200 allows the delineation of dominant intraprostatic lesion on CT scan and its use for high-precision radiotherapy treatment planning. Advances in knowledge: We investigated the application of a B-spline, mutual information-based multimodal DIR coupled with a simple, patient-unspecific but efficient contrast enhancement procedure in the pelvic body area, thus obtaining a robust and accurate methodology to transfer the functional information deriving from mpMRI onto a planning CT reference volume.

Breast tissue stiffness estimation for surgical guidance using gravity-induced excitation

Tissue stiffness interrogation is fundamental in breast cancer diagnosis and treatment. Furthermore, biomechanical models for predicting breast deformations have been created for several breast cancer applications. Within these applications, constitutive mechanical properties must be defined and the accuracy of this estimation directly impacts the overall performance of the model. In this study, we present an image-derived computational framework to obtain quantitative, patient specific stiffness properties for application in image-guided breast cancer surgery and interventions. The method uses two MR acquisitions of the breast in different supine gravity-loaded configurations to fit mechanical properties to a biomechanical breast model. A reproducibility assessment of the method was performed in a test–retest study using healthy volunteers and was further characterized in simulation. In five human data sets, the within subject coefficient of variation ranged from 10.7% to 27% and the intraclass correlation coefficient ranged from 0.91–0.944 for assessment of fibroglandular and adipose tissue stiffness. In simulation, fibroglandular content and deformation magnitude were shown to have significant effects on the shape and convexity of the objective function defined by image similarity. These observations provide an important step forward in characterizing the use of nonrigid image registration methodologies in conjunction with biomechanical models to estimate tissue stiffness. In addition, the results suggest that stiffness estimation methods using gravity-induced excitation can reliably and feasibly be implemented in breast cancer surgery/intervention workflows.

A Multistage Approach for Image Registration.

Successful image registration is an important step for object recognition, target detection, remote sensing, multimodal content fusion, scene blending, and disaster assessment and management. The geometric and photometric variations between images adversely affect the ability for an algorithm to estimate the transformation parameters that relate the two images. Local deformations, lighting conditions, object obstructions, and perspective differences all contribute to the challenges faced by traditional registration techniques. In this paper, a novel multistage registration approach is proposed that is resilient to view point differences, image content variations, and lighting conditions. Robust registration is realized through the utilization of a novel region descriptor which couples with the spatial and texture characteristics of invariant feature points. The proposed region descriptor is exploited in a multistage approach. A multistage process allows the utilization of the graph-based descriptor in many scenarios thus allowing the algorithm to be applied to a broader set of images. Each successive stage of the registration technique is evaluated through an effective similarity metric which determines subsequent action. The registration of aerial and street view images from pre- and post-disaster provide strong evidence that the proposed method estimates more accurate global transformation parameters than traditional feature-based methods. Experimental results show the robustness and accuracy of the proposed multistage image registration methodology.

Validating a new methodology for optical probe design and image registration in fNIRS studies

Functional near-infrared spectroscopy (fNIRS) is an imaging technique that relies on the principle of shining near-infrared light through tissue to detect changes in hemodynamic activation. An important methodological issue encountered is the creation of optimized probe geometry for fNIRS recordings. Here, across three experiments, we describe and validate a processing pipeline designed to create an optimized, yet scalable probe geometry based on selected regions of interest (ROIs) from the functional magnetic resonance imaging (fMRI) literature. In experiment 1, we created a probe geometry optimized to record changes in activation from target ROIs important for visual working memory. Positions of the sources and detectors of the probe geometry on an adult head were digitized using a motion sensor and projected onto a generic adult atlas and a segmented head obtained from the subject's MRI scan. In experiment 2, the same probe geometry was scaled down to fit a child's head and later digitized and projected onto the generic adult atlas and a segmented volume obtained from the child's MRI scan. Using visualization tools and by quantifying the amount of intersection between target ROIs and channels, we show that out of 21 ROIs, 17 and 19 ROIs intersected with fNIRS channels from the adult and child probe geometries, respectively. Further, both the adult atlas and adult subject-specific MRI approaches yielded similar results and can be used interchangeably. However, results suggest that segmented heads obtained from MRI scans be used for registering children's data. Finally, in experiment 3, we further validated our processing pipeline by creating a different probe geometry designed to record from target ROIs involved in language and motor processing.

The Insight ToolKit image registration framework.

Publicly available scientific resources help establish evaluation standards, provide a platform for teaching and improve reproducibility. Version 4 of the Insight ToolKit (ITK4) seeks to establish new standards in publicly available image registration methodology. ITK4 makes several advances in comparison to previous versions of ITK. ITK4 supports both multivariate images and objective functions; it also unifies high-dimensional (deformation field) and low-dimensional (affine) transformations with metrics that are reusable across transform types and with composite transforms that allow arbitrary series of geometric mappings to be chained together seamlessly. Metrics and optimizers take advantage of multi-core resources, when available. Furthermore, ITK4 reduces the parameter optimization burden via principled heuristics that automatically set scaling across disparate parameter types (rotations vs. translations). A related approach also constrains steps sizes for gradient-based optimizers. The result is that tuning for different metrics and/or image pairs is rarely necessary allowing the researcher to more easily focus on design/comparison of registration strategies. In total, the ITK4 contribution is intended as a structure to support reproducible research practices, will provide a more extensive foundation against which to evaluate new work in image registration and also enable application level programmers a broad suite of tools on which to build. Finally, we contextualize this work with a reference registration evaluation study with application to pediatric brain labeling.1

A Novel Image Fusion System for Multisensor and Multiband Remote Sensing Data

ABSTRACTThis paper presents a novel image fusion system for multisensor and multiband remote sensing data with an objective to synthesize an image which is either not feasible or not economical to obtain from single remote sensing satellite image. The fusion system focuses on objective, selection of data, pre-processing, registration, and fusion methodology with results. The paper also emphasizes on understanding of physics of remote sensing for meeting the objective as well as for success of fusion. In view of availability and archival of huge amount of remote sensing imagery from several satellites, different combinations for fusion from multisensor and multiband images are proposed. Due to use of images with differing modalities, resolution, and time of acquisition for fusion, a generalized and robust image registration methodology is adopted. Appropriate fusion methodologies are proposed for different fusion combinations and their results are illustrated and compared.

Non-Rigid Multimodal Medical Image Registration Based on the Conditional Statistics of the Joint Intensity Distribution

In this paper, we present a new methodology for multimodal non-rigid medical image registration. The proposed approach is based on combining a rigid registration achieved by a global optimization method, and a multimodal optical flow technique based on the conditional statistics of the joint intensity distribution (CS-JID) of the images to register. The methodology is essentially composed of two steps: first, the global deformation is approximated by using a rigid registration based on particle filtering; second, the optical flow is applied iteratively between the target and sequentially registered source image, by optimizing a new energy function that penalizes the difference between the intensities in one image with respect to the mean of the conditional intensity distribution of the other image, weighted by the conditional variance. After these steps, the non-rigid registration is made up by adding the resulting vector fields, computed by the rigid registration, and the sequential optical flow. The proposed algorithm was tested with three pairs of computed tomography (CT) and magnetic resonance (MR) images, aligned in the acquisition process, and subsequently warped with a synthetic non-rigid deformation. Preliminary results show that the methodology presents a good alternative for non-rigid multimodal registration, obtaining an average error of less than one pixel in the estimation of the deformation vector field in the majority of the cases.

Image registration for targeted MRI-guided transperineal prostate biopsy.

To develop and evaluate image registration methodology for automated re-identification of tumor-suspicious foci from preprocedural MR exams during MR-guided transperineal prostate core biopsy. A hierarchical approach for automated registration between planning and intra-procedural T2-weighted prostate MRI was developed and evaluated on the images acquired during 10 consecutive MR-guided biopsies. Registration accuracy was quantified at image-based landmarks and by evaluating spatial overlap for the manually segmented prostate and sub-structures. Registration reliability was evaluated by simulating initial mis-registration and analyzing the convergence behavior. Registration precision was characterized at the planned biopsy targets. The total computation time was compatible with a clinical setting, being at most 2 min. Deformable registration led to a significant improvement in spatial overlap of the prostate and peripheral zone contours compared with both rigid and affine registration. Average in-slice landmark registration error was 1.3 ± 0.5 mm. Experiments simulating initial mis-registration resulted in an estimated average capture range of 6 mm and an average in-slice registration precision of ±0.3 mm. Our registration approach requires minimum user interaction and is compatible with the time constraints of our interventional clinical workflow. The initial evaluation shows acceptable accuracy, reliability and consistency of the method.

Medical image registration: a review

This paper presents a review of automated image registration methodologies that have been used in the medical field. The aim of this paper is to be an introduction to the field, provide knowledge on the work that has been developed and to be a suitable reference for those who are looking for registration methods for a specific application. The registration methodologies under review are classified into intensity or feature based. The main steps of these methodologies, the common geometric transformations, the similarity measures and accuracy assessment techniques are introduced and described.

Prospective and retrospective motion correction in diffusion magnetic resonance imaging of the human brain

Diffusion-weighting in magnetic resonance imaging (MRI) increases the sensitivity to molecular Brownian motion, providing insight in the micro-environment of the underlying tissue types and structures. At the same time, the diffusion weighting renders the scans sensitive to other motion, including bulk patient motion. Typically, several image volumes are needed to extract diffusion information, inducing also inter-volume motion susceptibility. Bulk motion is more likely during long acquisitions, as they appear in diffusion tensor, diffusion spectrum and q-ball imaging. Image registration methods are successfully used to correct for bulk motion in other MRI time series, but their performance in diffusion-weighted MRI is limited since diffusion weighting introduces strong signal and contrast changes between serial image volumes. In this work, we combine the capability of free induction decay (FID) navigators, providing information on object motion, with image registration methodology to prospectively--or optionally retrospectively--correct for motion in diffusion imaging of the human brain. Eight healthy subjects were instructed to perform small-scale voluntary head motion during clinical diffusion tensor imaging acquisitions. The implemented motion detection based on FID navigator signals is processed in real-time and provided an excellent detection performance of voluntary motion patterns even at a sub-millimetre scale (sensitivity≥92%, specificity>98%). Motion detection triggered an additional image volume acquisition with b=0 s/mm2 which was subsequently co-registered to a reference volume. In the prospective correction scenario, the calculated motion-parameters were applied to perform a real-time update of the gradient coordinate system to correct for the head movement. Quantitative analysis revealed that the motion correction implementation is capable to correct head motion in diffusion-weighted MRI to a level comparable to scans without voluntary head motion. The results indicate the potential of this method to improve image quality in diffusion-weighted MRI, a concept that can also be applied when highest diffusion weightings are performed.

Implementation of Fiducial-Based Image Registration in the Cyberknife Robotic System

Fiducial-based image registration methodology as implemented in the Cyberknife system is explored. The Cyberknife is a radiosurgery system that uses image guidance technology and computer-controlled robotics to determine target positions and adjust beam directions accordingly during the dose delivery. The image guidance system consists of 2 x-ray sources mounted on the ceiling and a detection system mounted on both sides of the treatment couch. Two orthogonal live radiographs are taken prior to and during patient treatment. Fiducial markers are identified on these radiographs and compared to a library of digital reconstructed radiographs (DRRs) using the fiducial extraction software. The fiducial extraction software initially sets an intensity threshold on the live radiographs to generate white areas on black images referred to as “blobs.” Different threshold values are being used and blobs at the same location are assumed to originate from the same object. The number of blobs is then reduced by examining each blob against a predefined set of properties such as shape and exposure levels. The remaining blobs are further reduced by examining the location of the blobs in the inferior-superior patient axis. Those blobs that have the corresponding positions are assumed to originate from the same object. The remaining blobs are used to create fiducial configurations and are compared to the reference configuration from the computed tomography (CT) image dataset for treatment planning. The best-fit configuration is considered to have the appropriate fiducial markers. The patient position is determined based on these fiducial markers. During the treatment, the radiation beam is turned off when the Cyberknife changes nodes. This allows a time window to acquire live radiographs for the determination of the patient target position and to update the robotic manipulator to change beam orientations accordingly.

Evaluation of Three-dimensional Image Registration Methodologies for In Vivo Micro-computed Tomography

The advent of in vivo micro-computed tomography (micro-CT) provides a novel approach to measure the temporal adaptation of bone micro-architecture within an individual. Spatial alignment in the scanner between serial scans is challenging, but three-dimensional image registration can be used to superimpose the resulting image data, thus ensuring consistent regions of interest (ROI) for analysis. There have been several approaches to image registration developed, yet little is known about their application to high resolution micro-CT data. The purpose of this study was to explore combinations of three image registration similarity measures and three image interpolators, in addition to multi-resolution registration configurations, for assessment of computational efficiency and accuracy on both in vitro and in vivo micro-CT data. Accuracy measures were assessed by comparison with a gold-standard reference transform based on attached fiducial markers. It was concluded that a mutual information registration similarity measure with a linear image interpolator, applied at steps of increasing image resolution, provided the best compromise between accurate and efficient results. In vivo registration of tibial bone microstructure measured in an ovariectomized rat model provided consistent ROI thus demonstrating the usefulness of three-dimensional image registration for in vivo experimental and clinical micro-CT research. It is a technique that is poised to become commonly utilized for analysis of micro-CT data to diagnose and monitor efficacy of therapy in bone diseases.

Semi-Automatic Registration of Multi-Source Satellite Imagery with Varying Geometric Resolutions

Image registration is concerned with the problem of how to combine data and/or information from multiple sensors in order to achieve improved accuracies and better inference about the environment than could be attained through the use of a single sensor. Registration of imagery and information from multiple sources is essential for a variety of applications in remote sensing, medical diagnosis, computer vision, and pattern recognition. In general, an image registration methodology must deal with four issues. First, a decision has to be made regarding the choice of primitives for the registration procedure. The second issue is concerned with establishing the registration transformation function that mathematically relates geometric attributes of corresponding primitives. Then, a similarity measure should be devised to ensure the correspondence of conjugate primitives. Finally, a matching strategy has to be designed and implemented as a controlling framework that utilizes the primitives, the similarity measure, and the transformation function to solve the registration problem. This paper outlines a comprehensive investigation and implementation of the involved issues in a semi-automatic registration procedure capable of handling multi-source satellite imagery with varying geometric resolutions.