This paper was converted on www.awesomepapers.org from LaTeX by an anonymous user.
Want to know more? Visit the Converter page.

A method for large diffeomorphic registration via broken geodesics

Alphin J Thottupattu [email protected] Jayanthi Sivaswamy Venkateswaran P.Krishnan International Institute of Information Technology, Hyderabad 500032, India TIFR Centre for Applicable Mathematics, Bangalore 560065, India
Abstract

Anatomical variabilities seen in longitudinal data or inter-subject data is usually described by the underlying deformation, captured by non-rigid registration of these images. Stationary Velocity Field (SVF) based non-rigid registration algorithms are widely used for registration. SVF based methods form a metric-free framework which captures a finite dimensional submanifold of deformations embedded in the infinite dimensional smooth manifold of diffeomorphisms. However, these methods cover only a limited degree of deformations. In this paper, we address this limitation and define an approximate metric space for the manifold of diffeomorphisms 𝒢\mathcal{G}. We propose a method to break down the large deformation into finite compositions of small deformations. This results in a broken geodesic path on 𝒢\mathcal{G} and its length now forms an approximate registration metric. We illustrate the method using a simple, intensity-based, log-demon implementation. Validation results of the proposed method show that it can capture large and complex deformations while producing qualitatively better results than the state-of-the-art methods. The results also demonstrate that the proposed registration metric is a good indicator of the degree of deformation.

keywords:
Large Deformation, Inter-subject Registration, Approximate Registration Metric
journal: Journal of  Templates
This paper is under consideration at Computer Vision and Image Understanding

1 Introduction

Computational anatomy is an area of research focused on developing computational models of biological organs to study the anatomical variabilities in the deformation space. Anatomical variations arise due to structural differences across individuals and changes due to growth or atrophy in an individual. A common approach for quantifying the variability is to register the different images/shapes and parameterize the deformations with velocity fields. The registration algorithms typically optimize an energy functional based on a similarity function computed between the fixed and moving images.
Many initial image registration attempts use energy functionals inspired by physical processes to model the deformation as an elastic deformation [1], or viscous flow [2] or diffusion [3]. The diffusion-based approaches have been explored for 3D medical images in general [4] and with deformations constrained to be diffeomorphic [5] to ensure preservation of the topology. The two main approaches used to capture diffeomorphisms are parametric and nonparametric methods. The Free Form Deformation (FFD) model [6, 7] is a widely used parametric deformation model for medical image registration, where a rectangular grid with control points is used to model the deformation. Large diffeomorphic deformations [7] are handled by concatenating multiple FFDs. Deformable Registration via Attribute Matching and Mutual-Saliency Weighting (DRAMMS) [8] is a popular FFD-based method, which also handles inter-subject registration. DRAMMS matches Gabor features and prioritizes the reliable matching between images while performing registration. The main drawback of the deformations captured by FFD models is that they do not guarantee invertibility. The non-parametric methods represent the deformation with stationary or time varying velocity vector field. The diffeomorphic log-demon [5] is an example of the former while the Large Deformation Diffeomorphic Metric Mapping (LDDMM) [9] inspired from [10] is an example of the latter approach. In LDDMM, deformations are defined as geodesics on a Riemannian manifold, which is attractive; however, the methods based on this framework are computationally complex. The diffeomorphic log-demon framework [5], on the other hand, assigns a Lie group structure and assumes a stationary velocity field (SVF) which leads to computationally efficient methods, which is of interest to the community for practical purposes. This has motivated the exploration of a stationary LDDMM framework [11] that leverages the SVF advantage. The captured deformations are constrained to be symmetric in time-varying LDDMM [12] and log-demon [13] methods. The log-demon framework is of interest to the community for practical purposes because of its computational efficiency and simplicity.

The Lie group stucture gives a locally defined group exponential map to map the SVF to the deformation. Thus log-demon framework is meant to capture only neighboring elements in the manifold, i.e., only a limited degree of deformations can be captured. This will be referred to as the limited coverage issue of the SVF methods in this paper.

Notwithstanding the limited coverage, several SVF based methods have been reported for efficient medical image registration with different similarity metrics, sim, such as local correlation between the images [14], spectral features [15], modality independent neighborhood descriptors [16] and wavelet features [17, 18].

Lie group exponential map need not have any Riemannian metric associated with it as it is derived from the Lie group properties, and the log-demon framework is known to be metric free. The framework however, helps to analyze the underlying manifold and develop a representative group element called a template to study the variabilities among the manifold elements. The log-Euclidean mean [19] and the bi-invariant mean [20] are commonly used alternative approaches in diffeomorphic demons-based methods for template creation. Defining a metric space with SVF methods embedding complex deformations, is a challenging problem. A shape metric approximation method has been explored in [21] for the Lie group exponential map, with the shape metric taken to be the minimal length group exponential path connecting two shapes.

Defining a metric space with broader coverage for diffeomorphic deformations with Lie group structure is still unaddressed in the literature. The large deformations of interest are those that arise in the registration of inter-subject images/shapes. In this paper, we propose an image registration framework which can capture large diffeomorphisms. Any of the SVF based registration algorithms can be used in this framework. SVF based algorithms cannot handle complex deformations because the deformations are constrained to be smooth for the entire image and thus constrain the possible degree of deformation to some extent. We address this drawback by splitting the large deformation as compositions of smaller deformations.

2 Background

Let GG be a finite-dimensional Lie group with Lie algebra 𝔤\mathfrak{g}. Recall that 𝔤\mathfrak{g} is the tangent space TeGT_{e}G at the identity ee of GG. The exponential map exp:𝔤G\exp:\mathfrak{g}\rightarrow G is defined as follows: Let v𝔤v\in\mathfrak{g}. Then exp(v)=γv(1)\exp(v)=\gamma_{v}(1), where γ\gamma is the unique one-parameter subgroup of the Lie group GG with vv being its tangent vector at ee. The vector vv is called the infinitesimal generator of γ\gamma. The exponential map is a diffeomorphism from a small neighborhood containing 0 in the Lie algebra 𝔤\mathfrak{g} to a small neighborhood containing ee of GG.

Due to the fact that a bi-invariant metric may not exist for most of the Lie groups considered in medical image registration, the deformations considered here are elements of a Lie group with the Cartan-Schouten Connection [22]. This is the same as the one considered in the log-demon framework [5]. This is a left invariant connection [19] in which geodesics through the identity are one-parameter subgroups. The group geodesics are the geodesics of the connection. Any two neighboring points can be connected with a group geodesic. That is, if the stationary velocity field vv connecting two images in the manifold 𝒢\mathcal{G} is small enough, then its group exponential map forms a geodesic. Similarly every 𝔤G\mathfrak{g}\in G has a geodesically convex open neighbourhood [19].

3 Proposed method

SVF based registration methods capture only a limited degree of deformation because exponential mappings are only locally defined. In order to perform registration of a moving image towards a fixed image, SVF is computed iteratively by updating it with a smoothed velocity field. This update is computed via a similarity metric that measures the correspondence between the moving and fixed images. The spatial smoothing has a detrimental effect as we explain next. A complex deformation typically consists of spatially independent deformations in a local neighbourhood. Depending on the smoothing parameter value, only major SVF updates in each region is considered for registration. Thus, modeling complex deformations with a smooth stationary velocity field is highly dependent on the similarity metric and the smoothing parameter in a registration algorithm. Finding an ideal similarity metric and an appropriate smoothing parameter applicable for any registration problem, irrespective of the complexity of the deformation and the type of data, is difficult. We propose to address this issue as follows: Deform the moving image toward the fixed image by sequentially applying an SVF based registration. The SVF based algorithm chooses the major or the predominant (correspondence-based) deformation component among the spatially independent deformations in all the neighbourhoods to register along these predominant directions. The subsequent steps in the algorithm captures the next set of predominant directions sequentially. These sequentially captured deformations has a decreasing order of degree of pixel displacement caused by the deformations. Mathematically speaking, the discussion above can be summarised as follows. Consider complex deformations as a composition of finite group geodesics and use a registration metric approximation to quantify the deformation between two images in terms of the length of a broken geodesic connecting them; a broken geodesic is a piecewise smooth curve, where each curve segment is a geodesic.

In the proposed method, the similarity-based metric selects the predominant here deformation in each sequential step. The deformation that can bring the moving image in a step maximally closer to the target is selected from the one-parameter subgroup of deformations. In the manifold 𝒢\mathcal{G} every geodesic is contained in a unique maximal geodesic. Hence the maximal group geodesic γi\gamma_{i} computed using log-demon registration framework deforms the sequential image Si1S_{i-1} in the previous step maximally closer to SNS_{N}. The maximal group geodesic paths are composed to get the broken geodesic path. As the deformation segments are diffeomorphic, the composed large deformation of the segments is also diffeomorphic.

In the proposed method, the coverage of the SVF method and the degree of deformation determines the number of subgroups NN needed to cover the space. The feature based SVF methods in general, give more coverage for a single such subgroup and reduce the value of NN. The local deformations on the manifold 𝒢\mathcal{G} form a one-parameter subgroup, which is a finite-dimensional path connected subgroup. The topological space formed by composing the group geodesics also forms a path connected manifold, as shown in Figure 1. So a broken geodesic is a good choice to capture complex deformations as it can be computed between any two points in the manifold along with the metric associated with the path.

Refer to caption
Figure 1: Underlying manifold structure and a broken geodesic path connecting S0S_{0} and SNS_{N}.

A broken geodesic γ:[0,T]M\gamma:[0,T]\rightarrow M has finite number of geodesic segments γi\gamma_{i} for partitions of the domain 0<t1<t2<<ti<tN=T0<t_{1}<t_{2}<\cdots<t_{i}<\cdots t_{N}=T where i=1,.Ni=1,....N. The proposed algorithm to deform S0S_{0} towards SNS_{N} is given in Algorithm 1. We have chosen the registration algorithm from [13] to compute SVF, uiu_{i}, in Algorithm 1. The Energy term is as defined below where the first term is a functional of the similarity measure, which captures the correspondence between images, with sim(SN,Si)=SNSi1exp(vi)\mbox{sim}(S_{N},S_{i})=S_{N}-S_{i-1}\circ\exp(v_{i}). The second term is a regularization term, with Reg(γi)=γi2(\gamma_{i})=\lVert\bigtriangledown\gamma_{i}\rVert^{2}.

Energy(Si,SN)=sim(SN,Si)+Reg(γi).\mbox{Energy}(S_{i},S_{N})=\mbox{sim}(S_{N},S_{i})+\mbox{Reg}(\gamma_{i}). (1)
Algorithm 1 Proposed Algorithm
1:Input: S0S_{0} and SNS_{N}
2:Result: Transformation γ=exp(v1)exp(v2)exp(vN)\gamma=\exp(v_{1})\circ\exp(v_{2})\circ...\exp(v_{N})
3:Initialization: EminE_{\mathrm{min}}=Energy(S0,SN(S_{0},S_{N})
4:repeat
5:     Register Si1S_{i-1} to SNS_{N} \rightarrow uiu_{i}
6:     Temp=Si1exp(ui)\mbox{Temp}=S_{i-1}\circ\exp(u_{i})
7:     Ei=Energy(Temp,SN)E_{i}=\mbox{Energy}(\mbox{Temp},S_{N})
8:     if Ei<EminE_{i}<E_{\mathrm{min}} then
9:         vi=uiv_{i}=u_{i}
10:         Emin=EiE_{\mathrm{min}}=E_{i}
11:         Si=TempS_{i}=\mbox{Temp}
12:     end if
13:until Convergence

3.1 Registration metric approximation

Let γ\gamma be a broken geodesic decomposed into NN geodesics γi\gamma_{i} with stationary field viv_{i}, i.e. γi˙=vi(γ(t))Tγi(t)M\dot{\gamma_{i}}=v_{i}(\gamma(t))\in T_{\gamma_{i}(t)}M. Each of the constant velocity paths γi\gamma_{i} is parameterized by the time interval [ti1,ti][t_{i-1},t_{i}], and NN\in\mathbb{N} is minimized by requiring each of the geodesics in the broken geodesic to be maximal geodesics. The length of the broken geodesic is defined as,

l(γ)=iNl(γi)=iNd(Si1,Si)l(\gamma)=\sum_{i}^{N}l(\gamma_{i})=\sum_{i}^{N}d(S_{i-1},S_{i}) (2)

where, dd is a distance metric defined in Equation 3 .

d(Si1,Si)=inf{viV,Si1exp(vi)=Si}.d(S_{i-1},S_{i})=\inf\{\left\|v_{i}\right\|_{V},S_{i-1}\circ\exp(v_{i})=S_{i}\}. (3)

A registration metric needs to be defined to quantify the deformation between two images. The shape metric approximation in [21] can be used for the group geodesics of the Cartan-Schouten connection defined in the finite dimensional case as no bi-invariant metric exists. The length of a broken geodesic l(γ)l(\gamma) on the manifold 𝒢\mathcal{G} connecting S0S_{0} and SNS_{N}, computed by Equation 2 is defined as the proposed approximate metric. If any two points in the manifold 𝒢\mathcal{G} can be connected with a broken geodesic, then this would imply that the manifold is connected. Furthermore, there exists a notion of an asymmetric registration metric.

4 RESULTS

The proposed method was implemented using a simple intensity based diffeomorphic log-demon technique [23] for illustrating the concept which is openly available at: http://dx.doi.org/10.17632/29ssbs4tzf.1. This choice also facilitates understanding the key strengths of the method independently. Two state-of-the-art (SOTA) methods are considered for performance comparison with the proposed method: the symmetric LDDMM implementation in ANTs [12] and DRAMMS which is a feature based, free-form deformation estimation method [8]. These two methods are considered to be good tools for inter-subject registration [24]. Publicly available codes were used for the SOTA methods with parameter settings as suggested in [24] for optimal performance. Both methods were implemented with B-spline interpolation, unless specified. 3D registration was done and the images used in the experiments were sourced from [25] and [26] unless specified.

Refer to caption
Figure 2: Registration results for different methods. First row: pairs of images to be registered and registration results. Second row: absolute intensity difference between the fixed image and the rest of the images in the first row.

The proposed method and registration metric were validated with both controlled and natural deformations.

4.1 Experiments with controlled deformations

An arbitrary deformation was introduced to a 2D slice of MRI and the two were registered using ANTS, DRAMMS and the proposed method.

The results in Fig.2 indicate that SOTA methods have difficulty in dealing with complex deformations (regions marked with red arrows), as errors can be found in the registered results.

Next the deformation captured by proposed method was verified to be diffeomorphic. Fig.3 shows details of the 2D registration of the images in Fig.2 in terms of the forward and reverse deformations computed with a broken geodesic path. Included are the deformed images in each path. This provides a visual confirmation that the method captures diffeomorphic forward and inverse deformations. The deformed regions are pointed by the red arrow and can also be interpreted from the applied deformation.

Refer to caption
Figure 3: Diffeomorphic registration with the proposed method. Geodesic forward (first row) and backward path (second row) along with the deformations captured by the proposed method.

The proposed registration metric was validated as follows. Synthetic deformations were applied to a 2D MRI slice at 25 random control points in the image. The deformation was varied from approximately 0.05%0.05\% area coverage per control point in 10 equal intervals, i.e. k×k\times 0.05%0.05\%; k=1,210k=1,2...10 (these are referred to as the degree of deformation). Fig.4 shows a plot of the computed value of the proposed registration metric in Equation (2), as a function of the degree of deformations, kk, for 10 random deformations. The monotonic behaviour seen in the plot confirms the integrity of the proposed registration metric and the method for registration.

Refer to caption
Figure 4: Proposed registration metric as a function of increasing degree of deformation for 10 random deformations (the coloured plots)

4.2 Experiments with inter-subject image registration

The proposed image registration algorithm was used to register MRIs of different individuals. The mean squared error (MSE) was used as a similarity metric along with cubic interpolation. To analyse the performance visually, ten 3T MRI scans were collected. Five images collected from 20-30 year old male subjects were considered as moving images and five images collected from 40-50 year old female subjects were considered as fixed images. Performing a good registration is challenging with this selection of moving and fixed images. The high resolution MRI scans used for this experiment are openly available at http://dx.doi.org/10.17632/gnhg9n76nn.1. The registration results for these five different pairs are shown in Fig.5 where only a sample slice is visualized for the 5 cases. The quality of registration can be assessed by observing the degree of match between images in the last two rows of each column. The results indicate that the proposed method is good at capturing complex inter-subject deformations.

Refer to caption
Figure 5: Inter-subject image registration for 5 pairs of volumes (in 5 columns). Only sample slices are shown.

The deformation calculated by the proposed method was also checked to ascertain if it is a diffeomorphism or not. Fig.6 shows the forward and reverse deformation results with results of ANTs registration method included for comparison. The arrows overlaid on the registered images highlight regions where the proposed method yields error-free results as opposed to the other method. The forward and backward transforms in the last row compare well with the applied versions.

Refer to caption
Figure 6: Forward and Backward Image Registration. Blue (Red) arrow shows deformations in S0S_{0} (SNS_{N}) and SNS_{N} (S0S_{0}) registered to S0S_{0} (SNS_{N}). The proposed method captures finer details compared to ANTs.

The performance of the proposed method on medical images to capture natural deformations was next evaluated for inter-subject image registration and compared with the state-of-the-art methods in Fig.7. To apply the computed deformation, linear interpolation was used in all the methods. ANTs and the proposed method used MSE as a similarity metric for fair comparison and DRAMMS used its Gabor feature-based metric as it is a feature based method. The results shows that the deformations at the sulcal regions are better captured by the proposed method.

Refer to caption
Figure 7: Inter-subject image registration with 3 methods: DRAMMS, ANTs and the proposed method, implemented with linear interpolation. The regions near same colour arrows can be compared to check the registration accuracy.

Next we present a quantitative comparison of the proposed method compared with ANTs and DRAMMS under the same setting. The average MSE for the 10 pair registration with ANTs was 0.0036±0.00090.0036\pm 0.0009, with DRAMMS it was 0.0113±0.00680.0113\pm 0.0068 and with the proposed method it was 0.0012±7.0552e080.0012\pm 7.0552e-08.

The computed deformations in each method were used to transfer region segmentation (labels) from the moving image to the fixed image. The transferred segmentations are assessed using the Dice metric. Fig.8 shows a box plot of the obtained Dice values calculated by registering 10 pairs of brain MRIs with the fixed image, for white matter (WM), grey matter (GM) and 2 structures (L & R-hippocampus). The segmentation results for larger structures (i.e., WM and GM) are better with the proposed method compared to the other methods, whereas the smaller structure segmentation is comparable to DRAMMS.

These results taken together with the qualitative results, indicate that DRAMMS is not able to capture very complex deformations though the errors suffered by the label transfer is comparable to the proposed method.

Refer to caption
Figure 8: Assessment of registration via segmentation of different structures using ANTS (magenta), DRAMMS (red), and the proposed method (blue). Box plots for the Dice coefficient are shown for White Matter (WM), Gray Matter (GM) and the Left and Right Hippocampi.

Finally, a validation of the proposed registration metric was done using two age-differentiated (20-30 versus 70-90 years) sets of MRIs, of 6 female subjects. Images from these 3D image sets were registered to an (independently drawn) MRI of a 20 year-old subject. The proposed registration metric was computed for the 6 pairs of registrations. A box plot of the registration metric value for each age group is shown in Fig.9. Since the fixed image is that of a young subject, the registration metric value should be higher for the older group than for the younger group, which is confirmed by the plot. Hence, it can be concluded that the proposed registration metric is a good indicator of natural deformations as well.

Refer to caption
Figure 9: Validation of the proposed registration metric. Box plots of the proposed registration metric values for registration of the fixed image with images of young and old subject group.Only the central slice is displayed.

5 Conclusion

Group exponential map based methods, with simple similarity registration metrics, fail to capture large deformations as the map is local in nature. We have addressed this issue in this paper by modelling large deformations with broken geodesic paths with the path length taken to be the associated registration metric. The proposed framework/method makes the underlying manifold path-connected. The results of implementation with a simple log-demon method show the performance to be superior to SOTA methods for complex/large deformations. Efficient implementation of the proposed approach are currently being explored.

Declaration of interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

References

  • [1] C. Broit, Optimal registration of deformed images, University of Pennsylvania (1981) .
  • [2] T. Christensen et al., Shoving model for viscous flow, World Scientific 12 (1981) 375.
  • [3] J.-P.Thirion, Image matching as a diffusion process: an analogy with Maxwell’s demons, Med Image Anal. 2(3) (1998) 243–260.
  • [4] X. Pennec et al., Understanding the Demon’s Algorithm: 3D Non-rigid Registration by Gradient Descent (1999) 597–605.
  • [5] V. Arsigny et al., A Log-Euclidean Framework for Statistics on Diffeomorphisms, MICCAI 9 (2006) 924–31.
  • [6] J. Declerck et al., Automatic Registration and Alignment on a Template of Cardiac Stress and Rest Reoriented SPECT Images., IEEE transactions on medical imaging 16 (1997) 727–37.
  • [7] D. Rueckert et al., Diffeomorphic registration using B-splines, Med Image Comput Comput Assist Interv 9(Pt 2) (2006) 702–709.
  • [8] Y. Ou et al., DRAMMS: Deformable registration via attribute matching and mutual-saliency weighting., Med Image Anal. 15(4) (2011) 622–639.
  • [9] M. F. Beg et al., Computing Large Deformation Metric Mappings via Geodesic Flows of Diffeomorphisms, International Journal of Computer Vision 61 (2005) 139–157.
  • [10] A. Trouvé, Diffeomorphisms groups and pattern matching in image analysis, International Journal of Computer Vision 28 (1998) 213–221.
  • [11] M. Hernandez et al., Registration of anatomical images using geodesic paths of diffeomorphisms parameterized with stationary vector fields, IEEE 11th International Conference on Computer Vision (2007) 1–8.
  • [12] B. B. Avants et al., Symmetric Diffeomorphic Image Registration with Cross-Correlation: Evaluating Automated Labeling of Elderly and Neurodegenerative Brain, Medical image analysis 12 (2008) 26–41.
  • [13] T. Vercauteren et al. , Symmetric log-domain diffeomorphic Registration: a demons-based approach. , Med Image Comput Comput Assist Interv 11(Pt 1) (2008) 754–761.
  • [14] M. Lorenzi et al., LCC-Demons: A robust and accurate symmetric diffeomorphic registration algorithm, NeuroImage 81 (2013) 470 – 483.
  • [15] H. Lombaert et al., Spectral Log-Demons: Diffeomorphic Image Registration with Very Large Deformations., Int J Comput Vis 107 (2014) 254–271.
  • [16] S. Reaungamornrat et al., MIND Demons: Symmetric Diffeomorphic Deformable Registration of MR and CT for Image-Guided Spine Surgery , IEEE Trans Med Imaging 35(11) (2016) 2413–2424.
  • [17] N. Pham et al., Spectral Graph Wavelet based Nonrigid Image Registration, IEEE Transactions on Pattern Analysis and Machine Intelligence (2018) 3348–3352.
  • [18] J.T. Alphin et al. , Non-rigid Registration using Spectral Graph Wavelet Features , ICVGIP (2018) 4–6.
  • [19] V. Arsigny et al., A Fast and Log-Euclidean Polyaffine Framework for Locally Linear Registration, [Research Report]RR-5885,INRIA(2006).
  • [20] V. Arsigny et al., Bi-invariant Means in Lie Groups. Application to Left-invariant Polyaffine Transformations, [Research Report] INRIA Sophia Antipolis(2006).
  • [21] X. Yang et al., Diffeomorphic Metric Landmark Mapping Using Stationary Velocity Field Parameterization., Int J Comput Vis 115 (2015) 69–86.
  • [22] X. Pennec, Bi-invariant means on Lie groups with Cartan-Schouten connections, Geometric Science of Information (2013) 59–67.
  • [23] Herve Lombaert, Diffeomorphic Log Demons Image Registration., MATLAB Central File Exchange.
  • [24] Y. Ou et al., Comparative Evaluation of Registration Algorithms in Different Brain Databases With Varying Difficulty: Results and Insights, IEEE transactions on medical imaging 33 (2014) .
  • [25] B. Landman, S. Warfield , MICCAI 2012 workshop on multi-atlas labeling, Create Space Independent Publishing Platform 2 (2012) .
  • [26] J. Sivaswamy et al., Construction of Indian human brain atlas, Neurology India 67.