This paper was converted on www.awesomepapers.org from LaTeX by an anonymous user.
Want to know more? Visit the Converter page.

Non-Iterative Simultaneous Rigid Registration Method for Serial Sections of Biological Tissue

Abstract

In this paper, we propose a novel non-iterative algorithm to simultaneously estimate optimal rigid transformation for serial section images, which is a key component in volume reconstruction of serial sections of biological tissue. In order to avoid error accumulation and propagation caused by current algorithms, we add extra condition that the position of the first and the last section images should remain unchanged. This constrained simultaneous registration problem has not been solved before. Our algorithm method is non-iterative, it can simultaneously compute rigid transformation for a large number of serial section images in a short time. We prove that our algorithm gets optimal solution under ideal condition. And we test our algorithm with synthetic data and real data to verify our algorithm’s effectiveness.

Index Terms—  serial section, microscopic image, volume reconstruction, constrained simultaneous registration problem, rigid transformation, non-iterative.

1 Introduction

Volume reconstruction from serial sections of biological tissue [1, 2, 3] has drawn great attention in the community of neuroscience in recent years. Due to the distortion caused by sectioning, microscopic image registration which aims to recover the 3D continuity of serial sections becomes a key component therein.

Several 3D registration methods [4, 5, 6, 7, 8] have been proposed for serial section images. Since reliable correspondences could only be extracted from adjacent section images, these methods always choose one of section images as reference, and then do forward or backward image registration sequentially for every two neighboring images. These sequential methods alleviate the difficulty of 3D registration, but introduce error accumulation and propagation. And they are all time consuming making them inappropriate for simultaneously registering large numbers of section images.

Actually, the correct position of the first and the last section images can be known by taking photos of top and bottom surfaces of sample before sectioning. Assuming that positions of the first and the last section images have been correctly adjusted, if optimal transformation of remaining section images could be simultaneously estimated, error would not accumulate and propagate. Therefore it makes sense to achieve simultaneous registration for serial section images under the condition that the position of the first and the last section images are fixed. This constrained simultaneous registration problem is brand new, it has not been solved before.

To address above problem, we propose a novel non-iterative method to simultaneously estimate optimal rigid transformation for serial section images, while limiting the position of the first and the last section images to remain unchanged. We prove that our algorithm can get optimal solution when condition is ideal.

2 non-iterative simultaneous rigid registration method

First of all, we transform the first and the last images into correct positions according to their relative position before sectioning. We utilize SIFT flow method [9] to obtain robust correspondences between adjacent images. SIFT flow algorithm is able to match densely sampled, pixel-wise SIFT features between two images. Even though individual feature has low discrimination, its correspondence can be inferred by taking into account neighborhood relationship. From extracted dense correspondences, we further select sparse pairs with low matching error. In this way, the correspondences we obtain is robust and reliable. What remains to do is solving a constrained simultaneous registration problem.

Above problem can mathematically described as follows: Point set Xi,j{\textbf{X}_{i,j}} is composed of the landmarks extracted from i-th image, whose correspondences is Xj,i{\textbf{X}_{j,i}} from the j-th image. Since they are one-to-one correspondence, so the number of Xi,j{\textbf{X}_{i,j}} equals that of Xj,i{\textbf{X}_{j,i}}, denoted by mi{m_{i}}. Our goal turns to be estimating optimal rigid transformations for those point sets to minimize corresponding point distances across them, under the condition that the position of X1{\textbf{X}_{1}} and Xn{\textbf{X}_{n}} are fixed. So the objective can be defined as

argmin𝐑i,𝐓ii=1n1𝐑i𝐗i,i+1+𝐓i𝐞i𝐑i+1𝐗i+1,i𝐓i+1𝐞iF2s.t.{𝐑iT𝐑i=𝐈det(𝐑i)=1𝐑1=𝐑n=𝐈𝐓1=𝐓n=𝟎2×1\begin{array}[]{*{20}{l}}{\mathop{\arg\min}\limits_{{{\bf{R}}_{i}},{{\bf{T}}_{i}}}\sum\limits_{i=1}^{n-1}{{{\left\|{{{\bf{R}}_{i}}{{\bf{X}}_{i,i+1}}+{{\bf{T}}_{i}}{{\bf{e}}_{i}}-{{\bf{R}}_{i+1}}{{\bf{X}}_{i+1,i}}-{{\bf{T}}_{i+1}}{{\bf{e}}_{i}}}\right\|}_{F}}^{2}}}\\ {s.t.\left\{{\begin{array}[]{*{20}{c}}{{\bf{R}}_{i}^{T}{{\bf{R}}_{i}}={\bf{I}}}\\ {\det({{\bf{R}}_{i}})=1}\\ {{{\bf{R}}_{1}}={{\bf{R}}_{n}}={\bf{I}}}\\ {{{\bf{T}}_{1}}={{\bf{T}}_{n}}={{\bf{0}}_{2\times 1}}}\end{array}}\right.}\end{array} (1)

Where rigid transformation of point set Xi,j{\textbf{X}_{i,j}} is represented by the combination of rotation matrix 𝐑i{{\bf{R}}_{i}} and translation vector 𝐓i{{\bf{T}}_{i}}. 𝟎2×1{{\bf{0}}_{2\times 1}} is a zero vector of size 2×12\times 1, and 𝐞i{{\bf{e}}_{i}} is a row vector of length mi{m_{i}} with each component equal to one.

In following subsection, we will explain our approach to estimate rotation and translation, provide work flow of our method and discuss under what condition we can get optimal solution.

2.1 Estimation of Rotation Matrix

We move the centroid of every point set to the origin, and denote the point set after translation as Xi,j^\widehat{{X_{i,j}}}. This process is referred to as centralization of Xi,j{\textbf{X}_{i,j}}. We optimize (2) to estimate rotation matrix. It will be proven that under ideal condition, (2) is equivalent to (1).

argmin𝐑ii=1n1𝐑i𝐗i,i+1^𝐑i+1𝐗i+1,i^F2s.t.{𝐑iT𝐑i=Idet(𝐑i)=1𝐑1=𝐑n=I\begin{array}[]{*{20}{l}}{\mathop{\arg\min}\limits_{{{\bf{R}}_{i}}}\sum\limits_{i=1}^{n-1}{{{\left\|{{{\bf{R}}_{i}}\widehat{{{\bf{X}}_{i,i+1}}}-{{\bf{R}}_{i+1}}\widehat{{{\bf{X}}_{i+1,i}}}}\right\|}_{F}}^{2}}}\\ {s.t.\left\{{\begin{array}[]{*{20}{c}}{\begin{array}[]{*{20}{l}}{{\bf{R}}_{i}^{T}{{\bf{R}}_{i}}=I}\\ {\det({{\bf{R}}_{i}})=1}\end{array}}\\ {{{\bf{R}}_{1}}={{\bf{R}}_{n}}=I}\end{array}}\right.}\end{array} (2)

Let Wi=RiTRi+1,Ai=Xi+1,i^Xi,i+1^T{\textbf{W}_{i}}={\textbf{R}_{i}}^{T}{\textbf{R}_{i+1}},{\textbf{A}_{i}}=\widehat{{\textbf{X}_{i+1,i}}}{\widehat{{\textbf{X}_{i,i+1}}}^{T}}, so the minimization can be rewritten as follows:

argmin𝐖ii=1n1tr(𝐖i𝐀i)s.t.{i=1n𝐖i=𝐈𝐖iT𝐖i=𝐈det(𝐖i)=1\begin{array}[]{*{20}{l}}{\mathop{\arg\min}\limits_{{{\bf{W}}_{i}}}\sum\limits_{i=1}^{n-1}{-tr\left({{{\bf{W}}_{i}}{{\bf{A}}_{i}}}\right)}}\\ {s.t.\left\{{\begin{array}[]{*{20}{l}}{\begin{array}[]{*{20}{c}}{\prod\limits_{i=1}^{n}{{{\bf{W}}_{i}}}={\bf{I}}}\\ {{\bf{W}}_{\rm{i}}^{T}{{\bf{W}}_{i}}={\bf{I}}}\end{array}}\\ {\det({{\bf{W}}_{i}})=1}\end{array}}\right.}\end{array} (3)

By using Lemma 1 in the appendix, solving (3) is equivalent to solving (4).

argminθii=1n1tr(𝐂i𝐒i)cosθis.t.i=1n1θi=θ\begin{array}[]{*{20}{l}}{\mathop{\arg\min}\limits_{{\theta_{i}}}\sum\limits_{i=1}^{n-1}{-tr\left({{{\bf{C}}_{i}}{{\bf{S}}_{i}}}\right)\cos{\theta_{i}}}}\\ {s.t.\sum\limits_{i=1}^{n{\rm{-}}1}{{\theta_{i}}=-\theta}}\end{array} (4)

Optimal solution to (3) equals 𝐇i𝐕i𝐂i𝐔iT{{\bf{H}}_{i}}{{\bf{V}}_{i}}{{\bf{C}}_{i}}{\bf{U}}_{i}^{T}. Where 𝐇i{{\bf{H}}_{i}} is a 2×22\times 2 rotation matrix whose rotation degree is θi{\theta_{i}}, which is the solution of (4). And (4) can be easily solved by using interior point method. 𝐔i𝐒i𝐕iT{{\bf{U}}_{i}}{{\bf{S}}_{i}}{\bf{V}}_{i}^{T} is Singular Value Decomposition (SVD) of Ai\textbf{A}_{i}. 𝐂i{{\bf{C}}_{i}} is a diagonal matrix diag(1,det(𝐕i𝐔iT))diag(1,\det({{\bf{V}}_{i}}{\bf{U}}_{i}^{T})). θ\theta is the rotation degree of i=1n𝐕i𝐂i𝐔iT\prod\limits_{i=1}^{n}{{{\bf{V}}_{i}}{{\bf{C}}_{i}}{\bf{U}}_{i}^{T}}. We provide lemmas and their proofs in the appendix.

2.2 Estimation of Translation Vector

With the rotation matrix estimated, we define 𝐙i=𝐑i𝐗i,i+1𝐑i+1𝐗i+1,i{{\bf{Z}}_{i}}={{\bf{R}}_{i}}{{\bf{X}}_{i,i+1}}-{{\bf{R}}_{i+1}}{{\bf{X}}_{i+1,i}}, 𝐓𝐡i=𝐓i𝐓i+1{\bf{T}}{{\bf{h}}_{i}}={{\bf{T}}_{i}}-{{\bf{T}}_{i+1}}, minimization of function in (1) can be rewritten as

argmin𝐓𝐡ii=1n1𝐙i+𝐓𝐡i𝐞iF2s.t.i=1n1𝐓𝐡i=𝟎2×1\begin{array}[]{*{20}{l}}{\mathop{\arg\min}\limits_{{\bf{T}}{{\bf{h}}_{i}}}\sum\limits_{i=1}^{n-1}{{{\left\|{{{\bf{Z}}_{i}}+{\bf{T}}{{\bf{h}}_{i}}{{\bf{e}}_{i}}}\right\|}_{F}}^{2}}}\\ {s.t.\sum\limits_{i=1}^{n-1}{{\bf{T}}{{\bf{h}}_{i}}}={{\bf{0}}_{2\times 1}}}\end{array} (5)

Equating the partial derivative of (5) with respect to Thi\textbf{Th}_{i} to zero, and using Sherman-Morrison Formula [10], we obtain

𝐓𝐡i=mi1𝐙i𝐞iT+mi1m11++mn11j=1n1mj1𝐙j𝐞jT{\bf{T}}{{\bf{h}}_{i}}=-m_{i}^{-1}{{\bf{Z}}_{i}}{\bf{e}}_{i}^{T}+\frac{{m_{i}^{-1}}}{{m_{1}^{-1}+\cdots+m_{n-1}^{-1}}}\sum\limits_{j=1}^{n-1}{m_{j}^{-1}{{\bf{Z}}_{j}}{\bf{e}}_{j}^{T}} (6)

so

𝐓1=𝟎2×1,𝐓i=j=2i𝐓𝐡j1,i=2,,n{{\bf{T}}_{1}}={{{\bf{0}}_{2\times 1}}},{{\bf{T}}_{i}}=\sum\limits_{j=2}^{i}{{\bf{T}}{{\bf{h}}_{j-1}}},i=2,\cdots,n (7)

2.3 Algorithm Flow

We summarize our non-iterative simultaneous rigid registration algorithm in Algorithm 1.
  Algorithm 1: Non-iterative Simultaneous Rigid Registration
 
input: original serial section images 𝐈i(i=1,,n){{\bf{I}}_{i}}\quad(i=1,\ldots,n)
 
1:Xi,i+j{\textbf{X}_{i,i+j}} \longleftarrow landmarks of 𝐈i{{\bf{I}}_{i}}  (i=1,,n;j=1,1i=1,\ldots,n;j=-1,1)
2:Xi,i+j^\widehat{{\textbf{X}_{i,i+j}}} \longleftarrow centralized Xi,i+j{\textbf{X}_{i,i+j}}  (i=1,,n;j=1,1i=1,\ldots,n;j=-1,1)
3:Ai{\textbf{A}_{i}} \longleftarrow Xi+1,i^Xi,i+1^T\widehat{{\textbf{X}_{i+1,i}}}{\widehat{{\textbf{X}_{i,i+1}}}^{T}}  (i=1,,n1i=1,\ldots,n-1)
4:Vi\textbf{V}_{i},Si\textbf{S}_{i},Ui\textbf{U}_{i} \longleftarrow SVD of Ai\textbf{A}_{i}  (i=1,,n1i=1,\ldots,n-1)
5:Ci\textbf{C}_{i} \longleftarrow diag(1,det(ViUiT))diag(1,\det({\textbf{V}_{i}}\textbf{U}_{i}^{T}))  (i=1,,n1i=1,\ldots,n-1)
6:θi{\theta_{i}} \longleftarrow solution of (4)  (i=1,,n1i=1,\ldots,n-1)
7:Hi\textbf{H}_{i} \longleftarrow [cosθisinθisinθicosθi]\left[{\begin{array}[]{*{20}{c}}{\cos{\theta_{i}}}&{-\sin{\theta_{i}}}\\ {\sin{\theta_{i}}}&{\cos{\theta_{i}}}\end{array}}\right]  (i=1,,n1i=1,\ldots,n-1)
8:Wi{\textbf{W}_{i}} \longleftarrow HiViCiUiT{\textbf{H}_{i}}{\textbf{V}_{i}}{\textbf{C}_{i}}\textbf{U}_{i}^{T}  (i=1,,n1i=1,\ldots,n-1)
9:R1\textbf{R}_{1} \longleftarrow 𝐈{\bf{I}}, Ri\textbf{R}_{i} \longleftarrow k=1i1Wk\prod\limits_{k=1}^{i-1}{{\textbf{W}_{k}}}  (i=2,,ni=2,\ldots,n)
10:Zi{\textbf{Z}_{i}} \longleftarrow RiXi,i+1Ri+1Xi+1,i{\textbf{R}_{i}}{\textbf{X}_{i,i+1}}-{\textbf{R}_{i+1}}{\textbf{X}_{i+1,i}}  (i=1,,n1i=1,\ldots,n-1)
11:Thi{\textbf{Th}_{i}} \longleftarrow mi1𝐙i𝐞iT+mi1m11++mn11j=1n1mi1𝐙i𝐞iT-m_{i}^{-1}{{\bf{Z}}_{i}}{\bf{e}}_{i}^{T}+\frac{{m_{i}^{-1}}}{{m_{1}^{-1}+\cdots+m_{n-1}^{-1}}}\sum\limits_{j=1}^{n-1}{-m_{i}^{-1}{{\bf{Z}}_{i}}{\bf{e}}_{i}^{T}}
(i=1,,n1i=1,\ldots,n-1)
12:T1\textbf{T}_{1} \longleftarrow 𝟎2×1{{{\bf{0}}_{2\times 1}}}, Ti{\textbf{T}_{i}} \longleftarrow j=2i𝐓𝐡j1\sum\limits_{j=2}^{i}{{\bf{T}}{{\bf{h}}_{j-1}}}  (i=2,,ni=2,\ldots,n)
13:Ii{\textbf{I}_{i}} \longleftarrow Ii{\textbf{I}_{i}} transformed by Ri{\textbf{R}_{i}} and Ti{\textbf{T}_{i}}  (i=1,,ni=1,\ldots,n)
 
output: registered serial section images 𝐈i(i=1,,n){{\bf{I}}_{i}}\quad(i=1,\ldots,n)
 

2.4 Optimality Conditions

If all the images are under rigid transformation, for 𝐗i,i+1{{{\bf{X}}_{i,i+1}}} and 𝐗i+1,i{{{\bf{X}}_{i+1,i}}} are one-to-one correspondences, we can opine that they are just the same point set 𝐒i{{\bf{S}}_{i}} under different rigid transformations. Let 𝐗i,i+1=𝐫i𝐒i+𝐭i{{\bf{X}}_{i,i+1}}={{\bf{r}}_{i}}{{\bf{S}}_{i}}+{{\bf{t}}_{i}} and 𝐗i+1,i=𝐫i+1𝐒i+𝐭i+1{{\bf{X}}_{i+1,i}}={{\bf{r}}_{i+1}}{{\bf{S}}_{i}}+{{\bf{t}}_{i+1}}. If the position of the first and the last image have been correctly adjusted, we have 𝐫1=𝐫n=𝐈,𝐭1=𝐭n=𝟎2×1\begin{array}[]{*{20}{l}}{{{\bf{r}}_{1}}={{\bf{r}}_{n}}={\bf{I}},{{\bf{t}}_{1}}={{\bf{t}}_{n}}={{\bf{0}}_{2\times 1}}}\end{array}. Hence (2) can be rewritten as

argmin𝐑ii=1n1(𝐑i𝐫i𝐑i+1𝐫i+1)𝐒iF2s.t.{𝐑iT𝐑i=Idet(𝐑i)=1𝐑1=𝐑n=I\begin{array}[]{*{20}{l}}{\mathop{\arg\min}\limits_{{{\bf{R}}_{i}}}\sum\limits_{i=1}^{n-1}{{{\left\|{\left({{{\bf{R}}_{i}}{{\bf{r}}_{i}}-{{\bf{R}}_{i+1}}{{\bf{r}}_{i+1}}}\right){{\bf{S}}_{i}}}\right\|}_{F}}^{2}}}\\ {s.t.\left\{{\begin{array}[]{*{20}{c}}{\begin{array}[]{*{20}{l}}{{\bf{R}}_{i}^{T}{{\bf{R}}_{i}}=I}\\ {\det({{\bf{R}}_{i}})=1}\end{array}}\\ {{{\bf{R}}_{1}}={{\bf{R}}_{n}}=I}\end{array}}\right.}\end{array} (8)

Here we have a trivial solution to (8):

𝐑i=𝐫i1(i=2,,n1){{\bf{R}}_{i}}={\bf{r}}_{i}^{-1}{\rm{}}\quad(i=2,\ldots,n-1) (9)

Substitute (9) into (6), (6) is simplified as

𝐓𝐡i=mi1𝐙i𝐞iT{\bf{T}}{{\bf{h}}_{i}}=-m_{i}^{-1}{{\bf{Z}}_{i}}{\bf{e}}_{i}^{T} (10)

Substitute (10) into (1), we get (2), proving that under ideal condition, it is equivalent to use (2) to replace (1).

So if we want to get optimal solution, we have to satisfy two conditions: firstly all the serial sections are rigidly deformed, secondly the position of the first and the last image is correctly adjusted, which means that they have no relative displacement. Our algorithm is not designed to handle nonrigid deformation, but it can still offer robust initial estimate for other nonrigid registration algorithms.

3 Experimental Evaluation

In order to verify the effectiveness of the algorithm, we test our algorithm with both synthetic and real data. With the former we prove that even though correspondences are not accurate, we can still register well. While the latter demonstrates its application to real scenes.

3.1 Synthetic Data

We divide a point set which depicts a fish into 8 subsets, and apply different rigid transformations to them. Each subset shares partial points with adjacent subset, denoted by the same color. The first and the last point sets are completely overlapped, so their relative position does not need to be adjusted. We add random noise proportional to the coordinates of each point to simulate real scenes. Our experimental result is shown in the Fig. 1. We use mean square error (MSE) between ground truth and our registration result to measure accuracy.

Refer to caption
Fig. 1: Experimental result. Left: an example of test data. Middle: corresponding registration result. Right: plot of MSE versus noise ratio.

We can see from Fig. 1 that with noise ratio growing, MSE still maintains at a low level. Hence we can still get accurate registration result despite getting inaccurate one-to-one correspondences.

3.2 Real Data

We use our non-iterative simultaneous rigid registration algorithm (NSRR) to register serial section images of zebrafish, which contains 336 microscopic images imaged by scanning electron microscope (SEM). The thickness of the section is 50nm, the resolution of the image is 6144 by 6144 pixels, and the pixel size of the image is 110nm. Different levels of rotation, translation, scaling and nonlinear deformation are involved. We utilize SIFT flow method [9] to obtain correspondences illustrated in Fig. 2.

Refer to caption
Fig. 2: An exhibition of correspondences we extract. We utilize SIFT flow method to obtain dense correspondences between adjacent images, then we select sparse pairs with low matching error therein.
Table 1: Comparison of EPE and time
Method EPE Time
3D image registration 0.0738 2184s
Pairwise method 0.0418 0.329s
NSRR (ours) 0.0262 0.224s

We use endpoint error (EPE) to evaluate accuracy, which is Euclidean distance between adjacent images, averaged over all pixels. Here an image is resized to a vector. Pairwise method [11] and 3D image registration method [4] are used as baselines. Here pairwise method is applied sequentially to register adjacent section images. Table. 1 exhibits comparison among 3D image registration method, pairwise method and our method. Compared with these methods, our method achieves best accuracy with least time. Fig. 3 shows their registration results.

Refer to caption
Fig. 3: An exhibition of our experimental result. Original data, 3D image registration result, pairwise method result, and our method result are placed separately in the first row to the last row. The first five columns show original images and their corresponding registration results, and the last column exhibits average images of the section images before and after registration.

We can see from Fig. 3 that our method achieves best result and does not cause accumulation and propagation of error.

4 Conclusion

A constrained simultaneous rigid registration problem of serial section images is presented and solved in this work. Since reliable correspondences could only be extracted from adjacent section images, current 3D registration algorithms will degenerate into sequentially solving pairwise registration problem, resulting in error accumulation and propagation.

To address this issue, we add a constrain that the first and the last section images must keep their position unchanged, then we estimate optimal rigid transformations for remaining section images to minimize the distance between their correspondences. The proposed method is non-iterative and can get optimal solution under ideal condition. It can simultaneously compute rigid transformation for a large number of serial section images in a short time.

5 Appendix

Lemma 1:
Optimal solution of (3) is 𝐖i=𝐇i𝐕i𝐂i𝐔iT{{\bf{W}}_{i}}={{\bf{H}}_{i}}{{\bf{V}}_{i}}{{\bf{C}}_{i}}{\bf{U}}_{i}^{T}, where 𝐔i𝐒i𝐕iT{{\bf{U}}_{i}}{{\bf{S}}_{i}}{\bf{V}}_{i}^{T} is the Singular Value Decomposition(SVD) of Ai\textbf{A}_{i}, 𝐂i=diag(1,det(𝐕i𝐔iT)){{\bf{C}}_{i}}=diag(1,\det({{\bf{V}}_{i}}{\bf{U}}_{i}^{T})), HiH_{i} is 2×22\times 2 rotation matrix whose rotation degree θi{\theta_{i}} can be obtained by solving (4), and θ\theta is the rotation degree of i=1n𝐕i𝐂i𝐔iT\prod\limits_{i=1}^{n}{{{\bf{V}}_{i}}{{\bf{C}}_{i}}{\bf{U}}_{i}^{T}}.
The proof of lemma 1:
𝐕i𝐂i𝐔iT{{\bf{V}}_{i}}{{\bf{C}}_{i}}{\bf{U}}_{i}^{T} is the optimal rotation matrix in pairwise point sets registration [11]. We can assume that 𝐖i=𝐇i𝐕i𝐂i𝐔iT{{\bf{W}}_{i}}={{\bf{H}}_{i}}{{\bf{V}}_{i}}{{\bf{C}}_{i}}{\bf{U}}_{i}^{T}, where Hi{\textbf{H}_{i}} is an unknown rotation matrix we need to evaluate. Using commutative law of multiplication for rotation matrix, the constraint in (3) can be represented as

i=1n𝐖i=i=1n𝐕i𝐂i𝐔iT𝐇i=i=1n𝐕i𝐂i𝐔iTi=1n𝐇i=𝐈\prod\limits_{i=1}^{n}{{{\bf{W}}_{i}}}=\prod\limits_{i=1}^{n}{{{\bf{V}}_{i}}{{\bf{C}}_{i}}{\bf{U}}_{i}^{T}{{\bf{H}}_{i}}}=\prod\limits_{i=1}^{n}{{{\bf{V}}_{i}}{{\bf{C}}_{i}}{\bf{U}}_{i}^{T}}\prod\limits_{i=1}^{n}{{{\bf{H}}_{i}}}={\bf{I}} (11)

Denoting the rotation degree of i=1n𝐕i𝐂i𝐔iT\prod\limits_{i=1}^{n}{{{\bf{V}}_{i}}{{\bf{C}}_{i}}{\bf{U}}_{i}^{T}} to be θ\theta and the rotation degree of Hi{H_{i}} to be θi{\theta_{i}}, we obtain i=1nθi=θ\sum\limits_{i=1}^{n}{{\theta_{i}}}=-\theta. Using Lemma 2, the objective function in (3) becomes:

i=1n1tr(𝐖i𝐀i)=i=1n1tr(𝐂i𝐒i𝐕iT𝐇i𝐕i)=i=1n1tr(𝐂i𝐒i[cos±θisin±θisin±θicos±θi])=i=1n1tr(𝐂i𝐒i)cosθi\begin{array}[]{*{20}{l}}{\sum\limits_{i=1}^{n-1}{tr\left({{{\bf{W}}_{i}}{{\bf{A}}_{i}}}\right)}=\sum\limits_{i=1}^{n-1}{tr\left({{{\bf{C}}_{i}}{{\bf{S}}_{i}}{\bf{V}}_{i}^{T}{{\bf{H}}_{i}}{{\bf{V}}_{i}}}\right)}}\\ {{\quad\quad\quad\quad\quad\quad\,\,}=\sum\limits_{i=1}^{n-1}{tr\left({{{\bf{C}}_{i}}{{\bf{S}}_{i}}\left[{\begin{array}[]{*{20}{c}}{\cos\pm{\theta_{i}}}&{-\sin\pm{\theta_{i}}}\\ {\sin\pm{\theta_{i}}}&{\cos\pm{\theta_{i}}}\end{array}}\right]}\right)}}\\ {{\quad\quad\quad\quad\quad\quad\,\,}=\sum\limits_{i=1}^{n-1}{-tr\left({{{\bf{C}}_{i}}{{\bf{S}}_{i}}}\right)\cos{\theta_{i}}}}\end{array} (12)

Therefore solving (3) is equivalent to solving (4).
Lemma 2:
With orthogonal matrix O and rotation matrix P, we have 𝐎T𝐏𝐎=𝐏{{\bf{O}}^{T}}{\bf{PO}}={\bf{P}} or 𝐏T{{\bf{P}}^{T}}.
proof of lemma 2:
Since O is an orthogonal matrix, it is either a rotation matrix or a reflection matrix. If O is a rotation matrix, using commutative law of multiplication for rotation matrix, 𝐎T𝐏𝐎=𝐏𝐎T𝐎=𝐏{{\bf{O}}^{T}}{\bf{PO}}={\bf{P}}{{\bf{O}}^{T}}{\bf{O}}={\bf{P}}. If O is a reflection matrix, We denote Rot(θ)\textbf{Rot}(\theta) as a rotation matrix with rotation degree θ\theta, and Ref(ϕ){\rm{\textbf{Ref}}}(\phi) as a reflection matrix with reflection degree ϕ\phi, that is

𝐑𝐨𝐭(θ)=[cosθsinθsinθcosθ]𝐑𝐞𝐟(ϕ)=[cos2θsin2θsin2θcos2θ]\begin{array}[]{*{20}{l}}\begin{array}[]{l}{\bf{Rot}}(\theta)=\left[{\begin{array}[]{*{20}{c}}{\cos\theta}&{-\sin\theta}\\ {\sin\theta}&{\cos\theta}\end{array}}\right]\\ \end{array}\\ {{\bf{Ref}}(\phi)=\left[{\begin{array}[]{*{20}{c}}{\cos 2\theta}&{\sin 2\theta}\\ {\sin 2\theta}&{-\cos 2\theta}\end{array}}\right]}\end{array} (13)

It is known that:

{𝐑𝐨𝐭(θ)𝐑𝐞𝐟(ϕ)=𝐑𝐞𝐟(ϕ+θ/2)𝐑𝐞𝐟(θ)𝐑𝐞𝐟(ϕ)=𝐑𝐨𝐭(2(θϕ))\left\{{\begin{array}[]{*{20}{l}}{{\bf{Rot}}(\theta){\bf{Ref}}(\phi)={\bf{Ref}}(\phi+\theta/2)}\\ {{\bf{Ref}}(\theta){\bf{Ref}}(\phi)={\bf{Rot}}(2(\theta-\phi))}\end{array}}\right. (14)

Therefore

𝐎T𝐏𝐎=𝐑𝐞𝐟(ϕ)𝐑𝐨𝐭(θ)𝐑𝐞𝐟(ϕ)=𝐑𝐨𝐭(θ)=𝐏T{{\bf{O}}^{T}}{\bf{PO}}={\bf{Ref}}(\phi){\bf{Rot}}(\theta){\bf{Ref}}(\phi)={\bf{Rot}}(-\theta)={{\bf{P}}^{T}} (15)

References

  • [1] Kevin L Briggman and Davi D Bock, “Volume electron microscopy for neuronal circuit reconstruction,” Current opinion in neurobiology, vol. 22, no. 1, pp. 154–161, 2012.
  • [2] Moritz Helmstaedter, “Cellular-resolution connectomics: challenges of dense neural circuit reconstruction,” Nature methods, vol. 10, no. 6, pp. 501–507, 2013.
  • [3] Xie Qiwei, Chen Xi, Shen Lijun, Li Guoqing, Ma Hongtu, and Han Hua, “Micro reconstruction system for brain,” Systems Engineering: Theory and Practice, vol. 37, no. 11, pp. 3006–3017, 2017.
  • [4] Ching-Wei Wang, Eric Budiman Gosno, and Yen-Sheng Li, “Fully automatic and robust 3d registration of serial-section microscopic images,” Scientific reports, vol. 5, 2015.
  • [5] Blair J. Rossetti, Fusheng Wang, Pengyue Zhang, George Teodoro, Daniel J. Brat, and Jun Kong, “Dynamic registration for gigapixel serial whole slide images,” in IEEE International Symposium on Biomedical Imaging, 2017, p. 424.
  • [6] Sébastien Ourselin, Alexis Roche, Gérard Subsol, Xavier Pennec, and Nicholas Ayache, “Reconstructing a 3d structure from serial histological sections,” Image and vision computing, vol. 19, no. 1, pp. 25–31, 2001.
  • [7] Oliver Schmitt, Jan Modersitzki, Stefan Heldmann, Stefan Wirtz, and Bernd Fischer, “Image registration of sectioned brains,” International Journal of Computer Vision, vol. 73, no. 1, pp. 5–39, 2007.
  • [8] J Pichat, M Modat, T Yousry, and S Ourselin, “A multi-path approach to histology volume reconstruction,” in IEEE International Symposium on Biomedical Imaging, 2015, pp. 1280–1283.
  • [9] Ce Liu, Jenny Yuen, and Antonio Torralba, “Sift flow: Dense correspondence across scenes and its applications,” IEEE transactions on pattern analysis and machine intelligence, vol. 33, no. 5, pp. 978–994, 2011.
  • [10] William W. Hager, “Updating the inverse of a matrix,” Siam Review, vol. 31, no. 2, pp. 221–239, 1989.
  • [11] K. S. Arun, T. S. Huang, and S. D. Blostein, “Least-squares fitting of two 3-d point sets,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 9, no. 5, pp. 698, 1987.