This paper was converted on www.awesomepapers.org from LaTeX by an anonymous user.
Want to know more? Visit the Converter page.

A Bayesian Nonparametric model for textural pattern heterogeneity

Xiao Li
Personalized Healthcare, Genentech, Inc.
Michele Guindani
Department of Statistics, University of California
Chaan S.Ng
Department of Diagnostic Radiology,
The University of Texas MD Anderson Cancer Center
Brian P.Hobbs
Dell Medical School, The University of Texas at Austin
Abstract

Cancer radiomics is an emerging discipline promising to elucidate lesion phenotypes and tumor heterogeneity through patterns of enhancement, texture, morphology, and shape. The prevailing technique for image texture analysis relies on the construction and synthesis of Gray-Level Co-occurrence Matrices (GLCM). Practice currently reduces the structured count data of a GLCM to reductive and redundant summary statistics for which analysis requires variable selection and multiple comparisons for each application, thus limiting reproducibility. In this article, we develop a Bayesian multivariate probabilistic framework for the analysis and unsupervised clustering of a sample of GLCM objects. By appropriately accounting for skewness and zero-inflation of the observed counts and simultaneously adjusting for existing spatial autocorrelation at nearby cells, the methodology facilitates estimation of texture pattern distributions within the GLCM lattice itself. The techniques are applied to cluster images of adrenal lesions obtained from CT scans with and without administration of contrast. We further assess whether the resultant subtypes are clinically oriented by investigating their correspondence with pathological diagnoses. Additionally, we compare performance to a class of machine-learning approaches currently used in cancer radiomics with simulation studies.


Keywords: Cancer Radiomics; Gray-level co-occurrence matrix; Bayesian Nonparametrics; Multivariate count data

1 Introduction

Solid masses emerge and proliferate within diverse host tissue environments making their diagnosis a challenge. With advances in scanning and high throughput computational technologies, the radiological subdiscipline of “cancer radiomics” has evolved in recent years (Yip and Aerts, 2016; Parekh and Jacobs, 2016). Facilitating non-invasive interrogation of the entire tumor volume, radiomics-derived subtypes may better describe tumor heterogeneity through patterns of enhancement, texture, morphology, and shape than biopsy based subtyping methods which inform only one or a few discrete locations. Thus, the interest in radiomics technologies have expanded considerably over the past decade in clinical oncology (Gillies et al., 2015).

Aiming to quantitate the morphology of solid masses and elucidate its implications for prognosis, several authors have proposed machine-learning algorithms that reduce regions/volumes of interest to sets of summary statistics (or features) (Aerts et al., 2014; Buvat et al., 2015; Cook et al., 2014; Lambin et al., 2012). For example, in studying lung and head &\& neck (H&\&N) cancer patients, Parmar et al. (2015) employed consensus clustering to identify radiomics feature-based clusters which were subsequently validated by independent analyses. The estimated clusters were found to be significantly associated with patient survival and tumor histological profiles. Tang et al. (2018) used consensus and hierarchical clustering to develop a radiomics signature that characterizes the local immune pathology environment of non-small cell lung cancer patients treated with definitive resection. To differentiate asthma subgroups from 248 asthmatic patients, Choi et al. (2017) applied KK-means and hierarchical clustering algorithms with computed tomography (CT)-based structural and functional features. Nongpiur et al. (2017) employed hierarchical agglomerative clustering and a Gaussian mixture model approach on anterior segment optical coherence tomography (ASOCT) imaging data to determine if patients with primary angle-closure glaucoma could be stratified based on radiomics-derived subtypes and treatment benefit.

1.1 Texture analysis with Grey-level Co-occurrence Matrices

Different classes of features have been proposed and interrogated for their utility in clinical applications. Image texture analysis, the focus of this article, endeavors to describe tumour heterogeneity through patterns of gray-level spatial dependence. The predominate process for obtaining features for texture analysis involves mapping the image domain into a gray-level co-occurrence matrix (GLCM). Avoiding multivariate analysis, the GLCM object is then further summarized to produce sets of discrete, but highly redundant features for subsequent analysis via multiple regression and machine learning algorithms.

A GLCM is a symmetric matrix defined over an image domain with cells comprised of counts that describe the distribution of co-occurring gray-scale valued pixels (or voxels) at a given offset and all directions (Haralick et al., 1973). More specifically, the (l,h)th\left(l,h\right)^{th} entry of a GLCM represents the frequency with which a pixel with gray-level ll is present in a spatial location either horizontally, vertically or diagonally to the adjacent pixel with gray-level hh. Figure 1 provides a simple illustration of the mapping from an image in gray-scale to the associated GLCM. More specifically, figure 1 (a) depicts a toy image with only four gray levels (0 through 3). The associated GLCM for this image is shown in figure 1 (b), where each (l,h)(l,h) cell counts the number of times the gray level ll occurs with gray level hh at an adjacent neighborhood of ll. For example, to determine the value in cell (2,0)(2,0) in figure 1 (b), we count the co-occurrence of gray level 2 and gray level 0 (blue arrows) in figure 1 (a).

Refer to caption
Figure 1: Illustrative example of the mapping from a gray-scale image to the associated GLCM. The original 4 by 4 gray-scale image is on the left (a), the resulting GLCM is on the right (b). The blue arrows in (a) indicate the co-occurrences of gray level 2 and gray level 0 reported in cell (2,0)(2,0) in (b).

If we assume KK gray-level values (or bins), then the GLCM contains at most K(K+1)/2K(K+1)/2 unique cell counts if all directions are considered. This representation facilitates image standardization, which is useful in diagnostic oncology settings wherein targeted lesions may present with irregular shapes and sizes. The complex tumor images are thus mapped to a lower-dimensional standardized lattice, consisting of K(K+1)/2K(K+1)/2 structured, discrete random variables, thus simplifying model formulation and analysis.

Current practice further reduces the multivariate functional structure inherent to GLCMs to sets of summary statistics (e.g., GLCM-derived textural features) for subsequent analysis via multi-variable regression and machine learning algorithms. These reductive mappings are potentially limiting, as they may result in information loss. Moreover, many textural features are sensitive to rotations of the image and/or GLCM (Zhang et al., 2017). This lack of invariance impacts the robustness and reproducibility of feature-based approaches. Furthermore, important patterns for discerning the extent to which a malignant mass has proliferated throughout a region of interest are potentially masked with analysis based on the summary statistics.

To the best of our knowledge, statistical methods able to take into account the information provided by the complete GLCM objects, instead of GLCM-derived features, are lacking in cancer radiomics. Li et al. (2019) have recently proposed to analyze a GLCM as a multivariate object by means of a hierarchical Bayesian spatial model. The technique, based on Gaussian Markov random field priors, improved classification accuracy when compared with radiomics feature-based classifiers.

As a limitation, however, Li et al. (2019) employed a Gaussian transformation of the observable GLCM data prior to analysis, and thus lacked a formal model for the structured count data. The Gaussian transformation may fail to account for the typical skewness and zero-inflation of the distribution of the GLCM counts, thereby resulting in information loss. Also, the assumption of a Gaussian Markov random field intrinsically implies stationarity of the spatial process which is a restrictive assumption. Finally, Li et al. (2019) investigate the classification of tissue samples only in a supervised learning context, by means of binary classifiers trained by known pathology status. The objective of image-analysis is often discerning distinct patterns intrinsic to diverse tissue environments in settings wherein the specific clinical subtypes may be unknown. These limitations motivated the development of the proposed model presented herein, which extends GLCM-based textural pattern identification and analysis beyond supervised learning.

Here, we present a computationally feasible Bayesian nonparametric framework for inference of the GLCM as a multivariate count object. The modeling approach captures patterns of spatial dependence intrinsic to the GLCM lattices itself, thereby avoiding further processing steps to produce reductive and redundant GLCM summary statistics. A feature-based analysis requires careful variable selection and/or multiple comparisons, and often limits the reproducibility of the resultant classifiers. By way of contrast, our proposed model for the GLCM object appropriately accounts for over and under dispersion of the observed counts, and simultaneously adjusts for existing spatial autocorrelation at nearby cells. Model specification is facilitated by a rounded kernel mixture model (Canale and Dunson, 2011), such that the observed spatial distribution of GLCM cell counts are assumed to arise from a latent continuous random vector defined on the GLCM lattice. The rounded kernel framework allows a flexible and robust estimation of the data generating distribution for count data(Canale and Prünster, 2017), with respect to typical Poisson-Gamma mixtures (Karlis and Xekalaki, 2005; Guindani et al., 2014). Considering conjointly intra-lesion heterogeneity of the GLCMs objects with spatial correlation of the lattice counts, we further model the multivariate latent vectors using a spatial Dirichlet process (Gelfand et al., 2005). This is achieved by defining the base distribution with a conditionally auto-regressive (CAR) Gaussian structure. Hereafter, our method is referenced as the hierarchical rounded Gaussian spatial Dirichlet process (hierarchical rounded Gaussian SDP) model.

Flexible for actual applications, our modeling framework facilitates pattern identification with analyses of cohorts with heterogeneous lesion sizes. Our unsupervised Bayesian model is applied to identify textural patterns intrinsic to adrenal lesions with CT. Data was obtained in a retrospective study of patients who underwent concordant biopsy and imaging based on a dynamic sequence of CT scans with and without administration of contrast (Ng et al., 2018a, b, c). To elucidate whether textural subtypes identified exhibit pathological orientation, subtypes are evaluated for correspondence with each lesion’s diagnosed pathological status. Additionally, simulation is used to compare performance to a class of machine-learning approaches currently promoted with cancer radiomics applications. Our Bayesian nonparametric method demonstrates robustness to capturing the underlying spatial patterns of GLCM objects, whereas commonly employed feature-based algorithmic strategies fail to identify patterns in the multivariate structure intrinsic to GLCMs.

The manuscript is organized as follows. Section 2 describes the motivating adrenal lesion CT imaging study. Section 3 introduces the proposed hierarchical rounded Gaussian spatial Dirichlet process model. Sections 4 and 5 present our case and simulation studies.

2 Motivating adrenal CT study

Early identification and diagnosis of adrenal masses is considered pivotal clinically as it has implications for appropriate treatment selection as well as determining the prognostic status of a patient’s disease stage. Proper diagnosis of abdominal lesions is also critical in the metastatic setting to determine whether a patient has experienced distant migration. Yet, characterizing benign from malignant adrenal lesions is difficult on the basis of routine CT imaging at early stages (Altinmakas et al., 2017; Wanis and Kanthan, 2015). Our study of GLCM patterns was motivated by an adrenal lesion study that comprised patients who had CT imaging available in the MD Anderson Cancer Center’s radiology picture archiving and communication system (PACS) who also underwent pathological diagnoses between January 2001 and January 2010. CT images were acquired for both non-contrast (NC) and delayed post-contrast (DL) scans. CT with delayed post-contrast imaging has been well recognized in the evaluation of adrenal lesions (Korobkin et al., 1996; Boland et al., 1997; Park et al., 2012; Taffel et al., 2012). It leverages the observation of washout characteristics of adenomas and nonadenomas after intravenous CT contrast media administration (Korobkin et al., 1996; Boland et al., 1997). GLCM-based clustering analyses were considered on the basis of both NC and DL scans using pixel-level data from the slice that exhibited the maximal axial cross-sectional area of the adrenal mass. Data was observed for a total of 210 adrenal lesions in 204 patients. Pathological analysis was available to establish benignity from malignancy. Of the 210 lesions, 114 were benign and 96 were malignant. The images were reviewed using soft tissue windows (W=400; L=350), by a radiologist with more than 5 years of experience in abdominal CT imaging. For each lesion, a region of interest (ROI) was carefully drawn free-hand, with an electronic cursor and mouse, around the periphery of the adrenal lesion. As a precaution to avoid partial volume artifacts, the extreme edges of the mass were meticulously avoided. The same ROI was considered for both NC and DL scans on each subject. Then, GLCMs were constructed from the obtained ROIs as follows. Gray-level bins were constructed from the Hounsfield unit (HU) scale through evaluation of the empirical distribution of all pixels in the study, for NC scans. Pixel values below the 0.0250.025 and above the 0.9750.975 quantiles of this empirical distribution were scaled to gray-level 1 and the highest gray-level, respectively. To unfold the ‘contrast’ effect from NC phase to delay phase, we used the same bin values from NC scans to construct delay scan GLCMs. This approach provides robustness to extreme low and high pixel outliers when projecting from the Hounsfield unit space to gray-level space. The resulting GLCMs object provide second order summary statistics of the spatial properties of the images, and it is widely used for texture analysis in cancer radiomics.

3 A Bayesian nonparametric model for gray-level co-occurrence matrices

We start by recalling that a GLCM constructed from KK gray-levels is a symmetric matrix with K(K+1)/2K(K+1)/2 unique element counts. Counts in nearby cells are likely to be associated. Therefore, the GLCM can also be regarded as a lattice system with a finite collection of K(K+1)/2K(K+1)/2 random count variables. For notational simplicity, let 𝒔=(s1,s2,,sn)\bm{s}=\left(s_{1},s_{2},...,s_{n}\right) denote the GLCM locations spanning the unique cells of the symmetric structure. Correspondingly, let Zt(si)Z_{t}(s_{i}) represent the GLCM counts at site (cell) sis_{i} for the tt-th subject, t=1,2,,Tt=1,2,...,T and i=1,2,,ni=1,2,...,n. To flexibly describe the integer-valued responses, we assume a rounded kernel formulation (Canale and Dunson, 2011), that is we assume there exists a latent vector 𝒚(𝒔)=(y(s1),,y(sn))T\bm{y(s)}=(y(s_{1}),...,y(s_{n}))^{T}, such that the probability mass function pp of 𝒁(𝒔)=(Z(s1),,Z(sn))T\bm{Z(s)}=(Z(s_{1}),...,Z(s_{n}))^{T} can be represented by the mass assigned by the latent vector 𝒚(𝒔)\bm{y(s)} on a partition of n\mathbb{R}^{n} . More precisely, for each nn-tuple 𝒌={k1,,kn}n\bm{k}=\{k_{1},\ldots,k_{n}\}\in\mathbb{N}^{n}, we can define a disjoint partition of the latent space n\mathbb{R}^{n}, with partition sets defined as A𝒌={𝒙n:ak1x1<ak1+1,,aknxn<akn+1}A_{\bm{k}}=\{\bm{x}\in\mathbb{R}^{n}:a_{k_{1}}\leq x_{1}<a_{k_{1}+1},...,a_{k_{n}}\leq x_{n}<a_{k_{n}+1}\}, for a sequence of cut-points a1,a2,,a_{1},a_{2},\ldots, such that

p(Z(s1)=k1,,Z(sn)=kn)=Akf(𝒚(𝒔))d(𝒚(𝒔)),\displaystyle p(Z(s_{1})=k_{1},...,Z(s_{n})=k_{n})=\int_{A_{k}}\,f(\bm{y(s)})\,d(\bm{y(s)}),

where f():nf(\cdot):\mathbb{R}^{n}\to\mathbb{R} succinctly denotes the nn-dimensional density distribution of the latent vector y()y(\cdot). Hereafter, we choose the cut-point parameters akia_{k_{i}} as a0=a_{0}=-\infty and aki=ki1a_{k_{i}}=k_{i}-1 for ki{1,2,}k_{i}\in\{1,2,...\}.

An essential feature of cancer radiomics data is that patients undergo diagnostic scanning with lesions of varying sizes. The total number of pixels within a targeted region of interest (ROI) determines the upper bound for the count space of each GLCM cell and thereby needs to be accounted for in the analyses intended to capture the co-occurrence patterns of GLCM objects, and to compare patterns across subjects. To adjust for the image size effect, we can specify the distribution of the latent GLCM counts as a mixed-effects model, as follows

yt(si)=𝒙𝒕𝜷+γtθt(si)+εt(si)\displaystyle y_{t}(s_{i})=\bm{x_{t}}\bm{\beta}+\gamma_{t}\,\theta_{t}(s_{i})+\varepsilon_{t}(s_{i})

where 𝜷=(β1,,βp)\bm{\beta}=(\beta_{1},...,\beta_{p}) is a p×1p\times 1 vector of coefficients capturing the effect of available subject-specific covariates 𝒙𝒕\bm{x_{t}}, 𝜸t\bm{\gamma}_{t} is a scaling factor, more precisely the sum of counts for subject tt normalized over the whole cohort, and 𝜽𝒕=(θt(s1),,θt(sn))\bm{\theta_{t}}=(\theta_{t}(s_{1}),...,\theta_{t}(s_{n})) is a spatial random effect, which captures the spatial dependence of the GLCM measurements. The term εt(si)\varepsilon_{t}(s_{i}) denotes an i.i.d. error term, which is assumed as normally distributed with mean 0 and variance τ2\tau^{2}. As a result, the latent variable is ensured to be a continuous, normally distributed, random variable conditional on the realization of the process 𝜽t\bm{\theta}_{t}.

Refer to caption
Figure 2: Illustrative patterns of GLCM in adrenal lesions from non-contrast CT imaging for 3 representative subjects, pixel-level ROIs on the left, GLCMs on the right.

3.1 Modeling the heterogeneity of the adrenal lesions

Figure 2 depicts enhancement patterns on the Hounsfield unit domain of ROIs comprising adrenal lesions as well as their corresponding gray-level co-occurrence matrices for three representative subjects. The top image, reflects a high degree of co-occurrence at higher gray levels, which exploratory analyses suggest to be representative of cases of malignancies within our case study. Conversely, the bottom image tends to be indicative of benign lesions. The central image, for which high co-occurrences were observed at middle gray-levels, depicts an intermediate case. Importantly, the GLCM cells exhibit high correlation with their adjacent neighbors, as depicted by the fairly smooth changes observed when transversing away from the peak cell counts. This suggests that lesion heterogeneity may be differentiable by spatial pattern in the GLCM object by leveraging this dependence structure with an appropriate multivariate model. Here, we propose to describe the observed heterogeneity of the GLCM matrices by modeling the random effects 𝜽𝒕\bm{\theta_{t}} with a spatial Dirichlet process (Gelfand et al., 2005). In Bayesian modeling, nonparametric priors have been often employed for unsupervised learning, to achieve improved inference on subject-specific parameters by borrowing information within population subgroups. The spatial Dirichlet process assumes that each spatial random effect 𝜽𝒕\bm{\theta_{t}} is a sample from an a.s. discrete probability distribution GG,

𝜽𝒕GiidG,t=1,2,..,T.\displaystyle\bm{\theta_{t}}\mid G\mathrel{\overset{iid}{\scalebox{1.5}[1.0]{$\sim$}}}G,\qquad t=1,2,..,T.

This is a realization of a Dirichlet Process,

GDP(υG0),G\sim DP(\upsilon G_{0}),

where G0G_{0} denotes a base (or centering) parametric spatial model, such that E(G(A))=G0(A)E(G(A))=G_{0}(A) for any measurable set AnA\subset\mathcal{R}^{n}, and ν>0\nu>0 is a precision parameter, characterizing the prior uncertainty of GG around the parametric model G0()G_{0}(\cdot). Since GG is almost surely discrete, there is a positive probability that some of the vectors 𝜽𝒕\bm{\theta_{t}}’s take the same value for some of the subjects, thus inducing a probability-based clustering of the GLCM matrices in homogeneous subgroups.

Textural patterns in the GLCM object can be identified through model specifications that acknowledge spatial dependencies among adjacent cell counts. In particular, here we specify the base parametric model G0G_{0} as a nn-variate normal distribution by assuming a conditionally auto-regressive (CAR) structure (Besag, 1974; Banerjee et al., 2014)

G0(σ2,ρ)=MVN(𝟎,(𝑫ρ𝑾)1σ2),\displaystyle G_{0}(\cdot\mid\sigma^{2},\rho)=MVN(\cdot\mid\bm{0},(\bm{D}-\rho\bm{W})^{-1}\sigma^{2}),

where 𝑾\bm{W} is an adjacency matrix with WkdW_{kd} indicating whether lattice elements kk and dd are adjacent neighbors; 𝑫\bm{D} is a diagonal matrix with kkth entry denoting the number of neighbors for lattice kk; ρ\rho is a smoothing parameter controlling the degree of spatial dependence and σ2\sigma^{2} is a variance parameter (Banerjee et al., 2014). The covariance structure implied by the spatial Dirichlet process construction is of particular relevance. As a matter of fact, integrating out the unknown GG, the marginal covariance matrix of the latent vector 𝒚(s)\bm{y}(s) can be computed as

cov(𝒚(𝒔))\displaystyle cov(\bm{y(s)}) =\displaystyle= γ2σ2(𝑫ρ𝑾)1+τ2𝑰,\displaystyle\gamma^{2}\sigma^{2}(\bm{D}-\rho\bm{W})^{-1}+\tau^{2}\bm{I},

i.e. constant over the entire spatial domain. However, any realization GG of the spatial Dirichlet process is a.s. discrete, i.e. G=l=1plδ𝜽𝒍(𝒔)G=\sum_{l=1}^{\infty}\,p_{l}\,\delta_{\bm{\theta^{*}_{l}(s)}}, where δθ\delta_{\theta} denotes a point mass at θ\theta, wlw_{l} is a sequence of weights, and 𝜽𝒍(𝒔)\bm{\theta_{l}^{*}(s)} are sequences of unique realizations from the base distribution G0G_{0} (independently of the weights). Then, for any given GG, the conditional covariance matrix of 𝒚(s)\bm{y}(s) has elements

cov(y(si),y(sj)|G)\displaystyle cov(y(s_{i}),y(s_{j})|G) =\displaystyle= γ2[l=1plθl(si)θl(sj)(l=1plθl(si))(l=1plθl(sj))].\displaystyle\gamma^{2}[\sum_{l=1}^{\infty}p_{l}\theta^{*}_{l}(s_{i})\theta^{*}_{l}(s_{j})-(\sum_{l=1}^{\infty}p_{l}\theta^{*}_{l}(s_{i}))(\sum_{l=1}^{\infty}p_{l}\theta^{*}_{l}(s_{j}))].

Therefore, the covariance changes over the spatial domain, and in general it is not constant in any two locations. Thus, the spatial Dirichlet process formulation provides a flexible model to describe the spatial dependence observed in the GLCMs, including “non-stationary” patterns. Furthermore, the effect of the scaling factor γ\gamma on the covariance matrix reflects the general idea that regions of smaller size are characterized by smaller variance of the observed gray-scales over the spatial domain.

The hierarchical model is fully specified with the prior distributional assumptions for the remaining parameters. More specifically, for the regression coefficients, we can assume a multivariate Gaussian prior with mean 𝜷𝟎\bm{\beta_{0}} and covariance matrix 𝚺𝜷\bm{\Sigma_{\beta}}. To promote maximal data learning, it is common to set 𝜷𝟎\bm{\beta_{0}} as 𝟎\bm{0} and 𝚺𝜷\bm{\Sigma_{\beta}} as a diagonal matrix σβ2𝑰\sigma^{2}_{\beta}\,\bm{I} with large σβ2\sigma^{2}_{\beta}, to allow a vaguely non-informative specification spanning a large region of the parameter space. The parameters τ2\tau^{2} and σ2\sigma^{2} are assigned, respectively, (conditionally) conjugate inverse-gamma priors, IG(τ2aτ,bτ)IG(\tau^{2}\mid a_{\tau},b_{\tau}) and IG(σ2aσ,bσ)IG(\sigma^{2}\mid a_{\sigma},b_{\sigma}) (with means bτ/(aτ1)b_{\tau}/(a_{\tau}-1) and bσ/(aσ1)b_{\sigma}/(a_{\sigma}-1), respectively). The hyperparameters aτa_{\tau}, bτb_{\tau}, aσa_{\sigma}, bσb_{\sigma} are typically fixed to represent vague prior information. A Gamma(aυ,bυ)Gamma(a_{\upsilon},b_{\upsilon}) prior (with mean aυ/bυa_{\upsilon}/b_{\upsilon}) is imposed for υ\upsilon as the corresponding mixture of gamma full conditional facilitates MCMC computation (Escobar and West, 1995). Lastly, we follow prevailing literature and consider a Uniform(0,1)Uniform(0,1) distribution for the ρ\rho parameter in the CAR model (Lee, 2013).

Figure 3 provides a graphical representation of the proposed hierarchical model for the GLCM counts. Conditional on the latent 𝒚𝒕\bm{y_{t}}’s, the sampling distribution can be expressed as

P(𝒁|𝒚)\displaystyle\noindent P(\bm{Z}|\bm{y}) \displaystyle\propto t=1Ti=1nI{azt(si)yt(si)<azt(si)+1},\displaystyle\prod_{t=1}^{T}\prod_{i=1}^{n}I\left\{a_{z_{t}(s_{i})}\leq y_{t}(s_{i})<a_{z_{t}(s_{i})+1}\right\},

where I()I(\cdot) denotes the indicator function, for fixed cut-points a0a_{0}, a1a_{1}, …amaxt{zt}a_{\max_{t}\,\{z_{t}\}}. Then, the hierarchical model on the latent vector 𝒚𝒕\bm{y_{t}} can be summarized as follows:

𝒚𝒕𝜷,𝜽𝒕,τ2\displaystyle\noindent\bm{y_{t}}\mid\bm{\beta},\bm{\theta_{t}},\tau^{2} MVN(𝒚𝒕𝒙𝒕𝜷+γt𝜽𝒕,τ2𝑰),t=1,2,..,T\displaystyle\sim MVN\left(\bm{y_{t}}\mid\bm{x_{t}}\bm{\beta}+\gamma_{t}\bm{\theta_{t}},\tau^{2}\bm{I}\right),\qquad t=1,2,..,T
𝜽𝒕G(n)\displaystyle\bm{\theta_{t}}\mid G^{(n)} iidG(n),t=1,2,..,T\displaystyle\mathrel{\overset{iid}{\scalebox{1.5}[1.0]{$\sim$}}}G^{(n)},\qquad t=1,2,..,T
G(n)υ,σ2,ρ\displaystyle G^{(n)}\mid\upsilon,\sigma^{2},\rho DP(υG0(n))\displaystyle\sim DP(\upsilon G_{0}^{(n)})
G0(n)(σ2,ρ)\displaystyle G_{0}^{(n)}(\cdot\mid\sigma^{2},\rho) MVN(𝟎,σ2(𝑫ρ𝑾)1)\displaystyle\equiv MVN(\cdot\mid\bm{0},\sigma^{2}(\bm{D}-\rho\bm{W})^{-1})
𝜷\displaystyle\bm{\beta} MVN(𝜷𝜷𝟎,𝚺𝜷)\displaystyle\sim MVN\left(\bm{\beta}\mid\bm{\beta_{0}},\bm{\Sigma_{\beta}}\right)
τ2\displaystyle\tau^{2} IG(aτ,bτ)\displaystyle\sim IG(a_{\tau},b_{\tau})
σ2\displaystyle\sigma^{2} IG(aσ,bσ)\displaystyle\sim IG(a_{\sigma},b_{\sigma})
υ\displaystyle\upsilon Gamma(aυ,bυ)\displaystyle\sim Gamma(a_{\upsilon},b_{\upsilon})
ρ\displaystyle\rho Uniform(0,1).\displaystyle\sim Uniform(0,1).

Refer to caption


Figure 3: Graphical representation of the proposed hierarchical rounded Gaussian SDP model.

3.2 Posterior inference

In this section, we outline the main steps of the MCMC algorithm used to obtain posterior samples from the proposed hierarchical rounded Gaussian SDP model, and we discuss how we can summarize the posterior inference about the heterogeneity of the GLCM objects across subjects.

3.2.1 MCMC algorithm

The proposed MCMC sampling algorithm requires iterating the following steps:

  1. (a)

    Update of the latent vector 𝐲𝐭\bm{y_{t}}: similarly as in Canale and Dunson (2011), we use a data augmentation step to update each 𝒚𝒕\bm{y_{t}} from a truncated Gaussian distribution, conditional on the other parameters and the cluster assignments. More specifically,

    1. (a.1)

      Let wtw_{t} denote the cluster assignment of subject tt. Then, first sample from uniform random variables

      ut(si)U(Φ(azt(si)1|μ~t(si),σ~t2(si)),Φ(azt(si)|μ~t(si),σ~t2(si)))u_{t}(s_{i})\sim U\left(\Phi(a_{z_{t}(s_{i})-1}\big{|}\tilde{\mu}_{t}(s_{i}),\tilde{\sigma}^{2}_{t}(s_{i})),\Phi(a_{z_{t}(s_{i})}\big{|}\tilde{\mu}_{t}(s_{i}),\tilde{\sigma}^{2}_{t}(s_{i}))\right)

      where

      μ~t(si)=μwt(si)+Σwt,12Σwt,221(𝒚𝒕(𝒔𝒊)𝒐𝒍𝒅𝝁wt(𝒔𝒊)),\displaystyle\tilde{\mu}_{t}(s_{i})=\mu_{w_{t}}(s_{i})+\Sigma_{w_{t},12}\Sigma_{w_{t},22}^{-1}\left(\bm{y_{t}(-s_{i})^{old}}-\bm{\mu}_{w_{t}}\bm{(-s_{i})}\right),
      σ~t2(si)=σ~wt2(si)Σwt,12Σwt,221Σwt,21\displaystyle\tilde{\sigma}^{2}_{t}(s_{i})=\tilde{\sigma}^{2}_{w_{t}}(s_{i})-\Sigma_{w_{t},12}\Sigma_{w_{t},22}^{-1}\Sigma_{w_{t},21}

      are the usual conditional expectation and conditional variance of the multivariate normal with 𝝁𝒘𝒕=𝒙𝒕𝜷+γt𝜽𝒘𝒕\bm{\mu_{w_{t}}}=\bm{x_{t}}\bm{\beta}+\gamma_{t}\bm{\theta_{w_{t}}^{\ast}} and 𝚺𝒘𝒕=τ2𝑰\bm{\Sigma_{w_{t}}}=\tau^{2}\bm{I}, and 𝒔𝒊\bm{-s_{i}} denotes the collection of all locations with the exclusion of the currently considered location sis_{i}

    2. (a.2)

      Based on the generated ut(si)u_{t}(s_{i}), update the latent yt(si)y_{t}(s_{i}) as follows:

      yt(si)new=Φ1(ut(si)|μ~t(si),σ~t2(si))y_{t}(s_{i})^{new}=\Phi^{-1}\left(u_{t}(s_{i})\big{|}\tilde{\mu}_{t}(s_{i}),\tilde{\sigma}^{2}_{t}(s_{i})\right)
  2. (b)

    Update of the Dirichlet process parameters 𝛉𝐭\bm{\theta_{t}} and corresponding cluster allocations wtw_{t}: we jointly update the allocation vector wtw_{t} and the subject-specific parameter vectors 𝜽t\bm{\theta}_{t}’s as follows:

    1. (b.1)

      Integrate out the random probability measure GG and use the Pólya Urn representation of the Dirichlet Process:

      f(𝜽𝒕|𝜽𝒕,tt)\displaystyle f\left(\bm{\theta_{t}}\big{|}\bm{\theta_{t^{{}^{\prime}}}},t\neq t^{{}^{\prime}}\right) 1q0+j=1T(t)Tj(t)qj{q0h(𝜽𝒕𝒚𝒕,𝜷,τ2,σ2,ρ)\displaystyle\propto\frac{1}{q_{0}+\sum_{j=1}^{T_{(-t)}^{\ast}}T_{j(-t)}q_{j}}\big{\{}q_{0}h(\bm{\theta_{t}}\mid\bm{y_{t}},\bm{\beta},\tau^{2},\sigma^{2},\rho)
      +j=1T(t)Tj(t)qjδ𝜽𝒋(𝜽𝒕)},\displaystyle+\sum_{j=1}^{T_{(-t)}^{\ast}}T_{j(-t)}q_{j}\delta_{\bm{\theta_{j}^{\ast}}}(\bm{\theta_{t}})\big{\}},

      for t=1,2,,Tt=1,2,...,T, where the subscript (t)\left(-t\right) is used to denote all relevant quantities when 𝜽𝒕\bm{\theta_{t}} is removed from 𝜽\bm{\theta}. More specifically, T(t)T_{(-t)}^{\ast} refers to the number of clusters in (𝜽𝒕,tt)\left(\bm{\theta_{t^{{}^{\prime}}}},t^{{}^{\prime}}\neq t\right), and Tj(t)T_{j(-t)} refers to the number of elements in cluster jj, j=1,,T(t)j=1,...,T_{(-t)}^{\ast}, with 𝜽𝒕\bm{\theta_{t}} removed. The term qjq_{j}, j=1,,T(t)j=1,\ldots,T_{(-t)}^{\ast} denotes the density of the multivariate Gaussian distribution with mean vector 𝒙𝒕𝜷+γj𝜽𝒋\bm{x_{t}\beta}+\gamma_{j}\bm{\theta_{j}^{\ast}} and covariance matrix τ2𝑰.\tau^{2}\bm{I}. Let 𝑯=(𝑫ρ𝑾)1\bm{H}=\left(\bm{D}-\rho\bm{W}\right)^{-1}. Then,

      q0\displaystyle q_{0} =υ|(τ2γt2𝑰+σ2𝑯1)1|12|𝑯|12(2πσ2τ2)n2\displaystyle=\upsilon\left|(\tau^{-2}\gamma_{t}^{2}\bm{I}+\sigma^{-2}\bm{H}^{-1})^{-1}\right|^{\frac{1}{2}}\left|\bm{H}\right|^{-\frac{1}{2}}(2\pi\sigma^{2}\tau^{2})^{-\frac{n}{2}}
      exp[12τ2(𝒚𝒕𝒙𝒕𝜷)(𝑰τ2γt2(τ2γt2𝑰+σ2𝑯1)1)(𝒚𝒕𝒙𝒕𝜷)]\displaystyle\exp\left[-\frac{1}{2}\tau^{-2}(\bm{y_{t}-x_{t}\beta})^{{}^{\prime}}(\bm{I}-\tau^{-2}\gamma_{t}^{2}(\tau^{-2}\gamma_{t}^{2}\bm{I}+\sigma^{-2}\bm{H}^{-1})^{-1})(\bm{y_{t}-x_{t}\beta})\right]

      Similarly, h(𝜽𝒕𝒚𝒕,𝜷,τ2,σ2,ρ)h(\bm{\theta_{t}}\mid\bm{y_{t}},\bm{\beta},\tau^{2},\sigma^{2},\rho) denotes the density of multivariate normal distribution with mean vector τ2γt(τ2γt2𝑰+σ2𝑯1)1(𝒚𝒕𝒙𝒕𝜷)\tau^{-2}\gamma_{t}(\tau^{-2}\gamma_{t}^{2}\bm{I}+\sigma^{-2}\bm{H}^{-1})^{-1}(\bm{y_{t}-x_{t}\beta}) and covariance matrix (τ2γt2𝑰+σ2𝑯1)1(\tau^{-2}\gamma_{t}^{2}\bm{I}+\sigma^{-2}\bm{H}^{-1})^{-1}. Note that once 𝜽𝒕\bm{\theta_{t}} is updated, wtw_{t} is also implicitly updated.

    2. (b.2)

      In order to improve the mixing properties of the chain, we resample the unique cluster atoms θj\theta_{j}^{*} based on the specific configuration 𝒘=(w1,w2,,wT)\bm{w}=(w_{1},w_{2},...,w_{T}) obtained in step 2(a) and the associated TT^{\ast} cluster values, by drawing updated cluster atoms from the full conditional f(𝜽𝒋|T,𝒘,𝒚,𝜷,σ2,τ2,ρ)f(\bm{\theta_{j}^{\ast}}\big{|}T^{\ast},\bm{w},\bm{y},\bm{\beta},\sigma^{2},\tau^{2},\rho), which is a multivariate normal distribution with mean vector

      τ2(t:wt=jτ2γt2𝑰+σ2𝑯1)1(t:wt=jγt(𝒚𝒕𝒙𝒕𝜷))\tau^{-2}(\sum_{t:w_{t}=j}\tau^{-2}\gamma_{t}^{2}\bm{I}+\sigma^{-2}\bm{H}^{-1})^{-1}(\sum_{t:w_{t}=j}\gamma_{t}(\bm{y_{t}-x_{t}\beta}))

      and covariance matrix (t:wt=jτ2γt2𝑰+σ2𝑯1)1(\sum_{t:w_{t}=j}\tau^{-2}\gamma_{t}^{2}\bm{I}+\sigma^{-2}\bm{H}^{-1})^{-1}.

  3. (c)

    Update the vector of regression coefficients 𝛃\bm{\beta}.
    The full conditional for 𝜷\bm{\beta} is a multivariate normal distribution with mean
    (𝚺𝜷𝟏+τ2t=1T𝒙𝒕𝒙𝒕)1(𝚺𝜷𝟏𝜷𝟎+τ2t=1T𝒙𝒕(𝒚𝒕γt𝜽𝒕))\left(\bm{\Sigma_{\beta}^{-1}}+\tau^{-2}\sum_{t=1}^{T}\bm{x_{t}^{{}^{\prime}}x_{t}}\right)^{-1}\left(\bm{\Sigma_{\beta}^{-1}}\bm{\beta_{0}}+\tau^{-2}\sum_{t=1}^{T}\bm{x_{t}^{{}^{\prime}}}(\bm{y_{t}}-\gamma_{t}\bm{\theta_{t}})\right)
    and variance (𝚺𝜷𝟏+τ2t=1T𝒙𝒕𝒙𝒕)1\left(\bm{\Sigma_{\beta}^{-1}}+\tau^{-2}\sum_{t=1}^{T}\bm{x_{t}^{{}^{\prime}}x_{t}}\right)^{-1}.

  4. (d)

    Update the sampling variance τ2\tau^{2}. The full conditional distribution for τ2\tau^{2} yield an inverse-gamma distribution IG(τ2|a~τ,b~τ)IG(\tau^{2}|\tilde{a}_{\tau},\tilde{b}_{\tau}) with a~τ=Tn2+aτ,b~τ=bτ+12t=1T(𝒚𝒕𝒙𝒕𝜷γt𝜽𝒕)(𝒚𝒕𝒙𝒕𝜷γt𝜽𝒕)\tilde{a}_{\tau}=\frac{Tn}{2}+a_{\tau},\tilde{b}_{\tau}=b_{\tau}+\frac{1}{2}\sum_{t=1}^{T}(\bm{y_{t}-x_{t}\beta}-\gamma_{t}\bm{\theta_{t}})^{{}^{\prime}}(\bm{y_{t}-x_{t}\beta}-\gamma_{t}\bm{\theta_{t}})

  5. (e)

    Update the CAR variance σ2\sigma^{2}. Given that marginalize GG, the 𝜽𝒋\bm{\theta_{j}^{\ast}} are independent and identical with distribution G0G_{0}, the full conditional distribution for σ2\sigma^{2} is given by an inverse-gamma distribution IG(σ2|a~σ,b~σ)IG(\sigma^{2}|\tilde{a}_{\sigma},\tilde{b}_{\sigma}) with a~σ=Tn2+aσ,\tilde{a}_{\sigma}=\frac{T^{\ast}n}{2}+a_{\sigma}, and b~σ=bσ+12j=1T(𝜽𝒋)𝑯1(𝜽𝒋)\tilde{b}_{\sigma}=b_{\sigma}+\frac{1}{2}\sum_{j=1}^{T^{\ast}}(\bm{\theta_{j}^{\ast}})^{{}^{\prime}}\bm{H}^{-1}(\bm{\theta_{j}^{\ast}})

  6. (f)

    Update the spatial coefficient in the CAR precision matrix, ρ\rho. Since ρ\rho appears in the off-diagonal part of HH, Adaptive Rejection Metropolis Sampling method (Gilks et al., 1995), developed from Adaptive Rejection Sampling (Gilks and Wild, 1992) by including a Metropolis step to accommodate non-concavity in the log density, is implemented to draw posterior samples from the target density |H|T2exp(σ22j=1T(𝜽𝒋)𝑯1(𝜽𝒋))\left|H\right|^{-\frac{T^{\ast}}{2}}\exp\left(-\frac{\sigma^{-2}}{2}\sum_{j=1}^{T^{\ast}}(\bm{\theta_{j}^{\ast}})^{{}^{\prime}}\bm{H}^{-1}(\bm{\theta_{j}^{\ast}})\right)

  7. (g)

    Update the DP concentration parameter, υ\upsilon. In order to simulate posterior samples for υ\upsilon, we follow the augmentation idea from Escobar and West (1995): we introduce an auxiliary variable η\eta sampled from a beta distribution (η|υold+1,T)(\eta|\upsilon^{old}+1,T), then υ\upsilon is updated from the two-component mixture of gamma distributions pGamma(aυ+T,bυlog(η))+(1p)Gamma(aυ+T1,bυlog(η))p\cdot Gamma(a_{\upsilon}+T^{\ast},b_{\upsilon}-log(\eta))+(1-p)\cdot Gamma(a_{\upsilon}+T^{\ast}-1,b_{\upsilon}-log(\eta)), where p=(aυ+T1)/(T(bυlog(η))+aυ+T1).p=(a_{\upsilon}+T^{\ast}-1)\Big{/}\Big{(}T(b_{\upsilon}-log(\eta))+a_{\upsilon}+T^{\ast}-1\Big{)}.

3.2.2 Cluster inference

Characterization of intra-lesion pattern heterogeneity is the predominate motivation for study of GLCM objects. The use of a spatial Dirichlet process prior provides a flexible method for unsupervised learning with GLCM object data. Several approaches have been proposed in the literature to conduct post-MCMC inference with Bayesian nonparametrics. This often requires addressing either the issue of label switching intrinsic to Bayesian mixture models (Jasra et al., 2005) and/or the clustering behavior of the Dirichlet Process (Miller and Harrison, 2017). For example, Medvedovic and Sivaganesan (2002) employ a classical agglomerative hierarchical clustering method on the basis of dissimilarity matrices, with elements calculated as the posterior probability that any two observations ii and jj are assigned to different mixture components. Also Bandyopadhyay and Canale (2016) employ hierarchical clustering to cluster ordered periodontal measurements within and across subjects on the basis of a dissimilarity matrix. Dahl (2006) and Dahl and Newton (2007) estimate cluster membership by minimizing the posterior expected loss of binding through processing of all pairwise posterior probabilities from the proportion of MCMC samples in which two subjects are assigned the same mixture component. Whenever the optimal partition is not constrained to be in the sample, Hastie et al. (2015) have found that leveraging the entire sample of MCMC draws though implementation of additional clustering methods (such as partitioning around medoids) is more favorable in reducing Monte Carlo error. More recently, Wade and Ghahramani (2018) and Rastelli and Friel (2018) have proposed decision theoretic approaches to identify optimal partitions. Wade and Ghahramani (2018) also define posterior credible balls to quantify the uncertainty of the estimated partitions. Here, we propose an approach similar as in Zhang et al. (2016), who applied a hierarchical clustering approach to fMRI studies.The approach maintains simplicity to facilitate communication and discussion of the results with medical doctors, while focusing on the posterior estimates of the latent GLCM patterns to organize the observed GLCM matrices into homogeneous groups. More specifically, we first obtain subject-level posterior mean surfaces of the random effects using all iterations after burn-in. We then compute a dissimilarity matrix using squared Euclidean distance between each pair of the subjects. Finally, we obtain a partition of the GLCM matrices by using the Ward (1963) clustering method with Ward’s minimum variance implemented recursively by the Lance-Williams algorithm (Murtagh and Legendre, 2014) and Krzanowski and Lai (1988) criteria which minimizes intra-cluster dispersion.

4 Case study: textural patterns in adrenal lesions

In this section, we apply our proposed hierarchical rounded Gaussian SDP method and present the analysis of the retrospective adrenal diagnostic study data. The objective is to identify intrinsic textural patterns observable with CT as well as characterize their heterogeneity within the studied cohort. To assess whether the identified patterns are pathologically oriented, we study the relationships between GLCM lesion subtypes and pathology endpoints.

In particular, the proposed hierarchical rounded Gaussian SDP method was implemented to obtain a GLCM lesion subtype for each lesion for both NC and DL phase scans without consideration of true pathology status. We considered the (unnormalized) sum of counts of the GLCMs objects as a subject-specific covariate 𝐱t\mathbf{x}_{t} in the mixed effects model for the latent 𝒚(𝒔)\bm{y(s)}, to acknowledge that larger GLCMs are characterized by larger counts. We further assumed a vague prior for 𝜷\bm{\beta}, by setting 𝚺𝟎=105𝑰\bm{\Sigma_{0}}=10^{5}\bm{I}. The hyperparameters of the priors on τ2\tau^{2} and σ2\sigma^{2} were set to aτ=bτ=aσ=bσ=0.0001a_{\tau}=b_{\tau}=a_{\sigma}=b_{\sigma}=0.0001. A standard choice of a Gamma(aυ,bυ)Gamma(a_{\upsilon},b_{\upsilon}) prior with aυ=bυ=1a_{\upsilon}=b_{\upsilon}=1 is imposed for υ\upsilon, although the results appeared robust to fixing υ=1\upsilon=1 (Quintana et al., 2016). For each simulation, we ran the MCMC with 20,000 iterations, discarding the first 10,000 iterations as burn-in. Convergence was conferred for each replicate study sample from the Geweke diagnostic (Geweke, 1992) as implemented in the R package ‘coda’.

Refer to caption
Figure 4: Pixel-level ROIs of representative subjects for the 4 resultant subgroups, where NC stands for noncontrast scan phase, DL stands for delay scan phase.
Refer to caption
Figure 5: GLCMs of representative subjects for the 4 resultant subgroups, where NC stands for noncontrast scan phase, DL stands for delay scan phase. Each GLCM corresponds to each ROI in Figure 4.

The MCMC-based inference described in Section 4.2 identified two clusters of patients for each type of CT scan (NC and DL). Figure 4 and Figure 5 depict scans and GLCMs for representative lesions observed within the resultant four subgroups, respectively. The subgroup defined by NC cluster 1 and DL cluster 1 (top row, upper left quadrant), is characterized by high NC peak cells in the north-west direction and high DL peak cells either in the north-west direction or center, which illustrates that the majority of co-occurrences map to low grey-levels. By way of contrast, the subgroup defined by NC cluster 2 and DL cluster 2 (lower right quadrant) has both high peak cells in the south-east direction, demonstrating prevalence and co-occurrence of high grey-levels, as higher HU intensity are observed in the original NC and DL lesion ROI images. In addition, the DL GLCMs tend to be very sparse, yielding many 0s within low grey-level pairs. The subgroup defined by NC cluster 1 and DL cluster 2 has peak counts for NC in the north-west direction and south-east direction for DL, representing lower HU intensity in NC lesion ROI and higher HU intensity in DL lesion ROI. Finally, the subgroup defined by NC cluster 2 and DL cluster 1 is characterized by peak counts for NC in the central and high DL peak counts in the south-east cells, elucidating median HU intensity for NC scans and high HU intensity for DL scans. Furthermore, we should note that the sparsity in the DL GLCM measurements observed in the bottom row GLCMs is not revealed in the other subtypes.

Table 1 reports the resultant combined cluster assignments for combined non-contrast and delay images, together with the number of true malignant lesions in that specific subgroup. While entirely unsupervised, e.g. fitted to the GLCM matrices without reference to pathology, the table suggests that patterns identified by the Bayesian nonparametric model may convey pathological orientation. Flagging lesions as malignant (benign) when assigned to subtypes where the fraction of true malignancies is more (less) than 50%50\%, only 21.9%21.9\% of lesions are assigned to discordant subtypes.

Additional findings for individual scans (NC and DL) are presented in Section A of the supplementary materials.

Table 1: Adrenal case study results: Cluster assignments for combined non-contrast and delay images. The number in the brackets in each cell represents the number of true malignant lesions in that specific subgroup.
Non-contrast scan
cluster 1 cluster 2
Delay scan cluster 1 59(2) 52(20)
cluster 2 5(2) 94(72)

5 Simulation study

This section describes a simulation study devised to evaluate the performance of the proposed hierarchical rounded Gaussian spatial Dirichlet process (HRGSDP) method with respect to several competing clustering approaches typically encountered in the analysis of imaging data in oncology studies.

5.1 Simulation Design

To obtain appropriate synthetic data capable of representing the spatially-oriented patterns within GLCMs exhibited in our diagnostic cancer study of adrenal lesions, we generated GLCMs constructed with 16 gray-levels with normalized element-wise probability densities. Our simulation study was conducted using two data generating models. The first model assumed that density patterns within the GLCM objects were a sample from a bivariate normal distribution with

μ=(2+c,14c)andΣ=s[10.70.71].\mu=(2+c,14-c)^{{}^{\prime}}\quad\text{and}\quad\Sigma=s\begin{bmatrix}1&-0.7\\ -0.7&1\\ \end{bmatrix}.

Various simulation scenarios were obtained as different combinations of the shift parameter cc and the scale parameter ss, as described further below. A final smoothed event rate surface, wherein the event rate is regarded as the probability of observing a co-occurrence count within a given cell, was obtained for each simulated GLCM by smoothing over the Gaussian-derived empirical rate surface calculated in proportion to the number of generated points in each grid and with respect to the total number of generated points of the entire grid surface. Additionally, to reflect inter-patient heterogeneity in image size we scaled the rate surface over the discrete GLCM space by a random integer that is sampled from 500 to 20000. The scale densities were then rounded to the nearest integer value to yield simulated counts. The simulation design yields a distribution over the GLCM space that generates reasonably small and large GLCM count surfaces, representing both over- and under-dispersed scenarios. Simulation scenarios were then obtained by generating GLCMs under different choices of the mean shift parameter cc and variance scale parameter ss. In particular, for a given ss we generated GLCMs as a mixture of five components represented by c{5,5.5,6,6.5,7}c\in\{5,5.5,6,6.5,7\}, such that the center of the generating bivariate normal distribution shifts their location gradually from north-west toward south-east along the 135135^{\circ} diagonal of the GLCM. We also evaluated performance by varying s{10,12,15,16,17}s\in\{10,12,15,16,17\}, with each value of ss representing the extent to which the noise covers the true signal in the underlying spatial patterns intrinsic to each tissue class. As we set the mean vectors of the bivariate normal distribution of the different components closer to each other, increasing the value of ss diminishes the extent to which the spatial patterns are differentiable by any method. For each ss, we generated 100 subjects in total, with 20 patients in each of the five subtypes defined by cc. To interrogate robustness to the Gaussian assumption, in the Supplementary material, Section B, we also present a simulation using the bivariate skew normal distribution of Azzalini and Capitanio (1999) as the latent generator. The results are consistent with those described below for the bivariate normal setting.

5.2 Comparison with competing methods for texture analysis

We fitted the simulated GLCMs using the proposed HRGSDP method, where the model hyper-parameters were set to obtain vague prior specification as in the case study. MCMC was implemented with 20,000 iterations, the first 10,000 of which were discarded as burn-in. Convergence was assessed by using the Geweke diagnostic [31] with implementation using the R package ‘coda’.

We then considered five alternative clustering approaches, which are typically employed for the analysis of imaging data in oncology studies. More specifically, we considered (i) hierarchical clustering based on a few GLCM-derived texture features, which are reported routinely in radiomics studies (such as contrast, correlation, homogeneity, energy and entropy) (Kumar et al., 2012). We refer this method as ‘FeaHC’. Additionally, for the same GLCM-derived texture features, (ii) spectral clustering, referenced as ‘FeaSC’, (iii) K-means clustering, referenced as ‘FeaKM’ (iv) consensus clustering algorithms, referenced as ‘FeaCO’ and (v) Gaussian mixture model, referenced as ‘FeaGMM’ were also implemented as typically reported in clinical imaging studies (Gensheimer et al., 2015; Wu et al., 2016; Parmar et al., 2015; Zhou et al., 2018).

In contrast to our unsupervised approach, all of the competing methods above require the pre-specification of the number of clusters in advance of analysis. In order to optimize their performance , we adopted the true number of clusters as the ground truth, i.e. we assumed five simulated subtypes. That is, clusters were obtained for each simulated dataset by cutting the resultant dendrogram with rank equal to the true number of clusters. Of course, in real data settings, such knowledge would not be available. By way of contrast, no truth-based specification was used for ascertaining subtypes using our Bayesian method, which provided an artificial advantage favoring competing approaches.

5.3 Performance evaluation

While our modeling framework was devised for the purpose of unsupervised clustering, comparing the relative quality of competing sets of unsupervised clusters is abstruse in the absence of an underlying mechanism for understanding realizations of the objects that are the basis for cluster analysis. Therefore, our simulation study was devised under the assumption that GLCM objects arise from disparate true classes of lesions. Each class was assigned a true probability distribution for generating individual GLCMs, as described in Section 5.1, providing a basis for comparison. Specifically, method performance was evaluated in relation to the matching matrix constructed with true memberships as rows and the predicted membership as columns such that the (i,j)(i,j)th entry measures the counts of the iith class subject with membership assigned by the clustering approach jj. The matching matrix was computed with our proposed method and the above mentioned approaches for each simulated cohort on 100 replicate simulations for each value of s.s. To evaluate and compare the performance of our proposed HRGSDP method and the other competing approaches mentioned above, we used two performance metrics: a measure of the mis-assignment rate and the Pearson chi-square test statistic obtained from the resultant matching matrices.

With our proposed Bayesian nonparamteric approach, a membership assignment was obtained for each subject by posterior clustering of 𝜽\bm{\theta} (see Section 3.2.2). Then, the assigned membership along with its true class (defined by cc) were interrogated to measure the extent to which GLCMs arising from truly identical pattern distributions tended to cluster together. The competing methods require the pre-specification of the total number of clusters to assign the GLCMs to cluster labels. However, the HRGSDP is unsupervised, as it provides a data-driven estimate of the cluster rank. Nevertheless, in the following, we measure the performance of the competing methods with respect to the true rank (5) used to simulate GLCM patterns, which would be unknown in practice.

Methods were compared on the basis of their mis-assignment rate, which was defined to characterize the proportion of GLCM objects that cluster with truly uncommon patterns. This is calculated by tabulating the distribution of model-derived predicted cluster assignments by their true class, and identifying the mode class for each cluster (class with maximum proportion). For each predicted cluster, the number of assignments to other classes (not the mode) is taken as an error. The errors are summed and normalized by the sample size. Then, the resultant mis-assignment rate was defined as the proportion of mis-assigned subjects overall.

The Pearson chi-square test statistic was also used to measure the homogeneity of true class membership and the assigned class membership. Thus, larger values of the test statistic, which represent larger deviations from the null random frequency distribution, characterize better performance as cluster assignments derived from clustering techniques become more consistent with their true subtype memberships.

5.4 Simulation results

Figure 6 reports the mis-assignment rate distributions obtained in our simulation study as a function of the values of the dispersion parameter s{10,12,15,16,17}s\in\{10,12,15,16,17\}.

Refer to caption

Figure 6: Simulation results. Mis-assignment rate obtained for all methods considered in the simulation study, as a function of the sparsity parameter s{10,12,15,16,17}s\in\{10,12,15,16,17\}. See section 5.2 for detailed explanation of the method acronyms.

Among all currently employed feature-based approaches, the mean mis-assignment rates are similar, ranging from 32.4%32.4\% to 58.7%58.7\%, with the Gaussian mixture model (FeaGMM) having the best performance with s=15s=15 (32.4%32.4\%). The best performance for consensus clustering (FeaCO), hierarchical clustering (FeaHC), K-means (FeaKM) and spectral clustering (FeaSC) methods are 53.9%53.9\% with s=17s=17, 42.8%42.8\% with s=17s=17, 41.9%41.9\% with s=16s=16 and 38.6%38.6\% with s=16s=16, respectively. In all simulated scenarios, the Gaussian mixture model (FeaGMM) method yields the minimum mis-assignment rate among the feature-based approaches. As a contrast, the performance of the proposed method is globally superior at smaller values of ss (0.1% for s=10s=10 and 5.8%5.8\% for s=15s=15) ,i.e. for high signal-to-noise scenarios. As the random noise increases, the performance of the proposed method decreases but it is still better than or at least comparable to the performances of the competing methods, resulting in mean mis-assignment rates of 12.5%12.5\% for s=16s=16 and 19.2%19.2\% for s=17s=17. This behavior appears to be due to the combination of two factors. On the one hand, high noise results in imprecise cluster estimates. On the other hand, for large values of ss, the noise dominates the signal conveyed by the true mean spatial patterns of dependencies that characterize the true GLCM subtypes. As our simulations demonstrate, different subtypes are best identified by large differences in the values of the mean location parameter cc.

Figure 7 reports the distributions of the Pearson chi-square test statistic obtained as a function of the dispersion parameter s{10,12,15,16,17}s\in\{10,12,15,16,17\}, respectively.

Refer to caption

Figure 7: Simulation results. Pearson chi-square test statistic obtained for all methods considered in the simulation study as a function of the sparsity parameter s{10,12,15,16,17}s\in\{10,12,15,16,17\}. See section 5.2 for detailed explanation of the method acronyms.

We should note that, in our simulation scenario, the maximum possible value of the Pearson chi-square test statistic is 400. This is obtained whenever all clusters identified by a model consist entirely of GLCMs arising from the same true pattern distribution. We refer to this as perfect discrimination. The means of the statistic for all feature-based approaches are similar, ranging between 83 and 225. Among them, the Gaussian mixture model yielded the best clustering performance, reaching a maximum of 225 with s=17s=17. The maximum values of the Pearson chi-square test statistic obtained for the consensus clustering (FeaCO), hierarchical clustering (FeaHC), K-means (FeaKM) and spectral clustering (FeaSC) methods were 124, 162, 160 and 177 at s=17s=17, respectively.

Results for the HRGSDP model far exceeded those resulting from the above machine learning clustering approaches at all levels of signal-to-noise. As a matter of fact, results were perfect for s<15s<15 with our proposed HRGSDP model resulting in a mean Pearson chi-square test statistic of 400 at s=10s=10 and s=12s=12. In the presence of higher levels of random noise, the statistic was 373 at s=15s=15, 341 at s=16s=16 and 309 at s=17s=17, and thus globally superior.

The trends in the diagnostic performance that the HRGSDP method exhibited in our simulation study conform to intuition as it pertains to identification of spatial discriminatory patterns and random noise. Overall, the proposed HRGSDP method outperformed the machine-learning methods currently used in the literature for reasonable signal-to-noise ratios. The algorithmic-oriented techniques fail to take into account the multivariate lattice structure intrinsic to GLCMs, and thus are unable to properly capture the spatial dependencies and the distributional heterogeneity inherent to a sample of GLCM objects. In the presence of high signal-to-noise in the true GLCM generating distribution, as characterized by small values of ss, the patterns conveyed in GLCMs were more separable from each other. This resulted in enhanced discrimination results for the HRGSDP method which leverages the spatial location information. As the variance scale parameter ss increases, the distinction of spatial patterns among different cc are diminished. The methods yielded similar results when adopting the skew bivariate normal distribution as the latent generator. Full results arising from the skew normal distribution are described in detail in Section B of the Supplementary materials.

6 Discussion

Recent emphasis with respect to improving characterizations of tumor phenotypes based on scanning technologies has produced numerous machine learning subtyping schemes that utilize summary statistics obtained from gray-level co-occurrence matrices. Two limitations confront these methods. First, they don’t admit a model based framework for unsupervised learning. Moreover, they fail to fully utilize the spatial arrangements present in the image/GLCM.

In this manuscript, we considered the spatial distribution of enhancement levels within a lesion image as structured count data encoded by the GLCM object. The proposed Hierarchical Rounded Gaussian Spatial Dirichlet Process framework takes into account the spatial dependence observed in the GLCM lattices, and further captures the heterogeneity of texture patterns encountered within a study population, while adjusting for the individual lesion image sizes. By means of an application to an adrenal lesion study and to a synthetic dataset, we show how the proposed methodology leads to improved performance in discerning heterogeneities in textural patterns of adrenal lesions. Improvement was also demonstrated as it pertains to identifying discrete patterns that are intrinsic to adrenal lesion textural distributions with respect to commonly employed machine-learning methods for reasonable signal-to-noise ratios. The proposed hierarchical rounded Gaussian SDP model is also capable of dealing with the skewness and zero-inflation of counts observed within a GLCM, offering flexibility to deal with correlated multivariate count data. A salient characteristic of the proposed methodology is that, by considering the entire GLCM lattice, our method avoids the processing and analysis of potentially redundant feature-sets, which often require ad-hoc variable/feature selection steps for analysis that are targeted to each specific application. Therefore, we believe that our procedure may help increase the reproducibility of radiomics studies. Overall, the methodology offers insights into the manner in which imaging data may be better utilized to identify complex patterns that characterize the intrinsic heterogeneity observed in tumor pathology.

Adrenal lesion diagnosis remains a challenge for radiologists. In the context of our case study, images were selected for which routine radiological diagnosis approaches a random guess. Our proposed approach, on the other hand, capable of capturing spatial patterns in patients’ scans, yielded patterns from unsupervised learning, which described malignant and benign majority subtypes when combined with pathology.

We should additionally note that due to sparse GLCMs observed in our data, several GLCM summary features proposed in the radiomics literature were not defined from the actual lesion scans observed in our objective case study. For instance, some GLCMs, especially the delay phase scans, are characterized by a single non-zero entry. In such a scenario, a typical GLCM derived feature such as the correlation is not obtainable. Our Bayesian nonparametric approach, however, handles sparsity in GLCM observables facilitating robustness for actual application.

A few limitations should be noted, however. The clustering performance of the proposed hierarchical rounded Gaussian SDP method depends upon the extent to which functional patterns in the GLCM lattice are separable among subtype objects. As intrinsic to all Bayesian approaches, both prior and hyperprior specification is required for inference. The use of a CAR prior to describe global spatial patterns in the GLCMs is computationally convenient, but it may result in over-smoothing. While this was not the case in our application – and some smoothing may be beneficial to cluster the GLCMs’ patterns – Duncan and Mengersen (2020) show how different combinations of the parameter values aσa_{\sigma} and bσb_{\sigma} can be used to fit models with varying degrees of smoothing. They also introduced “Goodness-of-smoothing” metrics to compare models. Alternatively, one could model the spatial dependence as in Bandyopadhyay and Canale (2016) via a G-Wishart prior incorporating the CAR specification. A further limitation of our approach is that it does not provide an assessment of the uncertainty around the estimated clusters. Wade and Ghahramani (2018) have recently characterized 95% credible balls obtained based on suitable metrics on the space of partitions. The use of hierarchical clustering allows for easy communication and discussion of the results with radiologists, but appropriate ways to summarize uncertainty for diagnosis purposes are needed, especially in high-dimensional settings as the ones considered here. Possible extensions of our approach include embedding the hierarchical spatial clustering approach with other flexible models devised for quasi-sparse count data (see, e.g. Datta and Dunson, 2016). Finally, while unsupervised learning facilitates robustness to overfitting, supervised approaches may be developed within the proposed Bayesian framework by calibrating the Bayes factor for each class membership (Fronczyk et al., 2015; Wang et al., 2020, 2019).

References

  • Aerts et al. (2014) Aerts, H. J., Velazquez, E. R., Leijenaar, R. T., Parmar, C., Grossmann, P., Carvalho, S., Bussink, J., Monshouwer, R., Haibe-Kains, B., Rietveld, D. et al. (2014) Corrigendum: Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nature communications, 5, 4644.
  • Altinmakas et al. (2017) Altinmakas, E., Hobbs, B. P., Ye, H., Grubbs, E. G., Perrier, N. D., Prieto, V. G., Lee, J. E. and Ng, C. S. (2017) Diagnostic performance of 18-F-FDG-PET-CT in adrenal lesions using histopathology as reference standard. Abdominal Radiology, 42, 577–584.
  • Azzalini and Capitanio (1999) Azzalini, A. and Capitanio, A. (1999) Statistical applications of the multivariate skew normal distribution. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 61, 579–602.
  • Bandyopadhyay and Canale (2016) Bandyopadhyay, D. and Canale, A. (2016) Non-parametric spatial models for clustered ordered periodontal data. Journal of the Royal Statistical Society: Series C (Applied Statistics), 65, 619–640.
  • Banerjee et al. (2014) Banerjee, S., Carlin, B. P. and Gelfand, A. E. (2014) Hierarchical modeling and analysis for spatial data. Crc Press.
  • Besag (1974) Besag, J. (1974) Spatial interaction and the statistical analysis of lattice systems. Journal of the Royal Statistical Society. Series B (Methodological), 192–236.
  • Boland et al. (1997) Boland, G. W., Hahn, P. F., Peña, C. and Mueller, P. R. (1997) Adrenal masses: characterization with delayed contrast-enhanced CT. Radiology, 202, 693–696.
  • Buvat et al. (2015) Buvat, I., Orlhac, F. and Soussan, M. (2015) Tumor texture analysis in PET: where do we stand? Journal of Nuclear Medicine, 56, 1642–1644.
  • Canale and Dunson (2011) Canale, A. and Dunson, D. B. (2011) Bayesian kernel mixtures for counts. Journal of the American Statistical Association, 106, 1528–1539.
  • Canale and Prünster (2017) Canale, A. and Prünster, I. (2017) Robustifying bayesian nonparametric mixtures for count data. Biometrics, 73, 174–184.
  • Choi et al. (2017) Choi, S., Hoffman, E. A., Wenzel, S. E., Castro, M., Fain, S., Jarjour, N., Schiebler, M. L., Chen, K. and Lin, C.-L. (2017) Quantitative computed tomographic imaging–based clustering differentiates asthmatic subgroups with distinctive clinical phenotypes. Journal of Allergy and Clinical Immunology, 140, 690–700.
  • Cook et al. (2014) Cook, G. J., Siddique, M., Taylor, B. P., Yip, C., Chicklore, S. and Goh, V. (2014) Radiomics in PET: principles and applications. Clinical and Translational Imaging, 2, 269–276.
  • Dahl (2006) Dahl, D. B. (2006) Model-based clustering for expression data via a Dirichlet process mixture model. In Bayesian inference for gene expression and proteomics (eds. K. Do, P. Müller and M. Vannucci), 201–218. Cambridge: Cambridge University Press.
  • Dahl and Newton (2007) Dahl, D. B. and Newton, M. A. (2007) Multiple hypothesis testing by clustering treatment effects. Journal of the American Statistical Association, 102, 517–526.
  • Datta and Dunson (2016) Datta, J. and Dunson, D. B. (2016) Bayesian inference on quasi-sparse count data. Biometrika, 103, 971–983.
  • Duncan and Mengersen (2020) Duncan, E. W. and Mengersen, K. L. (2020) Comparing Bayesian spatial models: Goodness-of-smoothing criteria for assessing under- and over-smoothing. PLOS ONE, 15, 1–28.
  • Escobar and West (1995) Escobar, M. D. and West, M. (1995) Bayesian density estimation and inference using mixtures. Journal of the american statistical association, 90, 577–588.
  • Fronczyk et al. (2015) Fronczyk, K. M., Guindani, M., Hobbs, B. P., Ng, C. S. and Vannucci, M. (2015) A Bayesian nonparametric approach for functional data classification with application to hepatic tissue characterization. Cancer informatics, 14, CIN–S31933.
  • Gelfand et al. (2005) Gelfand, A. E., Kottas, A. and MacEachern, S. N. (2005) Bayesian nonparametric spatial modeling with Dirichlet process mixing. Journal of the American Statistical Association, 100, 1021–1035.
  • Gensheimer et al. (2015) Gensheimer, M. F., Hawkins, D. S., Ermoian, R. P. and Trister, A. D. (2015) Assessing the scale of tumor heterogeneity by complete hierarchical segmentation of MRI. Physics in medicine and biology, 60, 977.
  • Geweke (1992) Geweke, J. (1992) Evaluating the accuracy of sampling-based approaches to calculating posterior moments. In Bayesian Statistics 4 (eds. J. M. Bernardo, J. Berger, A. P. Dawid and J. F. M. Smith), 169–193. Oxford: Oxford University Press.
  • Gilks et al. (1995) Gilks, W. R., Best, N. and Tan, K. (1995) Adaptive rejection Metropolis sampling within Gibbs sampling. Journal of the Royal Statistical Society: Series C (Applied Statistics), 44, 455–472.
  • Gilks and Wild (1992) Gilks, W. R. and Wild, P. (1992) Adaptive rejection sampling for Gibbs sampling. Journal of the Royal Statistical Society: Series C (Applied Statistics), 41, 337–348.
  • Gillies et al. (2015) Gillies, R. J., Kinahan, P. E. and Hricak, H. (2015) Radiomics: images are more than pictures, they are data. Radiology, 278, 563–577.
  • Guindani et al. (2014) Guindani, M., Sepúlveda, N., Paulino, C. D. and Müller, P. (2014) A Bayesian semiparametric approach for the differential analysis of sequence counts data. Journal of the Royal Statistical Society: Series C (Applied Statistics), 63, 385–404.
  • Haralick et al. (1973) Haralick, R. M., Shanmugam, K. et al. (1973) Textural features for image classification. IEEE Transactions on systems, man, and cybernetics, SMC-3, 610–621.
  • Hastie et al. (2015) Hastie, D. I., Liverani, S. and Richardson, S. (2015) Sampling from Dirichlet process mixture models with unknown concentration parameter: mixing issues in large data implementations. Statistics and computing, 25, 1023–1037.
  • Jasra et al. (2005) Jasra, A., Holmes, C. C. and Stephens, D. A. (2005) Markov chain Monte Carlo methods and the label switching problem in Bayesian mixture modeling. Statistical Science, 20, 50–67.
  • Karlis and Xekalaki (2005) Karlis, D. and Xekalaki, E. (2005) Mixed poisson distributions. International Statistical Review/Revue Internationale de Statistique, 35–58.
  • Korobkin et al. (1996) Korobkin, M., Brodeur, F. J., Francis, I. R., Quint, L. E., Dunnick, N. R. and Goodsitt, M. (1996) Delayed enhanced ct for differentiation of benign from malignant adrenal masses. Radiology, 200, 737–742.
  • Krzanowski and Lai (1988) Krzanowski, W. J. and Lai, Y. (1988) A criterion for determining the number of groups in a data set using sum-of-squares clustering. Biometrics, 44, 23–34.
  • Kumar et al. (2012) Kumar, V., Gu, Y., Basu, S., Berglund, A., Eschrich, S. A., Schabath, M. B., Forster, K., Aerts, H. J., Dekker, A., Fenstermacher, D. et al. (2012) Radiomics: the process and the challenges. Magnetic resonance imaging, 30, 1234–1248.
  • Lambin et al. (2012) Lambin, P., Rios-Velazquez, E., Leijenaar, R., Carvalho, S., van Stiphout, R. G., Granton, P., Zegers, C. M., Gillies, R., Boellard, R., Dekker, A. et al. (2012) Radiomics: extracting more information from medical images using advanced feature analysis. European journal of cancer, 48, 441–446.
  • Lee (2013) Lee, D. (2013) CARBayes: an R package for Bayesian spatial modeling with conditional autoregressive priors. Journal of Statistical Software, 55, 1–24.
  • Li et al. (2019) Li, X., Guindani, M., Ng, C. S. and Hobbs, B. P. (2019) Spatial Bayesian modeling of GLCM with application to malignant lesion characterization. Journal of Applied Statistics, 46, 230–246.
  • Medvedovic and Sivaganesan (2002) Medvedovic, M. and Sivaganesan, S. (2002) Bayesian infinite mixture model based clustering of gene expression profiles. Bioinformatics, 18, 1194–1206.
  • Miller and Harrison (2017) Miller, J. W. and Harrison, M. T. (2017) Mixture models with a prior on the number of components. Journal of the American Statistical Association, 1–17.
  • Murtagh and Legendre (2014) Murtagh, F. and Legendre, P. (2014) Ward’s hierarchical agglomerative clustering method: which algorithms implement ward’s criterion? Journal of Classification, 31, 274–295.
  • Ng et al. (2018a) Ng, C. S., Altinmakas, E., Wei, W., Ghosh, P., Li, X., Grubbs, E. G., Perrier, N. A., Prieto, V. G., Lee, J. E. and Hobbs, B. P. (2018a) Combining washout and noncontrast data from adrenal protocol CT: improving diagnostic performance. Academic radiology, 25, 861–868.
  • Ng et al. (2018b) Ng, C. S., Altinmakas, E., Wei, W., Ghosh, P., Li, X., Grubbs, E. G., Perrier, N. D., Lee, J. E., Prieto, V. G. and Hobbs, B. P. (2018b) Utility of intermediate-delay washout CT images for differentiation of malignant and benign adrenal lesions: a multivariate analysis. American Journal of Roentgenology, 211, W109–W115.
  • Ng et al. (2018c) Ng, C. S., Wei, W., Altinmakas, E., Li, X., Ghosh, P., Perrier, N. A., Grubbs, E., Prieto, V. G., Lee, J. E. and Hobbs, B. P. (2018c) Differentiation of malignant and benign adrenal lesions with delayed CT: multivariate analysis and predictive models. American Journal of Roentgenology, 210, W156–W163.
  • Nongpiur et al. (2017) Nongpiur, M., Atalay, E., Gong, T., Loh, M., Lee, H., He, M., Perera, S. and Aung, T. (2017) Anterior segment imaging-based subdivision of subjects with primary angle-closure glaucoma. Eye, 31, 572.
  • Parekh and Jacobs (2016) Parekh, V. and Jacobs, M. A. (2016) Radiomics: a new application from established techniques. Expert Review of Precision Medicine and Drug Development, 1, 207–226.
  • Park et al. (2012) Park, S.-W., Kim, T. N., Yoon, J. H., Kim, T. H., Chung, J. M., Jeon, U. B. and Lee, W. (2012) The washout rate on the delayed CT image as a diagnostic tool for adrenal adenoma verified by pathology: a multicenter study. International urology and nephrology, 44, 1397–1402.
  • Parmar et al. (2015) Parmar, C., Leijenaar, R. T., Grossmann, P., Velazquez, E. R., Bussink, J., Rietveld, D., Rietbergen, M. M., Haibe-Kains, B., Lambin, P. and Aerts, H. J. (2015) Radiomic feature clusters and prognostic signatures specific for lung and head & neck cancer. Scientific reports, 5, 11044.
  • Quintana et al. (2016) Quintana, F. A., Johnson, W. O., Waetjen, L. E. and B. Gold, E. (2016) Bayesian nonparametric longitudinal data analysis. Journal of the American Statistical Association, 111, 1168–1181.
  • Rastelli and Friel (2018) Rastelli, R. and Friel, N. (2018) Optimal bayesian estimators for latent variable cluster models. Statistics and Computing, 28, 1169–1186.
  • Taffel et al. (2012) Taffel, M., Haji-Momenian, S., Nikolaidis, P. and Miller, F. H. (2012) Adrenal imaging: a comprehensive review. Radiologic Clinics, 50, 219–243.
  • Tang et al. (2018) Tang, C., Hobbs, B., Amer, A., Li, X., Behrens, C., Canales, J. R., Cuentas, E. P., Villalobos, P., Fried, D., Chang, J. Y. et al. (2018) Development of an immune-pathology informed radiomics model for non-small cell lung cancer. Scientific reports, 8, 1–9.
  • Wade and Ghahramani (2018) Wade, S. and Ghahramani, Z. (2018) Bayesian cluster analysis: Point estimation and credible balls (with discussion). Bayesian Anal., 13, 559–626. URL: https://doi.org/10.1214/17-BA1073.
  • Wang et al. (2019) Wang, Y., Hu, J., Do, K.-A. and Hobbs, B. P. (2019) An efficient nonparametric estimate for spatially correlated functional data. Statistics in Biosciences, 11, 162–183.
  • Wang et al. (2020) Wang, Y., Hu, J., Ng, C. S. and Hobbs, B. P. (2020) A functional model for classifying metastatic lesions integrating scans and biomarkers. Statistical Methods in Medical Research, 29, 137–150.
  • Wanis and Kanthan (2015) Wanis, K. N. and Kanthan, R. (2015) Diagnostic and prognostic features in adrenocortical carcinoma: a single institution case series and review of the literature. World Journal of Surgical Oncology, 13, 117.
  • Ward (1963) Ward, J. H. (1963) Hierarchical grouping to optimize an objective function. Journal of the American statistical association, 58, 236–244.
  • Wu et al. (2016) Wu, J., Gensheimer, M. F., Dong, X., Rubin, D. L., Napel, S., Diehn, M., Loo, B. W. and Li, R. (2016) Robust intratumor partitioning to identify high-risk subregions in lung cancer: a pilot study. International Journal of Radiation Oncology* Biology* Physics, 95, 1504–1512.
  • Yip and Aerts (2016) Yip, S. S. and Aerts, H. J. (2016) Applications and limitations of radiomics. Physics in medicine and biology, 61, R150.
  • Zhang et al. (2016) Zhang, L., Guindani, M., Versace, F., Engelmann, J. M. and Vannucci, M. (2016) A spatiotemporal nonparametric Bayesian model of multi-subject fMRI data. The Annals of Applied Statistics, 10, 638–666.
  • Zhang et al. (2017) Zhang, X., Cui, J., Wang, W. and Lin, C. (2017) A study for texture feature extraction of high-resolution satellite images based on a direction measure and gray level co-occurrence matrix fusion algorithm. Sensors, 17, 1474.
  • Zhou et al. (2018) Zhou, M., Scott, J., Chaudhury, B., Hall, L., Goldgof, D., Yeom, K. W., Iv, M., Ou, Y., Kalpathy-Cramer, J., Napel, S. et al. (2018) Radiomics in brain tumor: image assessment, quantitative feature descriptors, and machine-learning approaches. American Journal of Neuroradiology, 39, 208–216.