Spatio-temporal determinantal point processes
Abstract
Determinantal point processes are models for regular spatial point patterns, with appealing probabilistic properties. We present their spatio-temporal counterparts and give examples of these models, based on spatio-temporal covariance functions which are separable and non-separable in space and time.
Nafiseh Vafaei
Department of Computer and Statistics Sciences, Faculty of Sciences, University of Mohaghegh Ardabili, Ardabil, Iran
E-mail: [email protected]
Mohammad Ghorbani111Corresponding Author
Department of Engineering Sciences and Mathematics, Luleå University of Technology, Sweden
E-mail: [email protected]
Masoud Ganji
Department of Computer and Statistics Sciences, Faculty of Sciences, University of Mohaghegh Ardabili, Ardabil, Iran
E-mail: [email protected]
Mari Myllymäki
Natural Resources Institute Finland (Luke), Helsinki, Finland.
E-mail: [email protected]
Keywords: Covariance function; point process; regularity; spatio-temporal; spectral density
1 Introduction
Spatio-temporal point processes are random countable subsets of , where a point corresponds to an event occurring at time . We assume that the points do not overlap, i.e. . Examples of such events are the occurrence of epidemic diseases (such as corona or flu), sightings or births of a species, the occurrence of fires, earthquakes, tsunamis, or volcanic eruptions. We are interested here in spatio-temporal regular point processes, where neighbouring points in the process tend to repel each other.
In the context of spatial point processes, Gibbs point processes including Markov point processes and pairwise interaction point process models are generally used to model repulsiveness. Another class of regular spatial point process models are determinantal point processes (dpps), which have their origin in quantum physics. They were first identified as a class by Macchi (1975), who called them fermion processes because they reflect the distributions of fermion systems in thermal equilibrium that exhibit repulsive behaviour. dpps have been extensively studied in probability theory and have found applications in random matrix theory, quantum physics, wireless network modelling, Monte Carlo integration, and machine learning (see e.g. Lavancier et al., 2015). Recently, Lavancier et al. (2015) studied the statistical properties of dpps.
Some regular spatial point process models have already their spatio-temporal counterparts, but likelihood-based inference or simulation of these models is usually complicated and time-consuming. To circumvent these challenges, our objective here is to introduce the spatio-temporal determinantal point processes (stdpps) and study their properties, which is an open problem according to Lavancier et al. (2015, pages 875-876). We present the basic properties of these processes and give examples of them based on separable and non-separable spatio-temporal covariance functions. We derive the key summary characteristics for these examples that can be used, for example, for model fitting and evaluation.
2 Basic concepts and statistical properties
Assume that is a spatio-temporal point process with th-order product density , which describes the frequency of possible configurations of points. Suppose that are pairwise disjoint cylindrical regions having infinitesimal volumes and containing the points , respectively. Then, is the probability that has a point in each of .
Definition 1.
Let be a kernel function from to . We say that a spatio-temporal point process is a determinantal point process with kernel and write , if its th-order product density function is given by
for and , where is the matrix with as its -th entry and is the determinant of the matrix .
The point process is well-defined if, for each , for all . This implies that, in Definition 1, should be a non-negative definite matrix. Then all eigenvalues of the matrix are non-negative and thus its determinant is also non-negative (this follows from the fact that the determinant of a matrix is equal to the product of its eigenvalues) (Radhakrishna Rao and Bhaskara Rao, 1998). Therefore, covariance functions are possible choices for the kernel . Denoting the eigenvalues of by , another condition for the existence of stdpp() is that . This is a straightforward extension from the spatial setting, see details in Lavancier et al. (2015) and the references therein. The Poisson process with intensity results as a special case of stdpp() with setting and .
By Definition 1, the moment characteristics of arbitrary order can be easily attained for stdpps, e.g. the intensity function is given by and the second-order product density is given by
In what follows, we assume that the kernel function is of the form
where plays the role of the intensity function of the process, and are the spatial and temporal correlation parameters respectively, and is the correlation function correspondent to . Then, the (inhomogeneous space-time) pair correlation function is given by
(1) | ||||
(2) |
Since , the points of repel each other, which is a characteristic of regular point patterns.
In general, a stdpp is called second-order intensity reweighted stationary (soirs) if its space-time pair correlation function is a function of the spatial difference and the temporal difference (see, e.g. Ghorbani, 2013, and the references therein). Thus, a stdpp with kernel function is soirs if the correlation function is a function of and only, i.e. if takes the form for some function . For a soirs stdpp(C), , and hence . If in addition, the correlation function is invariant under rotation, i.e. isotropic, then it as well as the pair correlation function (1) depend only on the spatial distance and the temporal lag . The pair correlation function is then given by
(3) |
Further, the space-time -function (see e.g. Gabriel and Diggle, 2009; Møller and Ghorbani, 2012) is given by
(4) | ||||
(5) |
3 Examples of spatio-temporal determinantal point processes
Section 3.1 recalls the relationship between the covariance function and its spectral density. Then, in Sections 3.2 and 3.3, the Fourier transform of positive finite measures, i.e. spectral measures, are used to construct stationary spatio-temporal covariance functions, and characteristics of stdpps with these kernels are derived.
3.1 The covariance function and its spectral density
The covariance function of a stationary process can be represented as a Fourier transform of a positive finite measure. According to the Wiener-Khintchine theorem (see, e.g. Rasmussen and Williams, 2006), if the spectral density function exists, the covariance function and the spectral density are Fourier duals of each other given by
(6) | ||||
(7) |
where stands for transpose, is the -dimensional spatial component and is the temporal component.
A straightforward generalization of Proposition 3.1 in Lavancier et al. (2015) to the spatio-temporal setting, under continuity and stationarity of , when , implies that a stdpp with kernel exists if the corresponding spectral density satisfies
(8) |
3.2 Separable spatio-temporal covariance functions
A class of separable spatio-temporal covariance functions is usually given by
(9) |
which is valid (i.e. a positive definite function) if both the spatial covariance function, , and the temporal covariance function, , are valid covariance functions. For a separable class of covariance functions, the spectral density has also a separable form, namely
where and are the spatial and temporal spectral densities, respectively. According to (8), the condition must be satisfied for a stdpp with kernel (9) to exist. Further, for this class, the pair correlation function takes the following simple form
where and are the correlation functions in space and time corresponding to and , respectively. Therefore, by (4) the corresponding -function is given by
There are a large number of classes of valid spatial and valid temporal covariance functions in the literature, for example the Matérn, power exponential and Gaussian classes, to name a few (see, e.g. Cressie and Wikle, 2011). As an example, we consider the Gaussian covariance function , , with spectral density , and the exponential covariance function , with spectral density . Here and are the variance parameters of the spatial and time components, respectively, and and are the corresponding range parameters. A stationary stdpp with intensity and the separable covariance function (9) with these components, i.e
(10) |
will exist if
Since the maximum of the spectral density occurs at , so a stdpp() exists if , which implies that , and hence the maximal intensity is For this process the pair correlation function is simply given by
(11) |
The corresponding -function also has a closed-form expression, which is given in A.
Figure 1 (top row) shows that the values of the pair correlation function (11) decrease by the increase of the spatial range and the temporal delay . Thus, these parameters determine the degree of repulsion for the above separable model.

3.3 Non-separable spatio-temporal covariance function
Following Fuentes et al. (2007), we consider the spatio-temporal spectral density
(12) |
which is an extension of the commonly used Matérn spectral density (Cressie and Wikle, 2011). Here, the non-negative parameter (spatial range) explains the rate of decay of the spatial correlation, the non-negative parameter (temporal delay) explains the rate of decay for the temporal correlation. Further, is a scale parameter. The parameter measures the degree of smoothness of the process and it should be larger than to have a well-defined spectral density. The parameter controls the interaction between the spatial and temporal components. For the spectral density is non-separable while it is separable when . The maximum of the spectral density is and accordingly a stdpp with spectral density (12) exists if .
In the separable case, i.e. when , the spectral density is given by
(13) |
In this case, and are Matérn-type spectral densities in space and time, respectively. Consequently, the corresponding separable spatio-temporal covariance function, combining (6), and (13) and using the equations 6.726.4 and 8.432.5 in Gradshteyn and Ryzhik (2007) and setting , is given by
where is the modified Bessel function of the second kind of order . is proportional to the product of Matérn covariance functions in space and time. Using the special cases, and (Abramowitz and Stegun, 1992), the above covariance function for can be presented as
(14) |
For this case, considering the fact that (Yang and Chu, 2017), the intensity of the process is . Hence, taking into account that , a stdpp with kernel (14) exists if . For this separable case with , considering (3), the pair correlation function is
(15) |
For the spatio-temporal covariance function corresponding to (12) should be computed numerically as there is no exact closed-form expression. For the case , the stationary non-separable spatial-temporal spectral density is given by
(16) |
Combining (6) and (16), and using the equations 6.726.4 and 8.432.5 in Gradshteyn and Ryzhik (2007), the covariance function when is
According to (8), for and , there exists a stdpp with kernel
(17) |
if and only if . Further, it holds that for the covariance functions (17). Thus, under the condition , it holds that . Therefore, for a stdpp with the above covariance function, the intensity should be at most . Further, for this process the pair correlation function is simply given by
(18) |
The expression for the corresponding -function can be found in A.
Figure 1 (middle and bottom rows) shows that the values of the theoretical pair correlations (15) and (18) decrease as and increase. Thus, for these models, the parameters and play the role of spatial range and time delay that determine the degree of repulsion. Moreover, for fixed range parameters, the separable covariance model with (15) leads to smaller values of the pair correlation function and thus more repulsive patterns than the non-separable model with (18). While the separable covariance function controls to repulsiveness of points in space and time separately, in the non-separable case the points repel each other in the 3D space. This leads to the different small scale interactions.
4 Discussion and conclusion
The different forms of covariance functions presented here allow for stdpps with different types of repulsion. While empirical experiments in the spatio-temporal setting are to be conducted in future work, model fitting for dpps is available through the maximum likelihood or minimum contrast methods (Lavancier et al., 2015) based on the summary functions such as the pair correlation function presented here for the given examples, and for model assessment, e.g. the global envelope test (Myllymäki et al., 2017) can be employed.
Acknowledgement
The authors are grateful to Frederic Lavancier and Ege Rubak for good discussions. MG was financially supported by the Kempe Foundations (JCSMK22-0134) and MM by the Academy of Finland (project numbers 295100 and 327211).
Appendix A -functions of the proposed models
References
- (1)
- Abramowitz and Stegun (1992) Abramowitz, M. and Stegun, I. A. (1992). Handbook of mathematical functions with formulas, graphs, and mathematical tables, Dover Publications Inc., New York.
- Cressie and Wikle (2011) Cressie, N. and Wikle, C. K. (2011). Statistics for spatio-temporal data, John Wiley and Sons.
- Fuentes et al. (2007) Fuentes, M., Chen, L. and Davis, J. (2007). A class of nonseparable and nonstationary spatial temporal covariance functions, Environmetrics 9: 487–507.
- Gabriel and Diggle (2009) Gabriel, E. and Diggle, P. J. (2009). Second-order analysis of inhomogeneous spatio-temporal point process data, Statistica Neerlandica 63: 43–51.
- Ghorbani (2013) Ghorbani, M. (2013). Testing the weak stationarity of a spatio-temporal point process, Stochastic Environonmental Research and Risk Assessesment 27: 517–524.
- Gradshteyn and Ryzhik (2007) Gradshteyn, I. S. and Ryzhik, I. M. (2007). Table of Integrals, Series, and Products., 7th edn, Academic Press.
- Jones (2007) Jones, D. S. (2007). Incomplete Bessel functions. I, Proceedings of the Edinburgh Mathematical Society 50: 173–183.
- Lavancier et al. (2015) Lavancier, F., Møller, J. and Rubak, E. (2015). Determinantal point process models and statistical inference, Journal of the Royal Statistical Society: Series B (Statistical Methodology) 77(4): 853–877.
- Macchi (1975) Macchi, O. (1975). The coincidence approach to stochastic point processes, Advances in Applied Probability 7: 83–122.
- Møller and Ghorbani (2012) Møller, J. and Ghorbani, M. (2012). Aspects of second-order analysis of structured inhomogeneous spatio-temporal point processes, Statistica Neerlandica 66(4): 472–491.
- Myllymäki et al. (2017) Myllymäki, M., Mrkvička, T., Grabarnik, P., Seijo, H. and Hahn, U. (2017). Global envelope tests for spatial processes, Journal of the Royal Statistical Society: Series B (Statistical Methodology) 79(2): 381–404.
- Radhakrishna Rao and Bhaskara Rao (1998) Radhakrishna Rao, C. and Bhaskara Rao, M. (1998). Matrix Algebra and Its Applications to Statistics and Econometrics, World Scientific Publishing Co.
- Rasmussen and Williams (2006) Rasmussen, C. E. and Williams, C. K. I. (2006). Gaussian processes for machine learning, The MIT Press, London.
- Yang and Chu (2017) Yang, Z. H. and Chu, Y. M. (2017). On approximating the modified bessel function of the second kind, Journal of Inequalities and Applications 41.